Topic Modeling for Assessment of Text Complexity in Russian Textbooks
Authors:
- 1 December 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 102-108
Abstract
This article explores the problem of assessing the complexity of Russian educational texts. We present a quantitative and qualitative investigation of topics in the textbooks of different grades by applying several topic models. The corpus compiled for the current study comprises a collection of textbooks used in middle and high schools of the Russian Federation. The corpus consists of two sets of texts derived from textbooks on Social science by L.N. Bogolyubov and A.F. Nikitin. For our analysis, we employ Latent Dirichlet Allocation (LDA) and Additive regularization of topic models (ARTM). In this paper, we use the grades of educational texts as indicators of text complexity. To identify quantitative measures of text complexity, we analyze the correlation of book grades with topic properties. We also analyze a correlation of a topic's properties with the growth of its proportion in a book of a specific complexity level. The key finding of our research is the identification of statistically significant correlations of educational texts complexity with the revealed topic features, i.e., topic coherence and distance between topic words in a semantic space. This study can be beneficial for two communities: textbook writers and their consumers, i.e., teachers and schoolchildren.Keywords
Funding Information
- Russian Science Foundation (18-18-00436)
This publication has 15 references indexed in Scilit:
- Exploring convolutional neural networks and topic models for user profiling from drug reviewsMultimedia Tools and Applications, 2017
- Applications of Topic ModelsFoundations and Trends® in Information Retrieval, 2017
- Building Web-Interfaces for Vector Semantic Models with the WebVectors Toolkit2017
- Topic Quality Metrics Based on Distributed Word Representations2016
- The Sensitivity of Topic Coherence Evaluation to Topic Cardinality2016
- Additive regularization of topic modelsMachine Learning, 2014
- Unified (Russian) State Exam in English: Reading Comprehension TasksEnglish Language Teaching, 2014
- Machine Reading Tea Leaves: Automatically Evaluating Topic Coherence and Topic Model Quality2014
- Macroanalysis2013
- A new readability yardstick.Journal of Applied Psychology, 1948