Daria Gracheva
Research Subjects
Daria Gracheva has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
- Kseniya V. Tarasova
National Research University Higher School of Economics
5 shared publications - Irina Uglanova
Leibniz Institute for Science and Mathematics Education (IPN), Kiel, Germany
3 shared publications - Ekaterina Orel
HSE University
2 shared publications - Aleksandra Granaturova
HSE University
1 shared publication - Andrei Dementiev
HSE University
1 shared publication - Daniil P. Talov
National Research University Higher School of Economics
1 shared publication
Latest Publications
- 30 September 2026
- Published by SAGE Publications in Journal of Psychoeducational Assessment
Interactive Scenario-Based Tasks for Assessing Communication Skills in Early Adolescence
Effective communication is essential in both everyday and educational contexts. To efficiently address social skill challenges among students, teachers and parents require valid assessment tools. This study presents interactive scenario-based tasks (ISBTs) with automatic scoring for assessing communication skills in collaborative settings (CSCS), targeting early adolescents. Forty-seven performance indicators were developed across three ISBTs. Validity evidence was gathered based on the tool’s internal structure, text complexity analysis, and correlations with sociodemographic variables, academic achievement, and involvement in activities with friends and family. The assessment was validated using data from two studies (Study 1: n = 1841; Study 2: n = 729). Additionally, alternative forms of the ISBTs were developed to facilitate pretest–posttest analysis, and evidence of their comparability is presented. Finally, the study discusses future directions for the assessment of communication skills.
- 30 September 2026
- Published by SAGE Publications in Journal of Psychoeducational Assessment
Interactive Scenario-Based Tasks for Assessing Communication Skills in Early Adolescence
Effective communication is essential in both everyday and educational contexts. To efficiently address social skill challenges among students, teachers and parents require valid assessment tools. This study presents interactive scenario-based tasks (ISBTs) with automatic scoring for assessing communication skills in collaborative settings (CSCS), targeting early adolescents. Forty-seven performance indicators were developed across three ISBTs. Validity evidence was gathered based on the tool’s internal structure, text complexity analysis, and correlations with sociodemographic variables, academic achievement, and involvement in activities with friends and family. The assessment was validated using data from two studies (Study 1: n = 1841; Study 2: n = 729). Additionally, alternative forms of the ISBTs were developed to facilitate pretest–posttest analysis, and evidence of their comparability is presented. Finally, the study discusses future directions for the assessment of communication skills.
- 25 March 2025
- Published by National Research University, Higher School of Economics (HSE) in Voprosy Obrazovaniya / Educational Studies Moscow
- No. 4
Learning as Play: The Relationship Between Adolescents’ Attitudes Toward Game Mechanics and Their Motivation and Educational Outcomes
This article explores the relationship between adolescents’ attitudes toward the use of game mechanics in education and their academic motivation and transversal educational outcomes, including critical thinking, creativity, communication, collaboration (4Cs), and digital literacy. The study involved 312 adolescents aged 13–15 from 10 regions of Russia, all attending “IT-Cube” centers for digital education. Questionnaires and interactive tests (4C and DigLit) were used to assess perceptions of gamification, motivation, and skills. The findings indicate that frequent use of gamification mechanics, such as "tasks and quests" and "reward systems," positively correlates with students’ intrinsic motivation and engagement. However, some mechanics, particularly those involving competitive elements, may induce anxiety in high-achieving students. The frequency of gamification mechanics application shows a weak positive relationship with intrinsic motivation but has no significant effect on digital literacy or 4C skills. Gender differences were observed, with female students reporting higher anxiety related to gamification mechanics, though no differences were found in overall engagement. The article emphasizes the need to adapt gamification mechanics to educational goals, individual student characteristics, and motivational profiles.
- 25 March 2025
- Published by National Research University, Higher School of Economics (HSE) in Voprosy Obrazovaniya / Educational Studies Moscow
- No. 4
Learning as Play: The Relationship Between Adolescents’ Attitudes Toward Game Mechanics and Their Motivation and Educational Outcomes
This article explores the relationship between adolescents’ attitudes toward the use of game mechanics in education and their academic motivation and transversal educational outcomes, including critical thinking, creativity, communication, collaboration (4Cs), and digital literacy. The study involved 312 adolescents aged 13–15 from 10 regions of Russia, all attending “IT-Cube” centers for digital education. Questionnaires and interactive tests (4C and DigLit) were used to assess perceptions of gamification, motivation, and skills. The findings indicate that frequent use of gamification mechanics, such as "tasks and quests" and "reward systems," positively correlates with students’ intrinsic motivation and engagement. However, some mechanics, particularly those involving competitive elements, may induce anxiety in high-achieving students. The frequency of gamification mechanics application shows a weak positive relationship with intrinsic motivation but has no significant effect on digital literacy or 4C skills. Gender differences were observed, with female students reporting higher anxiety related to gamification mechanics, though no differences were found in overall engagement. The article emphasizes the need to adapt gamification mechanics to educational goals, individual student characteristics, and motivational profiles.
- 4 March 2025
- Published by Taylor & Francis in Studies in Higher Education
- Vol. 51 (3) , 649-664
Measuring changes in critical thinking skills among university economics students: insights from domain-specific assessment
- 4 March 2025
- Published by Taylor & Francis in Studies in Higher Education
- Vol. 51 (3) , 649-664
Measuring changes in critical thinking skills among university economics students: insights from domain-specific assessment
- Open Access
- 27 April 2024
- Published by Moscow State University of Psychology and Education in Journal of Modern Foreign Psychology
- Vol. 13 (1) , 58-68
Exploring the Relationship between Performance and Response Process Data in Digital Literacy Assessment
Measuring complex latent constructs is challenging because of their multi-dimensionality. In this context, computer-based assessments have gained popularity due to its ability to handle large diverse data. The aim of the study is to investigate the interrelationship between performance, time, and actions in computer-based digital literacy assessment. The study involved more than 400 8th-grade schoolchildren (approximately 14—15 years old) from secondary schools in Russia. A subset was obtained from indicators capturing the demonstration of analysis of data, information, and digital content, which is a component of the information literacy in the digital literacy framework. The data was used to create latent models in the structural equation modeling framework. Confirmatory one-factor model for the Performance factor showed a good fit to the data (CFI=1; TLI=1; RMSEA=0). The model with dependencies among indicators demonstrated improved model fit (χ2(18)=510,65; p=0,05) compared to the model without such dependencies. The results suggest that performance, time, and actions are interdependent. The findings underscore the need for a comprehensive approach to assessing digital literacy that accounts for these interdependencies, as well as investigating behavioral patterns of interaction with a large amount of information in the digital environment.
- 27 April 2024
- Published by Moscow State University of Psychology and Education in Journal of Modern Foreign Psychology
- Vol. 13 (1) , 58-68
Open AccessExploring the Relationship between Performance and Response Process Data in Digital Literacy Assessment
Measuring complex latent constructs is challenging because of their multi-dimensionality. In this context, computer-based assessments have gained popularity due to its ability to handle large diverse data. The aim of the study is to investigate the interrelationship between performance, time, and actions in computer-based digital literacy assessment. The study involved more than 400 8th-grade schoolchildren (approximately 14—15 years old) from secondary schools in Russia. A subset was obtained from indicators capturing the demonstration of analysis of data, information, and digital content, which is a component of the information literacy in the digital literacy framework. The data was used to create latent models in the structural equation modeling framework. Confirmatory one-factor model for the Performance factor showed a good fit to the data (CFI=1; TLI=1; RMSEA=0). The model with dependencies among indicators demonstrated improved model fit (χ2(18)=510,65; p=0,05) compared to the model without such dependencies. The results suggest that performance, time, and actions are interdependent. The findings underscore the need for a comprehensive approach to assessing digital literacy that accounts for these interdependencies, as well as investigating behavioral patterns of interaction with a large amount of information in the digital environment.
- Open Access
- 6 November 2023
- Published by National Research University, Higher School of Economics (HSE) in Voprosy Obrazovaniya / Educational Studies Moscow
- No. 3,p. 62-91
The Role of Context in Scenario-Based Tasks for Measuring Universal Skills: The Use of Generalizability Theory
В современных условиях большое внимание уделяется развитию и оцениванию универсальных навыков у школьников. Для такого оценивания необходимы новые тестовые форматы, основанные на наблюдаемых действиях учащегося в цифровой среде. Один из перспективных вариантов таких инструментов — контекстные задания сценарного типа. Однако контекстное разнообразие таких заданий может затруднять сравнение результатов. В статье анализируется роль контекста сценарных заданий при измерении двух универсальных навыков: критического мышления и коммуникации. С этой целью применяются методы теории генерализации, которые позволяют установить, в какой степени согласованными являются результаты, полученные с помощью разных контекстов сценарных заданий, и как путем изменения количества индикаторов или контекстов сценариев обеспечить достаточную надежность измерения. Исследование основано на данных, которые получены при тестировании учащихся 4-х классов с помощью разных заданий сценарного типа, входящих в состав инструмента «4К». Результаты анализа показали, что поведение тестируемых в сценариях с разным контекстом различается, при этом трудности контекстов практически одинаковы. Для достижения удовлетворительной надежности рекомендуется использовать минимум два сценария с разными контекстами, а использование трех и более сценарных заданий с разными контекстами позволяет существенно сократить количество индикаторов без потери надежности. В исследовании также оценивалась роль контекста при использовании альтернативных вариантов заданий. Альтернативные варианты схожи в основной проблеме и сюжете сценария, но различаются тематическим наполнением (контентом). Изменение только контента сценария позволяет экстраполировать результаты оценивания универсальных навыков на все варианты заданий, т. е. альтернативные варианты могут использоваться как взаимозаменяемые. Проведенное исследование демонстрирует возможности использования методов теории генерализации для оптимизации разработки заданий с учетом требований к надежности измерения.
- 6 November 2023
- Published by National Research University, Higher School of Economics (HSE) in Voprosy Obrazovaniya / Educational Studies Moscow
- No. 3,p. 62-91
Open AccessThe Role of Context in Scenario-Based Tasks for Measuring Universal Skills: The Use of Generalizability Theory
В современных условиях большое внимание уделяется развитию и оцениванию универсальных навыков у школьников. Для такого оценивания необходимы новые тестовые форматы, основанные на наблюдаемых действиях учащегося в цифровой среде. Один из перспективных вариантов таких инструментов — контекстные задания сценарного типа. Однако контекстное разнообразие таких заданий может затруднять сравнение результатов. В статье анализируется роль контекста сценарных заданий при измерении двух универсальных навыков: критического мышления и коммуникации. С этой целью применяются методы теории генерализации, которые позволяют установить, в какой степени согласованными являются результаты, полученные с помощью разных контекстов сценарных заданий, и как путем изменения количества индикаторов или контекстов сценариев обеспечить достаточную надежность измерения. Исследование основано на данных, которые получены при тестировании учащихся 4-х классов с помощью разных заданий сценарного типа, входящих в состав инструмента «4К». Результаты анализа показали, что поведение тестируемых в сценариях с разным контекстом различается, при этом трудности контекстов практически одинаковы. Для достижения удовлетворительной надежности рекомендуется использовать минимум два сценария с разными контекстами, а использование трех и более сценарных заданий с разными контекстами позволяет существенно сократить количество индикаторов без потери надежности. В исследовании также оценивалась роль контекста при использовании альтернативных вариантов заданий. Альтернативные варианты схожи в основной проблеме и сюжете сценария, но различаются тематическим наполнением (контентом). Изменение только контента сценария позволяет экстраполировать результаты оценивания универсальных навыков на все варианты заданий, т. е. альтернативные варианты могут использоваться как взаимозаменяемые. Проведенное исследование демонстрирует возможности использования методов теории генерализации для оптимизации разработки заданий с учетом требований к надежности измерения.
- Open Access
- 6 November 2023
- Published by National Research University, Higher School of Economics (HSE) in Voprosy Obrazovaniya / Educational Studies Moscow
- No. 3,p. 221-230
Computational Psychometrics: Near Future or Reality
Рецензируемое издание продолжает серию книг о методологии образовательного тестирования и оценивания, написанных ведущими психометриками и исследователями в области оценивания в образовании. Вычислительная психометрика рассматривается как сочетание методов вычислительных наук и психометрических принципов измерений для анализа данных, полученных в результате тестирования с использованием технологически усовершенствованных форматов теста. В первой части книги обсуждаются изменения, которые произошли в обучении и образовательном оценивании под влиянием цифровых технологий. Во второй части представлен обзор методов вычислительной психометрики: от традиционных психометрических моделей до технологий машинного обучения. Материалы книги могут быть полезны студентам и исследователям в области психометрики, которые занимаются разработкой, проектированием, анализом систем обучения и измерениями с использованием сложных тестовых форматов и данных. Сильной стороной книги является электронное приложение, содержащие код среды программирования R или Python для методологических глав.
- 6 November 2023
- Published by National Research University, Higher School of Economics (HSE) in Voprosy Obrazovaniya / Educational Studies Moscow
- No. 3,p. 221-230
Open AccessComputational Psychometrics: Near Future or Reality
Рецензируемое издание продолжает серию книг о методологии образовательного тестирования и оценивания, написанных ведущими психометриками и исследователями в области оценивания в образовании. Вычислительная психометрика рассматривается как сочетание методов вычислительных наук и психометрических принципов измерений для анализа данных, полученных в результате тестирования с использованием технологически усовершенствованных форматов теста. В первой части книги обсуждаются изменения, которые произошли в обучении и образовательном оценивании под влиянием цифровых технологий. Во второй части представлен обзор методов вычислительной психометрики: от традиционных психометрических моделей до технологий машинного обучения. Материалы книги могут быть полезны студентам и исследователям в области психометрики, которые занимаются разработкой, проектированием, анализом систем обучения и измерениями с использованием сложных тестовых форматов и данных. Сильной стороной книги является электронное приложение, содержащие код среды программирования R или Python для методологических глав.
- Open Access
- 20 January 2023
- Published by Moscow State University of Psychology and Education in Psychological Science and Education
- Vol. 27 (6) , 57-67
Analysis of Task Comparability in Digital Environment by the Case of Metacognitive Skills
This article discusses the problem of task comparability with the help of scenario-based tasks for metacognitive skills. Using the data of “«4С”» tool for measuring critical thinking (N=500), the comparability of two scenarios within an identical digital environment with one set of indicators was investigated. The main difference in the scenarios lies in the contextual characteristics. The measurement invariance analysis of the instrument using confirmatory factor analysis was conducted. The results show that even with the equivalent construct structure and tasks’ characteristics, the context of the scenario has an effect on the student`’s performance. The main differences in results were recorded for tasks involving interaction with the environment, where the test-taker created an object with elements. Tasks involving working with text in a digital environment can be considered comparable in case of elements content change. The possible reasons behind the observed differences in scenarios are discussed.
- 20 January 2023
- Published by Moscow State University of Psychology and Education in Psychological Science and Education
- Vol. 27 (6) , 57-67
Open AccessAnalysis of Task Comparability in Digital Environment by the Case of Metacognitive Skills
This article discusses the problem of task comparability with the help of scenario-based tasks for metacognitive skills. Using the data of “«4С”» tool for measuring critical thinking (N=500), the comparability of two scenarios within an identical digital environment with one set of indicators was investigated. The main difference in the scenarios lies in the contextual characteristics. The measurement invariance analysis of the instrument using confirmatory factor analysis was conducted. The results show that even with the equivalent construct structure and tasks’ characteristics, the context of the scenario has an effect on the student`’s performance. The main differences in results were recorded for tasks involving interaction with the environment, where the test-taker created an object with elements. Tasks involving working with text in a digital environment can be considered comparable in case of elements content change. The possible reasons behind the observed differences in scenarios are discussed.
- 23 December 2022
- Published by Wiley in British Journal of Educational Psychology
- Vol. 93 (2) , 531-544
Computer‐based performance approach for critical thinking assessment in children
Background: Critical thinking (CT) has been identified as one of the key skills in the modern world. Despite a variety of CT assessment systems for secondary school and higher education, there is a shortage of CT assessments for children. Aims: To fill the gap, we developed a computer‐based performance assessment (CPBA) of CT with automatic scoring. In the study, we analysed: (1) To what extent is the internal structure of the critical thinking assessment tool confirmed? (2) What are the patterns of students' behaviour within the CPBA? (3) To what extent is the convergent validity of the CPBA supported? Sample and Methods: The sample consists of 1689 students, aged 9–11 years. To answer the research questions, the following quantitative data analysis methods were selected. The Bayesian Network was applied to investigate the internal structure. Latent Class Analysis was used to investigate the patterns of students' behaviour. To verify the convergent validity, the students were asked to solve the standardized math and language literacy tests. Results and Conclusions: The theoretically expected internal structure of the CPBA was confirmed: the two‐factor structure (the Analysis of information and the Making inferences subskills of CT) describes the data appropriately. Moreover, CT was described not as a list but as a sequence of cognitive operations. Four different strategies that lead to different results of CT were revealed. A weak positive correlation between the results of the CPBA and the achievement tests confirmed the test validity.
- 23 December 2022
- Published by Wiley in British Journal of Educational Psychology
- Vol. 93 (2) , 531-544
Computer‐based performance approach for critical thinking assessment in children
Background: Critical thinking (CT) has been identified as one of the key skills in the modern world. Despite a variety of CT assessment systems for secondary school and higher education, there is a shortage of CT assessments for children. Aims: To fill the gap, we developed a computer‐based performance assessment (CPBA) of CT with automatic scoring. In the study, we analysed: (1) To what extent is the internal structure of the critical thinking assessment tool confirmed? (2) What are the patterns of students' behaviour within the CPBA? (3) To what extent is the convergent validity of the CPBA supported? Sample and Methods: The sample consists of 1689 students, aged 9–11 years. To answer the research questions, the following quantitative data analysis methods were selected. The Bayesian Network was applied to investigate the internal structure. Latent Class Analysis was used to investigate the patterns of students' behaviour. To verify the convergent validity, the students were asked to solve the standardized math and language literacy tests. Results and Conclusions: The theoretically expected internal structure of the CPBA was confirmed: the two‐factor structure (the Analysis of information and the Making inferences subskills of CT) describes the data appropriately. Moreover, CT was described not as a list but as a sequence of cognitive operations. Four different strategies that lead to different results of CT were revealed. A weak positive correlation between the results of the CPBA and the achievement tests confirmed the test validity.
- 1 March 2022
- Published by IATED Academy in INTED Proceedings
- p. 3703
THE RELATIONSHIP BETWEEN STUDENTS` ATTITUDES TOWARDS TASK CONTEXT AND ACHIEVEMENT IN THE ASSESSMENT OF 21ST-CENTURY SKILLS
Information about the paper titled "THE RELATIONSHIP BETWEEN STUDENTS` ATTITUDES TOWARDS TASK CONTEXT AND ACHIEVEMENT IN THE ASSESSMENT OF 21ST-CENTURY SKILLS" at IATED Digital Library
- 1 March 2022
- Published by IATED Academy in INTED Proceedings
- p. 3703
THE RELATIONSHIP BETWEEN STUDENTS` ATTITUDES TOWARDS TASK CONTEXT AND ACHIEVEMENT IN THE ASSESSMENT OF 21ST-CENTURY SKILLS
Information about the paper titled "THE RELATIONSHIP BETWEEN STUDENTS` ATTITUDES TOWARDS TASK CONTEXT AND ACHIEVEMENT IN THE ASSESSMENT OF 21ST-CENTURY SKILLS" at IATED Digital Library
- 1 July 2021
- Published by IATED Academy
- p. 8096-8103
ASSESSING CREATIVITY IN PRIMARY SCHOOL USING IMAGE ANALYSIS WITH NEURAL NETWORKS: A TWO-STEP APPROACH
- 1 July 2021
- Published by IATED Academy
- p. 8096-8103
ASSESSING CREATIVITY IN PRIMARY SCHOOL USING IMAGE ANALYSIS WITH NEURAL NETWORKS: A TWO-STEP APPROACH