DGDaria Gracheva

Daria Gracheva

*This is an algorithmically generated author record based on publicly available information.

Daria Gracheva has a total of 14 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Interactive Scenario-Based Tasks for Assessing Communication Skills in Early Adolescence

    by Irina Uglanova, Daria Gracheva, Maria Lebedeva, Aleksandra Granaturova

    Effective communication is essential in both everyday and educational contexts. To efficiently address social skill challenges among students, teachers and parents require valid assessment tools. This study presents interactive scenario-based tasks (ISBTs) with automatic scoring for assessing communication skills in collaborative settings (CSCS), targeting early adolescents. Forty-seven performance indicators were developed across three ISBTs. Validity evidence was gathered based on the tool’s internal structure, text complexity analysis, and correlations with sociodemographic variables, academic achievement, and involvement in activities with friends and family. The assessment was validated using data from two studies (Study 1: n = 1841; Study 2: n = 729). Additionally, alternative forms of the ISBTs were developed to facilitate pretest–posttest analysis, and evidence of their comparability is presented. Finally, the study discusses future directions for the assessment of communication skills.

  • Learning as Play: The Relationship Between Adolescents’ Attitudes Toward Game Mechanics and Their Motivation and Educational Outcomes

    by Kseniya V. Tarasova, Daria A. Gracheva, Svetlana M. Avdeeva, Victoria E. Kolesnikova, Kirill E. Pegov

    This article explores the relationship between adolescents’ attitudes toward the use of game mechanics in education and their academic motivation and transversal educational outcomes, including critical thinking, creativity, communication, collaboration (4Cs), and digital literacy. The study involved 312 adolescents aged 13–15 from 10 regions of Russia, all attending “IT-Cube” centers for digital education. Questionnaires and interactive tests (4C and DigLit) were used to assess perceptions of gamification, motivation, and skills. The findings indicate that frequent use of gamification mechanics, such as "tasks and quests" and "reward systems," positively correlates with students’ intrinsic motivation and engagement. However, some mechanics, particularly those involving competitive elements, may induce anxiety in high-achieving students. The frequency of gamification mechanics application shows a weak positive relationship with intrinsic motivation but has no significant effect on digital literacy or 4C skills. Gender differences were observed, with female students reporting higher anxiety related to gamification mechanics, though no differences were found in overall engagement. The article emphasizes the need to adapt gamification mechanics to educational goals, individual student characteristics, and motivational profiles.

  • Open Access

    Exploring the Relationship between Performance and Response Process Data in Digital Literacy Assessment

    by I.O. Tkachenko, K.V. Tarasova, D.A. Gracheva

    Measuring complex latent constructs is challenging because of their multi-dimensionality. In this context, computer-based assessments have gained popularity due to its ability to handle large diverse data. The aim of the study is to investigate the interrelationship between performance, time, and actions in computer-based digital literacy assessment. The study involved more than 400 8th-grade schoolchildren (approximately 14—15 years old) from secondary schools in Russia. A subset was obtained from indicators capturing the demonstration of analysis of data, information, and digital content, which is a component of the information literacy in the digital literacy framework. The data was used to create latent models in the structural equation modeling framework. Confirmatory one-factor model for the Performance factor showed a good fit to the data (CFI=1; TLI=1; RMSEA=0). The model with dependencies among indicators demonstrated improved model fit (χ2(18)=510,65; p=0,05) compared to the model without such dependencies. The results suggest that performance, time, and actions are interdependent. The findings underscore the need for a comprehensive approach to assessing digital literacy that accounts for these interdependencies, as well as investigating behavioral patterns of interaction with a large amount of information in the digital environment.

  • Open Access

    The Role of Context in Scenario-Based Tasks for Measuring Universal Skills: The Use of Generalizability Theory

    by Дарья Грачева

    В современных условиях большое внимание уделяется развитию и оцениванию универсальных навыков у школьников. Для такого оценивания необходимы новые тестовые форматы, основанные на наблюдаемых действиях учащегося в цифровой среде. Один из перспективных вариантов таких инструментов — контекстные задания сценарного типа. Однако контекстное разнообразие таких заданий может затруднять сравнение результатов. В статье анализируется роль контекста сценарных заданий при измерении двух универсальных навыков: критического мышления и коммуникации. С этой целью применяются методы теории генерализации, которые позволяют установить, в какой степени согласованными являются результаты, полученные с помощью разных контекстов сценарных заданий, и как путем изменения количества индикаторов или контекстов сценариев обеспечить достаточную надежность измерения. Исследование основано на данных, которые получены при тестировании учащихся 4-х классов с помощью разных заданий сценарного типа, входящих в состав инструмента «4К». Результаты анализа показали, что поведение тестируемых в сценариях с разным контекстом различается, при этом трудности контекстов практически одинаковы. Для достижения удовлетворительной надежности рекомендуется использовать минимум два сценария с разными контекстами, а использование трех и более сценарных заданий с разными контекстами позволяет существенно сократить количество индикаторов без потери надежности. В исследовании также оценивалась роль контекста при использовании альтернативных вариантов заданий. Альтернативные варианты схожи в основной проблеме и сюжете сценария, но различаются тематическим наполнением (контентом). Изменение только контента сценария позволяет экстраполировать результаты оценивания универсальных навыков на все варианты заданий, т. е. альтернативные варианты могут использоваться как взаимозаменяемые. Проведенное исследование демонстрирует возможности использования методов теории генерализации для оптимизации разработки заданий с учетом требований к надежности измерения.


  • Open Access

    Computational Psychometrics: Near Future or Reality

    by Дарья Грачева, Ксения Тарасова

    Рецензируемое издание продолжает серию книг о методологии образовательного тестирования и оценивания, написанных ведущими психометриками и исследователями в области оценивания в образовании. Вычислительная психометрика рассматривается как сочетание методов вычислительных наук и психометрических принципов измерений для анализа данных, полученных в результате тестирования с использованием технологически усовершенствованных форматов теста. В первой части книги обсуждаются изменения, которые произошли в обучении и образовательном оценивании под влиянием цифровых технологий. Во второй части представлен обзор методов вычислительной психометрики: от традиционных психометрических моделей до технологий машинного обучения. Материалы книги могут быть полезны студентам и исследователям в области психометрики, которые занимаются разработкой, проектированием, анализом систем обучения и измерениями с использованием сложных тестовых форматов и данных. Сильной стороной книги является электронное приложение, содержащие код среды программирования R или Python для методологических глав.


  • Open Access

    Analysis of Task Comparability in Digital Environment by the Case of Metacognitive Skills

    by D.A. Gracheva

    This article discusses the problem of task comparability with the help of scenario-based tasks for metacognitive skills. Using the data of “«4С”» tool for measuring critical thinking (N=500), the comparability of two scenarios within an identical digital environment with one set of indicators was investigated. The main difference in the scenarios lies in the contextual characteristics. The measurement invariance analysis of the instrument using confirmatory factor analysis was conducted. The results show that even with the equivalent construct structure and tasks’ characteristics, the context of the scenario has an effect on the student`’s performance. The main differences in results were recorded for tasks involving interaction with the environment, where the test-taker created an object with elements. Tasks involving working with text in a digital environment can be considered comparable in case of elements content change. The possible reasons behind the observed differences in scenarios are discussed.


  • Computer‐based performance approach for critical thinking assessment in children

    by Irina Uglanova, Ekaterina Orel, Daria Gracheva, Ksenia Tarasova

    Background: Critical thinking (CT) has been identified as one of the key skills in the modern world. Despite a variety of CT assessment systems for secondary school and higher education, there is a shortage of CT assessments for children. Aims: To fill the gap, we developed a computer‐based performance assessment (CPBA) of CT with automatic scoring. In the study, we analysed: (1) To what extent is the internal structure of the critical thinking assessment tool confirmed? (2) What are the patterns of students' behaviour within the CPBA? (3) To what extent is the convergent validity of the CPBA supported? Sample and Methods: The sample consists of 1689 students, aged 9–11 years. To answer the research questions, the following quantitative data analysis methods were selected. The Bayesian Network was applied to investigate the internal structure. Latent Class Analysis was used to investigate the patterns of students' behaviour. To verify the convergent validity, the students were asked to solve the standardized math and language literacy tests. Results and Conclusions: The theoretically expected internal structure of the CPBA was confirmed: the two‐factor structure (the Analysis of information and the Making inferences subskills of CT) describes the data appropriately. Moreover, CT was described not as a list but as a sequence of cognitive operations. Four different strategies that lead to different results of CT were revealed. A weak positive correlation between the results of the CPBA and the achievement tests confirmed the test validity.


  • THE RELATIONSHIP BETWEEN STUDENTS` ATTITUDES TOWARDS TASK CONTEXT AND ACHIEVEMENT IN THE ASSESSMENT OF 21ST-CENTURY SKILLS

    by Daria Gracheva

    Information about the paper titled "THE RELATIONSHIP BETWEEN STUDENTS` ATTITUDES TOWARDS TASK CONTEXT AND ACHIEVEMENT IN THE ASSESSMENT OF 21ST-CENTURY SKILLS" at IATED Digital Library

  • ASSESSING CREATIVITY IN PRIMARY SCHOOL USING IMAGE ANALYSIS WITH NEURAL NETWORKS: A TWO-STEP APPROACH

    by Irina Uglanova, Evgeniy Gelver, Sergei Tarasov, Daria Gracheva, Elena Vyrva