SACAT: Student-Adaptive Computerized Adaptive Testing
Open Access
- 30 November 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Abstract
Computerized Adaptive Testing refers to an online student ability testing system. It consists of Selection Algorithm and Cognitive Diagnosis Module (CDM). The Selection Algorithm aims to carefully select a small set of questions for the newly arrived student to answer, and the CDM aims to infer the ability of the newly arrived student based on his answers to the selected questions. The CDM faces the challenge of inferring student ability based on the short question-answer sequence. The state-of-the-art approach employs a meta-learning framework to solve this challenge. Specifically, in the outer-layer of the meta-learning framework, it learns an average student ability from all students as the initial ability for the newly arrived student, while in the inner-layer of the meta-learning framework, it infers the newly arrived student’s ability from the short sequence. However, this approach suffers from two major limitations: Firstly, collaborative information between the newly arrived student and all students was not utilized. Secondly, the meta-learning framework has a slow convergence. This paper introduces Student-Adaptive Computerized Adaptive Testing (SACAT), which addresses these issues by: Firstly, use the short sequence of the newly arrived student to retrieve similar students from all students. Secondly, design a fast adaptive function that can adaptively generate an ability representation suitable for the newly arrived student from abilities of similar students. Through extensive experiments on three real-world student response datasets, we validate that SACAT can outperform existing CAT methods. Furthermore, through the fast adaptation, we show that SACAT achieves fast model convergence.Keywords
This publication has 15 references indexed in Scilit:
- RCD: Relation Map Driven Cognitive Diagnosis for Intelligent Education Systems2021
- Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Prediction2020
- User Behavior Retrieval for Click-Through Rate Prediction2020
- Neural Cognitive Diagnosis for Intelligent Education SystemsProceedings of the AAAI Conference on Artificial Intelligence, 2020
- When Cognitive Diagnosis Meets Computerized Adaptive Testing: CD-CATPsychometrika, 2009
- Implementing Sympson-Hetter Item-Exposure Control in a Shadow-Test Approach to Constrained Adaptive TestingInternational Journal of Testing, 2008
- 31A Review of Cognitively Diagnostic Assessment and a Summary of Psychometric Models2006
- Using Multidimensional Item Response Theory to Evaluate Educational and Psychological TestsEducational Measurement: Issues and Practice, 2003
- The Relationship Between Item Exposure and Test Overlap in Computerized Adaptive TestingJournal of Educational Measurement, 2003
- A Global Information Approach to Computerized Adaptive TestingApplied Psychological Measurement, 1996