Automatic Generation of Quantitative Reasoning Items
Authors:
- 1 January 2006
- journal article
- Published by Hogrefe Publishing Group in Journal of Individual Differences
- Vol. 27 (1) , 2-14
Abstract
This paper deals with three studies on the computer-based, automatic generation of algebra word problems. The cognitive psychology based generative/quality control frameworks of the item generator are presented. In Study I the quality control framework is empirically tested using a first set of automatically generated items. Study II replicates the findings of Study I using a larger set of automatically generated algebra word problems. Study III deals with the generative framework of the item generator by testing construct validity aspects of the item generator produced items. Using nine Rasch-homogeneous subscales of the new intelligence structure battery (INSBAT, Hornke et al., 2004 ), a hierarchical confirmatory factor analysis is reported, which provides first evidence of convergent as well as divergent validity of the automatically generated items. The end of the paper discusses possible advantages of automatic item generation in general ranging from test security issues and the possibility of a more precise psychological assessment to mass testing and economical questions of test construction.Keywords
This publication has 41 references indexed in Scilit:
- Structural Models of Abilities Measured by the Ball Aptitude BatteryEducational and Psychological Measurement, 2002
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling: A Multidisciplinary Journal, 1999
- Using Algebra Word Problems to Assess Quantitative Ability: Attributes, Strategies, and ErrorsCognition and Instruction, 1996
- Content effects in problem categorization and problem solving.Journal of Experimental Psychology: Learning, Memory, and Cognition, 1996
- Components of quantitative reasoning: General and group ability factorsIntelligence, 1993
- A Theory of Algebra-Word-Problem Comprehension and Its Implications for the Design of Learning EnvironmentsCognition and Instruction, 1992
- Use of Restricted Item Response Models for Examining Item Difficulty Ordering and Slope UniformityJournal of Educational Measurement, 1991
- Exploring the Episodic Structure of Algebra Story Problem SolvingCognition and Instruction, 1989
- Within-task intercorrelations of skilled performance: Implications for predicting individual differences? A comment on Henry & Hulin, 1987.Journal of Applied Psychology, 1989
- Memory for algebra story problems.Journal of Educational Psychology, 1982