Multilevel Learner Modeling in Training Environments for Complex Decision Making
- 17 June 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Learning Technologies
- Vol. 13 (1) , 172-185
Abstract
Intelligent learning environments can be designed to support the development of learners' cognitive skills, strategies, and metacognitive processes as they work on complex decision-making and problem-solving tasks. However, the complexity of the tasks may impede the progress of novice learners. Providing adaptive feedback to learners who face difficulties requires learner modeling approaches that can identify learners' proficiencies and the difficulties they face in executing required skills, strategies, and metacognitive processes. This paper discusses a multilevel hierarchical learner modeling scheme that analyzes and captures learners' cognitive processes and problem-solving strategies along with their performance on assigned tasks in a game-based environment called UrbanSim that requires complex decision making for dealing with counterinsurgency scenarios. As the scenario evolves in a turn-by-turn fashion, UrbanSim evaluates the learners' moves using a number of performance measures. Our learner modeling scheme interprets the reported performance values by analyzing the learners' activities captured in log files to derive learners' proficiencies in associated cognitive skills and strategies, and updates the learner model. We discuss the details of the learner modeling algorithms in this paper, and then demonstrate the effectiveness of our approach by presenting results from a study we conducted at Vanderbilt University.Keywords
Funding Information
- Army Research Laboratory (W911NF-14-2-0050)
This publication has 35 references indexed in Scilit:
- Dynamic Problem SolvingApplied Psychological Measurement, 2012
- Improving Measurements of Self-Regulated LearningEducational Psychologist, 2010
- Measuring Cognitive and Metacognitive Regulatory Processes During Hypermedia Learning: Issues and ChallengesEducational Psychologist, 2010
- A context-aware ubiquitous learning environment for conducting complex science experimentsComputers & Education, 2009
- Naturalistic Decision MakingHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2008
- Differences in expert and novice situation awareness in naturalistic decision makingInternational Journal of Human-Computer Studies, 1996
- Training in Self-Explanation and Self-Regulation Strategies: Investigating the Effects of Knowledge Acquisition Activities on Problem SolvingCognition and Instruction, 1995
- Cognitive Tutors: Lessons LearnedJournal of the Learning Sciences, 1995
- The Challenges of Classroom Strategy InstructionThe Elementary School Journal, 1989
- Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry.American Psychologist, 1979