Identification of Cognitive Learning Complexity of Assessment Questions Using Multi-class Text Classification
Authors:
Open Access
- 15 June 2020
- journal article
- research article
- Published by Bastas Publications in Contemporary Educational Technology
- Vol. 12 (2) , ep275
Abstract
Cognitive learning complexity identification of assessment questions is an essential task in the domain of education, as it helps both the teacher and the learner to discover the thinking process required to answer a given question. Bloom’s Taxonomy cognitive levels are considered as a benchmark standard for the classification of cognitive thinking (learning complexity) in an educational environment. However, it was observed that some of the action verbs of Bloom’s Taxonomy are overlapping in multiple levels of the hierarchy, causing ambiguity about the real sense of cognition required. The paper describes two methodologies to automatically identify the cognitive learning complexity of given questions. The first methodology uses labelled Latent Dirichlet Allocation (LDA) as a machine learning approach. The second methodology uses the BERT framework for multi-class text classification for deep learning. The experiments were performed on an ensemble of 3000+ educational questions, which were based on previously published datasets along with the TREC question corpus and AI2 Biology How/Why question corpus datasets. The labelled LDA reached an accuracy of 83% while BERT based approach reached 89% accuracy. An analysis of both the results is shown, evaluating the significant factors responsible for determining cognitive knowledge.Keywords
This publication has 30 references indexed in Scilit:
- Bloom’s Taxonomy–Based Classification for Item Bank Questions Using Support Vector Machines2012
- Autonomous and Adaptive Identification of Topics in Unstructured TextLecture Notes in Computer Science, 2011
- Merlin C. Wittrock and the Revision of Bloom's TaxonomyEducational Psychologist, 2010
- A Revision of Bloom's Taxonomy: An OverviewTheory Into Practice, 2002
- The Effects of Adjunct Questions and Feedback on Improving the Reading Comprehension Skills of Learning-Disabled AdolescentsContemporary Educational Psychology, 2001
- Application adjunct post-questions and conceptual problem solvingContemporary Educational Psychology, 1992
- A Framework for the Evaluation of the Effectiveness of Adjunct Questions and ObjectivesReview of Educational Research, 1985
- A Meta-Analysis of Experimental Research on Teacher Questioning BehaviorReview of Educational Research, 1981
- Does Answering Higher-Level Questions While Reading Facilitate Productive Learning?Review of Educational Research, 1979
- The Concept of Mathemagenic ActivitiesReview of Educational Research, 1970