Question classification based on Bloom’s taxonomy cognitive domain using modified TF-IDF and word2vec
Authors:
Top Cited Papers
Open Access
- 19 March 2020
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 15 (3) , e0230442
Abstract
The assessment of examination questions is crucial in educational institutes since examination is one of the most common methods to evaluate students’ achievement in specific course. Therefore, there is a crucial need to construct a balanced and high-quality exam, which satisfies different cognitive levels. Thus, many lecturers rely on Bloom’s taxonomy cognitive domain, which is a popular framework developed for the purpose of assessing students’ intellectual abilities and skills. Several works have been proposed to automatically handle the classification of questions in accordance with Bloom’s taxonomy. Most of these works classify questions according to specific domain. As a result, there is a lack of technique of classifying questions that belong to the multi-domain areas. The aim of this paper is to present a classification model to classify exam questions based on Bloom’s taxonomy that belong to several areas. This study proposes a method for classifying questions automatically, by extracting two features, TFPOS-IDF and word2vec. The purpose of the first feature was to calculate the term frequency-inverse document frequency based on part of speech, in order to assign a suitable weight for essential words in the question. The second feature, pre-trained word2vec, was used to boost the classification process. Then, the combination of these features was fed into three different classifiers; K-Nearest Neighbour, Logistic Regression, and Support Vector Machine, in order to classify the questions. The experiments used two datasets. The first dataset contained 141 questions, while the other dataset contained 600 questions. The classification result for the first dataset achieved an average of 71.1%, 82.3% and 83.7% weighted F1-measure respectively. The classification result for the second dataset achieved an average of 85.4%, 89.4% and 89.7% weighted F1-measure respectively. The finding from this study showed that the proposed method is significant in classifying questions from multiple domains based on Bloom’s taxonomy.Keywords
Funding Information
- Pusat Penyelidikan Automotif, Universiti Kebangsaan Malaysia (GUP-2019-058)
This publication has 35 references indexed in Scilit:
- A Study on Term Weighting for Text Categorization: A Novel Supervised Variant of tf.idf2015
- Semantic Clustering and Convolutional Neural Network for Short Text Categorization2015
- Convolutional Neural Networks for Sentence Classification2014
- Analyzing the Cognitive Level of Classroom Questions Using Machine Learning TechniquesProcedia - Social and Behavioral Sciences, 2013
- Combining Lexical and Semantic Features for Short Text ClassificationProcedia Computer Science, 2013
- Automated Analysis of Exam Questions According to Bloom's TaxonomyProcedia - Social and Behavioral Sciences, 2012
- Bloom’s Taxonomy–Based Classification for Item Bank Questions Using Support Vector Machines2012
- Non-Manual Control Devices2011
- Part of Speech Based Term Weighting for Information Retrieval2009
- Support-vector networksMachine Learning, 1995