An Ontology-Driven Learning Assessment Using the Script Concordance Test
Open Access
- 29 January 2022
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 12 (3) , 1472
Abstract
Assessing the level of domain-specific reasoning acquired by students is one of the major challenges in education particularly in medical education. Considering the importance of clinical reasoning in preclinical and clinical practice, it is necessary to evaluate students’ learning achievements accordingly. The traditional way of assessing clinical reasoning includes long-case exams, oral exams, and objective structured clinical examinations. However, the traditional assessment techniques are not enough to answer emerging requirements in the new reality due to limited scalability and difficulty for adoption in online education. In recent decades, the script concordance test (SCT) has emerged as a promising tool for assessment, particularly in medical education. The question is whether the usability of SCT could be raised to a level high enough to match the current education requirements by exploiting opportunities that new technologies provide, particularly semantic knowledge graphs (SCGs) and ontologies. In this paper, an ontology-driven learning assessment is proposed using a novel automated SCT generation platform. SCTonto ontology is adopted for knowledge representation in SCT question generation with the focus on using electronic health records data for medical education. Direct and indirect strategies for generating Likert-type scores of SCT are described in detail as well. The proposed automatic question generation was evaluated against the traditional manually created SCT, and the results showed that the time required for tests creation significantly reduced, which confirms significant scalability improvements with respect to traditional approaches.Keywords
This publication has 36 references indexed in Scilit:
- Ontology-Based Multiple Choice Question GenerationThe Scientific World Journal, 2014
- Script concordance test: Insights from the literature and early stages of its implementation in osteopathyInternational Journal of Osteopathic Medicine, 2013
- Education Research: Can my electronic health record teach me something?Neurology, 2013
- Script concordance testing: From theory to practice: AMEE Guide No. 75Medical Teacher, 2013
- Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical educationBMC Medical Education, 2012
- Online Script Concordance Test for Clinical Reasoning Assessment in OtorhinolaryngologyThe Association Between Performance and Clinical ExperienceJAMA Otolaryngology–Head & Neck Surgery, 2011
- An application of intelligent techniques and semantic web technologies in e-learning environmentsExpert Systems with Applications, 2009
- Script Concordance Tests: Guidelines for ConstructionBMC Medical Informatics and Decision Making, 2008
- Stability of clinical reasoning assessment results with the Script Concordance test across two different linguistic, cultural and learning environmentsMedical Teacher, 2002
- Ontologies: principles, methods and applicationsThe Knowledge Engineering Review, 1996