A group decision approach to developing concept–effect models for diagnosing student learning problems in mathematics
- 23 May 2012
- journal article
- research article
- Published by Wiley in British Journal of Educational Technology
- Vol. 44 (3) , 453-468
Abstract
Diagnosing student learning barriers has been recognized as the most fundamental and important issue for improving the learning achievements of students. In the past decade, several learning diagnosis approaches have been proposed based on the concept–effect relationship (CER) model. However, past studies have shown that the effectiveness of this model heavily depends on the concept relationship knowledge provided by the domain experts (eg, experienced teachers or educators for a specified subject); ie, the performance of the developed learning diagnosis systems could be significantly affected by subjective opinions, ignorance or insufficient knowledge if those concept relationships are derived from a single domain expert. To cope with this problem, this study proposes a group decision approach for developing the CER model with the cooperation of multiple domain experts. Based on the proposed approach, a testing and diagnostic system has been implemented; moreover, an experiment has been conducted to evaluate the effectiveness of this new approach. The experimental results show that this approach is able to develop quality CER models, and hence the low‐achievement students who received the generated learning suggestions had significantly better learning achievements than those who learned with the previous approach. Practitioner notes: What is already known about this topic Diagnosing student learning barriers is a fundamental and important issue for improving the learning achievements of students. Several learning diagnosis approaches have been proposed based on the concept–effect relationship (CER) model. The effectiveness of the learning diagnosis model heavily depends on the concept relationship knowledge provided by the domain experts. What this paper adds A group decision approach for developing the CER model with the cooperation of multiple domain experts is proposed. A testing and diagnostic system was implemented based on the proposed approach. An experiment was conducted to investigating whether the students guided by the proposed approach had better learning achievements than those guided by the original CER model approach. Implications for practice and/or policy The experimental results show that the low‐achievement students who received the learning suggestions generated by the new approach had significantly better learning achievements than those who learned with the previous approach. Further studies of developing more effective tools or leading in other group decision strategies to help domain experts cooperatively determine the prerequisite relationships are needed.Keywords
This publication has 38 references indexed in Scilit:
- Adaptive learning for ESL based on computationBritish Journal of Educational Technology, 2011
- Creating opportunities for students in large cohorts to reflect in and on practice: Lessons learnt from a formative evaluation of students' experiences of a technology‐enhanced blended learning designBritish Journal of Educational Technology, 2010
- Ontology‐based concept map for planning a personalised learning pathBritish Journal of Educational Technology, 2009
- Application of automatically constructed concept map of learning to conceptual diagnosis of e-learningExpert Systems with Applications, 2009
- What are learners actually regulating when given feedback?British Journal of Educational Technology, 2009
- Mutual feedback in e‐portfolio assessment: an approach to the netfolio systemBritish Journal of Educational Technology, 2009
- Diagnostic online assessment of basic IT skills in 1st‐year undergraduates in the Medical Sciences Division, University of OxfordBritish Journal of Educational Technology, 2009
- Students' evaluation of the use of online summative assessment on an undergraduate financial accounting moduleBritish Journal of Educational Technology, 2009
- A Delphi-based approach to developing expert systems with the cooperation of multiple expertsExpert Systems with Applications, 2008
- An effective metacognitive strategy: learning by doing and explaining with a computer‐based Cognitive TutorCognitive Science, 2002