An efficient approach to improve the usability of e-learning resources: the role of heuristic evaluation
- 1 September 2013
- journal article
- Published by American Physiological Society in Advances in Physiology Education
- Vol. 37 (3) , 242-248
Abstract
Optimizing the usability of e-learning materials is necessary to maximize their potential educational impact, but this is often neglected when time and other resources are limited, leading to the release of materials that cannot deliver the desired learning outcomes. As clinician-teachers in a resource-constrained environment, we investigated whether heuristic evaluation of our multimedia e-learning resource by a panel of experts would be an effective and efficient alternative to testing with end users. We engaged six inspectors, whose expertise included usability, e-learning, instructional design, medical informatics, and the content area of nephrology. They applied a set of commonly used heuristics to identify usability problems, assigning severity scores to each problem. The identification of serious problems was compared with problems previously found by user testing. The panel completed their evaluations within 1 wk and identified a total of 22 distinct usability problems, 11 of which were considered serious. The problems violated the heuristics of visibility of system status, user control and freedom, match with the real world, intuitive visual layout, consistency and conformity to standards, aesthetic and minimalist design, error prevention and tolerance, and help and documentation. Compared with user testing, heuristic evaluation found most, but not all, of the serious problems. Combining heuristic evaluation and user testing, with each involving a small number of participants, may be an effective and efficient way of improving the usability of e-learning materials. Heuristic evaluation should ideally be used first to identify the most obvious problems and, once these are fixed, should be followed by testing with typical end users.Keywords
This publication has 26 references indexed in Scilit:
- Usability testing of a multimedia e‐learning resource for electrolyte and acid‐base disordersBritish Journal of Educational Technology, 2013
- Development and evaluation of a multimedia e-learning resource for electrolyte and acid-base disordersAdvances in Physiology Education, 2011
- Software development methods and usability: Perspectives from a survey in the software industry in NorwayInteracting with Computers, 2008
- Usability Assessment MethodsReviews of Human Factors and Ergonomics, 2006
- Usability Meanings and Interpretations in ISO StandardsSoftware Quality Journal, 2003
- The Evaluator Effect: A Chilling Fact About Usability Evaluation MethodsInternational Journal of Human–Computer Interaction, 2001
- Comparison of empirical testing and walkthrough methods in user interface evaluation1992
- Formal modelling techniques in human-computer interactionActa Psychologica, 1991
- User interface evaluation in the real world1991
- Designing for usability: key principles and what designers thinkCommunications of the ACM, 1985