Integration of Subjective and Objective Usability Evaluation Based on IEC/IEC 15939: A Case Study for Traffic Supervision Systems
- 11 August 2016
- journal article
- research article
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- Vol. 32 (12) , 931-955
Abstract
Usability evaluation for interactive systems is one of the greatest interests for the Human–Computer Interaction community. To support this evaluation, several subjective and objective methods have been proposed and applied in academy and industry. In this context, usability evaluators usually work with a lot of and different kinds of data (e.g., ordinal values from questionnaires and performance rates) generated from different methods and tools and related to different usability criteria. In this article, we propose to integrate these data in a single way to better support the quality evaluators’ decision-making for traffic supervision systems domain. We apply the measurement information model defined by IEC/IEC 15939 with the use of indicators in an interactive system evaluation environment. Four indicators are presented from their specifications to their application in the evaluation of a system from a company. These indicators integrate evaluation results from usability questionnaires, an automated ergonomic guidelines inspector, and an electronic informer.Keywords
Funding Information
- International Campus on Safety and Intermodality in Transportation the Nord Pas-de-Calais Region
- European Community
- Regional Delegation for Research and Technology
- Ministry of Higher Education and Research
- National Center for Scientific Research
This publication has 39 references indexed in Scilit:
- Assessing and improving health in the workplace: an integration of subjective and objective measures with the STress Assessment and Research Toolkit (St.A.R.T.) methodJournal of Occupational Medicine and Toxicology, 2012
- Web log analysis: a review of a decade of studies about information acquisition, inspection and interpretation of user interactionData Mining and Knowledge Discovery, 2011
- Improving interpretation of component-based systems quality through visualisation techniquesIET Software, 2010
- Ergonomic criteria for evaluating the ergonomic quality of interactive systemsBehaviour & Information Technology, 1997
- A proposed index of usability: A method for comparing the relative usability of different software systemsBehaviour & Information Technology, 1997
- The MUSiC performance measurement methodBehaviour & Information Technology, 1997
- IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for useInternational Journal of Human–Computer Interaction, 1995
- SUMI: the Software Usability Measurement InventoryBritish Journal of Educational Technology, 1993
- Psychometric evaluation of an after-scenario questionnaire for computer usability studiesACM SIGCHI Bulletin, 1991
- Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information TechnologyMIS Quarterly, 1989