Analysis in practical usability evaluation
Authors:
Open Access
- 5 May 2012
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 2127-2136
Abstract
Analysis is a key part of conducting usability evaluations, yet rarely systematically studied. Thus, we lack direction on how to do research on supporting practitioners' analysis and lose an opportunity for practitioners to learn from each other. We have surveyed 155 usability practitioners on the analysis in their latest usability evaluation. Analysis is typically flexible and light-weight. At the same time, practitioners see a need to strengthen reliability in evaluation. Redesign is closely integrated with analysis; more than half of the respondents provide visual redesign suggestions in their evaluation deliverables. Analysis support from academic research, including tools, forms and structured formats, does not seem to have direct impact on analysis practice. We provide six recommendations for future research to better support analysis.Keywords
This publication has 18 references indexed in Scilit:
- Ingredients and Meals Rather Than Recipes: A Proposal for Research That Does Not Treat Usability Evaluation Methods as Indivisible WholesInternational Journal of Human–Computer Interaction, 2011
- Work-domain knowledge in usability evaluation: Experiences with Cooperative Usability TestingJournal of Systems and Software, 2010
- Supporting novice usability practitioners with usability engineering toolsInternational Journal of Human-Computer Studies, 2009
- Heuristic evaluation: Comparing ways of finding and reporting usability problemsInteracting with Computers, 2007
- Usability professionals—current practices and future developmentInteracting with Computers, 2006
- Determining the Effectiveness of the Usability Problem Inspector: A Theory-Based Model and Tool for Finding Usability ProblemsHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2003
- A survey of user-centered design practice2002
- The user action framework: a reliable foundation for usability engineering support toolsInternational Journal of Human-Computer Studies, 2001
- Thinking aloud: reconciling theory and practiceIEEE Transactions on Professional Communication, 2000
- Comparison of evaluation methods using structured usability problem reportsBehaviour & Information Technology, 1997