DEVAN: A tool for detailed video analysis of user test data
Authors:
- Arnold P. O. S. VermeerenAVArnold P. O. S. Vermeeren
- Karin Den BouwmeesterKBKarin Den Bouwmeester
- Jans AasmanJAJans Aasman
- Huib de RidderHRHuib de Ridder
- 1 January 2002
- journal article
- research article
- Published by Taylor & Francis in Behaviour & Information Technology
- Vol. 21 (6) , 403-423
Abstract
A tool was developed for structured and detailed analysis of video data from user tests of interactive systems. It makes use of a table format for representing an interaction at multiple levels of abstraction. Interactions are segmented based on threshold times for pauses between actions. Usability problems are found using a list of observable indications for the occurrence of problems. The tool was evaluated by having two analysts apply it to three data sets from user tests on two different products. The segmentation technique proved to yield meaningful segments that helped in understanding the interaction. The interaction table was explicit enough to discuss in detail what had caused the differences in the analysts' lists of usability problems. The results suggested that the majority of differences were caused by unavoidable differences in interpretations of subjects' behaviour and that only minor improvements should be expected by refining the tool.Keywords
This publication has 10 references indexed in Scilit:
- Anticipation of Usability Problems by PractitionersProceedings of the Human Factors and Ergonomics Society Annual Meeting, 2000
- Designing Pleasurable Products2000
- Model mismatch analysis: Towards a deeper explanation of users' usability problemsBehaviour & Information Technology, 2000
- Comparing interfaces based on what users watch and do2000
- Comparative evaluation of usability tests1999
- The evaluator effect in usability tests1998
- Comparison of evaluation methods using structured usability problem reportsBehaviour & Information Technology, 1997
- A comparison of usability evaluations conducted by different teams1994
- The phenotype of erroneous actionsInternational Journal of Man-Machine Studies, 1993
- User Centered System Design1986