Empirical development of a heuristic evaluation methodology for shared workspace groupware
Authors:
Open Access
- 16 November 2002
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 96-105
Abstract
Good real time groupware products are hard to develop, in part because evaluating their support for basic teamwork activities is difficult and costly. To address this problem, we are developing discount evaluation methods that look for groupware-specific usability problems. In a previous paper, we detailed a new set of usability heuristics that evaluators can use to inspect shared workspace groupware to see how they support teamwork. We wanted to determine whether the new heuristics could be integrated into a low-cost methodology that parallels Nielsen's traditional heuristic evaluation (HE). To this end, we examined 27 evaluations of two shared workspace groupware systems and analysed the inspectors' relative performance and variability. Similar to Nielsen's findings for traditional HE, individual inspectors discovered about a fifth of the total known teamwork problems, and that there was only modest overlap in the problems they found. Groups of three to five inspectors would report about 40-60% of the total known teamwork problems. These results suggest that heuristic evaluation using our groupware heuristics can be an effective and efficient method for identifying teamwork problems in shared workspace groupware systems.Keywords
This publication has 9 references indexed in Scilit:
- A Descriptive Framework of Workspace Awareness for Real-Time GroupwareComputer Supported Cooperative Work (CSCW), 2002
- A comparison of usage evaluation and inspection methods for assessing groupware usability2001
- Supporting collaborative interpretation in distributed Groupware2000
- Using Language1996
- Building real-time groupware with GroupKit, a groupware toolkitACM Transactions on Computer-Human Interaction, 1996
- Finding usability problems through heuristic evaluation1992
- Findings from observational studies of collaborative workInternational Journal of Man-Machine Studies, 1991
- Heuristic evaluation of user interfaces1990
- Why CSCW applications fail: problems in the design and evaluationof organizational interfaces1988