Interactive Critiquing as a Form of Decision Support: An Empirical Evaluation
- 1 March 1999
- journal article
- Published by SAGE Publications in Human Factors: The Journal of the Human Factors and Ergonomics Society
- Vol. 41 (1) , 72-89
Abstract
This research focused on the design of a decision-support system to assist blood bankers in identifying alloantibodies in patients' blood. It was hypothesized that critiquing, a technique in which a computer monitors human performance for errors, would be an effective role for such a decision-support system if the error monitoring was unobtrusive and if the critiquing was in response to both intermediate and final conclusions made by the user. A prototype critiquing system monitored medical technologists for (a) errors of commission and errors of omission, b) failure to follow a complete protocol, (c) answers inconsistent with the data collected, and (d) answers inconsistent with prior probability information. Participants using the critiquing system had significantly better performance (completely eliminating misdiagnosis rates for 3 out of 4 test cases) than a comparable control group. Detailed analysis of the behavioral protocols provided insights into how specific design features influenced performance. Practical applications of this research include its use (after refinements) as a tool for routine antibody identification in blood banks.Keywords
This publication has 28 references indexed in Scilit:
- Performance of Four Computer-Based Diagnostic SystemsNew England Journal of Medicine, 1994
- A laboratory evaluation of a human operator support systemInternational Journal of Human-Computer Studies, 1994
- Comparative Study of Human Expertise and an Expert System: Application to the Diagnosis of Child's MeningitisComputers and Biomedical Research, 1993
- Performance Consequences of Automation-Induced 'Complacency'The International Journal of Aviation Psychology, 1993
- Validation of the medical expert system PNEUMON-IAComputers and Biomedical Research, 1992
- Coping with the complexities of multiple-solution problems: a case studyInternational Journal of Man-Machine Studies, 1991
- A Desktop Expert System for the Differential Diagnosis of Dementia: An Evaluation StudyInternational Journal of Technology Assessment in Health Care, 1990
- Evaluation Issues in the Development of Expert Systems in MedicineEvaluation & the Health Professions, 1989
- PUFF: An expert system for interpretation of pulmonary function dataComputers and Biomedical Research, 1983
- Categorization of action slips.Psychological Review, 1981