Consistency and Accuracy in Decision Aids: Experiments with Four Multiattribute Systems*
Authors:
- 1 November 1995
- journal article
- Published by Wiley in Decision Sciences
- Vol. 26 (6) , 723-747
Abstract
There have been a number of multiattribute decision aids developed to aid selection problems. Multiattribute value theory and the analytic hierarchy process are two commonly used techniques. Different systems can result in radically different conclusions if they inaccurately and inconsistently reflect the preference structure of decision makers, or if they are based on inappropriate theoretical models. This study examines the impact of the underlying theoretical model, the method in which preference information is elicited, and the structure of alternatives as influences on the results from using various decision aids. It was found that two systems based on the multiattribute value theory model were just as diverse in their conclusions as were results between AHP and the multiattribute value theory models. Therefore, accuracy of information reflecting decision maker preference is an important consideration. Feedback capable of assuring the decision maker that information provided is consistent is a necessary feature required of decision aids applied to selection problems. The study also found that the way in which information is elicited influenced the result more than did the underlying model. Exact numerical data for complex concepts such as attribute importance and alternative performance on attributes is not necessary, and elicitation procedures that are more natural for the user are likely to be more accurate.Keywords
This publication has 33 references indexed in Scilit:
- On the evaluation and application of different scales for quantifying pairwise comparisons in fuzzy setsJournal of Multi-Criteria Decision Analysis, 1994
- Scale sensitivity in the multiplicative AHP and SMARTJournal of Multi-Criteria Decision Analysis, 1993
- Experiments comparing qualitative approaches to rank ordering of multiattribute alternativesJournal of Multi-Criteria Decision Analysis, 1993
- Software review. Overview of the MCDA software marketJournal of Multi-Criteria Decision Analysis, 1992
- Review of Empirical Studies in Multiobjective Mathematical Programming: Subject Reflection of Nonlinear Utility and LearningDecision Sciences, 1992
- Deriving weights from pairwise comparison matrices: The additive caseOperations Research Letters, 1990
- Decision support systems effectiveness: Conceptual framework and empirical evaluationOrganizational Behavior and Human Decision Processes, 1990
- A comparison of weight approximation techniques in multiattribute utility decision makingOrganizational Behavior and Human Performance, 1981
- Unit weighting schemes for decision makingOrganizational Behavior and Human Performance, 1975
- Linear models in decision making.Psychological Bulletin, 1974