From Measurement to Decision: Sensitivity of Decision Outcome to Input and Model Uncertainties
Authors:
- 5 November 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 68 (9) , 3100-3108
Abstract
While formal and rigorous procedures are adopted to ensure the reliability of measurement results, the decision-making activities based on the information returned by measurement are often poorly structured and based on vague assumptions and reasoning, thus negatively impacting the reliability of the achieved conclusion. To overcome this problem, a structured multicriteria decision-making approach based on the analytic hierarchy process was recently proposed in the literature to properly support decision-making activities by exploiting the information provided by measurement results related to heterogeneous properties and its application was demonstrated in a case study. Using the same case study, this paper analyses the sensitivity of the obtained conclusion to various uncertainty sources that are embedded in that approach. In particular, the impact of uncertainties on both measurement and pairwise comparisons of the criteria is analyzed and their combined effect is evaluated by considering a worst case situation. Moreover, the effect of the formula adopted to aggregate the information returned by the measurement of heterogeneous properties on the final decision is considered. The performed analysis contributes to support a disciplined and methodologically sound implementation of decision-making activities, significantly improving both the repeatability and reproducibility of the whole evaluation process, as well as the confidence in the achieved conclusions.Keywords
This publication has 20 references indexed in Scilit:
- A Structured Methodology for Measurement DevelopmentIEEE Transactions on Instrumentation and Measurement, 2015
- From Measures to Conclusions Using Analytic Hierarchy Process in Dependability BenchmarkingIEEE Transactions on Instrumentation and Measurement, 2014
- Multicriteria Decision-Making Methodology for Systems EngineeringIEEE Systems Journal, 2014
- Metric of the Application Environment Impact to the Passive UHF RFID SystemIEEE Transactions on Instrumentation and Measurement, 2014
- Rank reversals in multi-criteria decision analysis with statistical modelling of ratio-scale pairwise comparisonsJournal of the Operational Research Society, 2005
- Two new cases of rank reversals when the AHP and some of its additive variants are used that do not occur with the multiplicative AHPJournal of Multi-Criteria Decision Analysis, 2001
- Scale sensitivity in the multiplicative AHP and SMARTJournal of Multi-Criteria Decision Analysis, 1993
- A cost-benefit decision model: analysis, comparison amd selection of data managementACM Transactions on Database Systems, 1987
- A note on the analysis of subjective judgment matricesJournal of Mathematical Psychology, 1985
- A scaling method for priorities in hierarchical structuresJournal of Mathematical Psychology, 1977