Detection of Decision-Making Manipulation in the Pairwise Comparison Method
Open Access
- 4 October 2024
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 14 (19) , 8946
Abstract
Most decision-making models, including the pairwise comparison method, assume the honesty of the decision-maker. However, it is easy to imagine a situation where the decision-maker tries to manipulate the ranking results. This problem applies to many decision-making methods, including the pairwise comparison method. This article proposes three simple algorithmic methods for manipulating data using the pairwise comparison method. The proposed solutions try to mimic the behavior of a dishonest decision-maker who, acting under time pressure, chooses a simple strategy that leads to pushing through a given alternative. We also test the susceptibility to detection of the proposed manipulation strategies. To this end, we propose a convolutional neural network architecture, which we train based on generated data consisting of the original random pairwise comparison matrices and their manipulated counterparts. Our approach treats the pairwise comparison matrices as two- or three-dimensional images specific to the decision situation. In the latter case, the matrices are initially transformed into a three-dimensional map of local inconsistencies, and only data processed in this way are subjected to analysis using neural networks. The experiments indicate a significant level of detection of the proposed manipulations. In numerical tests, the effectiveness of the presented solution ranges from 88% to 100% effectiveness, depending on the tested algorithm and test parameters. The measured average computation time for the single case analyzed oscillated below one millisecond, which is a more than satisfactory result of the performance of the built implementation. We can successfully use the neural networks trained on synthetic data to detect manipulation attempts carried out by real experts. Preliminary tests with respondents also indicated high effectiveness in detecting manipulation. At the same time, they signaled the difficulty of distinguishing actual manipulation from a situation in which an expert strongly prefers one or more selected alternatives.Keywords
All Related Versions
Funding Information
- Narodowe Centrum Nauki (2021/41/B/HS4/03475, 11.11.420.004)
- Polish Ministry of Science and Higher Education within the internal task of AGH University of Krakow (2021/41/B/HS4/03475, 11.11.420.004)
This publication has 76 references indexed in Scilit:
- Almost optimal manipulation of pairwise comparisons of alternativesJournal of Global Optimization, 2024
- An approach to prevent weight manipulation by minimum adjustment and maximum entropy method in social network group decision makingArtificial Intelligence Review, 2022
- Specific Tastes or Cliques of Jurors? How to Reduce the Level of Manipulation in Group Decisions?Group Decision and Negotiation, 2020
- Axiomatizations of inconsistency indices for triadsAnnals of Operations Research, 2019
- How to reduce the number of rating scale items without predictability loss?Scientometrics, 2017
- Group Aggregation Techniques for Analytic Hierarchy Process and Analytic Network Process: A Comparative AnalysisGroup Decision and Negotiation, 2015
- Analyzing the Robustness of Decision Strategies in Multiagent Decision MakingGroup Decision and Negotiation, 2013
- Relative measurement and its generalization in decision making why pairwise comparisons are central in mathematics for the measurement of intangible factors the analytic hierarchy/network processRevista de la Real Academia de Ciencias Exactas, Fisicas y Naturales. Serie A. Matematicas, 2008
- On Saaty’s and Koczkodaj’s inconsistencies of pairwise comparison matricesJournal of Global Optimization, 2007
- Advanced Lectures on Machine Learning2004