On Benchmarking Interactive Evolutionary Multiobjective Algorithms
- 27 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Evolutionary Computation
- Vol. 28 (4) , 1084-1098
Abstract
We carry out a detailed performance assessment of two interactive evolutionary multi-objective algorithms (EMOAs) using a machine decision maker that enables us to repeat experiments and study specific behaviours modeled after human decision makers (DMs). Using the same set of benchmark test problems as in the original papers on these interactive EMOAs (in up to 10 objectives), we bring to light interesting effects when we use a machine DM based on sigmoidal utility functions that have support from the psychology literature (replacing the simpler utility functions used in the original papers). Our machine DM enables us to go further and simulate human biases and inconsistencies as well. Our results from this study, which is the most comprehensive assessment of multiple interactive EMOAs so far conducted, suggest that current well-known algorithms have shortcomings that need addressing. These results further demonstrate the value of improving the benchmarking of interactive EMOAs.Keywords
Funding Information
- Alliance Manchester Business School under the Ph.D. Scholarship “Quantitative Models of Realistic Human Decision-Makers for Data Analytics and Optimisation.”
This publication has 39 references indexed in Scilit:
- Towards Automatic Testing of Reference Point Based Interactive Methods2016
- Machine Decision Makers as a Laboratory for Interactive EMO2015
- Interactive Multiobjective Optimization from a Learning Perspective2008
- Quality Assessment of Pareto Set Approximations2008
- Multiobjective Optimization2008
- Pattern Recognition and Machine Learning2006
- Scalable Test Problems for Evolutionary Multiobjective Optimization2005
- Integrating User Preferences into Evolutionary Multi-Objective Optimization2005
- Nonlinear Multiobjective Optimization1998
- Robustness of Additive Value Function Methods in MCDMJournal of Multi-Criteria Decision Analysis, 1996