AdaMoR-DDMOEA: Adaptive Model Selection with a Reliable Individual-Based Model Management Framework for Offline Data-Driven Multi-Objective Optimization
Open Access
- 3 January 2025
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 13 (1) , 158
Abstract
Many real-world expensive industrial and engineering multi-objective optimization problems (MOPs) are driven by historical, experimental, or simulation data. In such scenarios, due to the expensive cost and time required, we are only left with a small amount of labeled data to perform the optimization. These offline data-driven MOPs are usually solved by multi-objective evolutionary algorithms (MOEAs) with the help of surrogate models constructed from offline historical data. The key challenge in developing these data-driven MOEAs is that they have to replace multiple conflicting fitness functions by approximating these objective functions, which may produce cumulative approximation errors and misguide the search. In order to build a reliable surrogate model from a small amount of multi-output offline data and solve the DDMOPs, we have proposed an adaptive model selection method with a reliable individual-based model management-driven MOEA. The proposed algorithm dynamically selects between DNN and XGBoost by comparing their k-fold cross-validation MAE error, which can capture the true generalization ability of the surrogates on unseen data. Then, the selected surrogate is updated with a reliable individual selection strategy, where the individual who is closest, both in the decision and objective space, to the most preferred solution among labeled offline data is chosen. As a result, these two strategies guide the underlying MOEA to the Pareto optimal solutions. The empirical results of the ZDT and DTLZ benchmark test suite validate the use of the three state-of-the-art offline DDMOEAs, showing that our algorithm is able to achieve highly competitive results in terms of convergence and diversity for 2–3 objectives. Finally, our algorithm is applied to an offline data-driven multi-objective problem—transonic airfoil (RAE 2822) shape optimization—to validate its efficiency on real-world DDMOPs.Keywords
Funding Information
- Prince Sattam bin Abdulaziz University (PSAU/2024/R/1446)
This publication has 40 references indexed in Scilit:
- ALeRSa-DDEA: active learning with reliability sampling-based evolutionary algorithm framework for solving offline data-driven expensive engineering optimizationStructural and Multidisciplinary Optimization, 2022
- Surrogate modeling: tricks that endured the test of time and some recent developmentsStructural and Multidisciplinary Optimization, 2021
- Integrating $\varepsilon $-dominance and RBF surrogate optimization for solving computationally expensive many-objective optimization problemsJournal of Global Optimization, 2021
- Two-layer adaptive surrogate-assisted evolutionary algorithm for high-dimensional computationally expensive problemsJournal of Global Optimization, 2019
- An efficient multi-objective PSO algorithm assisted by Kriging metamodel for expensive black-box problemsJournal of Global Optimization, 2016
- Multi objective optimization of computationally expensive multi-modal functions with RBF surrogates and multi-rule selectionJournal of Global Optimization, 2015
- Metamodel-assisted optimization based on multiple kernel regression for mixed variablesStructural and Multidisciplinary Optimization, 2014
- Efficient global optimization algorithm assisted by multiple surrogate techniquesJournal of Global Optimization, 2012
- Structure optimization of neural networks for evolutionary design optimizationSoft Computing, 2003
- Faster convergence by means of fitness estimationSoft Computing, 2003