Enhanced Innovized Repair Operator for Evolutionary Multi- and Many-objective Optimization
Authors:
- Sukrit MittalSMSukrit Mittal
- Dhish Kumar SaxenaDSDhish Kumar Saxena
- Kalyanmoy DebKDKalyanmoy Deb
- Erik GoodmanEGErik Goodman
Preprint
Abstract
"Innovization" is a task of learning common relationships among some or all of the Pareto-optimal (PO) solutions in multi- and many-objective optimization problems. Recent studies have shown that a chronological sequence of non-dominated solutions obtained in consecutive iterations during an optimization run also possess salient patterns that can be used to learn problem features to help create new and improved solutions. In this paper, we propose a machine-learning- (ML-) assisted modelling approach that learns the modifications in design variables needed to advance population members towards the Pareto-optimal set. We then propose to use the resulting ML model as an additional innovized repair (IR2) operator to be applied on offspring solutions created by the usual genetic operators, as a novel mean of improving their convergence properties. In this paper, the well-known random forest (RF) method is used as the ML model and is integrated with various evolutionary multi- and many-objective optimization algorithms, including NSGA-II, NSGA-III, and MOEA/D. On several test problems ranging from two to five objectives, we demonstrate improvement in convergence behaviour using the proposed IR2-RF operator. Since the operator does not demand any additional solution evaluations, instead using the history of gradual and progressive improvements in solutions over generations, the proposed ML-based optimization opens up a new direction of optimization algorithm development with advances in AI and ML approaches.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- Distributed memetic differential evolution with the synergy of Lamarckian and Baldwinian learningApplied Soft Computing, 2013
- Hybrid evolutionary multi-objective optimization and analysis of machining operationsEngineering Optimization, 2012
- Multi-objective immune algorithm with Baldwinian learningApplied Soft Computing, 2012
- Towards automating the discovery of certain innovative design principles through a clustering-based optimization techniqueEngineering Optimization, 2011
- A survey of repair methods used as constraint handling techniques in evolutionary algorithmsComputer Science Review, 2009
- Scalable Test Problems for Evolutionary Multiobjective Optimization2005
- Unveiling innovative design principles by means of multiple conflicting objectivesEngineering Optimization, 2003
- Evolutionary Algorithms for Solving Multi-Objective Problems2002
- A Survey of Optimization by Building and Using Probabilistic ModelsComputational Optimization and Applications, 2002
- A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimization: NSGA-II2000