Augmenting High-dimensional Nonlinear Optimization with Conditional GANs
Preprint
Abstract
Many mathematical optimization algorithms fail to sufficiently explore the solution space of high-dimensional nonlinear optimization problems due to the curse of dimensionality. This paper proposes generative models as a complement to optimization algorithms to improve performance in problems with high dimensionality. To demonstrate this method, a conditional generative adversarial network (C-GAN) is used to augment the solutions produced by a genetic algorithm (GA) for a 311-dimensional nonconvex multi-objective mixed-integer nonlinear optimization. The C-GAN, composed of two networks with three fully connected hidden layers, is trained on solutions generated by GA, and then given sets of desired labels (i.e., objective function values), generates complementary solutions corresponding to those labels. Six experiments are conducted to evaluate the capabilities of the proposed method. The generated complementary solutions are compared to the original solutions in terms of optimality and diversity. The generative model generates solutions with objective functions up to 100% better, and with hypervolumes up to 100% higher, than the original solutions. These findings show that a C-GAN with even a simple training approach and architecture can, with a much shorter runtime, highly improve the diversity and optimality of solutions found by an optimization algorithm for a high-dimensional nonlinear optimization problem. [Link to GitHub repository: https://github.com/PouyaREZ/GAN_GA]Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Performance indicators in multiobjective optimizationEuropean Journal of Operational Research, 2021
- Distributionally robust chance constrained programming with generative adversarial networks (GANs)AIChE Journal, 2020
- A novel approach to district heating and cooling network design based on life cycle cost optimizationEnergy, 2020
- A MINLP multi-objective optimization model for operational planning of a case study CCHP system in urban ChinaApplied Energy, 2018
- Measuring the curse of dimensionality and its effects on particle swarm optimization and differential evolutionApplied Intelligence, 2014
- Non-convex mixed-integer nonlinear programming: A surveySurveys in Operations Research and Management Science, 2012
- SMS-EMOA: Multiobjective selection based on dominated hypervolumeEuropean Journal of Operational Research, 2007
- Information-Guided Genetic Algorithm Approach to the Solution of MINLP ProblemsIndustrial & Engineering Chemistry Research, 2007
- An improved PSO algorithm for solving non-convex NLP/MINLP problems with equality constraintsComputers & Chemical Engineering, 2007
- ?BB: A global optimization method for general constrained nonconvex problemsJournal of Global Optimization, 1995