Black-Box Optimization for Automated Discovery
Open Access
- 26 February 2021
- journal article
- review article
- Published by American Chemical Society (ACS) in Accounts of Chemical Research
- Vol. 54 (6) , 1334-1346
Abstract
In chemistry and materials science, researchers and engineers discover, design, and optimize chemical compounds or materials with their professional knowledge and techniques. At the highest level of abstraction, this process is formulated as black-box optimization. For instance, the trial-and-error process of synthesizing various molecules for better material properties can be regarded as optimizing a black-box function describing the relation between a chemical formula and its properties. Various black-box optimization algorithms have been developed in the machine learning and statistics communities. Recently, a number of researchers have reported successful applications of such algorithms to chemistry. They include the design of photofunctional molecules and medical drugs, optimization of thermal emission materials and high Li-ion conductive solid electrolytes, and discovery of a new phase in inorganic thin films for solar cells. There are a wide variety of algorithms available for black-box optimization, such as Bayesian optimization, reinforcement learning, and active learning. Practitioners need to select an appropriate algorithm or, in some cases, develop novel algorithms to meet their demands. It is also necessary to determine how to best combine machine learning techniques with quantum mechanics- and molecular mechanics-based simulations, and experiments. In this Account, we give an overview of recent studies regarding automated discovery, design, and optimization based on black-box optimization. The Account covers the following algorithms: Bayesian optimization to optimize the chemical or physical properties, an optimization method using a quantum annealer, best-arm identification, gray-box optimization, and reinforcement learning. In addition, we introduce active learning and boundless objective-free exploration, which may not fall into the category of black-box optimization. Data quality and quantity are key for the success of these automated discovery techniques. As laboratory automation and robotics are put forward, automated discovery algorithms would be able to match human performance at least in some domains in the near future.Keywords
Funding Information
- New Energy and Industrial Technology Development Organization (P15009)
- Ministry of Education, Culture, Sports, Science and Technology
- Exploratory Research for Advanced Technology (JPMJER1903)
- Core Research for Evolutional Science and Technology (JPMJCR17J2, JPMJCR1502)
- Japan Agency for Medical Research and Development (Jp20nk0101111)
- Cabinet Office, Government of Japan
This publication has 48 references indexed in Scilit:
- Pushing property limits in materials discoveryviaboundless objective-free explorationChemical Science, 2020
- Efficient construction method for phase diagrams using uncertainty samplingPhysical Review Materials, 2019
- Hunting for Organic Molecules with Artificial Intelligence: Molecules Optimized for Desired Excitation EnergiesACS Central Science, 2018
- Crystal structure prediction accelerated by Bayesian optimizationPhysical Review Materials, 2018
- Designing Nanostructures for Phonon Transport via Bayesian OptimizationPhysical Review X, 2017
- Acceleration of stable interface structure searching using a kriging approachJapanese Journal of Applied Physics, 2016
- Taking the Human Out of the Loop: A Review of Bayesian OptimizationProceedings of the IEEE, 2015
- Prediction of Low-Thermal-Conductivity Compounds with First-Principles Anharmonic Lattice-Dynamics Calculations and Bayesian OptimizationPhysical Review Letters, 2015
- A Survey of Monte Carlo Tree Search MethodsIEEE Transactions on Computational Intelligence and AI in Games, 2012
- Efficient Global Optimization of Expensive Black-Box FunctionsJournal of Global Optimization, 1998