Learning an Optimization Algorithm Through Human Design Iterations
Open Access
- 30 August 2017
- journal article
- research article
- Published by Wiley in Journal of Mechanical Design
- Vol. 139 (10)
Abstract
Solving optimal design problems through crowdsourcing faces a dilemma: On the one hand, human beings have been shown to be more effective than algorithms at searching for good solutions of certain real-world problems with high-dimensional or discrete solution spaces; on the other hand, the cost of setting up crowdsourcing environments, the uncertainty in the crowd's domain-specific competence, and the lack of commitment of the crowd contribute to the lack of real-world application of design crowdsourcing. We are thus motivated to investigate a solution-searching mechanism where an optimization algorithm is tuned based on human demonstrations on solution searching, so that the search can be continued after human participants abandon the problem. To do so, we model the iterative search process as a Bayesian optimization (BO) algorithm and propose an inverse BO (IBO) algorithm to find the maximum likelihood estimators (MLEs) of the BO parameters based on human solutions. We show through a vehicle design and control problem that the search performance of BO can be improved by recovering its parameters based on an effective human search. Thus, IBO has the potential to improve the success rate of design crowdsourcing activities, by requiring only good search strategies instead of good solutions from the crowd.Keywords
All Related Versions
Funding Information
- National Science Foundation (CMMI-1266184)
This publication has 33 references indexed in Scilit:
- Solving tough problems with gamesProceedings of the National Academy of Sciences, 2013
- Initial mental representations of design problems: Differences between experts and novicesDesign Studies, 2013
- Phylo: A Citizen Science Approach for Improving Multiple Sequence AlignmentPLOS ONE, 2012
- An Empirical Comparison of Information-Theoretic Criteria in Estimating the Number of Independent Components of fMRI DataPLOS ONE, 2011
- Algorithm discovery by protein folding game playersProceedings of the National Academy of Sciences, 2011
- A Unified attentional bottleneck in the human brainProceedings of the National Academy of Sciences, 2011
- A Survey on Policy Search for RoboticsFoundations and Trends in Robotics, 2011
- Autonomous Helicopter Aerobatics through Apprenticeship LearningThe International Journal of Robotics Research, 2010
- Simulated Annealing and the Generation of the Objective Function: A Model of Learning During Problem SolvingComputational Intelligence, 1997
- The formation of learning sets.Psychological Review, 1949