Data Farming
Open Access
- 31 October 2020
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Modeling and Computer Simulation
- Vol. 30 (4) , 1-30
Abstract
Data farming is a descriptive metaphor that captures the notion of generating data purposefully to maximize the information “yield” from simulation models. Large-scale designed experiments let us grow the simulation output efficiently and effectively. We can explore massive input spaces, uncover interesting features of complex simulation response surfaces, and explicitly identify cause-and-effect relationships. Data farming has been used in the defense community over the past two decades, and has resulted in quantum leaps in the breadth, depth, and timeliness of the insights yielded by simulation models. In this article, we provide an overview of current data farming capabilities and their relationship to emerging techniques in data science and analytics. We use graphics to motivate insight into some of the benefits of a data farming approach. Finally, we share some thoughts about opportunities and challenges for further improving the state of the art, and transforming the state of the practice, in the data farming domain.Keywords
This publication has 26 references indexed in Scilit:
- SESSLACM Transactions on Modeling and Computer Simulation, 2014
- Efficient, nearly orthogonal-and-balanced, mixed designs: an effective way to conduct trade-off analyses via simulationJournal of Simulation, 2013
- Stochastic Trust-Region Response-Surface Method (STRONG)—A New Response-Surface Framework for Simulation OptimizationINFORMS Journal on Computing, 2013
- Constructing nearly orthogonal latin hypercubes for any nonsaturated run-variable combinationACM Transactions on Modeling and Computer Simulation, 2012
- Stochastic Optimization for Natural Disaster Asset PrepositioningProduction and Operations Management, 2010
- Two-phase screening procedure for simulation experimentsACM Transactions on Modeling and Computer Simulation, 2009
- Causal inference in statistics: An overviewStatistics Surveys, 2009
- State-of-the-Art Review: A User’s Guide to the Brave New World of Designing Simulation ExperimentsINFORMS Journal on Computing, 2005
- Input feature selection for classification problemsIEEE Transactions on Neural Networks, 2002
- Using mutual information for selecting features in supervised neural net learningIEEE Transactions on Neural Networks, 1994