Cognito: Automated Feature Engineering for Supervised Learning
Authors:
- Udayan KhuranaUKUdayan Khurana
- Deepak TuragaDTDeepak Turaga
- Horst SamulowitzHSHorst Samulowitz
- Srinivasan ParthasrathySPSrinivasan Parthasrathy
- 1 December 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1304-1307
Abstract
Feature engineering involves constructing novel features from given data with the goal of improving predictive learning performance. Feature engineering is predominantly a human-intensive and time consuming step that is central to the data science workflow. In this paper, we present a novel system called "Cognito", that performs automatic feature engineering on a given dataset for supervised learning. The system explores various feature construction choices in a hierarchical and non-exhaustive manner, while progressively maximizing the accuracy of the model through a greedy exploration strategy. Additionally, the system allows users to specify domain or data specific choices to prioritize the exploration. Cognito is capable of handling large datasets through sampling and built-in parallelism, and integrates well with a state-of-the-art model selection strategy. We present the design and operation of Cognito, along with experimental results on eight real datasets to demonstrate its efficacy.Keywords
This publication has 5 references indexed in Scilit:
- Selecting Near-Optimal Learners via Incremental Data AllocationProceedings of the AAAI Conference on Artificial Intelligence, 2016
- Deep feature synthesis: Towards automating data science endeavors2015
- Strengthening learning algorithms by feature discoveryInformation Sciences, 2012
- Generalized and Heuristic-Free Feature Construction for Improved Accuracy2010
- Feature Generation Using General Constructor FunctionsMachine Learning, 2002