The autofeat Python Library for Automated Feature Engineering and Selection
Preprint
Abstract
This paper describes the autofeat Python library, which provides scikit-learn style linear regression and classification models with automated feature engineering and selection capabilities. Complex non-linear machine learning models, such as neural networks, are in practice often difficult to train and even harder to explain to non-statisticians, who require transparent analysis results as a basis for important business decisions. While linear models are efficient and intuitive, they generally provide lower prediction accuracies. Our library provides a multi-step feature engineering and selection process, where first a large pool of non-linear features is generated, from which then a small and robust set of meaningful features is selected, which improve the prediction accuracy of a linear model while retaining its interpretability.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Agnostic Feature Selection2020
- Time Series FeatuRe Extraction on basis of Scalable Hypothesis tests (tsfresh – A Python package)Neurocomputing, 2018
- SISSO: A compressed-sensing method for identifying the best low-dimensional descriptor in an immensity of offered candidatesPhysical Review Materials, 2018
- Methods for interpreting and understanding deep neural networksDigital Signal Processing, 2018
- Strengthening learning algorithms by feature discoveryInformation Sciences, 2012
- Feature Generation Using General Constructor FunctionsMachine Learning, 2002
- An introduction to kernel-based learning algorithmsIEEE Transactions on Neural Networks, 2001
- Modeling of strength of high-performance concrete using artificial neural networksCement and Concrete Research, 1998
- Hedonic housing prices and the demand for clean airJournal of Environmental Economics and Management, 1978
- On Physically Similar Systems; Illustrations of the Use of Dimensional EquationsPhysical Review B, 1914