AutoLearn — Automated Feature Generation and Selection
Authors:
- Ambika KaulAKAmbika Kaul
- Saket MaheshwarySMSaket Maheshwary
- Vikram PudiVPVikram Pudi
- 1 November 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 217-226
Abstract
In recent years, the importance of feature engineering has been confirmed by the exceptional performance of deep learning techniques, that automate this task for some applications. For others, feature engineering requires substantial manual effort in designing and selecting features and is often tedious and non-scalable. We present AutoLearn, a regression-based feature learning algorithm. Being data-driven, it requires no domain knowledge and is hence generic. Such a representation is learnt by mining pairwise feature associations, identifying the linear or non-linear relationship between each pair, applying regression and selecting those relationships that are stable and improve the prediction performance. Our experimental evaluation on 18 UC Irvine and 7 Gene expression datasets, across different domains, provides evidence that the features learnt through our model can improve the overall prediction accuracy by 13.28%, compared to original feature space and 5.87% over other top performing models, across 8 different classifiers without using any domain knowledge.Keywords
This publication has 14 references indexed in Scilit:
- ExploreKit: Automatic Feature Generation and Selection2016
- Automated feature generation from structured knowledge2011
- Generalized and Heuristic-Free Feature Construction for Improved Accuracy2010
- Measuring and testing dependence by correlation of distancesThe Annals of Statistics, 2007
- A review of feature selection techniques in bioinformaticsBioinformatics, 2007
- Genetic Programming with a Genetic Algorithm for Feature Construction and SelectionGenetic Programming and Evolvable Machines, 2005
- Feature Generation Using General Constructor FunctionsMachine Learning, 2002
- ID2-of-3: Constructive Induction of M-of-N Concepts for Discriminators in Decision Trees1991
- Incremental learning from noisy dataMachine Learning, 1986
- VII. Note on regression and inheritance in the case of two parentsProceedings of the Royal Society of London, 1895