Feature Interaction in Terms of Prediction Performance
Author:
Open Access
- 29 November 2019
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 9 (23) , 5191
Abstract
There has been considerable development in machine learning in recent years with some remarkable successes. Although there are many high-performance methods, the interpretation of learning models remains challenging. Understanding the underlying theory behind the specific prediction of various models is difficult. Various studies have attempted to explain the working principle behind learning models using techniques like feature importance, partial dependency, feature interaction, and the Shapley value. This study introduces a new feature interaction measure. While recent studies have measured feature interaction using partial dependency, this study redefines feature interaction in terms of prediction performance. The proposed measure is easy to interpret, faster than partial dependency-based measures, and useful to explain feature interaction, which affects prediction performance in both regression and classification models.Keywords
Funding Information
- MIST/IITP (2018-0-00242)
This publication has 12 references indexed in Scilit:
- A Survey of Methods for Explaining Black Box ModelsACM Computing Surveys, 2018
- Interpreting tree ensembles with inTreesInternational Journal of Data Science and Analytics, 2018
- Do little interactions get lost in dark random forests?BMC Bioinformatics, 2016
- Letter to the Editor: On the term 'interaction' and related phrases in the literature on Random ForestsBriefings in Bioinformatics, 2014
- Accurate intelligible models with pairwise interactions2013
- Predictive learning via rule ensemblesThe Annals of Applied Statistics, 2008
- Detecting statistical interactions with additive groves of trees2008
- Random ForestsMachine Learning, 2001
- Greedy function approximation: A gradient boosting machine.The Annals of Statistics, 2001
- Hedonic housing prices and the demand for clean airJournal of Environmental Economics and Management, 1978