Feature Selection with Interactions for Continuous Attributes and Discrete Class
- 1 September 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 318-323
Abstract
Nowadays there exist diverse feature selection ranking methods and metrics for databases with pure discrete data (attributes and class), or pure continuous data. However, little work has been done for the case of continuous attributes with discrete class, and at the same time evaluating attribute subsets considering its inter- dependencies or interactions. Normally what we can do is perform discretization, and then apply some traditional feature selection method; nevertheless the results vary depending on the discretization method that we utilized. Additionally, if we only evaluate isolated attributes, we probably obtain poor results, because we are not considering attribute inter-dependencies. We propose a metric and method for feature selection on continuous data with discrete class, inspired in the Shannon's entropy and the Information Gain, which overcomes the above problems. In the experiments that we realized, with synthetic and real databases, the proposed method has shown to be fast and produce near optimum solutions, selecting few attributes.Keywords
This publication has 9 references indexed in Scilit:
- Fast Feature Selection Method for Continuous Attributes with Nominal Class2006
- Feature selection algorithms: a survey and experimental evaluation2003
- Evaluating feature selection methods for learning in data mining applications2002
- SOAP: Efficient Feature Selection of Numeric AttributesLecture Notes in Computer Science, 2002
- Data mining in soft computing framework: a surveyIEEE Transactions on Neural Networks, 2002
- When and how to subsampleACM SIGKDD Explorations Newsletter, 2002
- Empirical Evaluation of Feature Subset Selection Based on a Real-World Data SetLecture Notes in Computer Science, 2000
- Wrappers for feature subset selectionArtificial Intelligence, 1997
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948