Ensemble Feature Selection: Consistent Descriptor Subsets for Multiple QSAR Models
Authors:
- 4 April 2007
- journal article
- research article
- Published by American Chemical Society (ACS) in Journal of Chemical Information and Modeling
- Vol. 47 (3) , 989-997
Abstract
Selecting a small subset of descriptors from a large pool to build a predictive quantitative structure−activity relationship (QSAR) model is an important step in the QSAR modeling process. In general, subset selection is very hard to solve, even approximately, with guaranteed performance bounds. Traditional approaches employ deterministic or stochastic methods to obtain a descriptor subset that leads to an optimal model of a single type (such as linear regression or a neural network). With the development of ensemble modeling approaches, multiple models of differing types are individually developed resulting in different descriptor subsets for each model type. However, it is advantageous, from the point of view of developing interpretable QSAR models, to have a single set of descriptors that can be used for different model types. In this paper, we describe an approach to the selection of a single, optimal, subset of descriptors for multiple model types. We apply this approach to three data sets, covering both regression and classification, and show that the constraint of forcing different model types to use the same set of descriptors does not lead to a significant loss in predictive ability for the individual models considered. In addition, interpretations of the individual models developed using this approach indicate that they encode similar structure−activity trends.Keywords
This publication has 18 references indexed in Scilit:
- Filter Methods2008
- QSAR Modeling of Human Serum Protein Binding with Several Modeling Techniques Utilizing Structure−Information RepresentationJournal of Medicinal Chemistry, 2006
- Boosting: An Ensemble Learning Tool for Compound Classification and QSAR ModelingJournal of Chemical Information and Modeling, 2005
- Feature Selection Methods for Multiphase Reactors Data ClassificationIndustrial & Engineering Chemistry Research, 2005
- Generation of multiple pharmacophore hypotheses using multiobjective optimisation techniquesJournal of Computer-Aided Molecular Design, 2004
- On the Physical Interpretation of QSAR ModelsJournal of Chemical Information and Computer Sciences, 2003
- Development of Binary Classification of Structural Chromosome Aberrations for a Diverse Set of Organic Compounds from Molecular StructureChemical Research in Toxicology, 2003
- Combinatorial Library Design Using a Multiobjective Genetic AlgorithmJournal of Chemical Information and Computer Sciences, 2002
- Bump hunting in high-dimensional dataStatistics and Computing, 1999
- Wrappers for feature subset selectionArtificial Intelligence, 1997