Determining the Degree of Randomness of Descriptors in Linear Regression Equations with Respect to the Data Size
- 11 November 2011
- journal article
- research article
- Published by American Chemical Society (ACS) in Journal of Chemical Information and Modeling
- Vol. 51 (12) , 3099-3104
Abstract
Linear regression equations suffer from the curse of dimensionality that leads to overfitting and accidental correlation, particularly for small data sets and when many variables are present. This can lead to cases where descriptors based on random numbers exhibit higher correlations than actual descriptors. In this study, it was therefore investigated how high the degree of accidental correlation of a single descriptor can be with respect to the number of observations. On the basis of computer simulations for data sizes ranging from 7 to 500 observations, a formula was derived that expresses the degree of randomness (in percent) of a chosen descriptor depending on its correlation coefficient and the size of the data set. This allows one to determine a cutoff for the correlation below which descriptors can be discarded due to a high risk of chance correlation. Doing so, the number of eligible variables for the regression analysis can be reduced substantially. Corresponding applications are reported for several QSAR data sets of various sizes.Keywords
This publication has 31 references indexed in Scilit:
- Legitimate Utilization of Large Descriptor Pools for QSPR/QSAR ModelsJournal of Chemical Information and Modeling, 2008
- The Trouble with QSAR (or How I Learned To Stop Worrying and Embrace Fallacy)Journal of Chemical Information and Modeling, 2007
- y-Randomization and Its Variants in QSPR/QSARJournal of Chemical Information and Modeling, 2007
- An Improved Approximation to the Estimation of the Critical F Values in Best Subset RegressionJournal of Chemical Information and Modeling, 2006
- Judging the Significance of Multiple Linear Regression ModelsJournal of Medicinal Chemistry, 2005
- The Problem of OverfittingJournal of Chemical Information and Computer Sciences, 2003
- Pitfalls in QSARJournal of Molecular Structure: THEOCHEM, 2003
- Inflation of R 2 in Best Subset RegressionTechnometrics, 1980
- Chance factors in studies of quantitative structure-activity relationshipsJournal of Medicinal Chemistry, 1979
- Chance correlations in structure-activity studies using multiple regression analysisJournal of Medicinal Chemistry, 1972