Two-Level Regression Method Using Ensembles of Trees with Optimal Divergence
Open Access
- 1 July 2021
- journal article
- research article
- Published by Pleiades Publishing Ltd in Doklady Mathematics
- Vol. 104 (1) , 212-215
Abstract
The article discusses a new two-level regression analysis method in which a corrective procedure is applied to optimal ensembles of regression trees. Optimization is carried out based on the simultaneous achievement of the divergence of the algorithms in the forecast space and a good approximation of the data by individual algorithms of the ensemble. Simple averaging, random regression forest, and gradient boosting are used as corrective procedures. Experiments are presented comparing the proposed method with the standard decision forest and the standard gradient boosting method for decision trees.Keywords
This publication has 5 references indexed in Scilit:
- Regression model based on convex combinations best correlated with responseComputational Mathematics and Mathematical Physics, 2015
- The Elements of Statistical Learning2009
- Bagging PredictorsMachine Learning, 1996
- Stacked RegressionsMachine Learning, 1996
- Stacked generalizationNeural Networks, 1992