Incorporation of structural properties of the response surface into oblique model trees
Open Access
- 1 October 2025
- journal article
- research article
- Published by Walter de Gruyter GmbH in at - Automatisierungstechnik
- Vol. 73 (10) , 727-739
Abstract
Oblique model trees are nonparametric regression models that partition the input space using axis-oblique splits to define local regions for regression. The Hierarchical Local Model Tree algorithm (HILOMOT) efficiently constructs these trees and produces a continuous output from overlapping local models, making it well suited for industrial applications. We enhance HILOMOT with a novel semi-greedy splitting method to reduce the short-sightedness of its greedy splitting, eliminate an undesirable trade-off during tree construction that can cause underfitting, and improve split interpretability. Our approach first estimates the strongest direction of curvature in a partition that the existing model cannot approximate. Then, a non-greedy method determines the optimal split orthogonal to this direction. We compare our method in experiments on synthetic data against HILOMOT and other established regression techniques. Qualitative results confirm that our method produces more interpretable splits, while quantitative results show it generally constructs more accurate and compact trees. Regardless of the splitting method, HILOMOT consistently outperforms all reference methods in accuracy.Keywords
This publication has 33 references indexed in Scilit:
- Recent advances in decision trees: an updated surveyArtificial Intelligence Review, 2022
- On sparse optimal regression treesEuropean Journal of Operational Research, 2022
- Machine learning and data mining in manufacturingExpert Systems with Applications, 2021
- Nonlinear System Identification2020
- An extensive experimental survey of regression methodsNeural Networks, 2019
- Evolutionary Decision Trees in Large-Scale Data Mining2019
- The role of decision tree representation in regression problems – An evolutionary perspectiveApplied Soft Computing, 2016
- Hinging hyperplane based regression tree identified by fuzzy clustering and its applicationApplied Soft Computing, 2013
- Quasi-regressionJournal of Complexity, 2001
- Introduction to Non-Linear Optimization1985