PreciSplit: A Novel Approach to Predicting Polynomial Regression Data
Preprint
- 29 June 2023
- preprint
- Published by Springer Nature in Research Square
Abstract
Time complexity is crucial in machine learning models, especially with large datasets, as it impacts efficiency and scalability. Reducing time complexity even by a fraction is necessary to avoid computational bottlenecks and enable faster model development cycles. It saves on resources, allowing for cost-effective operations. Data splitting involves dividing datasets into subsets for training, validation, and testing. It enables unbiased evaluation, prevents overfitting, and facilitates hyperparameter tuning and model selection. By evaluating models on separate test sets, their performance on unseen data can be assessed, leading to better generalization and more reliable machine learning systems. This paper introduces PreciSplit, a highly effective approach for data splitting based on the dataset’s points of inflection. By strategically dividing the data at non-linear regions, PreciSplit creates nearly linear data segments, enabling the application of 1 precise linear regression on each split region. Additionally, the evaluation of models on distinct test sets allows for comprehensive assessment of their performance on unseen data. This evaluation process enhances generalization capabilities and fosters the development of more reliable machine learning systems. The proposed PreciSplit method showcases promising potential for advancing data analysis and model accuracy. For smaller datasets, PreciSplit shows slower training times and lower accuracy compared to Support Vector Regression (SVR).However, as the dataset size grows,it exhibits a substantial improvement in training speed, outperforming SVR, while maintaining only a slight increase in error margin.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Evolving simple and accurate symbolic regression models via asynchronous parallel computingApplied Soft Computing, 2021
- Decision trees using local support vector regression models for large datasetsJournal of Information and Telecommunication, 2019
- An Overview of Overfitting and its SolutionsJournal of Physics: Conference Series, 2019
- Data dimensional reduction and principal components analysisProcedia Computer Science, 2019
- A novel formulation of orthogonal polynomial kernel functions for SVM classifiers: The Gegenbauer familyPattern Recognition, 2018
- Support Vector Regression2015
- k‐Nearest neighbors optimization‐based outlier removalJournal of Computational Chemistry, 2014
- Decision Trees2006
- KNN Model-Based Approach in Classification2003
- Radial basis functionsActa Numerica, 2000