A Sparse -Norm Regularized Least Squares Support Vector Regression
Open Access
- 18 February 2026
- journal article
- research article
- Published by MDPI AG in Algorithms
- Vol. 19 (2) , 160
Abstract
Although Least Squares Support Vector Regression (LSSVR) reduces the hyperparameter space to two, it sacrifices sparsity, causing all training samples to become support vectors and increasing storage costs. In contrast, standard Support Vector Regression (SVR) preserves sparsity but requires tuning three highly coupled hyperparameters, leading to higher computational burden. To address these limitations, this paper proposes a sparse -norm regularized least squares SVR framework that incorporates the infinity norm of approximation errors into both the objective function and inequality constraints. The resulting optimization problem minimizes model complexity while controlling the maximum prediction deviation through a single slack variable, thereby transforming the conventional three-hyperparameter SVR tuning task into a two-parameter problem involving only the regularization coefficient and kernel width. This formulation restores sparsity by enabling a compact support vector set, while preserving the stability and convexity advantages of LSSVR. Experiments on both static and dynamic datasets demonstrate that the proposed method consistently achieves higher predictive accuracy and improved robustness compared with standard SVR and LSSVR. These results indicate that the proposed -norm regularized framework offers a mathematically principled and computationally efficient alternative for sparse, robust, and scalable regression modeling.
Keywords
Funding Information
- National Natural Science Foundation of China (61966006)
- Key Laboratory Project of the Guizhou Provincial Department of Education (QJJ[2023]029)
- Zunyi Science and Technology Innovation Team Project (KCTD065)
- Moutai Institute Joint Science and Technology Research and Development Project (ZSKHHZ[2024] No. 384)
- Moutai Institute Joint Science and Technology Research and Development Project (ZSKHHZ[2024] No. 385)
- Moutai Institute Joint Science and Technology Research and Development Project (ZSKHHZ[2023] No. 123)
- Maotai College Academic New Seed Cultivation and Free Exploration Innovation Special Funding Project (myxm202304)
- Moutai Institute (mygccrc[2024]011)
- Moutai Institute (mygc[2024]012)
This publication has 37 references indexed in Scilit:
- Performance evaluation of machine learning algorithms for the prediction of particle Froude number (F) using hyper-parameter optimizations techniquesExpert Systems with Applications, 2024
- Grid search with a weighted error function: Hyper-parameter optimization for financial time series forecastingApplied Soft Computing, 2024
- Least squares support vector regression for complex censored dataArtificial Intelligence in Medicine, 2023
- Optimal tuning of support vector machines and k-NN algorithm by using Bayesian optimization for newborn cry signal diagnosis based on audio signal processing featuresChaos, Solitons & Fractals, 2022
- A Robust Least Squares Support Vector Machine Based on L∞-normNeural Processing Letters, 2020
- An improved weighted one class support vector machine for turboshaft engine fault detectionEngineering Applications of Artificial Intelligence, 2020
- Hyper-parameter optimization for support vector machines using stochastic gradient descent and dual coordinate descentEURO Journal on Computational Optimization, 2019
- Composite kernel support vector machine based performance enhancement of brain computer interface in conjunction with spatial filterBiomedical Signal Processing and Control, 2017
- A flexible algorithm for fault diagnosis in a centrifugal pump with corrupted data and noise based on ANN and support vector machine with hyper-parameters optimizationApplied Soft Computing, 2013
- The Nature of Statistical Learning Theory1995