One class SVM model based on neural tangent kernel for anomaly detection task on small-scale data
Authors:
- 21 July 2022
- journal article
- research article
- Published by SAGE Publications in Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology
- Vol. 43 (3) , 2731-2746
Abstract
Recent studies have shown that the evolution of infinitely wide neural networks satisfying certain conditions can be described by a kernel function called neural tangent kernel (NTK). We introduce NTK into a one-class support vector machine model and select data from different domains in UCI for a small-sample outlier detection task, demonstrate that NTK-OCSVM generally outperforms a variety of commonly used classification models, with more than 20% improvement in accuracy for similar models. When the kernel function parameters are varied, the experiments show that the model has strong robustness within a certain parameter range. Finally, we experimentally compare the time complexity of different models and the decision boundaries, and demonstrate that NTK-OCSVM improves accuracy at the expense of operational efficiency and has linear decision boundaries.Keywords
This publication has 10 references indexed in Scilit:
- Application of variational mode decomposition and chaotic grey wolf optimizer with support vector regression for forecasting electric loadsKnowledge-Based Systems, 2021
- Machine learning to estimate surface roughness from satellite images2021
- Chaos cloud quantum bat hybrid optimization algorithmNonlinear Dynamics, 2021
- Wide neural networks of any depth evolve as linear models under gradient descent *Journal of Statistical Mechanics: Theory and Experiment, 2020
- A Machine Learning Approach to Predict the Average Localization Error With Applications to Wireless Sensor NetworksIEEE Access, 2020
- Comparison of kernel functions of support vector machines: A case study for the solar cell output power predictionInternational Journal of Energy Applications and Technologies, 2020
- Performance analysis of Two-class SVM to detect thin interlayer debondings within pavement structures2020
- Reconciling modern machine-learning practice and the classical bias–variance trade-offProceedings of the National Academy of Sciences, 2019
- Estimating the Support of a High-Dimensional DistributionNeural Computation, 2001
- Priors for Infinite Networks1996