Attribute Noise in Tabular Classification: Noise-Matched Training and the Train–Test Noise Mismatch on Public Benchmarks
Open Access
- 27 October 2026
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 15 (21) , 4981
Abstract
Attribute noise, the measurement error in feature values, is a data-related challenge distinct from label noise, and the noise present at training time rarely equals the noise present at deployment. This article studies this train–test noise mismatch in tabular classification. Its main contribution is noise-matched training (NMT), which estimates a feature-wise noise level from the variance excess of unlabeled deployment inputs over the training inputs, with a threshold calibrated on the training split, and injects noise of that level in one additional fit. Its identifiability assumption, that the clean deployment variance equals the training variance, is stated and tested. In a one-dimensional Gaussian model, the excess risk of a rule tuned at the wrong noise level vanishes only at the matched level. Five learners on ten public OpenML/UCI datasets were evaluated under eight test-time noise conditions and twelve training conditions, with the dataset as the unit of inference. The matched level was, on average, the best fixed training level, except for nearest-neighbor classification. NMT had the highest average accuracy and helped most when only some features were noisy, but none of its dataset-level comparisons remained significant after multiplicity adjustment. It gave no benefit under impulsive noise, for nearest neighbors, or under covariate shift without noise.Keywords
Funding Information
- Korea government (P0001111)
This publication has 46 references indexed in Scilit:
- A Comprehensive Survey on Test-Time Adaptation Under Distribution ShiftsInternational Journal of Computer Vision, 2024
- Data collection and quality challenges in deep learning: a data-centric AI perspectiveThe VLDB Journal, 2023
- Tabular data: Deep learning is not all you needInformation Fusion, 2022
- Data Preprocessing in Data Mining2015
- Analyzing the presence of noise in multi-class problems: alleviating its influence with the One-vs-One decompositionKnowledge and Information Systems, 2012
- A study of the effect of different types of noise on the precision of supervised learning techniquesArtificial Intelligence Review, 2010
- Class Noise vs. Attribute Noise: A Quantitative StudyArtificial Intelligence Review, 2004
- Noise modelling and evaluating learning from examplesArtificial Intelligence, 1996
- Measurement Error Models1987
- Induction of decision treesMachine Learning, 1986