Multiclass threshold-based classification and model evaluation
Preprint
Abstract
In this paper, we introduce a threshold-based framework for multiclass classification that generalizes the standard argmax rule. This is done by replacing the probabilistic interpretation of softmax outputs with a geometric one on the multidimensional simplex, where the classification depends on a multidimensional threshold. This change of perspective enables for any trained classification network an \textit{a posteriori} optimization of the classification score by means of threshold tuning, as usually carried out in the binary setting, thus allowing for a further refinement of the prediction capability of any network. Our experiments show indeed that multidimensional threshold tuning yields performance improvements across various networks and datasets. Moreover, we derive a multiclass ROC analysis based on \emph{ROC clouds} -- the attainable (FPR,TPR) operating points induced by a single multiclass threshold -- and summarize them via a \emph{Distance From Point} (DFP) score to $(0,1)$. This yields a coherent alternative to standard One-vs-Rest (OvR) curves and aligns with the observed tuning gains.
Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Deep Learning for Active Region Classification: A Systematic Study from Convolutional Neural Networks to Vision TransformersThe Astrophysical Journal, 2025
- MedMNIST v2 - A large-scale lightweight benchmark for 2D and 3D biomedical image classificationScientific Data, 2023
- Calibrated simplex-mapping classificationPLOS ONE, 2023
- Score-Oriented Loss (SOL) functionsPattern Recognition, 2022
- Implementation paradigm for supervised flare forecasting studies: A deep learning application with video dataAstronomy & Astrophysics, 2022
- Deep Learning for Automatic Recognition of Magnetic Type in Sunspot GroupsAdvances in Astronomy, 2019
- A novel perspective on multiclass classification: Regular simplex support vector machineInformation Sciences, 2019
- Predicting survival from colorectal cancer histology slides using deep learning: A retrospective multicenter studyPLOS Medicine, 2019
- Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep LearningCell, 2018