CalexNet: Soft Cascade-Aligned Training and Calibration for Lightweight Early-Exit Branches
Open Access
- 16 May 2026
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 15 (10) , 2149
Abstract
Early-exit cascades over a frozen convolutional backbone enable adaptive inference but suffer from three sources of train–inference mismatch: branches train on samples they will never see at inference; their per-class precision thresholds are calibrated on the wrong distribution; the standard cross-entropy target on backbone argmax labels discards the backbone’s uncertainty signal. We close all three gaps with CalexNet (cascade-aligned early exits), a training-recipe-only modification: branches train under continuously weighted importance sampling that matches the cascade-survivor distribution; per-class precision thresholds are calibrated on the actual cascade-survivor subset of the validation set; the classification head is trained against the backbone’s full softmax via a temperature-scaled KL objective. Combined with an augmented prototype-pooling branch head, CalexNet is evaluated on ResNet18 and ResNet50 backbones across CIFAR-100 (20-supe-class coarse, the harder primary setting) and CINIC-10 (10-class, the easier cross-validation counterpart). On the accuracy–FLOPs Pareto frontier, CalexNet matches or exceeds three published baselines (PTEEnet, ZTW, BoostNet) and a within-paper “no-alignment, no-KD” reference. The largest gains appear in the practically relevant 30–70% FLOPs-reduction regime and show consistent trends across training seeds. CalexNet requires no inference-time architectural change and is a drop-in for any frozen-backbone early-exit cascade.
Keywords
All Related Versions
This publication has 35 references indexed in Scilit:
- Deep active learning framework for chest-abdominal CT scans segmentationExpert Systems with Applications, 2024
- Zero time waste in pre-trained early exit neural networksNeural Networks, 2023
- PTEENet: Post-Trained Early-Exit Neural Networks Augmentation for Inference Cost OptimizationIEEE Access, 2022
- Pruning and quantization for deep neural network acceleration: A surveyNeurocomputing, 2021
- Cascade R-CNN: Delving Into High Quality Object Detection2018
- Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference2018
- Identity Mappings in Deep Residual Networks2016
- Deep Residual Learning for Image Recognition2016
- Rapid object detection using a boosted cascade of simple features2005
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997