Memory-Efficient and Trustworthy Neural Networks via Random Seed-Based Design
Open Access
- 30 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 14, 19424-19439
Abstract
Deep learning models deployed in resource-constrained and safety-critical settings must be not only compact and accurate but also trustworthy and capable of expressing predictive uncertainty. However, conventional compression techniques such as pruning and quantization often make models overconfident, while uncertainty-aware methods like Bayesian inference and ensembles ignore memory and compute budgets. In this work, we propose Random Seed-Based Design, a framework that elevates the random seed to a first-class design primitive for jointly shaping sparsity, freezing, and stochastic inference. Random seeds deterministically generate all stochastic components: Strong Lottery Ticket weights, partially frozen masks, and Monte Carlo Dropout masks, so that a deployed model can be exactly regenerated from seeds, binary masks, and a small set of interpretable hyperparameters instead of dense weight tensors. We formulate this seed-based construction as a multi-objective design problem over accuracy, calibration, uncertainty, FLOP, and memory footprint, and solve it with Bayesian optimization. This seed-based design enables us to characterize Pareto-optimal trade-offs between efficiency and trustworthiness across diverse architectures, including convolutional neural networks and graph neural networks, thereby illuminating domain-dependent relationships between computational efficiency and predictive reliability. Our method discovers models that are tens to hundreds of times smaller than their dense counterparts, reduces expected calibration error by up to an order of magnitude, and matches or improves accuracy. These results show that structured seed-controlled randomness improves both compression and trustworthiness, rather than treating them as competing objectives. The source code is available at https://github.com/itocha/SLT-TRUST.Keywords
Funding Information
- Japan Science and Technology Agency–Advanced Low Carbon Technology Research and Development Program(JST-ALCA-Next), Japan (JPMJAN24F3)
- Japan Science and Technology Agency–Broadening Opportunities for Outstanding Young Researchers and Doctoral Students in Strategic Areas, Japan, (JPMJBS2430)
- Japan Science and Technology Agency–Broadening Opportunities for Outstanding Young Researchers and Doctoral Students in Strategic Areas, Japan, (JPMJBY24G7)
- U.K. Engineering and Physical Sciences Research Council (EP/W032635/1)
- U.K. Engineering and Physical Sciences Research Council (EP/V028251/1)
- U.K. Engineering and Physical Sciences Research Council (EP/S030069/1)
- U.K. Engineering and Physical Sciences Research Council (EP/X036006/1)
- U.K. Engineering and Physical Sciences Research Council (EP/W03221X/1)
- UK Research and Innovation (256;)
- Korea Institute for Advancement of Technology
- Altera;
- Intel;
- AMD.
This publication has 8 references indexed in Scilit:
- Trustworthy Deep Learning Acceleration with Customizable Design Flow Automation2025
- FPGA-Based Acceleration for Bayesian Convolutional Neural NetworksIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2022
- Accelerating Bayesian Neural Networks via Algorithmic and Hardware OptimizationsIEEE Transactions on Parallel and Distributed Systems, 2022
- Optimizing Bayesian Recurrent Neural Networks on an FPGA-based Accelerator2021
- What’s Hidden in a Randomly Weighted Neural Network?2020
- Deep Residual Learning for Image Recognition2016
- Collective Classification in Network DataAI Magazine, 2008
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998