QS4D: Quantization‐Aware Training for Efficient Hardware Deployment of Structured State‐Space Sequential Models
Open Access
- 27 January 2026
- journal article
- Published by Wiley in Advanced Intelligent Systems
- Vol. 8 (4)
Abstract
Structured state space models (SSM) have recently emerged as a new class of deep learning models, particularly well‐suited for processing long sequences. Their constant memory footprint, in contrast to the linearly scaling memory demands of transformers, makes them attractive candidates for deployment on resource‐constrained edge‐computing devices. While recent works have explored the effect of quantization‐aware training (QAT) on SSMs, they typically do not address its implications for specialized edge hardware, for example, analog in‐memory computing (AIMC) chips. In this work, it is demonstrated that QAT can significantly reduce the complexity of SSMs by up to two orders of magnitude across various performance metrics. The relation between model size and numerical precision is analyzed, and it is shown that QAT enhances robustness to analog noise and enables structural pruning. Finally, these techniques are integrated to deploy SSMs on a memristive AIMC substrate and highlight the resulting benefits in terms of computational efficiency.Keywords
All Related Versions
Funding Information
- Bundesministerium für Forschung und Technologie (03ZU2106CB)
This publication has 10 references indexed in Scilit:
- Sensing and Machine Learning for Automotive Perception: A ReviewIEEE Sensors Journal, 2023
- Thousands of conductance levels in memristors integrated on CMOSNature, 2023
- On the Parameterization and Initialization of Diagonal State Space Models2022
- The Heidelberg Spiking Data Sets for the Systematic Evaluation of Spiking Neural NetworksIEEE Transactions on Neural Networks and Learning Systems, 2020
- A fully integrated reprogrammable memristor–CMOS system for efficient multiply–accumulate operationsNature Electronics, 2019
- Automated Depression Detection Using Deep Representation and Sequence Learning with EEG SignalsJournal of Medical Systems, 2019
- Memristive crossbar arrays for brain-inspired computingNature Materials, 2019
- A guide to deep learning in healthcareNature Medicine, 2019
- Loihi: A Neuromorphic Manycore Processor with On-Chip LearningIEEE Micro, 2018
- Nanoionics-based resistive switching memoriesNature Materials, 2007