Early Termination for Hyperdimensional Computing Using Inferential Statistics
Open Access
- 30 March 2025
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 342-360
Abstract
Hyperdimensional Computing (HDC) is a brain-inspired, lightweight computing paradigm that has shown great potential for inference on the edge and on emerging hardware technologies, achieving state-of-the-art accuracy on certain classification tasks. HDC classifiers are inherently error resilient and support early termination of inference to approximate classification results. Practitioners have developed heuristic methods to terminate inference early for individual inputs, reducing the computation of inference at the cost of accuracy. These techniques lack statistical guarantees and may unacceptably degrade classification accuracy or terminate inference later than is needed to obtain an accuracy result. We present Omen, the first dynamic HDC optimizer that uses inferential statistics to terminate inference early while providing accuracy guarantees. To realize Omen, we develop a statistical view of HDC that reframes HD computations as statistical sampling and testing tasks, enabling the use of statistical tests. We evaluate Omen on 19 benchmark instantiations of four classification tasks. Omen is computationally efficient, delivering up to 7.21--12.18× inference speed-ups over an unoptimized baseline while only incurring a 0.0--0.7% drop in accuracy. Omen outperforms heuristic methods, achieving an additional 0.04--5.85× inference speed-up over the unoptimized baseline compared to heuristic methods while maintaining higher or comparable accuracy.Keywords
This publication has 45 references indexed in Scilit:
- TinyML: Tools, applications, challenges, and future research directionsMultimedia Tools and Applications, 2023
- In-memory factorization of holographic perceptual representationsNature Nanotechnology, 2023
- A neuro-vector-symbolic architecture for solving Raven’s progressive matricesNature Machine Intelligence, 2023
- Hyper-Dimensional Computing Challenges and Opportunities for AI ApplicationsIEEE Access, 2021
- Exploring Hyperdimensional Associative Memory2017
- Modular Composite RepresentationCognitive Computation, 2014
- An Introduction to Statistical Learning2013
- Geometric analogue of holographic reduced representationJournal of Mathematical Psychology, 2009
- Representation and processing of structures with binary sparse distributed codesIEEE Transactions on Knowledge and Data Engineering, 2001
- Holographic reduced representationsIEEE Transactions on Neural Networks, 1995