Recent Progress and Development of Hyperdimensional Computing (HDC) for Edge Intelligence
- 6 February 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal on Emerging and Selected Topics in Circuits and Systems
- Vol. 13 (1) , 119-136
Abstract
Brain-inspired Hyperdimensional Computing (HDC) is an emerging framework in low-energy designs for solving classification tasks at the edge. Unlike mainstream neural networks (NNs) with high computational complexity, HDC offers a fast training strategy and an energy-efficient inference mechanism by computing data in the high-dimensional space with high parallelism. However, the original computing method of HDC results in weak accuracy due to its simplicity. Therefore, many works have proposed algorithmic innovations to improve the accuracy of HDC, while maintaining its efficiency with dedicated hardware architectures. Given this period of rapid evolution, this review paper presents a comprehensive study of recent developments improving the accuracy-efficiency trade-off of HDC, covering both algorithm and hardware-level approaches. Besides, as the amount of data generated by the Internet of the Things (IoT) devices keeps increasing, edge-cloud collaboration has become a key area of research. The emerging federated learning (FL) has become a key enabler in overcoming security and privacy issues by exchanging locally trained models for global aggregation. However, the energy constraint of edge devices hinders them from the real-time training of NN models. Alternatively, adopting HDC as a local model can be a potential solution to alleviating this issue since the computational requirements of HDC are affordable to most edge devices. In addition, HDC-based coding for wireless communication has been gaining traction due to its noise robustness. Therefore, this paper also covers recent works on HDC-based edge-cloud collaborative learning. Finally, we conclude this paper by highlighting the possible applications and future directions of HDC.Keywords
Funding Information
- Ministry of Science and Technology of Taiwan (MOST 111-2218-E-002-018-MBK, MOST 110-2218-E-002-034-MBK, MOST 109-2221-E-002-175)
- NOVATEK Fellowship
This publication has 86 references indexed in Scilit:
- Exploring Hyperdimensional Associative Memory2017
- Hyperdimensional computing with 3D VRRAM in-memory kernels: Device-architecture co-design for energy-efficient, error-resilient language recognition2016
- Hyperdimensional biosignal processing: A case study for EMG-based hand gesture recognition2016
- A Robust and Energy-Efficient Classifier Using Brain-Inspired Hyperdimensional Computing2016
- Human-level concept learning through probabilistic program inductionScience, 2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Introducing a New Benchmarked Dataset for Activity Monitoring2012
- Hyperdimensional Computing: An Introduction to Computing in Distributed Representation with High-Dimensional Random VectorsCognitive Computation, 2009
- Extreme learning machine: Theory and applicationsNeurocomputing, 2006
- Pruning Training Sets for Learning of Object Categories2005