HDCC: A Hyperdimensional Computing compiler for classification on embedded systems and high-performance computing
Preprint
Abstract
Hyperdimensional Computing (HDC) is a bio-inspired computing framework that has gained increasing attention, especially as a more efficient approach to machine learning (ML). This work introduces the \name{} compiler, the first open-source compiler that translates high-level descriptions of HDC classification methods into optimized C code. The code generated by the proposed compiler has three main features for embedded systems and High-Performance Computing: (1) it is self-contained and has no library or platform dependencies; (2) it supports multithreading and single instruction multiple data (SIMD) instructions using C intrinsics; (3) it is optimized for maximum performance and minimal memory usage. \name{} is designed like a modern compiler, featuring an intuitive and descriptive input language, an intermediate representation (IR), and a retargetable backend. This makes \name{} a valuable tool for research and applications exploring HDC for classification tasks on embedded systems and High-Performance Computing. To substantiate these claims, we conducted experiments with HDCC on several of the most popular datasets in the HDC literature. The experiments were run on four different machines, including different hyperparameter configurations, and the results were compared to a popular prototyping library built on PyTorch. The results show a training and inference speedup of up to 132x, averaging 25x across all datasets and machines. Regarding memory usage, using 10240-dimensional hypervectors, the average reduction was 5x, reaching up to 14x. When considering vectors of 64 dimensions, the average reduction was 85x, with a maximum of 158x less memory utilization.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- An Extension to Basis-Hypervectors for Learning from Circular Data in Hyperdimensional Computing2023
- A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data TransformationsACM Computing Surveys, 2022
- OpenHD: A GPU-Powered Framework for Hyperdimensional ComputingIEEE Transactions on Computers, 2022
- A comparison of vector symbolic architecturesArtificial Intelligence Review, 2021
- Efficient Biosignal Processing Using Hyperdimensional Computing: Network Templates for Combined Learning and Classification of ExG SignalsProceedings of the IEEE, 2018
- A Robust and Energy-Efficient Classifier Using Brain-Inspired Hyperdimensional Computing2016
- The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web]IEEE Signal Processing Magazine, 2012
- Hyperdimensional Computing: An Introduction to Computing in Distributed Representation with High-Dimensional Random VectorsCognitive Computation, 2009
- Holographic reduced representationsIEEE Transactions on Neural Networks, 1995