OpenHD: A GPU-Powered Framework for Hyperdimensional Computing
- 31 May 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 71 (11) , 2753-2765
Abstract
Hyperdimensional computing (HDC) has emerged as an alternative lightweight learning solution to deep neural networks. A key characteristic of HDC is the great extent of parallelism that can facilitate hardware acceleration. However, previous hardware implementations of HDC seldom focus on GPU designs, which were also inefficient partly due to the complexity of accelerating HDC on GPUs. In this paper, we present OpenHD, a flexible and high-performance GPU-powered framework for automating the mapping of general HDC applications including classification and clustering to GPUs. OpenHD takes advantage of memory optimization strategies specialized for HDC, minimizing the access time to different memory subsystems, and removing redundant operations. We also propose a novel training method to enable data parallelism in HDC training. Our evaluation result shows that the proposed training rapidly achieves the target accuracy, reducing the required training epochs by 4×. With OpenHD, users can deploy GPU-accelerated HDC applications without domain expert knowledge. Compared to the state-of-the-art GPU-powered HDC implementation, our evaluation on NVIDIA Jetson TX2 shows that OpenHD is up to 10.5× and 314× faster for HDC-based classification and clustering, respectively. Compared with non-HDC classification and clustering on GPUs, OpenHD-based HDC is 11.7× and 53× faster at comparable accuracy. OpenHD is available at: https://github.com/UCSD-SEELab/openhd .Keywords
Funding Information
- CRISP
- Defense Advanced Research Projects Agency
- SRC Global Research Collaboration
- DARPA HyDDENN
- National Science Foundation (1911095, 2003279, 2100237, 2120019)
- National Research Foundation of Korea (NRF-2018R1A5A1060031)
This publication has 31 references indexed in Scilit:
- Exploring Hyperdimensional Associative Memory2017
- Hyperdimensional computing with 3D VRRAM in-memory kernels: Device-architecture co-design for energy-efficient, error-resilient language recognition2016
- A Robust and Energy-Efficient Classifier Using Brain-Inspired Hyperdimensional Computing2016
- Numba2015
- Kokkos: Enabling manycore performance portability through polymorphic memory access patternsJournal of Parallel and Distributed Computing, 2014
- Modeling Dependencies in Multiple Parallel Data Streams with Hyperdimensional ComputingIEEE Signal Processing Letters, 2014
- Introducing a New Benchmarked Dataset for Activity Monitoring2012
- PyCUDA and PyOpenCL: A scripting-based approach to GPU run-time code generationParallel Computing, 2012
- Automatic C-to-CUDA Code Generation for Affine Programs2010
- Hyperdimensional Computing: An Introduction to Computing in Distributed Representation with High-Dimensional Random VectorsCognitive Computation, 2009