Application Codesign of Near-Data Processing for Similarity Search
Authors:
- Vincent T. LeeVLVincent T. Lee
- Amrita MazumdarAMAmrita Mazumdar
- Carlo C. del MundoCMCarlo C. del Mundo
- Armin AlaghiAAArmin Alaghi
- Luis CezeLCLuis Ceze
- Mark OskinMOMark Oskin
- 1 May 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 896-907
Abstract
Similarity search is key to a variety of applications including content-based search for images and video, recommendation systems, data deduplication, natural language processing, computer vision, databases, computational biology, and computer graphics. At its core, similarity search manifests as k-nearest neighbors (kNN), a computationally simple primitive consisting of highly parallel distance calculations and a global top-k sort. However, kNN is poorly supported by today's architectures because of its high memory bandwidth requirements. This paper proposes an application codesign of a near-data processing accelerator for similarity search: the Similarity Search Associative Memory (SSAM). By instantiating compute units close to memory, SSAM benefits from the higher memory bandwidth and density exposed by emerging memory technologies. We evaluate the SSAM design down to layout on top of the Micron hybrid memory cube (HMC), and show that SSAM can achieve up to two orders of magnitude area-normalized throughput and energy efficiency improvement over multicore CPUs. We also show SSAM has higher throughput and is more energy efficient than competing GPUs and FPGAs.Keywords
All Related Versions
This publication has 45 references indexed in Scilit:
- A scalable processing-in-memory accelerator for parallel graph processing2015
- Active Memory Cube: A processing-in-memory architecture for exascale systemsIBM Journal of Research and Development, 2015
- Glove: Global Vectors for Word Representation2014
- Resistive computationACM SIGARCH Computer Architecture News, 2010
- Top 10 algorithms in data miningKnowledge and Information Systems, 2007
- Scalable hardware priority queue architectures for high-speed packet switchesIEEE Transactions on Computers, 2000
- Computational RAM: implementing processors in memoryIEEE Design & Test of Computers, 1999
- Active pagesACM SIGARCH Computer Architecture News, 1998
- A case for intelligent RAMIEEE Micro, 1997
- The CRAY-1 computer systemCommunications of the ACM, 1978