Bancroft: Genomics Acceleration Beyond On-Device Memory
Preprint
Abstract
This paper presents Bancroft, a computational genomics acceleration platform that provides the illusion of practically infinite on-device memory capacity by compressing genomic data movement over PCIe. Bancroft introduces novel optimizations for efficient accelerator implementation to reference-based genome compression, including fixed-stride matching using cuckoo hashes and grouped header encoding, incorporated into a familiar interface supporting random accesses. We evaluate a prototype implementation of Bancroft on an affordable Alveo U50 FPGA equipped with 8 GB of HBM. Thanks to the orders of magnitude improvements in performance and resource efficiency of genomic compression, our prototype provides access to TBs of host-side genomic data at memory-class performance, measuring speeds over 30% of the on-device HBM bandwidth, an order of magnitude higher than conventional PCIe-limited architectures. Using a real-world pre-alignment filtering application, Bancroft demonstrates over 6x improvement over the conventional PCIe-attached architecture, achieving 30% of peak internal throughput of an accelerator with HBM, and 90% of the one with DDR4. Bancroft supports memory-class performance to practically infinite data capacity, using a small, fixed amount of HBM, making it an attractive solution to continued future scalability of computational genomics.Keywords
All Related Versions
This publication has 63 references indexed in Scilit:
- Quantum gate algorithm for reference-guided DNA sequence alignmentComputational Biology and Chemistry, 2023
- Survey on storage-accelerator data movementCCF Transactions on High Performance Computing, 2022
- On Next-Generation Sequencing Compression via Multi-GPU2022
- Designing Future Crops: Genomics-Assisted Breeding Comes of AgeTrends in Plant Science, 2021
- PIM-Align: A Processing-in-Memory Architecture for FM-Index Search AlgorithmJournal of Computer Science and Technology, 2021
- In-memory database acceleration on FPGAs: a surveyThe VLDB Journal, 2019
- FPGASW: Accelerating Large-Scale Smith–Waterman Sequence Alignment Application with Backtracking on FPGA Linear Systolic ArrayInterdisciplinary Sciences: Computational Life Sciences, 2017
- GSWABE: faster GPU‐accelerated sequence alignment with optimal alignment retrieval for short DNA sequencesConcurrency and Computation: Practice and Experience, 2014
- Personalized medicine: new genomics, old lessonsHuman Genetics, 2011
- Cuckoo hashingJournal of Algorithms, 2004