MetaProFi: an ultrafast chunked Bloom filter for storing and querying protein and nucleotide sequence data for accurate identification of functionally relevant genetic variants
Open Access
- 24 February 2023
- journal article
- research article
- Published by Oxford University Press (OUP) in Bioinformatics
- Vol. 39 (3)
Abstract
Motivation: Bloom filters are a popular data structure that allows rapid searches in large sequence datasets. So far, all tools work with nucleotide sequences; however, protein sequences are conserved over longer evolutionary distances, and only mutations on the protein level may have any functional significance.Results: We present MetaProFi, a Bloom filter-based tool that, for the first time, offers the functionality to build indexes of amino acid sequences and query them with both amino acid and nucleotide sequences, thus bringing sequence comparison to the biologically relevant protein level. MetaProFi implements additional efficient engineering solutions, such as a shared memory system, chunked data storage and efficient compression. In addition to its conceptual novelty, MetaProFi demonstrates state-of-the-art performance and excellent memory consumption-to-speed ratio when applied to various large datasets.Availability and implementation: Source code in Python is available at https://github.com/kalininalab/metaprofi.Keywords
Funding Information
- UdS-HIPS TANDEM Interdisciplinary Graduate School for Drug Research
This publication has 15 references indexed in Scilit:
- Ultrafast search of all deposited bacterial and viral genomic dataNature Biotechnology, 2019
- DREAM-Yara: an exact read mapper for very large databases with short update timeBioinformatics, 2018
- Mantis: A Fast, Small, and Exact Large-Scale Sequence-Search IndexCell Systems, 2018
- Squeakr: an exact and approximate k-mer counting systemBioinformatics, 2017
- Compacting de Bruijn graphs from sequencing data quickly and in low memoryBioinformatics, 2016
- Fast search of thousands of short-read sequencing experimentsNature Biotechnology, 2016
- Reference sequence (RefSeq) database at NCBI: current status, taxonomic expansion, and functional annotationNucleic Acids Research, 2015
- A Holistic Approach to Marine Eco-Systems BiologyPLOS Biology, 2011
- The Sequence Read ArchiveNucleic Acids Research, 2010
- The European Nucleotide ArchiveNucleic Acids Research, 2010