16S rRNA sequence embeddings: Meaningful numeric feature representations of nucleotide sequences that are convenient for downstream analyses
Open Access
- 26 February 2019
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS Computational Biology
- Vol. 15 (2) , e1006721
Abstract
Advances in high-throughput sequencing have increased the availability of microbiome sequencing data that can be exploited to characterize microbiome community structure in situ. We explore using word and sentence embedding approaches for nucleotide sequences since they may be a suitable numerical representation for downstream machine learning applications (especially deep learning). This work involves first encoding (“embedding”) each sequence into a dense, low-dimensional, numeric vector space. Here, we use Skip-Gram word2vec to embed k-mers, obtained from 16S rRNA amplicon surveys, and then leverage an existing sentence embedding technique to embed all sequences belonging to specific body sites or samples. We demonstrate that these representations are meaningful, and hence the embedding space can be exploited as a form of feature extraction for exploratory analysis. We show that sequence embeddings preserve relevant information about the sequencing data such as k-mer context, sequence taxonomy, and sample class. Specifically, the sequence embedding space resolved differences among phyla, as well as differences among genera within the same family. Distances between sequence embeddings had similar qualities to distances between alignment identities, and embedding multiple sequences can be thought of as generating a consensus sequence. In addition, embeddings are versatile features that can be used for many downstream tasks, such as taxonomic and sample classification. Using sample embeddings for body site classification resulted in negligible performance loss compared to using OTU abundance data, and clustering embeddings yielded high fidelity species clusters. Lastly, the k-mer embedding space captured distinct k-mer profiles that mapped to specific regions of the 16S rRNA gene and corresponded with particular body sites. Together, our results show that embedding sequences results in meaningful representations that can be used for exploratory analyses or for downstream machine learning applications that require numeric data. Moreover, because the embeddings are trained in an unsupervised manner, unlabeled data can be embedded and used to bolster supervised machine learning tasks. Improvements in the way genomes are sequenced have led to an abundance of microbiome data. With the right approaches, researchers use these data to thoroughly characterize how microbes interact with each other and their host, but sequencing data is of a form (sequences of letters) not ideal for many data analysis approaches. We therefore present an approach to transform sequencing data into arrays of numbers that can capture interesting qualities of the data at the sub-sequence, full-sequence, and sample levels. This allows us to measure the importance of certain microbial sequences with respect to the type of microbe and the condition of the host. Also, representing sequences in this way improves our ability to use other complicated modeling approaches. Using microbiome data from human samples, we show that our numeric representations captured differences between various types of microbes, as well as differences in the body site location from which the samples were collected.Keywords
All Related Versions
This publication has 54 references indexed in Scilit:
- Obesity and the gut microbiome: Striving for causalityMolecular Metabolism, 2012
- Shifts in human skin and nares microbiota of healthy children and adultsGenome Medicine, 2012
- Exploring the oral microbiota of children at various developmental stages of their dentition in the relation to their oral healthBMC Medical Genomics, 2011
- QIIME allows analysis of high-throughput community sequencing dataNature Methods, 2010
- Naïve Bayesian Classifier for Rapid Assignment of rRNA Sequences into the New Bacterial TaxonomyApplied and Environmental Microbiology, 2007
- Greengenes, a Chimera-Checked 16S rRNA Gene Database and Workbench Compatible with ARBApplied and Environmental Microbiology, 2006
- Quantification of denitrifying bacteria in soils by nirK gene targeted real-time PCRJournal of Microbiological Methods, 2004
- Application of Real-Time PCR To Study Effects of Ammonium on Population Size of Ammonia-Oxidizing Bacteria in SoilApplied and Environmental Microbiology, 2004
- Sequence of the tuf A gene encoding elongation factor EF‐Tu from Thermus aquaticus and overproduction of the protein in Escherichia coliEuropean Journal of Biochemistry, 1992
- Least squares quantization in PCMIEEE Transactions on Information Theory, 1982