Integrating Protein and DNA Embeddings for Improving Genome-Wide Transcription Factor Binding Site Prediction
Authors:
- Shreya BasnetSBShreya Basnet
- Jianlin ChengJianlin Cheng
Preprint
Abstract
Transcription factors (TFs) regulate gene expression by binding to specific DNA sites on genome, making accurate TF binding site prediction critical for understanding gene regulation and downstream phenotypes. Current deep learning methods use only DNA-related information to predict TF binding sites, ignoring the fact that different TF protein sequences and structures recognize distinct DNA patterns. Not leveraging TF information not only limits prediction accuracy but also makes the methods not generalizable to predicting binding sites of new TFs that do not exist in the traning data. Here, we present TransBind, a protein-aware deep learning architecture that integrates DNA sequence information with protein embeddings containing both sequence and structural information derived from a protein language model pretrained on DNA-binding proteins, to improve TF binding site prediction. Through the cross-attention, a TF embedding selectively attends to genomic regions according to its unique binding properties. Evaluated on the data of 690 ChIP-seq experiments spanning 161 TFs across 91 human cell types, TransBind achieves an AUROC of 0.950 and AUPR of 0.371—representing a ≥11.3% relative AUPR improvement over state-of-the-art methods including TBiNet, DanQ, and DeepSEA. The model outperformed existing methods in ≥97.1% of TF–cell type combinations. It also recovered 160 known TF binding motifs in the JASPAR database, providing the biological interpretability of the model. Moreover, the approach enables zero-shot prediction for unseen TFs, demonstrating its potential of generalizing to new, poorly characterized TFs. The source code of TransBind is available at https://github.com/jianlin-cheng/TransBind .Keywords
All Related Versions
- Published version: NAR Genomics and Bioinformatics, 8 (2).
This publication has 22 references indexed in Scilit:
- Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequencesProceedings of the National Academy of Sciences of the United States of America, 2021
- Enhancing the interpretability of transcription factor binding site prediction using attention mechanismScientific Reports, 2020
- The Human Transcription FactorsCell, 2018
- Convolutional neural network architectures for predicting DNA–protein bindingBioinformatics, 2016
- Predicting effects of noncoding variants with deep learning–based sequence modelNature Methods, 2015
- Quantitative modeling of transcription factor binding specificities using DNA shapeProceedings of the National Academy of Sciences, 2015
- Determination and Inference of Eukaryotic Transcription Factor Sequence SpecificityCell, 2014
- Discovery of directional and nondirectional pioneer transcription factors by modeling DNase profile magnitude and shapeNature Biotechnology, 2014
- Statistical Mechanics of Transcription-Factor Binding Site Discovery Using Hidden Markov ModelsJournal of Statistical Physics, 2010
- Unbiased Mapping of Transcription Factor Binding Sites along Human Chromosomes 21 and 22 Points to Widespread Regulation of Noncoding RNAsCell, 2004