Comparative analysis of models in predicting the effects of SNPs on TF-DNA binding using large-scale in vitro and in vivo data
Open Access
- 22 January 2024
- journal article
- review article
- Published by Oxford University Press (OUP) in Briefings in Bioinformatics
- Vol. 25 (2)
Abstract
Non-coding variants associated with complex traits can alter the motifs of transcription factor (TF)–deoxyribonucleic acid binding. Although many computational models have been developed to predict the effects of non-coding variants on TF binding, their predictive power lacks systematic evaluation. Here we have evaluated 14 different models built on position weight matrices (PWMs), support vector machines, ordinary least squares and deep neural networks (DNNs), using large-scale in vitro (i.e. SNP-SELEX) and in vivo (i.e. allele-specific binding, ASB) TF binding data. Our results show that the accuracy of each model in predicting SNP effects in vitro significantly exceeds that achieved in vivo. For in vitro variant impact prediction, kmer/gkm-based machine learning methods (deltaSVM_HT-SELEX, QBiC-Pred) trained on in vitro datasets exhibit the best performance. For in vivo ASB variant prediction, DNN-based multitask models (DeepSEA, Sei, Enformer) trained on the ChIP-seq dataset exhibit relatively superior performance. Among the PWM-based methods, tRap demonstrates better performance in both in vitro and in vivo evaluations. In addition, we find that TF classes such as basic leucine zipper factors could be predicted more accurately, whereas those such as C2H2 zinc finger factors are predicted less accurately, aligning with the evolutionary conservation of these TF classes. We also underscore the significance of non-sequence factors such as cis-regulatory element type, TF expression, interactions and post-translational modifications in influencing the in vivo predictive performance of TFs. Our research provides valuable insights into selecting prioritization methods for non-coding variants and further optimizing such models.Keywords
Funding Information
- National Key R&D Program of China (2021YFA1100501)
- National Natural Science Foundation of China (32370690)
This publication has 63 references indexed in Scilit:
- The EN-TEx resource of multi-tissue personal epigenomes & variant-impact modelsCell, 2023
- Transcription factors: Bridge between cell signaling and gene regulationProteomics, 2021
- Sequence and chromatin determinants of transcription factor binding and the establishment of cell type-specific binding patternsBiochimica et Biophysica Acta (BBA) - Gene Regulatory Mechanisms, 2020
- Integration of multiple epigenomic marks improves prediction of variant impact in saturation mutagenesis reporter assayHuman Mutation, 2019
- The Genetic Basis of Metabolic DiseaseCell, 2019
- The Human Transcription FactorsCell, 2018
- Predicting enhancer activity and variant impact using gkm‐SVMHuman Mutation, 2017
- The Genetics of Transcription Factor DNA Binding VariationCell, 2016
- Determination and Inference of Eukaryotic Transcription Factor Sequence SpecificityCell, 2014
- DNA-Binding Specificities of Human Transcription FactorsCell, 2013