CRMSNet: A deep learning model that uses convolution and residual multi‐head self‐attention block to predict RBPs for RNA sequence
Authors:
- 28 March 2023
- journal article
- research article
- Published by Wiley in Proteins: Structure, Function, and Bioinformatics
- Vol. 91 (8) , 1032-1041
Abstract
RNA‐binding proteins (RBPs) play significant roles in many biological life activities, many algorithms and tools are proposed to predict RBPs for researching biological mechanisms of RNA‐protein binding sites. Deep learning algorithms based on traditional machine learning get better result for predicting RBPs. Recently, deep learning method fused with attention mechanism has attracted huge attention in many fields and gets competitive result. Thus, attention mechanism module may also improve model performance for predicting RNA‐protein binding sites. In this study, we propose convolutional residual multi‐head self‐attention network (CRMSNet) that combines convolutional neural network (CNN), ResNet, and multi‐head self‐attention blocks to find RBPs for RNA sequence. First, CRMSNet incorporates convolutional neural networks, recurrent neural networks, and multi‐head self‐attention block. Second, CRMSNet can draw binding motif pictures from the convolutional layer parameters. Third, attention mechanism module combines the local and global RNA sequence information for capturing long sequence feature. CRMSNet gets competitive AUC (area under the receiver operating characteristic [ROC] curve) result in a large‐scale dataset RBP‐24. And CRMSNet experiment result is also compared with other state‐of‐the‐art methods. The source code of our proposed CRMSNet method can be found in https://github.com/biomg/CRMSNet.Keywords
Funding Information
- National Natural Science Foundation of China (61300155)
- Natural Science Foundation of Shandong Province (ZR2020MF134)
This publication has 29 references indexed in Scilit:
- A compendium of RNA-binding motifs for decoding gene regulationNature, 2013
- doRiNA: a database of RNA interactions in post-transcriptional regulationNucleic Acids Research, 2011
- A quantitative analysis of CLIP methods for identifying binding sites of RNA-binding proteinsNature Methods, 2011
- RNAcontext: A New Method for Learning the Sequence and Structure Binding Preferences of RNA-Binding ProteinsPLOS Computational Biology, 2010
- RNA-binding proteins in human genetic diseaseTrends in Genetics, 2008
- A Direct Role for FMRP in Activity-Dependent Dendritic mRNA Transport Links Filopodial-Spine Morphogenesis to Fragile X SyndromeDevelopmental Cell, 2008
- RNA‐binding proteins and post‐transcriptional gene regulationFEBS Letters, 2008
- RNA–protein interactions and control of mRNA stability in neuronsJournal of Neuroscience Research, 2007
- Quantifying similarity between motifsGenome Biology, 2007
- WebLogo: A Sequence Logo Generator: Figure 1Genome Research, 2004