Global Importance Analysis: An Interpretability Method to Quantify Importance of Genomic Features in Deep Neural Networks
Authors:
Preprint
Abstract
Deep neural networks have demonstrated improved performance at predicting the sequence specificities of DNA- and RNA-binding proteins compared to previous methods that rely on k -mers and position weight matrices. To gain insights into why a DNN makes a given prediction, model interpretability methods, such as attribution methods, can be employed to identify motif-like representations along a given sequence. Because explanations are given on an individual sequence basis and can vary substantially across sequences, deducing generalizable trends across the dataset and quantifying their effect size remains a challenge. Here we introduce global importance analysis (GIA), a model interpretability method that quantifies the population-level effect size that putative patterns have on model predictions. GIA provides an avenue to quantitatively test hypotheses of putative patterns and their interactions with other patterns, as well as map out specific functions the network has learned. As a case study, we demonstrate the utility of GIA on the computational task of predicting RNA-protein interactions from sequence. We first introduce a convolutional network, we call ResidualBind, and benchmark its performance against previous methods on RNAcompete data. Using GIA, we then demonstrate that in addition to sequence motifs, ResidualBind learns a model that considers the number of motifs, their spacing, and sequence context, such as RNA secondary structure and GC-bias.Keywords
All Related Versions
- Published version: PLOS Computational Biology, 17 (5), e1008925.
This publication has 51 references indexed in Scilit:
- Robust transcriptome-wide discovery of RNA-binding protein binding sites with enhanced CLIP (eCLIP)Nature Methods, 2016
- Resources for the Comprehensive Discovery of Functional RNA ElementsMolecular Cell, 2016
- RNA Bind-n-Seq: Quantitative Assessment of the Sequence and Structural Binding Specificity of RNA Binding ProteinsMolecular Cell, 2014
- Hidden specificity in an apparently nonspecific RNA-binding proteinNature, 2013
- A compendium of RNA-binding motifs for decoding gene regulationNature, 2013
- iCLIP reveals the function of hnRNP particles in splicing at individual nucleotide resolutionNature Structural & Molecular Biology, 2010
- RNAcontext: A New Method for Learning the Sequence and Structure Binding Preferences of RNA-Binding ProteinsPLOS Computational Biology, 2010
- Transcriptome-wide Identification of RNA-Binding Protein and MicroRNA Target Sites by PAR-CLIPCell, 2010
- HITS-CLIP yields genome-wide insights into brain alternative RNA processingNature, 2008
- Statistical mechanical modeling of genome-wide transcription factor occupancy data by MatrixREDUCEBioinformatics, 2006