TSViz: Demystification of Deep Learning Models for Time-Series Analysis
Open Access
- 23 April 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 67027-67040
Abstract
This paper presents a novel framework for the demystification of convolutional deep learning models for time-series analysis. This is a step towards making informed/explainable decisions in the domain of time-series, powered by deep learning. There have been numerous efforts to increase the interpretability of image-centric deep neural network models, where the learned features are more intuitive to visualize. Visualization in the domain of time-series is significantly challenging as there is no direct interpretation of the filters and inputs as compared to the image modality. In addition, little or no concentration has been devoted to the development of such tools in the domain of time-series in the past. TSViz provides possibilities to explore and analyze the network from different dimensions at different levels of abstraction which includes identification of the parts of the input that were responsible for a particular prediction (including per filter saliency), importance of the different filters present in the network, notion of diversity present in the network through filter clustering, understanding of the main sources of variation learnt by the network through inverse optimization, and analysis of the network’s robustness against adversarial noise. As a sanity check for the computed influence values, we demonstrate our results on pruning of neural networks based on the computed influence information. These representations allow the user to better understand the network so that the acceptability of these deep models for time-series analysis can be enhanced. This is extremely important in domains like finance, industry 4.0, self-driving cars, health-care, counter-terrorism etc., where reasons for reaching a particular prediction are equally important as the prediction itself. We assess the proposed framework for interpretability with a set of desirable properties essential for any method in this direction.Keywords
All Related Versions
Funding Information
- Bundesministerium für Forschung, Technologie und Raumfahrt (01IW17002)
- Nvidia
This publication has 10 references indexed in Scilit:
- Textual Explanations for Self-Driving Vehicles2018
- Methods for interpreting and understanding deep neural networksDigital Signal Processing, 2018
- Opening the Black Box of Financial AI with CLEAR-Trade: A CLass-Enhanced Attentive Response Approach for Explaining and Visualizing Deep Learning-Driven Stock Market PredictionJournal of Computational Vision and Imaging Systems, 2017
- Towards Evaluating the Robustness of Neural Networks2017
- On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance PropagationPLOS ONE, 2015
- Deep learning and the information bottleneck principle2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Multi‐scale Internet traffic forecasting using neural networks and time series methodsExpert Systems, 2010
- Toward accurate dynamic time warping in linear time and spaceIntelligent Data Analysis: An International Journal, 2007
- Learning representations by back-propagating errorsNature, 1986