Mutual Information Variational Autoencoders and Its Application to Feature Extraction of Multivariate Time Series
Authors:
- 23 April 2022
- journal article
- research article
- Published by World Scientific Pub Co Pte Ltd in International Journal of Pattern Recognition and Artificial Intelligence
- Vol. 36 (06)
Abstract
The application of deep learning in time-series prediction has developed gradually. In this paper, we propose a deep generative network model for feature extraction of multivariate time series, namely, mutual information variational autoencoders (MI-VAE). In the architecture of the proposed model, we use the latent space of VAE for feature learning, which can extract the essential features of multivariate time-series data effectively. The latent space employed directly as a feature extractor can avoid poor interpretability of model. In addition, we introduce a mutual information term into the loss function, which improves the expression capability and accuracy of model. The proposed model, combining the merits of VAE and mutual information, extracts features for multivariate time-series data from a new perspective. The Lorenz system and Beijing air quality time series are used to test performance of the proposed model and comparative models. Results show that the proposed model is superior to other similar models in terms of accuracy and expression capability of latent space.Keywords
Funding Information
- National Natural Science Foundation of China (61773087)
- Fundamental Research Funds for the Central Universities (DUT20LAB114)
This publication has 31 references indexed in Scilit:
- A Review on Predicting Ground PM2.5 Concentration Using Satellite Aerosol Optical DepthAtmosphere, 2016
- Time series prediction using artificial wavelet neural network and multi-resolution analysis: Application to wind speed dataRenewable Energy, 2016
- A space–time delay neural network model for travel time predictionEngineering Applications of Artificial Intelligence, 2016
- Day-Ahead Prediction of Wind Speed with Deep Feature LearningInternational Journal of Pattern Recognition and Artificial Intelligence, 2016
- Cost-sensitive feature selection using random forest: Selecting low-cost subsets of informative featuresKnowledge-Based Systems, 2016
- Learning deep representations via extreme learning machinesNeurocomputing, 2015
- Chaotic Time Series Prediction Based on a Novel Robust Echo State NetworkIEEE Transactions on Neural Networks and Learning Systems, 2012
- EVALUATION OF MUTUAL INFORMATION ESTIMATORS FOR TIME SERIESInternational Journal of Bifurcation and Chaos, 2009
- 25 years of time series forecastingInternational Journal of Forecasting, 2006
- Principal component analysisChemometrics and Intelligent Laboratory Systems, 1987