Meta-Feature Fusion for Few-Shot Time Series Classification
Open Access
- 26 April 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 41400-41414
Abstract
Deep learning has been widely adopted for end-to-end time-series classification (TSC). However, the effectiveness of deep learning heavily relies on large-scale data. Thus, deep learning is prone to overfit when only few labeled samples are available. Few-shot learning (FSL) aims to address this issue by learning to generalize to new tasks with few training samples (e.g., one or five samples per class). FSL considers learning good representations crucial to classify accurately using discriminative features. In this study, we propose a framework for few-shot TSC that encodes a time series as different types of images (i.e., Recurrence plot, Markov transition field, and Gramian angular summation/difference field) and train these images to the model using the FSL procedure. Different features of each image enable the model to learn rich information. In addition, we propose temporal-context attention (TCA) and meta-feature fusion (MFF) to maximize the representation ability of these images. TCA incorporates global context of the feature map and highlights pixels having informative relevance with other pixels. After extracting features, MFF refines each feature using different kernels generated based on cross-modality features and fuses the refined features. Finally, the test samples are classified to the nearest class prototype in the embedding space. All experiments are conducted on various N-way K-shot problems. Our framework outperforms state-of-the-art models on 28 standard datasets in the UCR (University of California, Riverside) archive, which is a widely used benchmark dataset in time series classification, from 0.34% up to 29.4%.Keywords
Funding Information
- National Research Foundation of Korea (NRF-2021R1A2C2010893)
- Institute of Information and Communications Technology Planning and Evaluation
- Korea Government [Ministry of Science and ICT (MSIT)] (RS-2022-00155915)
- Artificial Intelligence Convergence Innovation Human Resources Development, Inha University
- Inha University Research Grant
This publication has 45 references indexed in Scilit:
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- HIVE-COTE: The Hierarchical Vote Collective of Transformation-Based Ensembles for Time Series Classification2016
- The great time series classification bake off: a review and experimental evaluation of recent algorithmic advancesData Mining and Knowledge Discovery, 2016
- Deep Residual Learning for Image Recognition2016
- Wide Residual Networks2016
- Going deeper with convolutions2015
- The BOSS is concerned with time series classification in the presence of noiseData Mining and Knowledge Discovery, 2014
- A time series forest for classification and feature extractionInformation Sciences, 2013
- A shapelet transform for time series classification2012
- Recurrence Plots of Dynamical Systems1995