Enhancing Classification Results of Slope Entropy Using Downsampling Schemes
Open Access
Abstract
Entropy calculation provides meaningful insight into the dynamics and complexity of temporal signals, playing a crucial role in classification tasks. These measures are able to describe intrinsic characteristics of temporal series, such as regularity, complexity or predictability. Depending on the characteristics of the signal under study, the performance of entropy as a feature for classification may vary, and not any kind of entropy calculation technique may be suitable for that specific signal. Therefore, we aim to increase entropy’s classification accuracy performance, specially in the case of Slope Entropy (SlpEn), by enhancing the information content of the patterns present in the data before calculating the entropy, with downsampling techniques. More specifically, we will be using both uniform downsampling (UDS) and non-uniform downsampling techniques. In the case of non-uniform downsapling, the technique used is known as Trace Segmentation (TS), which is a non-uniform downsampling scheme that is able to enhance the most prominent patterns present in a temporal series while discarding the less relevant ones. SlpEn is a novel method recently proposed in the field of time series entropy estimation that in general outperforms other methods in classification tasks. We will combine it both with TS or UDS. In addition, since both techniques reduce the number of samples that the entropy will be calculated on, it can significantly decrease the computation time. In this work, we apply TS or UDS to the data before calculating SlpEn to assess how downsampling can impact the behaviour of SlpEn in terms of performance and computational cost, experimenting on different kinds of datasets. In addition, we carry out a comparison between SlpEn and one of the most commonly used entropy calculation methods: Permutation Entropy (PE). Results show that both uniform and non-uniform downsampling are able to enhance the performance of both SlpEn and PE when used as the only features in classification tasks, gaining up to 13% and 22% in terms of accuracy, respectively, when using TS and up to 10% and 21% when using UDS. In addition, when downsampling to 50% of the original data, we obtain a speedup around ×2 with individual entropy calculations, while, when incorporating the downsampling algorithms into time count, speedups with UDS are between ×1.2 and ×1.7, depending on the dataset. With TS, these speedups are above ×2, while maintaining accuracy levels similar to those obtained when using the 100% of the original data. Our findings suggest that most temporal series, specially medical ones, have been measured using a sampling frequency above the optimal threshold, thus obtaining unnecessary information for classification tasks, which is then discarded when performing downsampling. Downsampling techniques are potentially beneficial to any kind of entropy calculation technique, not only those used in the paper. It is able to enhance entropy’s performance in classification tasks while reducing its computation time, thus resulting in a win-win situation. We recommend to downsample to percentages between 20% and 45% of the original data to obtain the best results in terms of accuracy in classification tasks.Keywords
This publication has 86 references indexed in Scilit:
- A novel similarity-constrained feature selection method for epilepsy detection via EEG signalsJournal of King Saud University Computer and Information Sciences, 2025
- Cardiac arrhythmia detection using cross‐sample entropy measure based on short and long RR interval seriesJournal of Arrhythmia, 2023
- EEG datasets for seizure detection and prediction— A reviewEpilepsia Open, 2023
- Breast cancer detection model using fuzzy entropy segmentation and ensemble classificationBiomedical Signal Processing and Control, 2022
- A novel complexity-based mode feature representation for feature extraction of ship-radiated noise using VMD and slope entropyApplied Acoustics, 2022
- A permutation entropy-based EMD–ANN forecasting ensemble approach for wind speed predictionNeural Computing and Applications, 2020
- Epileptic seizures classification in EEG signal based on semantic features and variational mode decompositionCluster Computing, 2018
- Assessing the complexity of short-term heartbeat interval series by distribution entropyMedical & Biological Engineering & Computing, 2014
- Possible generalization of Boltzmann-Gibbs statisticsJournal of Statistical Physics, 1988
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948