Interactive Guiding Sparse Auto-Encoder with Wasserstein Regularization for Efficient Classification
Open Access
- 12 June 2023
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 13 (12) , 7055
Abstract
In the era of big data, feature engineering has proved its efficiency and importance in dimensionality reduction and useful information extraction from original features. Feature engineering can be expressed as dimensionality reduction and is divided into two types of methods, namely, feature selection and feature extraction. Each method has its pros and cons. There are a lot of studies that combine these methods. The sparse autoencoder (SAE) is a representative deep feature learning method that combines feature selection with feature extraction. However, existing SAEs do not consider feature importance during training. It causes extracting irrelevant information. In this paper, we propose an interactive guiding sparse autoencoder (IGSAE) to guide the information by two interactive guiding layers and sparsity constraints. The interactive guiding layers keep the main distribution using Wasserstein distance, which is a metric of distribution difference, and it suppresses the leverage of guiding features to prevent overfitting. We perform our experiments using four datasets that have different dimensionalities and numbers of samples. The proposed IGSAE method produces a better classification performance compared to other dimensionality reduction methods.Keywords
All Related Versions
Funding Information
- Inha University Grant
This publication has 34 references indexed in Scilit:
- Auto-encoder based dimensionality reductionNeurocomputing, 2016
- A review of feature selection methods with applications2015
- A Hierarchical Neural Autoencoder for Paragraphs and Documents2015
- Autoencoder for wordsNeurocomputing, 2014
- A survey on feature selection methodsComputers and Electrical Engineering, 2014
- Stochastic neighbor embedding (SNE) for dimension reduction and visualization using arbitrary divergencesNeurocomputing, 2012
- Principles and Practice of Scaled Difference Chi-Square TestingStructural Equation Modeling: A Multidisciplinary Journal, 2012
- A direct LDA algorithm for high-dimensional data — with application to face recognitionPattern Recognition, 2001
- PCA versus LDAIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- A surrogate-model-based method for constrained optimization2000