TSTELM: Two-Stage Transfer Extreme Learning Machine for Unsupervised Domain Adaptation
Open Access
- 18 July 2022
- journal article
- research article
- Published by Wiley in Computational Intelligence and Neuroscience
- Vol. 2022, 1-18
Abstract
As a single-layer feedforward network (SLFN), extreme learning machine (ELM) has been successfully applied for classification and regression in machine learning due to its faster training speed and better generalization. However, it will perform poorly for domain adaptation in which the distributions between training data and testing data are inconsistent. In this article, we propose a novel ELM called two-stage transfer extreme learning machine (TSTELM) to solve this problem. At the statistical matching stage, we adopt maximum mean discrepancy (MMD) to narrow the distribution difference of the output layer between domains. In addition, at the subspace alignment stage, we align the source and target model parameters, design target cross-domain mean approximation, and add the output weight approximation to further promote the knowledge transferring across domains. Moreover, the prediction of test sample is jointly determined by the ELM parameters generated at the two stages. Finally, we investigate the proposed approach in classification task and conduct experiments on four public domain adaptation datasets. The result indicates that TSTELM could effectively enhance the knowledge transfer ability of ELM with higher accuracy than other existing transfer and non-transfer classifiers.Keywords
Funding Information
- National Natural Science Foundation of China (62073124, 51805149, 22A120005, 201701420002)
- Key Scientific Research Projects of Universities in Henan Province (62073124, 51805149, 22A120005, 201701420002)
- National Aviation Fund Projects (62073124, 51805149, 22A120005, 201701420002)
This publication has 58 references indexed in Scilit:
- Prediction Reweighting for Domain AdaptationIEEE Transactions on Neural Networks and Learning Systems, 2016
- Blind Domain Adaptation With Augmented Extreme Learning Machine FeaturesIEEE Transactions on Cybernetics, 2016
- Domain Adaptation Extreme Learning Machines for Drift Compensation in E-Nose SystemsIEEE Transactions on Instrumentation and Measurement, 2014
- Semi-Supervised and Unsupervised Extreme Learning MachinesIEEE Transactions on Cybernetics, 2014
- Learning Categories From Few Examples With Multi Model Knowledge TransferIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Hierarchical extreme learning machine for feedforward neural networkNeurocomputing, 2013
- Adaptation Regularization: A General Framework for Transfer LearningIEEE Transactions on Knowledge and Data Engineering, 2013
- Weighted extreme learning machine for imbalance learningNeurocomputing, 2013
- Extreme Learning Machine for Regression and Multiclass ClassificationIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2011
- Covariate Shift by Kernel Mean Matching2008