Unsupervised Transfer Learning Approach With Adaptive Reweighting and Resampling Strategy for Inter-Subject EOG-Based Gaze Angle Estimation
- 6 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 28 (1) , 157-168
Abstract
Gaze estimation based on electrooculograms (EOGs) has been widely explored. However, the inter-subject variability of EOGs still leaves a significant challenge for practical applications. It contributes to performance degradation when handling inter-subject issues. In this paper, an unsupervised transfer learning approach with an adaptive reweighting and resampling (ARR) strategy to fully consider individual variability is proposed for EOG-based gaze angle estimation. It allows quantifying domain shifts by leveraging the source-target similarities, reweighting and resampling the source data to retain relevant instances and disregard irrelevant instances during adaptation. Specifically, our proposed methodology first assesses the domain shifts via decomposing transformation matrices, which are estimated between the training subjects (denoted as multi-source domains) and the test subject (denoted as target domain). Then, the multi-domain shifts are assigned as weighted indicators to resample the multi-source domains for model training. Comparative experiments with several prevailing transfer learning methods including CORrelation ALignment (CORAL), Geodesic Flow Kernel (GFK), Joint Distribution Adaptation (JDA), Transfer component analysis (TCA), and Balanced distribution adaption (BDA) using two different normalization processes were conducted on a realistic scenario across 18 subjects. Experimental results demonstrate that the ARR strategy can significantly improve performance (mean absolute error (MAE) reduction: 7.0%, root mean square error (RMSE) reduction: 6.3%), outperforming the prevailing methods. Besides, the impacts of data diversity and data size on ARR strategy are further investigated. It exhibits that data size is more important than data diversity for EOG-based gaze angle estimation, and also presents the benefits of the ARR strategy for dealing with practical scenarios.Keywords
Funding Information
- Greater Bay Area Institute of Precision Medicine (IPM2021C011)
- Shanghai Committee of Science and Technology (20S31903900)
- National Natural Science Foundation of China (62001118)
This publication has 42 references indexed in Scilit:
- Support Vector Regression2015
- Direct Gaze Estimation Based on Nonlinearity of EOGIEEE Transactions on Biomedical Engineering, 2015
- Induction of self awareness in dreams through frontal low current stimulation of gamma activityNature Neuroscience, 2014
- EOG-based eye movements codification for human computer interactionExpert Systems with Applications, 2012
- Domain Adaptation via Transfer Component AnalysisIEEE Transactions on Neural Networks, 2010
- A novel eye movement detection algorithm for EOG driven human computer interfacePattern Recognition Letters, 2010
- Eye Movement Analysis for Activity Recognition Using ElectrooculographyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010
- EOG-based Human–Computer Interface system developmentExpert Systems with Applications, 2010
- Predicting electricity energy consumption: A comparison of regression analysis, decision tree and neural networksEnergy, 2007
- A general regression neural networkIEEE Transactions on Neural Networks, 1991