Xue Jiang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Xue Jiang has a total of 16 co-authors. Here are the top co-authors by number of shared publications:
- Dongrui Wu
Huazhong University of Science and Technology
8 shared publications - Ruimin Peng
Key Laboratory of the Ministry of Education for Image Processing and Intelligent Control, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China
2 shared publications - Yifan Xu
Key Laboratory of the Ministry of Education for Image Processing and Intelligent Control, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China
2 shared publications Hanbin Luo
School of Civil Engineering and Mechanics Huazhong University of Science and Technology China
1 shared publication- Jiajing Liu
School of Civil Engineering and Mechanics Huazhong University of Science and Technology China
1 shared publication - Jian Huang
Huazhong University of Science and Technology
1 shared publication
Latest Publications
- Open Access
Cross-Task Inconsistency Based Active Learning (CTIAL) for Emotion Recognition
Emotion recognition is a critical component of affective computing. Training accurate machine learning models for emotion recognition typically requires a large amount of labeled data. Due to the subtleness and complexity of emotions, multiple evaluators are usually needed for each affective sample to obtain its ground-truth label, which is expensive. To save the labeling cost, this paper proposes an inconsistency-based active learning approach for cross-task transfer between emotion classification and estimation. Affective norms are utilized as prior knowledge to connect the label spaces of categorical and dimensional emotions. Then, the prediction inconsistency on the two tasks for the unlabeled samples is used to guide sample selection in active learning for the target task. Experiments on within-corpus and cross-corpus transfers demonstrated that cross-task inconsistency could be a very valuable metric in active learning. To our knowledge, this is the first work that utilizes prior knowledge on affective norms and data in a different task to facilitate active learning for a new task, even the two tasks are from different datasets.
Open AccessCross-Task Inconsistency Based Active Learning (CTIAL) for Emotion Recognition
Emotion recognition is a critical component of affective computing. Training accurate machine learning models for emotion recognition typically requires a large amount of labeled data. Due to the subtleness and complexity of emotions, multiple evaluators are usually needed for each affective sample to obtain its ground-truth label, which is expensive. To save the labeling cost, this paper proposes an inconsistency-based active learning approach for cross-task transfer between emotion classification and estimation. Affective norms are utilized as prior knowledge to connect the label spaces of categorical and dimensional emotions. Then, the prediction inconsistency on the two tasks for the unlabeled samples is used to guide sample selection in active learning for the target task. Experiments on within-corpus and cross-corpus transfers demonstrated that cross-task inconsistency could be a very valuable metric in active learning. To our knowledge, this is the first work that utilizes prior knowledge on affective norms and data in a different task to facilitate active learning for a new task, even the two tasks are from different datasets.
- 30 October 2024
- Published by Elsevier in Knowledge-Based Systems
- Vol. 305
CSP-Net: Common spatial pattern empowered neural networks for EEG-based motor imagery classification
- 30 October 2024
- Published by Elsevier in Knowledge-Based Systems
- Vol. 305
CSP-Net: Common spatial pattern empowered neural networks for EEG-based motor imagery classification
- 16 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 15 (3) , 1659-1668
Cross-Task Inconsistency Based Active Learning (CTIAL) for Emotion Recognition
Emotion recognition is a critical component of affective computing. Training accurate machine learning models for emotion recognition typically requires a large amount of labeled data. Due to the subtleness and complexity of emotions, multiple evaluators are usually needed for each affective sample to obtain its ground-truth label, which is expensive. To save the labeling cost, this paper proposes an inconsistency-based active learning approach for cross-task transfer between emotion classification and estimation. Affective norms are utilized as prior knowledge to connect the label spaces of categorical and dimensional emotions. Then, the prediction inconsistency on the two tasks for the unlabeled samples is used to guide sample selection in active learning for the target task. Experiments on within-corpus and cross-corpus transfers demonstrated that cross-task inconsistency could be a very valuable metric in active learning. To our knowledge, this is the first work that utilizes prior knowledge on affective norms and data in a different task to facilitate active learning for a new task, even the two tasks are from different datasets.
- 16 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 15 (3) , 1659-1668
Cross-Task Inconsistency Based Active Learning (CTIAL) for Emotion Recognition
Emotion recognition is a critical component of affective computing. Training accurate machine learning models for emotion recognition typically requires a large amount of labeled data. Due to the subtleness and complexity of emotions, multiple evaluators are usually needed for each affective sample to obtain its ground-truth label, which is expensive. To save the labeling cost, this paper proposes an inconsistency-based active learning approach for cross-task transfer between emotion classification and estimation. Affective norms are utilized as prior knowledge to connect the label spaces of categorical and dimensional emotions. Then, the prediction inconsistency on the two tasks for the unlabeled samples is used to guide sample selection in active learning for the target task. Experiments on within-corpus and cross-corpus transfers demonstrated that cross-task inconsistency could be a very valuable metric in active learning. To our knowledge, this is the first work that utilizes prior knowledge on affective norms and data in a different task to facilitate active learning for a new task, even the two tasks are from different datasets.
- 16 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biomedical Engineering
- Vol. 71 (4) , 1308-1318
Deep Source Semi-Supervised Transfer Learning (DS3TL) for Cross-Subject EEG Classification
Objective: An electroencephalogram (EEG) based brain-computer interface (BCI) maps the user's EEG signals into commands for external device control. Usually a large amount of labeled EEG trials are required to train a reliable EEG recognition model. However, acquiring labeled EEG data is time-consuming and user-unfriendly. Semi-supervised learning (SSL) and transfer learning can be used to exploit the unlabeled data and the auxiliary data, respectively, to reduce the amount of labeled data for a new subject. Methods: This paper proposes deep source semi-supervised transfer learning (DS3TL) for EEG-based BCIs, which assumes the source subject has a small number of labeled EEG trials and a large number of unlabeled ones, whereas all EEG trials from the target subject are unlabeled. DS3TL mainly includes a hybrid SSL module, a weakly-supervised contrastive module, and a domain adaptation module. The hybrid SSL module integrates pseudo-labeling and consistency regularization for SSL. The weakly-supervised contrastive module performs contrastive learning by using the true labels of the labeled data and the pseudo-labels of the unlabeled data. The domain adaptation module reduces the individual differences by uncertainty reduction. Results: Experiments on three EEG datasets from different tasks demonstrated that DS3TL outperformed a supervised learning baseline with many more labeled training data, and multiple state-of-the-art SSL approaches with the same number of labeled data. Significance: To our knowledge, this is the first approach in EEG-based BCIs that exploits the unlabeled source data for more accurate target classifier training.
- 16 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biomedical Engineering
- Vol. 71 (4) , 1308-1318
Deep Source Semi-Supervised Transfer Learning (DS3TL) for Cross-Subject EEG Classification
Objective: An electroencephalogram (EEG) based brain-computer interface (BCI) maps the user's EEG signals into commands for external device control. Usually a large amount of labeled EEG trials are required to train a reliable EEG recognition model. However, acquiring labeled EEG data is time-consuming and user-unfriendly. Semi-supervised learning (SSL) and transfer learning can be used to exploit the unlabeled data and the auxiliary data, respectively, to reduce the amount of labeled data for a new subject. Methods: This paper proposes deep source semi-supervised transfer learning (DS3TL) for EEG-based BCIs, which assumes the source subject has a small number of labeled EEG trials and a large number of unlabeled ones, whereas all EEG trials from the target subject are unlabeled. DS3TL mainly includes a hybrid SSL module, a weakly-supervised contrastive module, and a domain adaptation module. The hybrid SSL module integrates pseudo-labeling and consistency regularization for SSL. The weakly-supervised contrastive module performs contrastive learning by using the true labels of the labeled data and the pseudo-labels of the unlabeled data. The domain adaptation module reduces the individual differences by uncertainty reduction. Results: Experiments on three EEG datasets from different tasks demonstrated that DS3TL outperformed a supervised learning baseline with many more labeled training data, and multiple state-of-the-art SSL approaches with the same number of labeled data. Significance: To our knowledge, this is the first approach in EEG-based BCIs that exploits the unlabeled source data for more accurate target classifier training.
- Top Cited Papers
- 14 June 2022
- Published by Elsevier in Neural Networks
- Vol. 153, 235-253
Transfer learning for motor imagery based brain–computer interfaces: A tutorial
- 14 June 2022
- Published by Elsevier in Neural Networks
- Vol. 153, 235-253
Top Cited PapersTransfer learning for motor imagery based brain–computer interfaces: A tutorial
- Open Access
Transfer Learning for Motor Imagery Based Brain-Computer Interfaces: A Complete Pipeline
Transfer learning (TL) has been widely used in motor imagery (MI) based brain-computer interfaces (BCIs) to reduce the calibration effort for a new subject, and demonstrated promising performance. While a closed-loop MI-based BCI system, after electroencephalogram (EEG) signal acquisition and temporal filtering, includes spatial filtering, feature engineering, and classification blocks before sending out the control signal to an external device, previous approaches only considered TL in one or two such components. This paper proposes that TL could be considered in all three components (spatial filtering, feature engineering, and classification) of MI-based BCIs. Furthermore, it is also very important to specifically add a data alignment component before spatial filtering to make the data from different subjects more consistent, and hence to facilitate subsequential TL. Offline calibration experiments on two MI datasets verified our proposal. Especially, integrating data alignment and sophisticated TL approaches can significantly improve the classification performance, and hence greatly reduces the calibration effort.
Open AccessTransfer Learning for Motor Imagery Based Brain-Computer Interfaces: A Complete Pipeline
Transfer learning (TL) has been widely used in motor imagery (MI) based brain-computer interfaces (BCIs) to reduce the calibration effort for a new subject, and demonstrated promising performance. While a closed-loop MI-based BCI system, after electroencephalogram (EEG) signal acquisition and temporal filtering, includes spatial filtering, feature engineering, and classification blocks before sending out the control signal to an external device, previous approaches only considered TL in one or two such components. This paper proposes that TL could be considered in all three components (spatial filtering, feature engineering, and classification) of MI-based BCIs. Furthermore, it is also very important to specifically add a data alignment component before spatial filtering to make the data from different subjects more consistent, and hence to facilitate subsequential TL. Offline calibration experiments on two MI datasets verified our proposal. Especially, integrating data alignment and sophisticated TL approaches can significantly improve the classification performance, and hence greatly reduces the calibration effort.
- Open Access
Pool-Based Unsupervised Active Learning for Regression Using Iterative Representativeness-Diversity Maximization (iRDM)
Active learning (AL) selects the most beneficial unlabeled samples to label, and hence a better machine learning model can be trained from the same number of labeled samples. Most existing active learning for regression (ALR) approaches are supervised, which means the sampling process must use some label information, or an existing regression model. This paper considers completely unsupervised ALR, i.e., how to select the samples to label without knowing any true label information. We propose a novel unsupervised ALR approach, iterative representativeness-diversity maximization (iRDM), to optimally balance the representativeness and the diversity of the selected samples. Experiments on 12 datasets from various domains demonstrated its effectiveness. Our iRDM can be applied to both linear regression and kernel regression, and it even significantly outperforms supervised ALR when the number of labeled samples is small.
Open AccessPool-Based Unsupervised Active Learning for Regression Using Iterative Representativeness-Diversity Maximization (iRDM)
Active learning (AL) selects the most beneficial unlabeled samples to label, and hence a better machine learning model can be trained from the same number of labeled samples. Most existing active learning for regression (ALR) approaches are supervised, which means the sampling process must use some label information, or an existing regression model. This paper considers completely unsupervised ALR, i.e., how to select the samples to label without knowing any true label information. We propose a novel unsupervised ALR approach, iterative representativeness-diversity maximization (iRDM), to optimally balance the representativeness and the diversity of the selected samples. Experiments on 12 datasets from various domains demonstrated its effectiveness. Our iRDM can be applied to both linear regression and kernel regression, and it even significantly outperforms supervised ALR when the number of labeled samples is small.
- Open Access
Active Learning for Black-Box Adversarial Attacks in EEG-Based Brain-Computer Interfaces
Deep learning has made significant breakthroughs in many fields, including electroencephalogram (EEG) based brain-computer interfaces (BCIs). However, deep learning models are vulnerable to adversarial attacks, in which deliberately designed small perturbations are added to the benign input samples to fool the deep learning model and degrade its performance. This paper considers transferability-based black-box attacks, where the attacker trains a substitute model to approximate the target model, and then generates adversarial examples from the substitute model to attack the target model. Learning a good substitute model is critical to the success of these attacks, but it requires a large number of queries to the target model. We propose a novel framework which uses query synthesis based active learning to improve the query efficiency in training the substitute model. Experiments on three convolutional neural network (CNN) classifiers and three EEG datasets demonstrated that our method can improve the attack success rate with the same number of queries, or, in other words, our method requires fewer queries to achieve a desired attack performance. To our knowledge, this is the first work that integrates active learning and adversarial attacks for EEG-based BCIs.
Open AccessActive Learning for Black-Box Adversarial Attacks in EEG-Based Brain-Computer Interfaces
Deep learning has made significant breakthroughs in many fields, including electroencephalogram (EEG) based brain-computer interfaces (BCIs). However, deep learning models are vulnerable to adversarial attacks, in which deliberately designed small perturbations are added to the benign input samples to fool the deep learning model and degrade its performance. This paper considers transferability-based black-box attacks, where the attacker trains a substitute model to approximate the target model, and then generates adversarial examples from the substitute model to attack the target model. Learning a good substitute model is critical to the success of these attacks, but it requires a large number of queries to the target model. We propose a novel framework which uses query synthesis based active learning to improve the query efficiency in training the substitute model. Experiments on three convolutional neural network (CNN) classifiers and three EEG datasets demonstrated that our method can improve the attack success rate with the same number of queries, or, in other words, our method requires fewer queries to achieve a desired attack performance. To our knowledge, this is the first work that integrates active learning and adversarial attacks for EEG-based BCIs.