Peng Peng
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Peng Peng has a total of 65 co-authors. Here are the top co-authors by number of shared publications:
- Hongwei Wang
Zhejiang University, Hangzhou, China
20 shared publications - Mengxuan Li
College of Computer Science and Technology, Zhejiang University, Hangzhou, China
5 shared publications - Haiyue Sun
ZJU-UIUC Institute, Zhejiang University
4 shared publications - Hanrong Zhang
ZJU-UIUC Joint Institute, Zhejiang University, Haining, China
4 shared publications - Shuting Tao
College of Computer Science and Technology, Zhejiang University, Hangzhou, China
4 shared publications - Gaoang Wang
Zhejiang University, Hangzhou, China
3 shared publications
Latest Publications
- 11 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 21  (6) , 4344-4354
Class Incremental Fault Diagnosis Under Limited Fault Data via Supervised Contrastive Knowledge Distillation
Class-incremental fault diagnosis requires a model to adapt to new fault classes while retaining previous knowledge. However, limited research exists for imbalanced and long-tailed data. Extracting discriminative features from few-shot fault data is challenging, and adding new fault classes often demands costly model retraining. Moreover, incremental training of existing methods risks catastrophic forgetting, and severe class imbalance can bias the model's decisions toward normal classes. To tackle these issues, we introduce a supervised contrastive knowledge distillation for class incremental fault diagnosis (SCLIFD) framework proposing supervised contrastive knowledge distillation for improved representation learning capability and less forgetting, a novel prioritized exemplar selection method for sample replay to alleviate catastrophic forgetting, and the random forest classifier to address the class imbalance. Extensive experimentation on simulated and real-world industrial datasets across various imbalance ratios demonstrates the superiority of SCLIFD over existing approaches.
- 11 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 21  (6) , 4344-4354
Class Incremental Fault Diagnosis Under Limited Fault Data via Supervised Contrastive Knowledge Distillation
Class-incremental fault diagnosis requires a model to adapt to new fault classes while retaining previous knowledge. However, limited research exists for imbalanced and long-tailed data. Extracting discriminative features from few-shot fault data is challenging, and adding new fault classes often demands costly model retraining. Moreover, incremental training of existing methods risks catastrophic forgetting, and severe class imbalance can bias the model's decisions toward normal classes. To tackle these issues, we introduce a supervised contrastive knowledge distillation for class incremental fault diagnosis (SCLIFD) framework proposing supervised contrastive knowledge distillation for improved representation learning capability and less forgetting, a novel prioritized exemplar selection method for sample replay to alleviate catastrophic forgetting, and the random forest classifier to address the class imbalance. Extensive experimentation on simulated and real-world industrial datasets across various imbalance ratios demonstrates the superiority of SCLIFD over existing approaches.
- 15 January 2025
- Published by Elsevier in Medical Image Analysis
- Vol. 101, 103464
UnICLAM: Contrastive representation learning with adversarial masking for unified and interpretable Medical Vision Question Answering
- 15 January 2025
- Published by Elsevier in Medical Image Analysis
- Vol. 101, 103464
UnICLAM: Contrastive representation learning with adversarial masking for unified and interpretable Medical Vision Question Answering
- Open Access
- 14 August 2024
- Published by IOP Publishing in Measurement Science and Technology
- Vol. 35  (11) , 116203
Hard sample mining-enabled supervised contrastive feature learning for wind turbine pitch system fault diagnosis
The presence of multiple failure severities in the wind turbine pitch system due to the long-term wear and tear poses challenges in accurately classifying the system’s health condition, thus increasing maintenance costs or damage risks. This paper proposes a novel method based on hard sample mining (HSM)-enabled supervised contrastive learning to address this problem. The proposed method leverages the powerful feature extraction capabilities of supervised contrastive learning to extract discriminative features from highly imbalanced data. Additionally, the method incorporates a cosine similarity-based HSM framework that constructs hard sample pairs within mini-batches during both the representation learning and classifier training phases, thereby improving the diagnostic performance of the model for hard samples. The proposed method achieves macro G-mean of 0.9991 and 0.9971 on two real datasets containing data on wind turbine pitch system cog belt fractures. These results indicate significantly superior fault diagnosis performance compared to existing methods, highlighting its potential for enhancing the reliability and efficiency of fault diagnosis in wind turbine pitch systems.
- 14 August 2024
- Published by IOP Publishing in Measurement Science and Technology
- Vol. 35  (11) , 116203
Open AccessHard sample mining-enabled supervised contrastive feature learning for wind turbine pitch system fault diagnosis
The presence of multiple failure severities in the wind turbine pitch system due to the long-term wear and tear poses challenges in accurately classifying the system’s health condition, thus increasing maintenance costs or damage risks. This paper proposes a novel method based on hard sample mining (HSM)-enabled supervised contrastive learning to address this problem. The proposed method leverages the powerful feature extraction capabilities of supervised contrastive learning to extract discriminative features from highly imbalanced data. Additionally, the method incorporates a cosine similarity-based HSM framework that constructs hard sample pairs within mini-batches during both the representation learning and classifier training phases, thereby improving the diagnostic performance of the model for hard samples. The proposed method achieves macro G-mean of 0.9991 and 0.9971 on two real datasets containing data on wind turbine pitch system cog belt fractures. These results indicate significantly superior fault diagnosis performance compared to existing methods, highlighting its potential for enhancing the reliability and efficiency of fault diagnosis in wind turbine pitch systems.
- 30 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 20  (8) , 9987-9996
Generalized Out-of-Distribution Fault Diagnosis (GOOFD) via Internal Contrastive Learning
Fault diagnosis is crucial in monitoring machines within industrial processes. With the increasing complexity of working conditions and demand for safety during production, diverse diagnosis methods are required, and an integrated fault diagnosis system capable of handling multiple tasks is highly desired. However, the diagnosis subtasks are often studied separately, and the current methods still need improvement for such a generalized system. To address this issue, we propose the generalized out-of-distribution fault diagnosis (GOOFD) framework to integrate diagnosis subtasks. Additionally, a unified fault diagnosis method based on internal contrastive learning and Mahalanobis distance is put forward to underpin the proposed generalized framework. The method involves feature extraction through internal contrastive learning and outlier recognition based on the Mahalanobis distance. Our proposed method can be applied to multiple fault diagnosis tasks and achieve better performance than the existing single-task methods. Experiments are conducted on benchmark and practical process datasets, indicating the effectiveness of the proposed framework.
- 30 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 20  (8) , 9987-9996
Generalized Out-of-Distribution Fault Diagnosis (GOOFD) via Internal Contrastive Learning
Fault diagnosis is crucial in monitoring machines within industrial processes. With the increasing complexity of working conditions and demand for safety during production, diverse diagnosis methods are required, and an integrated fault diagnosis system capable of handling multiple tasks is highly desired. However, the diagnosis subtasks are often studied separately, and the current methods still need improvement for such a generalized system. To address this issue, we propose the generalized out-of-distribution fault diagnosis (GOOFD) framework to integrate diagnosis subtasks. Additionally, a unified fault diagnosis method based on internal contrastive learning and Mahalanobis distance is put forward to underpin the proposed generalized framework. The method involves feature extraction through internal contrastive learning and outlier recognition based on the Mahalanobis distance. Our proposed method can be applied to multiple fault diagnosis tasks and achieve better performance than the existing single-task methods. Experiments are conducted on benchmark and practical process datasets, indicating the effectiveness of the proposed framework.
- 17 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1483-1489
NeuTR: A Learnable Neural Data Augmentation Strategy for Supervised Contrastive Representation Learning in Fault Diagnosis with Limited Fault Data
Data augmentation techniques, such as rotations, masks, and noise, have become critical and effective tools in addressing the scarcity of common datasets in various deep learning tasks. This article proposes a novel learnable neural data augmentation strategy specifically tailored for the task of supervised contrastive representation learning (SCL) in fault diagnosis when faced with limited fault data. The core concept revolves around generating a set of transformations that maintain similar semantic information to the original sample while exhibiting dissimilarity from one another. Our approach encompasses two stages: the generation of augmented data and SCL-based feature extraction. Many experiments conducted on the Tennessee Eastman process (TEP) benchmark dataset reveal that our method outperforms existing data augmentation strategies and fault diagnosis methods, surpassing performance even without the utilization of any prior information.
- 17 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1483-1489
NeuTR: A Learnable Neural Data Augmentation Strategy for Supervised Contrastive Representation Learning in Fault Diagnosis with Limited Fault Data
Data augmentation techniques, such as rotations, masks, and noise, have become critical and effective tools in addressing the scarcity of common datasets in various deep learning tasks. This article proposes a novel learnable neural data augmentation strategy specifically tailored for the task of supervised contrastive representation learning (SCL) in fault diagnosis when faced with limited fault data. The core concept revolves around generating a set of transformations that maintain similar semantic information to the original sample while exhibiting dissimilarity from one another. Our approach encompasses two stages: the generation of augmented data and SCL-based feature extraction. Many experiments conducted on the Tennessee Eastman process (TEP) benchmark dataset reveal that our method outperforms existing data augmentation strategies and fault diagnosis methods, surpassing performance even without the utilization of any prior information.
- 1 October 2023
- Published by Springer Nature
- p. 382-393
Debiasing Medical Visual Question Answering via Counterfactual Training
- 1 October 2023
- Published by Springer Nature
- p. 382-393
Debiasing Medical Visual Question Answering via Counterfactual Training
- Open Access
UnICLAM:Contrastive Representation Learning with Adversarial Masking for Unified and Interpretable Medical Vision Question Answering
Medical Visual Question Answering (Medical-VQA) aims to to answer clinical questions regarding radiology images, assisting doctors with decision-making options. Nevertheless, current Medical-VQA models learn cross-modal representations through residing vision and texture encoders in dual separate spaces, which lead to indirect semantic alignment. In this paper, we propose UnICLAM, a Unified and Interpretable Medical-VQA model through Contrastive Representation Learning with Adversarial Masking. Specifically, to learn an aligned image-text representation, we first establish a unified dual-stream pre-training structure with the gradually soft-parameter sharing strategy. Technically, the proposed strategy learns a constraint for the vision and texture encoders to be close in a same space, which is gradually loosened as the higher number of layers. Moreover, for grasping the unified semantic representation, we extend the adversarial masking data augmentation to the contrastive representation learning of vision and text in a unified manner. Concretely, while the encoder training minimizes the distance between original and masking samples, the adversarial masking module keeps adversarial learning to conversely maximize the distance. Furthermore, we also intuitively take a further exploration to the unified adversarial masking augmentation model, which improves the potential ante-hoc interpretability with remarkable performance and efficiency. Experimental results on VQA-RAD and SLAKE public benchmarks demonstrate that UnICLAM outperforms existing 11 state-of-the-art Medical-VQA models. More importantly, we make an additional discussion about the performance of UnICLAM in diagnosing heart failure, verifying that UnICLAM exhibits superior few-shot adaption performance in practical disease diagnosis.
Open AccessUnICLAM:Contrastive Representation Learning with Adversarial Masking for Unified and Interpretable Medical Vision Question Answering
Medical Visual Question Answering (Medical-VQA) aims to to answer clinical questions regarding radiology images, assisting doctors with decision-making options. Nevertheless, current Medical-VQA models learn cross-modal representations through residing vision and texture encoders in dual separate spaces, which lead to indirect semantic alignment. In this paper, we propose UnICLAM, a Unified and Interpretable Medical-VQA model through Contrastive Representation Learning with Adversarial Masking. Specifically, to learn an aligned image-text representation, we first establish a unified dual-stream pre-training structure with the gradually soft-parameter sharing strategy. Technically, the proposed strategy learns a constraint for the vision and texture encoders to be close in a same space, which is gradually loosened as the higher number of layers. Moreover, for grasping the unified semantic representation, we extend the adversarial masking data augmentation to the contrastive representation learning of vision and text in a unified manner. Concretely, while the encoder training minimizes the distance between original and masking samples, the adversarial masking module keeps adversarial learning to conversely maximize the distance. Furthermore, we also intuitively take a further exploration to the unified adversarial masking augmentation model, which improves the potential ante-hoc interpretability with remarkable performance and efficiency. Experimental results on VQA-RAD and SLAKE public benchmarks demonstrate that UnICLAM outperforms existing 11 state-of-the-art Medical-VQA models. More importantly, we make an additional discussion about the performance of UnICLAM in diagnosing heart failure, verifying that UnICLAM exhibits superior few-shot adaption performance in practical disease diagnosis.
- 20 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 35  (5) , 6194-6205
SCCAM: Supervised Contrastive Convolutional Attention Mechanism for Ante-Hoc Interpretable Fault Diagnosis With Limited Fault Samples
In real industrial processes, fault diagnosis methods are required to learn from limited fault samples since the procedures are mainly under normal conditions and the faults rarely occur. Although attention mechanisms have become increasingly popular for the task of fault diagnosis, the existing attention-based methods are still unsatisfying for the above practical applications. First, pure attention-based architectures like transformers need a substantial quantity of fault samples to offset the lack of inductive biases thus performing poorly under limited fault samples. Moreover, the poor fault classification dilemma further leads to the failure of the existing attention-based methods to identify the root causes. To develop a solution to the aforementioned problems, we innovatively propose a supervised contrastive convolutional attention mechanism (SCCAM) with ante-hoc interpretability, which solves the root cause analysis problem under limited fault samples for the first time. First, accurate classification results are obtained under limited fault samples. More specifically, we integrate the convolutional neural network (CNN) with attention mechanisms to provide strong intrinsic inductive biases of locality and spatial invariance, thereby strengthening the representational power under limited fault samples. In addition, we ulteriorly enhance the classification capability of the SCCAM method under limited fault samples by employing the supervised contrastive learning (SCL) loss. Second, a novel ante-hoc interpretable attention-based architecture is designed to directly obtain the root causes without expert knowledge. The convolutional block attention module (CBAM) is utilized to directly provide feature contributions behind each prediction thus achieving feature-level explanations. The proposed SCCAM method is testified on a continuous stirred tank heater (CSTH) and the Tennessee Eastman (TE) industrial process benchmark. Three common fault diagnosis scenarios are covered, including a balanced scenario for additional verification and two scenarios with limited fault samples (i.e., imbalanced scenario and long-tail scenario). The effectiveness of the presented SCCAM method is evidenced by the comprehensive results that show our method outperforms the state-of-the-art methods in terms of fault classification and root cause analysis.
- 20 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 35  (5) , 6194-6205
SCCAM: Supervised Contrastive Convolutional Attention Mechanism for Ante-Hoc Interpretable Fault Diagnosis With Limited Fault Samples
In real industrial processes, fault diagnosis methods are required to learn from limited fault samples since the procedures are mainly under normal conditions and the faults rarely occur. Although attention mechanisms have become increasingly popular for the task of fault diagnosis, the existing attention-based methods are still unsatisfying for the above practical applications. First, pure attention-based architectures like transformers need a substantial quantity of fault samples to offset the lack of inductive biases thus performing poorly under limited fault samples. Moreover, the poor fault classification dilemma further leads to the failure of the existing attention-based methods to identify the root causes. To develop a solution to the aforementioned problems, we innovatively propose a supervised contrastive convolutional attention mechanism (SCCAM) with ante-hoc interpretability, which solves the root cause analysis problem under limited fault samples for the first time. First, accurate classification results are obtained under limited fault samples. More specifically, we integrate the convolutional neural network (CNN) with attention mechanisms to provide strong intrinsic inductive biases of locality and spatial invariance, thereby strengthening the representational power under limited fault samples. In addition, we ulteriorly enhance the classification capability of the SCCAM method under limited fault samples by employing the supervised contrastive learning (SCL) loss. Second, a novel ante-hoc interpretable attention-based architecture is designed to directly obtain the root causes without expert knowledge. The convolutional block attention module (CBAM) is utilized to directly provide feature contributions behind each prediction thus achieving feature-level explanations. The proposed SCCAM method is testified on a continuous stirred tank heater (CSTH) and the Tennessee Eastman (TE) industrial process benchmark. Three common fault diagnosis scenarios are covered, including a balanced scenario for additional verification and two scenarios with limited fault samples (i.e., imbalanced scenario and long-tail scenario). The effectiveness of the presented SCCAM method is evidenced by the comprehensive results that show our method outperforms the state-of-the-art methods in terms of fault classification and root cause analysis.
- 2 September 2023
- Published by Elsevier in Expert Systems with Applications
- Vol. 237
Supervised contrastive representation learning with tree-structured parzen estimator Bayesian optimization for imbalanced tabular data
- 2 September 2023
- Published by Elsevier in Expert Systems with Applications
- Vol. 237
Supervised contrastive representation learning with tree-structured parzen estimator Bayesian optimization for imbalanced tabular data