Multi-Task Load Identification and Signal Denoising via Hierarchical Knowledge Distillation
- 17 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network Science and Engineering
- Vol. 12 (3) , 1967-1980
Abstract
Complex neural networks with deep structures are beneficial for solving problems such as load classification in Non-intrusive load monitoring (NILM) due to their powerful feature extraction capabilities. Unfortunately, corresponding complex models designed based on deep learning algorithms require high computational and memory resources. Additionally, the external noise interference during practical load identification poses a challenge. To solve these difficulties with practical industrial significance, this paper proposes a multi-task-knowledge distillation (MTL-KD) framework for NILM. The main contributions within this framework include a new feature extraction method that combines variational mode extraction (VME) and mutual information (MI) to extract unique features and filter out noise interference, an attention-based MTL model to simultaneously perform the load identification and signal de-noising tasks, and new KD modules to transfer knowledge from a complex teacher model to a small student model. Experimental evaluations conducted on public datasets such as the plug-load appliance identification dataset (PLAID) and the worldwide household and industry transient energy dataset (WHITED), as well as a private load dataset collected in the lab, demonstrate that the proposed MTL-KD framework surpasses state-of-the-art approaches.Keywords
Funding Information
- National Science and Technology Major Project (2022ZD0117302)
- National Natural Science Foundation of China (62373073, 62272081)
This publication has 27 references indexed in Scilit:
- NILM-LANN: A Lightweight Attention-based Neural Network in Non-Intrusive Load Monitoring2024
- Improving Knowledge Distillation for Non-Intrusive Load Monitoring Through Explainability Guided Learning2023
- Leveraging sequence-to-sequence learning for online non-intrusive load monitoring in edge deviceInternational Journal of Electrical Power & Energy Systems, 2023
- Ensemble Compressed Language Model Based on Knowledge Distillation and Multi-Task Learning2022
- Non-intrusive load decomposition based on CNN–LSTM hybrid deep learning modelEnergy Reports, 2021
- Non-intrusive load identification based on the improved voltage-current trajectory with discrete color encoding background and deep-forest classifierEnergy and Buildings, 2021
- SA-Net: Shuffle Attention for Deep Convolutional Neural Networks2021
- Group Normalization2018
- Nonintrusive load monitoring (NILM) performance evaluationEnergy Efficiency, 2014
- Nonintrusive appliance load monitoringProceedings of the IEEE, 1992