Seasonal-Trend Transformer-based Diffusion Model for Non-Intrusive Load Monitoring

Authors:

Abstract
Non-intrusive load monitoring (NILM) separates household electricity consumption into individual appliance profiles, providing a non-invasive method for energy management. Deep learning has greatly advanced the field of NILM, with Transformer-based architectures playing a relevant role. However, the generalization ability of these models to unseen houses and high-density appliance environments is undermined by the noise and volatility of the mixture of signals from multiple overlapping sources. To face these challenges, we present DifFormer-NILM, a novel framework that integrates a specialized Transformer-based architecture into a Denoising Diffusion Probabilistic Model (DDPM). By formulating energy disaggregation as a conditional generative task, this work represents an innovative method of exploiting Transformers and diffusion models to increase overall robustness. In particular, the proposed network introduces Trend and Fourier Synthetic Layers for effective seasonal-trend decomposition, which reveal crucial in capturing both periodic patterns and short-term fluctuations. Tested on real-world use cases from the UKDALE dataset, DifFormer-NILM outperforms Transformer baselines in household scenarios with a high density of appliances and when trained with limited data available.