Combining Smart Speaker and Smart Meter to Infer Your Residential Power Usage by Self-supervised Cross-modal Learning
Open Access
- 27 September 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 7 (3) , 1-26
Abstract
Energy disaggregation is a key enabling technology for residential power usage monitoring, which benefits various applications such as carbon emission monitoring and human activity recognition. However, existing methods are difficult to balance the accuracy and usage burden (device costs, data labeling and prior knowledge). As the high penetration of smart speakers offers a low-cost way for sound-assisted residential power usage monitoring, this work aims to combine a smart speaker and a smart meter in a house to liberate the system from a high usage burden. However, it is still challenging to extract and leverage the consistent/complementary information (two types of relationships between acoustic and power features) from acoustic and power data without data labeling or prior knowledge. To this end, we design COMFORT, a cross-modality system for self-supervised power usage monitoring, including (i) a cross-modality learning component to automatically learn the consistent and complementary information, and (ii) a cross-modality inference component to utilize the consistent and complementary information. We implement and evaluate COMFORT with a self-collected dataset from six houses in 14 days, demonstrating that COMFORT finds the most appliances (98%), improves the appliance recognition performance in F-measure by at least 41.1%, and reduces the Mean Absolute Error (MAE) of energy disaggregation by at least 30.4% over other alternative solutions.Keywords
Funding Information
- Innovation Research Group Project of NSFC (61921003)
- National Natural Science Foundation of China (62222202: 62232004)
This publication has 27 references indexed in Scilit:
- Fine-grained appliance usage and energy monitoring through mobile and power-line sensingPervasive and Mobile Computing, 2016
- Identifying outlets at which electrical appliances are used by electrical wire sensing to gain positional information about appliance use2014
- Monitoring household activities and user location with a cheap, unobtrusive thermal sensor array2014
- EnergyLens2014
- An efficient and inexpensive method for activity recognition within a smart home based on load signatures of appliancesPervasive and Mobile Computing, 2014
- Reduce the Number of Sensors2013
- ANN-based appliance recognition from low-frequency energy monitoring data2013
- TinyEARS2010
- ViridiScope2009
- Hierarchical Grouping to Optimize an Objective FunctionJournal of the American Statistical Association, 1963