Machine learning calibration of low-cost NO2 and PM10 sensors: non-linear algorithms and their impact on site transferability
Open Access
- 18 August 2021
- journal article
- research article
- Published by Copernicus GmbH in Atmospheric Measurement Techniques
- Vol. 14 (8) , 5637-5655
Abstract
Low-cost air pollution sensors often fail to attain sufficient performance compared with state-of-the-art measurement stations, and they typically require expensive laboratory-based calibration procedures. A repeatedly proposed strategy to overcome these limitations is calibration through co-location with public measurement stations. Here we test the idea of using machine learning algorithms for such calibration tasks using hourly-averaged co-location data for nitrogen dioxide (NO2) and particulate matter of particle sizes smaller than 10 µm (PM10) at three different locations in the urban area of London, UK. We compare the performance of ridge regression, a linear statistical learning algorithm, to two non-linear algorithms in the form of random forest regression (RFR) and Gaussian process regression (GPR). We further benchmark the performance of all three machine learning methods relative to the more common multiple linear regression (MLR). We obtain very good out-of-sample R2 scores (coefficient of determination) >0.7, frequently exceeding 0.8, for the machine learning calibrated low-cost sensors. In contrast, the performance of MLR is more dependent on random variations in the sensor hardware and co-located signals, and it is also more sensitive to the length of the co-location period. We find that, subject to certain conditions, GPR is typically the best-performing method in our calibration setting, followed by ridge regression and RFR. We also highlight several key limitations of the machine learning methods, which will be crucial to consider in any co-location calibration. In particular, all methods are fundamentally limited in how well they can reproduce pollution levels that lie outside those encountered at training stage. We find, however, that the linear ridge regression outperforms the non-linear methods in extrapolation settings. GPR can allow for a small degree of extrapolation, whereas RFR can only predict values within the training range. This algorithm-dependent ability to extrapolate is one of the key limiting factors when the calibrated sensors are deployed away from the co-location site itself. Consequently, we find that ridge regression is often performing as good as or even better than GPR after sensor relocation. Our results highlight the potential of co-location approaches paired with machine learning calibration techniques to reduce costs of air pollution measurements, subject to careful consideration of the co-location training conditions, the choice of calibration variables and the features of the calibration algorithm.Keywords
All Related Versions
Funding Information
- H2020 European Research Council
This publication has 44 references indexed in Scilit:
- Evaluating the performance of low cost chemical sensors for air pollution researchFaraday Discussions, 2015
- Quantification Method for Electrolytic Sensors in Long-Term Monitoring of Ambient Air QualitySensors, 2015
- Field calibration of a cluster of low-cost available sensors for air quality monitoring. Part A: Ozone and nitrogen dioxideSensors and Actuators B: Chemical, 2015
- On the feasibility of measuring urban air pollution by wireless distributed sensor networksScience of The Total Environment, 2015
- The use of electrochemical sensors for monitoring urban air quality in low-cost, high-density networksAtmospheric Environment, 2013
- Escaping the Curse of Dimensionality in Estimating Multivariate Transfer EntropyPhysical Review Letters, 2012
- Collinearity: a review of methods to deal with it and a simulation study evaluating their performanceEcography, 2012
- Development and validation of the volatile correction model for PM10 – An empirical method for adjusting TEOM measurements for their loss of volatile particulate matterAtmospheric Environment, 2009
- Predicting Multivariate Responses in Multiple Linear RegressionJournal of the Royal Statistical Society Series B: Statistical Methodology, 1997
- Ridge Regression: Biased Estimation for Nonorthogonal ProblemsTechnometrics, 1970