Reducing Bias in Cropland Soil Organic Carbon and Clay Predictions using Sentinel-2 Composites and Data Balancing
Authors:
Preprint
- 16 May 2025
- preprint
- Published by California Digital Library (CDL) in EarthArXiv
Abstract
Accurate maps of cropland soil organic carbon stocks (SOCS) and clay content are essential for climate-smart agriculture. Soil reflectance composites (SRC), derived from multispectral bare soil observations, offer a scalable approach to high-resolution soil mapping. While studies often focus on maximizing model performance, challenges remain regarding (1) the bias introduced by masking and excluding soil samples during SRC generation and (2) the accurate representation of the full range and distribution of soil properties in the resulting maps. Evaluating different SRC parameters, we found that commonly used indices such as the Normalized Burn Ratio 2 (NBR2) and the Normalized Difference Vegetation Index (NDVI) were significantly correlated with clay content and SOCS, respectively. These dependencies can lead to the systematic exclusion of high SOCS (>80 Mg ha-1) and clay (>30 mass%) samples during SRC generation, introducing bias in the resulting maps. Models trained solely on SRC bands failed to capture the full range of the training data, limiting the applicability of the soil property maps. While the inclusion of additional remote sensing features, such as spectral-temporal metrics and indices, significantly improved the prediction accuracy, the representation of the imbalanced samples remained challenging. We demonstrated that a combined framework of spatial data augmentation and majority undersampling was effective in improving the range and concordance correlation coefficient (CCC) of the predictions (SOCS = 0.82; Clay = 0.9). Our findings emphasize the importance of (1) evaluating excluded samples to identify potential SRC-induced bias, and (2) optimizing model predictions reflecting the observed data range to improve the reliability and usability of the resulting soil maps.Keywords
This publication has 74 references indexed in Scilit:
- Plot‐scale variability of organic carbon in temperate agricultural soils—Implications for soil monitoring#Journal of Plant Nutrition and Soil Science, 2022
- High-resolution agriculture soil property maps from digital soil mapping methods, Czech RepublicCATENA, 2022
- Stocks of organic carbon in German agricultural soils—Key results of the first comprehensive inventoryJournal of Plant Nutrition and Soil Science, 2020
- Importance of spatial predictor variable selection in machine learning applications – Moving from data reproduction to spatial predictionEcological Modelling, 2019
- Imaging Spectroscopy for Soil Mapping and MonitoringSurveys in Geophysics, 2019
- Beyond clay: towards an improved set of variables for predicting soil organic matter contentBiogeochemistry, 2018
- Spatial and vertical variation of soil carbon at two grassland sites — Implications for measuring soil carbon stocksGeoderma, 2007
- Support-vector networksMachine Learning, 1995
- A soil-adjusted vegetation index (SAVI)Remote Sensing of Environment, 1988
- Red and photographic infrared linear combinations for monitoring vegetationRemote Sensing of Environment, 1979