Towards Fine-Tuning-Based Site Calibration for Knowledge-Guided Machine Learning: A Summary of Results
Preprint
Abstract
Accurate and cost-effective quantification of the agroecosystem carbon cycle at decision-relevant scales is essential for climate mitigation and sustainable agriculture. However, both transfer learning and the exploitation of spatial variability in this field are challenging, as they involve heterogeneous data and complex cross-scale dependencies. Conventional approaches often rely on location-independent parameterizations and independent training, underutilizing transfer learning and spatial heterogeneity in the inputs, and limiting their applicability in regions with substantial variability. We propose FTBSC-KGML (Fine-Tuning-Based Site Calibration-Knowledge-Guided Machine Learning), a pretraining- and fine-tuning-based, spatial-variability-aware, and knowledge-guided machine learning framework that augments KGML-ag with a pretraining-fine-tuning process and site-specific parameters. Using a pretraining-fine-tuning process with remote-sensing GPP, climate, and soil covariates collected across multiple midwestern sites, FTBSC-KGML estimates land emissions while leveraging transfer learning and spatial heterogeneity. A key component is a spatial-heterogeneity-aware transfer-learning scheme, which is a globally pretrained model that is fine-tuned at each state or site to learn place-aware representations, thereby improving local accuracy under limited data without sacrificing interpretability. Empirically, FTBSC-KGML achieves lower validation error and greater consistency in explanatory power than a purely global model, thereby better capturing spatial variability across states. This work extends the prior SDSA-KGML framework.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Physics-Based Abnormal Trajectory Gap DetectionACM Transactions on Intelligent Systems and Technology, 2024
- Knowledge-guided machine learning can improve carbon cycle quantification in agroecosystemsNature Communications, 2024
- Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental SystemsACM Computing Surveys, 2022
- Understanding COVID-19 Effects on Mobility: A Community-Engaged ApproachAGILE: GIScience Series, 2022
- Spatial Variability Aware Deep Neural Networks (SVANN): A General ApproachACM Transactions on Intelligent Systems and Technology, 2021
- Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equationsJournal of Computational Physics, 2019
- Theory-Guided Data Science: A New Paradigm for Scientific Discovery from DataIEEE Transactions on Knowledge and Data Engineering, 2017
- Notes on Continuous Stochastic PhenomenaBiometrika, 1950