Leakage-aware spatial and temporal validation of flood susceptibility models on Jeju Island
Authors:
- Sooyeon HanSHSooyeon Han
- Woojin LeeWLWoojin Lee
- Saro LeeSLSaro Lee
Preprint
- 2 September 2026
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
Study Region: Jeju Island, Republic of Korea: a 1,833 km² basaltic shield volcano whose permeable lava sequence keeps the incised radial channels (geoncheon) dry between storms and routes runoff to a densely settled coastal fringe, while orographic rainfall peaks inland.Study Focus: We tested whether flood-susceptibility skill survives evaluation designs respecting the mapped observation units. A 398,878-cell inventory from 1,795 inundation polygons spanning seven flood years (2006–2019) was audited for leakage and partitioned by event and polygon before pixel extraction. Frequency ratio, regularised logistic regression, random forest and gradient-boosted trees were compared on identical folds under a random pixel split, grouped spatial blocks, leave-one-event-out validation and a 2019 temporal holdout, with uncertainty resampled from polygons and blocks.New Hydrological Insights for the Region: The random split shares 94.3% of polygons and all seven years; the area under the receiver operating characteristic curve (AUC) falls monotonically from 0.9019–0.9906 to 0.8000–0.8795, 0.7304–0.7819 and 0.7115–0.7711, inverting the model ordering. The flood label’s autocorrelation range, 19.1 km, exceeds any block a 73 by 41 km island can accommodate, so grouped skill only bounds geographic transfer from above. Orographic rainfall is spatially decoupled from mapped inundation: co-varying with lithology and valley depth, its negative attribution marks the interior-to-coast contrast, not reduced flood generation. Watershed-basin membership identifies location, not a catchment control. The maps are relative screening scores, not transferable predictions.Keywords
This publication has 26 references indexed in Scilit:
- Flood susceptibility mapping of Cheongju, South Korea based on the integration of environmental factors using various machine learning approachesJournal of Environmental Management, 2024
- Flood susceptible prediction through the use of geospatial variables and machine learning methodsJournal of Hydrology, 2023
- Hybrid-based approaches for the flood susceptibility prediction of Kermanshah province, IranNatural Hazards, 2022
- Case study on an integrated interoperable metadata model for geoscience information resourcesGeoscience Data Journal, 2022
- Flood susceptibility mapping in an arid region of Pakistan through ensemble machine learning modelStochastic Environmental Research and Risk Assessment, 2022
- Novel forecasting approaches using combination of machine learning and statistical models for flood susceptibility mappingJournal of Environmental Management, 2018
- Flood susceptibility mapping using a novel ensemble weights-of-evidence and support vector machine models in GISJournal of Hydrology, 2014
- Landslide susceptibility mapping using frequency ratio, logistic regression, artificial neural networks and their comparison: A case study from Kat landslides (Tokat—Turkey)Computers & Geosciences, 2009
- Landslide hazard mapping at Selangor, Malaysia using frequency ratio and logistic regression modelsLandslides, 2006
- An introduction to ROC analysisPattern Recognition Letters, 2006