Modeling Image Segmentation Label Noise Through Concave Region Removal
Open Access
- 19 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 14, 9778-9787
Abstract
The effects of label noise geometry on image segmentation model training are under-studied, in part because prevailing segmentation metrics such as the Intersection over Union are based on pixel counts and cannot describe spatial properties of label noise. It is well established that the degree of label noise randomness affects training, however, the effects of non-random geometric label noise have not been evaluated. To this end, we describe a new class of non-random geometric label noise characterized by removal of concave regions from connected components in segmentation masks. This class of label noise geometry is motivated by the observation that both human and automated annotations have vulnerabilities that disproportionately affect concave regions. We validate this class of label noise by demonstrating its prevalence in a dataset containing noisy crowdsourced labels for the PASCAL, BDD100K, and COCO benchmarks. We then show that concave region label noise affects model training differently than uniformly applied geometric transformations across a range of model architectures and image domains. These results motivate the study of new segmentation metrics better tuned to detect label noise geometries most detrimental to model training.Keywords
This publication has 44 references indexed in Scilit:
- Rethinking Boundary Detection in Deep Learning Models for Medical Image Segmentation2023
- Incremental retraining, clinical implementation, and acceptance rate of deep learning auto‐segmentation for male pelvis in a multiuser environmentMedical Physics, 2023
- Label Noise in Segmentation Networks: Mitigation Must Deal with Bias2021
- Effect of Label Noise on Robustness of Deep Neural Network Object Detectors2021
- Kvasir-SEG: A Segmented Polyp Dataset2019
- Imperfect Segmentation Labels: How Much Do They Matter?2018
- ICNet for Real-Time Semantic Segmentation on High-Resolution Images2018
- Convexity Shape Prior for Segmentation2014
- Erosion and Dilation2004
- Convex Hulls: Basic Algorithms1985