Infrared radiometric image classification and segmentation of cloud structures using a deep-learning framework from ground-based infrared thermal camera observations
Open Access
- 12 May 2025
- journal article
- research article
- Published by Copernicus GmbH in Atmospheric Measurement Techniques
- Vol. 18 (9) , 2083-2101
Abstract
Infrared thermal cameras offer reliable means of assessing atmospheric conditions by measuring the downward radiance from the sky, facilitating their usage in cloud monitoring endeavors. The precise identification and detection of clouds in images pose great challenges stemming from the indistinct boundaries inherent to cloud formations. Various methodologies for segmentation have been previously suggested. Most of them rely on color as the distinguishing criterion for cloud identification in the visible spectral domain and thus lack the ability to detect cloud structures in gray-scaled images with satisfying accuracy. In this work, we propose a new complete deep-learning framework to perform image classification and segmentation with convolutional neural networks. We demonstrate the effectiveness of this technique by conducting a series of tests and validations based on self-captured infrared sky images. Our findings reveal that the models can effectively differentiate between image types and accurately capture detailed cloud structure information at the pixel level, even when trained with a single binary ground-truth mask per input sample. The classifier model achieves an excellent accuracy of 99 % in image type distinction, while the segmentation model attains a mean pixel accuracy of 95 % in our dataset. We emphasize that our framework exhibits strong viability and can be used for infrared thermal ground-based cloud monitoring operations over extended durations. We expect to take advantage of this framework for astronomical applications by providing cloud cover selection criteria for ground-based photometric observations within the StarDICE experiment.Keywords
All Related Versions
Funding Information
- Centre National de la Recherche Scientifique (Part of regular IN2P3 activities)
This publication has 130 references indexed in Scilit:
- CloudU-Netv2: A Cloud Segmentation Method for Ground-Based Cloud Images Based on Deep LearningNeural Processing Letters, 2021
- Deep tensor fusion network for multimodal ground-based cloud classification in weather station networksAd Hoc Networks, 2020
- Satellite Remote Sensing: Sensors, Applications and TechniquesProceedings of the National Academy of Sciences, India Section A: Physical Sciences, 2017
- The growing impact of satellite observations sensitive to humidity, cloud and precipitationQuarterly Journal of the Royal Meteorological Society, 2017
- Uncooled infrared focal plane arraysIEEJ Transactions on Electrical and Electronic Engineering, 2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Satellite remote sensing of surface air qualityAtmospheric Environment, 2008
- Ground-based remote sensing of the atmospheric boundary layer: 25 years of progressBoundary-Layer Meteorology, 1996
- Support-vector networksMachine Learning, 1995
- Rayleigh scattering by airPlanetary and Space Science, 1984