Combining crowd-sourcing and deep learning to explore the meso-scale organization of shallow convection
Authors:
- Stephan RaspSRStephan Rasp
- Hauke SchulzHSHauke Schulz
- Sandrine BonySBSandrine Bony
- Bjorn StevensBSBjorn Stevens
Preprint
Abstract
Humans excel at detecting interesting patterns in images, for example those taken from satellites. This kind of anecdotal evidence can lead to the discovery of new phenomena. However, it is often difficult to gather enough data of subjective features for significant analysis. This paper presents an example of how two tools that have recently become accessible to a wide range of researchers, crowd-sourcing and deep learning, can be combined to explore satellite imagery at scale. In particular, the focus is on the organization of shallow cumulus convection in the trade wind regions. Shallow clouds play a large role in the Earth's radiation balance yet are poorly represented in climate models. For this project four subjective patterns of organization were defined: Sugar, Flower, Fish and Gravel. On cloud labeling days at two institutes, 67 scientists screened 10,000 satellite images on a crowd-sourcing platform and classified almost 50,000 mesoscale cloud clusters. This dataset is then used as a training dataset for deep learning algorithms that make it possible to automate the pattern detection and create global climatologies of the four patterns. Analysis of the geographical distribution and large-scale environmental conditions indicates that the four patterns have some overlap with established modes of organization, such as open and closed cellular convection, but also differ in important ways. The results and dataset from this project suggests promising research questions. Further, this study illustrates that crowd-sourcing and deep learning complement each other well for the exploration of image datasets.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- Sugar, Gravel, Fish, and Flowers: Dependence of Mesoscale Patterns of Trade‐Wind Clouds on Environmental ConditionsGeophysical Research Letters, 2020
- Discovering the Importance of Mesoscale Cloud Organization Through Unsupervised ClassificationGeophysical Research Letters, 2020
- Sugar, gravel, fish and flowers: Mesoscale cloud patterns in the trade windsQuarterly Journal of the Royal Meteorological Society, 2019
- Deep learning and process understanding for data-driven Earth system scienceNature, 2019
- Insensitivity of the Cloud Response to Surface Warming Under Radical Changes to Boundary Layer Turbulence and Cloud Microphysics: Results From the Ultraparameterized CAMJournal of Advances in Modeling Earth Systems, 2018
- Crowdsourcing Methods for Data Collection in Geophysics: State of the Art, Issues, and Future DirectionsReviews of Geophysics, 2018
- EUREC4A: A Field Campaign to Elucidate the Couplings Between Clouds, Convection and CirculationSurveys in Geophysics, 2017
- Clouds at Barbados are representative of clouds across the trade wind regions in observations and climate modelsProceedings of the National Academy of Sciences, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Deep learningNature, 2015