MeltPondNet: A Swin Transformer U-Net for Detection of Melt Ponds on Arctic Sea Ice
Open Access
- 10 October 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 15 (19391404) , 8776-8784
Abstract
High-resolution aerial photographs of Arctic region are a great source for different sea ice feature recognition, which are crucial to validate, tune and improve climate models. Melt ponds on the surface of melting Arctic sea ice are of particular interest as they are sensitive and valuable indicators and are proxy to the processes in the Arctic climate system. Manual analysis of this remote sensing data is extremely difficult and time-consuming due to the complex shapes and unpredictable boundaries of the melt ponds, and that leads to the necessity for automatizing the processes. In this study, we propose a robust and efficient automatic method for melt pond region segmentation and boundary extraction from high-resolution aerial photographs. The proposed algorithm is based on a swin transformer U-Net in which we introduce novel cross-channel attention mechanisms into the decoder design. The framework operates with optical data and allows for classifying imagery into four classes: sea ice/snow, open water, melt pond, and submerged ice. We use aerial photographs collected during the Healy-Oden Trans Arctic Expedition (HO-TRAX) expedition over Arctic sea ice in the summer season of 2005 as test data. The experimental results show that the proposed method is suitable for precise automatic extraction of melt pond geometry and it can also be extended for other optical data sources that involve melt ponds. The approach has a promising potential to be used to analyze melt ponds' corresponding changes between years.Keywords
Funding Information
- National Science Foundation (PHY-2102906)
This publication has 30 references indexed in Scilit:
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Seasonal evolution of melt ponds on Arctic sea iceJournal of Geophysical Research: Oceans, 2015
- Fully convolutional networks for semantic segmentation2015
- On the Estimation of Melt Pond Fraction on the Arctic Sea Ice With ENVISAT WSM ImagesIEEE Transactions on Geoscience and Remote Sensing, 2014
- Changes in Arctic melt season and implications for sea ice lossGeophysical Research Letters, 2014
- Impact of melt ponds on Arctic sea ice simulations from 1990 to 2007Journal of Geophysical Research: Oceans, 2012
- Melt ponds on Arctic sea ice determined from MODIS satellite data using an artificial neural networkThe Cryosphere, 2012
- Transpolar observations of the morphological properties of Arctic sea iceJournal of Geophysical Research: Oceans, 2009
- Seasonal evolution of the albedo of multiyear Arctic sea iceJournal of Geophysical Research: Oceans, 2002
- Sea-Ice Melt-Pond Fraction as Determined from Low Level Aerial PhotographsArctic and Alpine Research, 1997