Real-Time Automated Classification of Sky Conditions Using Deep Learning and Edge Computing
Open Access
- 27 September 2021
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 13 (19) , 3859
Abstract
The radiometric quality of remotely sensed imagery is crucial for precision agriculture applications because estimations of plant health rely on the underlying quality. Sky conditions, and specifically shadowing from clouds, are critical determinants in the quality of images that can be obtained from low-altitude sensing platforms. In this work, we first compare common deep learning approaches to classify sky conditions with regard to cloud shadows in agricultural fields using a visible spectrum camera. We then develop an artificial-intelligence-based edge computing system to fully automate the classification process. Training data consisting of 100 oblique angle images of the sky were provided to a convolutional neural network and two deep residual neural networks (ResNet18 and ResNet34) to facilitate learning two classes, namely (1) good image quality expected, and (2) degraded image quality expected. The expectation of quality stemmed from the sky condition (i.e., density, coverage, and thickness of clouds) present at the time of the image capture. These networks were tested using a set of 13,000 images. Our results demonstrated that ResNet18 and ResNet34 classifiers produced better classification accuracy when compared to a convolutional neural network classifier. The best overall accuracy was obtained by ResNet34, which was 92% accurate, with a Kappa statistic of 0.77. These results demonstrate a low-cost solution to quality control for future autonomous farming systems that will operate without human intervention and supervision.Keywords
This publication has 25 references indexed in Scilit:
- Real-Time Driver Drowsiness Detection for Embedded System Using Model Compression of Deep Neural Networks2017
- ResNet-Based Vehicle Classification and Localization in Traffic Surveillance Systems2017
- Learning Pooling for Convolutional Neural NetworkNeurocomputing, 2017
- Deep Residual Learning for Image Recognition2016
- Cloud Cover Assessment for Operational Crop Monitoring Systems in Tropical AreasRemote Sensing, 2016
- Radiometric quality assessment of images acquired by UAV’s in various lighting and weather conditionsMeasurement, 2015
- An Analysis of Shadow Effects on Spectral Vegetation Indexes Using a Ground-Based Imaging SpectrometerIEEE Geoscience and Remote Sensing Letters, 2015
- Remote Sensing of Irrigated Agriculture: Opportunities and ChallengesRemote Sensing, 2010
- The availability of cloud-free Landsat ETM+ data over the conterminous United States and globallyRemote Sensing of Environment, 2008
- A Review on Remote Sensing of Weeds in AgriculturePrecision Agriculture, 2004