Application of UAV RGB Images and Improved PSPNet Network to the Identification of Wheat Lodging Areas
Open Access
Abstract
As one of the main disasters that limit the formation of wheat yield and affect the quality of wheat, lodging poses a great threat to safety production. Therefore, an improved PSPNet (Pyramid Scene Parsing Network) integrating the Normalization-based Attention Module (NAM) (NAM-PSPNet) was applied to the high-definition UAV RGB images of wheat lodging areas at the grain-filling stage and maturity stage with the height of 20 m and 40 m. First, based on the PSPNet network, the lightweight neural network MobileNetV2 was used to replace ResNet as the feature extraction backbone network. The deep separable convolution was used to replace the standard convolution to reduce the amount of model parameters and calculations and then improve the extraction speed. Secondly, the pyramid pool structure of multi-dimensional feature fusion was constructed to obtain more detailed features of UAV images and improve accuracy. Then, the extracted feature map was processed by the NAM to identify the less significant features and compress the model to reduce the calculation. The U-Net, SegNet and DeepLabv3+ were selected as the comparison models. The results show that the extraction effect at the height of 20 m and the maturity stage is the best. For the NAM-PSPNet, the MPA (Mean Pixel Accuracy), MIoU (Mean Intersection over Union), Precision, Accuracy and Recall is, respectively, 89.32%, 89.32%, 94.95%, 94.30% and 95.43% which are significantly better than the comparison models. It is concluded that NAM-PSPNet has better extraction performance for wheat lodging areas which can provide the decisionmaking basis for severity estimation, yield loss assessment, agricultural operation, etc.Keywords
Funding Information
- Industry–University Collaborative Education Project of Ministry of Education (220606353282640, 2021jyxm0060, 2008085MF184, 31971789, 202003a06020016)
- Provincial Quality Engineering Project of Anhui Provincial Department of Education (220606353282640, 2021jyxm0060, 2008085MF184, 31971789, 202003a06020016)
- Natural Science Foundation of Anhui Province (220606353282640, 2021jyxm0060, 2008085MF184, 31971789, 202003a06020016)
- National Natural Science Foundation of China (220606353282640, 2021jyxm0060, 2008085MF184, 31971789, 202003a06020016)
- Science and Technology Major Project of Anhui Province (220606353282640, 2021jyxm0060, 2008085MF184, 31971789, 202003a06020016)
This publication has 18 references indexed in Scilit:
- Genetic progress in stem lodging resistance of the dominant wheat cultivars adapted to Yellow-Huai River Valleys Winter Wheat Zone in China since 1964Journal of Integrative Agriculture, 2020
- Use of Unmanned Aerial Vehicle Imagery and Deep Learning UNet to Extract Rice LodgingSensors, 2019
- Improving Lodging Resistance: Using Wheat and Rice as Classical ExamplesInternational Journal of Molecular Sciences, 2019
- Crop Lodging Prediction From UAV-Acquired Images of Wheat and Canola Using a DCNN Augmented With Handcrafted Texture Features2019
- CBAM: Convolutional Block Attention Module2018
- Estimates of rice lodging using indices derived from UAV visible and thermal infrared imagesAgricultural and Forest Meteorology, 2018
- Pyramid Scene Parsing Network2017
- The contribution of wheat to human diet and healthFood and Energy Security, 2015
- Angular Dependency of Hyperspectral Measurements over Wheat Characterized by a Novel UAV Based GoniometerRemote Sensing, 2015
- LabelMe: Online Image Annotation and ApplicationsProceedings of the IEEE, 2010