Pix2Pix Network to Estimate Agricultural Near Infrared Images from RGB Data
- 27 January 2022
- journal article
- research article
- Published by Taylor & Francis in Canadian Journal of Remote Sensing
- Vol. 48 (2) , 299-315
Abstract
Remote sensing has been applied to agriculture, making it possible to acquire a large amount of data far away from crops, providing information for decision making by producers that can impact production costs and crops quality. One way of getting the production information is through vegetation indices, arithmetic operations that use spectral bands, especially the Near Infrared (NIR). However, sensors that capture this spectral information are very expensive for small producers to afford it. In a previous article, a pixel-to-pixel image synthesis model to estimate NIR images from RGB data using hyperspectral endmembers (pure hyperspectral signatures) was described. In this work, an image-to-image synthesis model, known as Pix2Pix, is used for estimating NIR images from low-cost RGB camera images. Pix2Pix is a kind of Generative Adversarial Networks (GANs), composed by two neural networks, a generator (G) and a discriminator (D), that compete. G learns to create images from a random noise inputs and D learns to verify if these images are real or fake. The results showed that the presented method generated NIR images quite similar to real ones, reaching a value of 0.912 on M3SIM similarity metric, outperforming results obtained with the previous endmembers method (0.775 on M3SIM).Keywords
Funding Information
- CAPES (Coordenação de Aperfeiçoamento de Pessoal de Ensino Superior), Ministry of Education, Brazil (001)
This publication has 22 references indexed in Scilit:
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Deep learningNature, 2015
- Twenty five years of remote sensing in precision agriculture: Key advances and remaining knowledge gapsBiosystems Engineering, 2013
- Advances in Remote Sensing of Agriculture: Context Description, Existing Operational Monitoring Systems and Major Information NeedsRemote Sensing, 2013
- Comparison of different vegetation indices for the remote assessment of green leaf area index of cropsRemote Sensing of Environment, 2011
- On Endmember Identification in Hyperspectral Images Without Pure Pixels: A Comparison of AlgorithmsJournal of Mathematical Imaging and Vision, 2011
- Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier]IEEE Computational Intelligence Magazine, 2010
- Multiscale structural similarity for image quality assessment2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Nearest neighbor pattern classificationIEEE Transactions on Information Theory, 1967