LZLibo Zhang

Libo Zhang

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Libo Zhang has a total of 16 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Elimination of Leaf Angle Impacts on Plant Reflectance Spectra Using Fusion of Hyperspectral Images and 3D Point Clouds

    by Libo Zhang, Jian Jin, Liangju Wang, Tanzeel U. Rehman, Mark T. Gee

    During recent years, hyperspectral imaging technologies have been widely applied in agriculture to evaluate complex plant physiological traits such as leaf moisture content, nutrient level, and disease stress. A critical component of this technique is white referencing used to remove the effect of non-uniform lighting intensity in different wavelengths on raw hyperspectral images. However, a flat white tile cannot accurately reflect the lighting intensity variance on plant leaves, since the leaf geometry (e.g., tilt angles) and its interaction with the illumination severely impact plant reflectance spectra and vegetation indices such as the normalized difference vegetation index (NDVI). In this research, the impacts of leaf angles on plant reflectance spectra were summarized, and an improved image calibration model using the fusion of leaf hyperspectral images and 3D point clouds was built. Corn and soybean leaf samples were imaged at different tilt angles and orientations using an indoor desktop hyperspectral imaging system and analyzed for differences in the NDVI values. The results showed that the leaf’s NDVI largely changed with angles. The changing trends with angles differed between the two species. Using measurements of leaf tilt angle and orientation obtained from the 3D point cloud data taken simultaneously with the hyperspectral images, a support vector regression (SVR) model was successfully developed to calibrate the NDVI values of pixels at different angles on a leaf to a same standard as if the leaf was laid flat on a horizontal surface. The R-squared values between the measured and predicted leaf angle impacts were 0.76 and 0.94 for corn and soybean, respectively. This method has a potential to be used in any general plant imaging systems to improve the phenotyping quality.


  • Open Access

    Common Latent Space Exploration for Calibration Transfer across Hyperspectral Imaging-Based Phenotyping Systems

    by Tanzeel U. Rehman, Libo Zhang, Dongdong Ma, Jian Jin

    Hyperspectral imaging has increasingly been used in high-throughput plant phenotyping systems. Rapid advancement in the field of phenotyping has resulted in a wide array of hyperspectral imaging systems. However, sharing the plant feature prediction models between different phenotyping facilities becomes challenging due to the differences in imaging environments and imaging sensors. Calibration transfer between imaging facilities is crucially important to cope with such changes. Spectral space adjustment methods including direct standardization (DS), its variants (PDS, DPDS) and spectral scale transformation (SST) require the standard samples to be imaged in different facilities. However, in real-world scenarios, imaging the standard samples is practically unattractive. Therefore, in this study, we presented three methods (TCA, c-PCA, and di-PLSR) to transfer the calibration models without requiring the standard samples. In order to compare the performance of proposed approaches, maize plants were imaged in two greenhouse-based HTPP systems using two pushbroom-style hyperspectral cameras covering the visible near-infrared range. We tested the proposed methods to transfer nitrogen content (N) and relative water content (RWC) calibration models. The results showed that prediction R2 increased by up to 14.50% and 42.20%, while the reduction in RMSEv was up to 74.49% and 76.72% for RWC and N, respectively. The di-PLSR achieved the best results for almost all the datasets included in this study, with TCA being second. The performance of c-PCA was not at par with the di-PLSR and TCA. Our results showed that the di-PLSR helped to recover the performance of RWC, and N models plummeted due to the differences originating from new imaging systems (sensor type, spectrograph, lens system, spatial resolution, spectral resolution, field of view, bit-depth, frame rate, and exposure time) or lighting conditions. The proposed approaches can alleviate the requirement of developing a new calibration model for a new phenotyping facility or to resort to the spectral space adjustment using the standard samples.


  • Open Access

    Modeling of Environmental Impacts on Aerial Hyperspectral Images for Corn Plant Phenotyping

    by Dongdong Ma, Tanzeel U. Rehman, Libo Zhang, Hideki Maki, Mitchell R. Tuinstra, Jian Jin

    Aerial imaging technologies have been widely applied in agricultural plant remote sensing. However, an as yet unexplored challenge with field imaging is that the environmental conditions, such as sun angle, cloud coverage, temperature, and so on, can significantly alter plant appearance and thus affect the imaging sensor’s accuracy toward extracting plant feature measurements. These image alterations result from the complicated interaction between the real-time environments and plants. Analysis of these impacts requires continuous monitoring of the changes through various environmental conditions, which has been difficult with current aerial remote sensing systems. This paper aimed to propose a modeling method to comprehensively understand and model the environmental influences on hyperspectral imaging data. In 2019, a fixed hyperspectral imaging gantry was constructed in Purdue University’s research farm, and over 8000 repetitive images of the same corn field were taken with a 2.5 min interval for 31 days. Time-tagged local environment data, including solar zenith angle, solar irradiation, temperature, wind speed, and so on, were also recorded during the imaging time. The images were processed for phenotyping data, and the time series decomposition method was applied to extract the phenotyping data variation caused by the changing environments. An artificial neural network (ANN) was then built to model the relationship between the phenotyping data variation and environmental changes. The ANN model was able to accurately predict the environmental effects in remote sensing results, and thus could be used to effectively eliminate the environment-induced variation in the phenotyping features. The test of the normalized difference vegetation index (NDVI) calculated from the hyperspectral images showed that variance in NDVI was reduced by 79%. A similar performance was confirmed with the relative water content (RWC) predictions. Therefore, this modeling method shows great potential for application in aerial remote sensing applications in agriculture, to significantly improve the imaging quality by effectively eliminating the effects from the changing environmental conditions.


  • Open Access

    Modeling of Diurnal Changing Patterns in Airborne Crop Remote Sensing Images

    by Dongdong Ma, Tanzeel U. Rehman, Libo Zhang, Hideki Maki, Mitchell R. Tuinstra, Jian Jin

    Airborne remote sensing technologies have been widely applied in field crop phenotyping. However, the quality of current remote sensing data suffers from significant diurnal variances. The severity of the diurnal issue has been reported in various plant phenotyping studies over the last four decades, but there are limited studies on the modeling of the diurnal changing patterns that allow people to precisely predict the level of diurnal impacts. In order to comprehensively investigate the diurnal variability, it is necessary to collect time series field images with very high sampling frequencies, which has been difficult. In 2019, Purdue agricultural (Ag) engineers deployed their first field visible to near infrared (VNIR) hyperspectral gantry platform, which is capable of repetitively imaging the same field plots every 2.5 min. A total of 8631 hyperspectral images of the same field were collected for two genotypes of corn plants from the vegetative stage V4 to the reproductive stage R1 in the 2019 growing season. The analysis of these images showed that although the diurnal variability is very significant for almost all the image-derived phenotyping features, the diurnal changes follow stable patterns. This makes it possible to predict the imaging drifts by modeling the changing patterns. This paper reports detailed diurnal changing patterns for several selected plant phenotyping features such as Normalized Difference Vegetation Index (NDVI), Relative Water Content (RWC), and single spectrum bands. For example, NDVI showed a repeatable V-shaped diurnal pattern, which linearly drops by 0.012 per hour before the highest sun angle and increases thereafter by 0.010 per hour. The different diurnal changing patterns in different nitrogen stress treatments, genotypes and leaf stages were also compared and discussed. With the modeling results of this work, Ag remote sensing users will be able to more precisely estimate the deviation/change of crop feature predictions caused by the specific imaging time of the day. This will help people to more confidently decide on the acceptable imaging time window during a day. It can also be used to calibrate/compensate the remote sensing result against the time effect.


  • Open Access

    Stress Distribution Analysis on Hyperspectral Corn Leaf Images for Improved Phenotyping Quality

    by Dongdong Ma, Liangju Wang, Libo Zhang, Zhihang Song, Tanzeel U. Rehman, Jian Jin

    High-throughput imaging technologies have been developing rapidly for agricultural plant phenotyping purposes. With most of the current crop plant image processing algorithms, the plant canopy pixels are segmented from the images, and the averaged spectrum across the whole canopy is calculated in order to predict the plant’s physiological features. However, the nutrients and stress levels vary significantly across the canopy. For example, it is common to have several times of difference among Soil Plant Analysis Development (SPAD) chlorophyll meter readings of chlorophyll content at different positions on the same leaf. The current plant image processing algorithms cannot provide satisfactory plant measurement quality, as the averaged color cannot characterize the different leaf parts. Meanwhile, the nutrients and stress distribution patterns contain unique features which might provide valuable signals for phenotyping. There is great potential to develop a finer level of image processing algorithm which analyzes the nutrients and stress distributions across the leaf for improved quality of phenotyping measurements. In this paper, a new leaf image processing algorithm based on Random Forest and leaf region rescaling was developed in order to analyze the distribution patterns on the corn leaf. The normalized difference vegetation index (NDVI) was used as an example to demonstrate the improvements of the new algorithm in differentiating between different nitrogen stress levels. With the Random Forest method integrated into the algorithm, the distribution patterns along the corn leaf’s mid-rib direction were successfully modeled and utilized for improved phenotyping quality. The algorithm was tested in a field corn plant phenotyping assay with different genotypes and nitrogen treatments. Compared with the traditional image processing algorithms which average the NDVI (for example) throughout the whole leaf, the new algorithm more clearly differentiates the leaves from different nitrogen treatments and genotypes. We expect that, besides NDVI, the new distribution analysis algorithm could improve the quality of other plant feature measurements in similar ways.


  • Open Access

    Precise Estimation of NDVI with a Simple NIR Sensitive RGB Camera and Machine Learning Methods for Corn Plants

    by Liangju Wang, Yunhong Duan, Libo Zhang, Tanzeel U. Rehman, Dongdong Ma, Jian Jin

    The normalized difference vegetation index (NDVI) is widely used in remote sensing to monitor plant growth and chlorophyll levels. Usually, a multispectral camera (MSC) or hyperspectral camera (HSC) is required to obtain the near-infrared (NIR) and red bands for calculating NDVI. However, these cameras are expensive, heavy, difficult to geo-reference, and require professional training in imaging and data processing. On the other hand, the RGBN camera (NIR sensitive RGB camera, simply modified from standard RGB cameras by removing the NIR rejection filter) have also been explored to measure NDVI, but the results did not exactly match the NDVI from the MSC or HSC solutions. This study demonstrates an improved NDVI estimation method with an RGBN camera-based imaging system (Ncam) and machine learning algorithms. The Ncam consisted of an RGBN camera, a filter, and a microcontroller with a total cost of only $70 ~ 85. This new NDVI estimation solution was compared with a high-end hyperspectral camera in an experiment with corn plants under different nitrogen and water treatments. The results showed that the Ncam with two-band-pass filter achieved high performance (R2 = 0.96, RMSE = 0.0079) at estimating NDVI with the machine learning model. Additional tests showed that besides NDVI, this low-cost Ncam was also capable of predicting corn plant nitrogen contents precisely. Thus, Ncam is a potential option for MSC and HSC in plant phenotyping projects.


  • Open Access

    LeafScope: A Portable High-Resolution Multispectral Imager for In Vivo Imaging Soybean Leaf

    by Liangju Wang, Yunhong Duan, Libo Zhang, Jialei Wang, Yikai Li, Jian Jin

    Portable devices for measuring plant physiological features with their isolated measuring chamber are playing an increasingly important role in plant phenotyping. However, currently available commercial devices of this type, such as soil plant analysis development (SPAD) meter and spectrometer, are dot meters that only measure a small region of the leaf, which does not perfectly represent the highly varied leaf surface. This study developed a portable and high-resolution multispectral imager (named LeafScope) to in-vivo image a whole leaf of dicotyledon plants while blocking the ambient light. The hardware system is comprised of a monochrome camera, an imaging chamber, a lightbox with different bands of light-emitting diodes (LEDs) array, and a microcontroller. During measuring, the device presses the leaf to lay it flat in the imaging chamber and acquires multiple images while alternating the LED bands within seconds in a certain order. The results of an experiment with soybean plants clearly showed the effect of nitrogen and water treatments as well as the genotype differences by the color and morphological features from image processing. We conclude that the low cost and easy to use LeafScope can provide promising imaging quality for dicotyledon plants, so it has great potential to be used in plant phenotyping.


  • Open Access

    Improving High-Throughput Phenotyping Using Fusion of Close-Range Hyperspectral Camera and Low-Cost Depth Sensor

    by Peikui Huang, Xiwen Luo, Jian Jin, Liangju Wang, Libo Zhang, Jie Liu, Zhigang Zhang

    Hyperspectral sensors, especially the close-range hyperspectral camera, have been widely introduced to detect biological processes of plants in the high-throughput phenotyping platform, to support the identification of biotic and abiotic stress reactions at an early stage. However, the complex geometry of plants and their interaction with the illumination, severely affects the spectral information obtained. Furthermore, plant structure, leaf area, and leaf inclination distribution are critical indexes which have been widely used in multiple plant models. Therefore, the process of combination between hyperspectral images and 3D point clouds is a promising approach to solve these problems and improve the high-throughput phenotyping technique. We proposed a novel approach fusing a low-cost depth sensor and a close-range hyperspectral camera, which extended hyperspectral camera ability with 3D information as a potential tool for high-throughput phenotyping. An exemplary new calibration and analysis method was shown in soybean leaf experiments. The results showed that a 0.99 pixel resolution for the hyperspectral camera and a 3.3 millimeter accuracy for the depth sensor, could be achieved in a controlled environment using the method proposed in this paper. We also discussed the new capabilities gained using this new method, to quantify and model the effects of plant geometry and sensor configuration. The possibility of 3D reflectance models can be used to minimize the geometry-related effects in hyperspectral images, and to significantly improve high-throughput phenotyping. Overall results of this research, indicated that the proposed method provided more accurate spatial and spectral plant information, which helped to enhance the precision of biological processes in high-throughput phenotyping.