Linear Feature-Based Triangulation for Large-Scale Orthophoto Generation Over Mechanized Agricultural Fields
- 14 April 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 60 (01962892) , 1-18
Abstract
Unmanned aerial vehicles (UAVs) equipped with imaging and ranging sensors have become an effective remote sensing data acquisition tool for digital agriculture. Among potential products derived from UAVs, high-resolution orthophotos play an important role in several phenotyping activities, such as canopy cover estimation and flowering date identification. Current structure from motion (SfM) tools for image-based 3-D reconstruction and orthophoto generation cannot perform well when working with large-scale imagery over mechanized agricultural fields. This failure is mainly due to their inability to identify enough conjugate points among overlapping images captured at low altitudes. This study addresses such limitation through a new strategy that uses plant row segments as linear features in the triangulation process. The linear features are derived in two steps. First, an automated approach is implemented to extract plant row segments from the LiDAR data which are then back-projected to the imagery using available trajectory and system calibration parameters. In the second step, a machine-assisted strategy is used to adjust the line segments in image space for deriving accurate linear features. In the proposed framework, the triangulation process is conducted by investigating two mathematical models—referred to as object-space and image-space coplanarity constraints—for incorporating linear features in the bundle adjustment (BA). The orthophoto is generated using the refined trajectory and system calibration parameters derived from the BA process. Several experimental results over an agricultural filed show that the proposed framework outperforms commonly used SfM tools, e.g., Pix4D Mapper Pro and Agisoft Metashape in terms of generating orthophotos with high visual quality and geolocation accuracy. Also, results indicate that the object-space coplanarity constraint is more robust against potential noise in line measurements when compared to the image-space coplanarity model. However, both models lead to high absolute accuracy in the range of ±2–4 cm when the noise level in the image measurements of points along the line is reasonable, i.e., ~5–10 pixels.Keywords
Funding Information
- Civil Engineering Center for Applications of UAS for a Sustainable Environment
- Advanced Research Projects Agency Energy (ARPA-E), U.S. Department of Energy (DE AR0001135)
This publication has 51 references indexed in Scilit:
- An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistencyJournal of Visual Communication and Image Representation, 2013
- Determination of Exterior Orientation Using Linear Features from Vector MapsThe Photogrammetric Record, 2006
- Structure-from-motion using lines: Representation, triangulation, and bundle adjustmentComputer Vision and Image Understanding, 2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- From point-based to feature-based aerial triangulationISPRS Journal of Photogrammetry and Remote Sensing, 2004
- An efficient solution to the five-point relative pose problemIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- A simple and robust line detection algorithm based on small eigenvalue analysisPattern Recognition Letters, 2004
- Autonomous space resection using Point‐ and Line‐Based representation of FREE‐FORM control Linear FeaturesThe Photogrammetric Record, 2003
- Bundle Adjustment with Self–Calibration Using Straight LinesThe Photogrammetric Record, 2002
- Relative and absolute orientation based on linear featuresISPRS Journal of Photogrammetry and Remote Sensing, 1991