Dual-View Stereovision-Guided Automatic Inspection System for Overhead Transmission Line Corridor
Open Access
- 21 August 2022
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 14 (16) , 4095
Abstract
Overhead transmission line corridor detection is important to ensure the safety of power facilities. Frequent and uncertain changes in the transmission line corridor environment requires an efficient and autonomous UAV inspection system, whereas the existing UAV-based inspection systems has some shortcomings in control model and ground clearance measurement. For one thing, the existing manual control model has the risk of striking power lines because it is difficult for manipulators to judge the distance between the UAV fuselage and power lines accurately. For another, the ground clearance methods based on UAV usually depend on LiDAR (Light Detection and Ranging) or single-view visual repeat scanning, with which it is difficult to balance efficiency and accuracy. Aiming at addressing the challenging issues above, a novel UAV inspection system is developed, which can sense 3D information of transmission line corridor by the cooperation of the dual-view stereovision module and an advanced embedded NVIDIA platform. In addition, a series of advanced algorithms are embedded in the system to realize autonomous control of UAVs and ground clearance measurement. Firstly, an edge-assisted power line detection method is proposed to locate the power line accurately. Then, 3D reconstruction of the power line is achieved based on binocular vision, and the target flight points are generated in the world coordinate system one-by-one to guide the UAVs movement along power lines autonomously. In order to correctly detect whether the ground clearances are in the range of safety, we propose an aerial image classification based on a light-weight semantic segmentation network to provide auxiliary information categories of ground objects. Then, the 3D points of ground objects are reconstructed according to the matching points set obtained by an efficient feature matching method, and concatenated with 3D points of power lines. Finally, the ground clearance can be measured and detected according to the generated 3D points of the transmission line corridor. Tests on both corresponding datasets and practical 220-kV transmission line corridors are conducted. The experimental results of different modules reveal that our proposed system can be applied in practical inspection environments and has good performance.Keywords
Funding Information
- National Natural Science Foundation of China (62001156)
- Key research and development plan of Jiangsu Province (BE2019036, BE2020092)
This publication has 39 references indexed in Scilit:
- Automatic Power Line Inspection Using UAV ImagesRemote Sensing, 2017
- Pyramid Scene Parsing Network2017
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- UAV-Based Oblique Photogrammetry for Outdoor Data Acquisition and Offsite Visual Inspection of Transmission LineRemote Sensing, 2017
- UAV Low Altitude Photogrammetry for Power Line InspectionISPRS International Journal of Geo-Information, 2017
- Extending kalibr: Calibrating the extrinsics of multiple IMUs and of individual axes2016
- Holistically-Nested Edge Detection2015
- Power line detection from optical imagesNeurocomputing, 2014
- LSD: a Line Segment DetectorImage Processing On Line, 2012
- Multiple camera types simultaneous stereo calibration2011