Integrative Use of Computer Vision and Unmanned Aircraft Technologies in Public Inspection
Authors:
Open Access
- 9 June 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- Vol. 2021, 437-443
Abstract
Unmanned Aircraft Systems (UAS) have become an important resource for public service providers and smart cities. The purpose of this study is to expand this research area by integrating computer vision and UAS technology to automate public inspection. As an initial case study for this work, a dataset of common foreign object debris (FOD) is developed to assess the potential of light-weight automated detection. This paper presents the rationale and creation of this dataset. Future iterations of our work will include further technical details analyzing experimental implementation. At a local airport, UAS and portable cameras are used to collect the data contained in the initial version of this dataset. After collecting these videos of FOD, they were split into individual frames and stored as several thousand images. These frames are then annotated following standard computer vision format and stored in a folder-structure that reflects our creation method. The dataset annotations are validated using a custom tool that could be abstracted to fit future applications. Initial detection models were successfully created using the famous You Only Look Once algorithm, which indicates the practicality of the proposed data. Finally, several potential scenarios that could utilize either this dataset or similar methods for other public service are presented.Keywords
All Related Versions
Funding Information
- NASA Nebraska Space Grant (NNX15AI09H)
This publication has 9 references indexed in Scilit:
- Research on FOD Detection for Airport Runway based on YOLOv32020
- Cover 2IEEE Communications Magazine, 2018
- Field Application of UAS-Based Bridge InspectionTransportation Research Record: Journal of the Transportation Research Board, 2018
- Foreign object debris material recognition based on convolutional neural networksEURASIP Journal on Image and Video Processing, 2018
- Region Based CNN for Foreign Object Debris Detection on Airfield PavementSensors, 2018
- A machine learning-based method for the large-scale evaluation of the qualities of the urban environmentComputers, Environment and Urban Systems, 2017
- IoT-Driven Automated Object Detection Algorithm for Urban Surveillance Systems in Smart CitiesIEEE Internet of Things Journal, 2017
- You Only Look Once: Unified, Real-Time Object Detection2016
- Traffic monitoring with computer vision2009