Contaminated Facade Identification Using Convolutional Neural Network and Image Processing
Open Access
- 30 September 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 180010-180021
Abstract
In recent years, as number of new building getting larger, there has been an increased interest in the cleaning of exterior walls. Accordingly, there is a growing interest in automatic cleaning robots that move around the outer building fagade. These robots are also required to apply different cleaning methods to remove various contaminants on the outer wall of the building. However, current surface contaminant detection systems can either detect only a single type of contaminant, or are not compact enough for installation on mobile platforms that move around the outer fagade. As cleaning workers are able to distinguish various contaminants with the naked eye, we aim to solve this problem by developing a machine-vision system using convolutional neural networks (CNNs) and image processing methods. As it is a compact system that uses only a camera to take pictures and a processor to process the images, it is suitable for applications involving mobile platforms. Object-type contaminants such as avian feces are handled by the YOLOv3 module using the object-detection algorithm. Area-type contaminants such as rusty stains are processed using the color-detection module using the HSV color space, median filter, and flood fill algorithm. Particle-type contaminants such as dust are handled by the grayscale module, converting images to grayscale images and then comparing the average brightness with a reference that is provided in advance. This proposed machine vision system will detect objects, areas, and particle-type contaminants with a single image and some reference images provided in advance.Keywords
Funding Information
- National Research Foundation of Korea (NRF) Grant funded by the Ministry of Science and ICT for the First-Mover Program for Accelerating Disruptive Technology Development (2018M3C1B9088331, 2018M3C1B9088332)
- Hanyang University (HY-2019)
This publication has 31 references indexed in Scilit:
- Integer-based accurate conversion between RGB and HSV color spacesComputers and Electrical Engineering, 2015
- Fully convolutional networks for semantic segmentation2015
- YUV vs RGB—Choosing a Color Space for Human-Machine Interaction2014
- Robotic cleaning system for glass facade of high-rise airport control towerIndustrial Robot: the international journal of robotics research and application, 2010
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- A series of pneumatic glass‐wall cleaning robots for high‐rise buildingsIndustrial Robot: the international journal of robotics research and application, 2007
- Application of Taguchi method in the optimization of end milling parametersJournal of Materials Processing Technology, 2004
- Bilateral filtering for gray and color images2002
- Short-range noncontact detection of surface contamination using Raman lidar2002
- A study of efficiency and accuracy in the transformation from RGB to CIELAB color spaceIEEE Transactions on Image Processing, 1997