Efficient collection and automatic annotation of real-world object images by taking advantage of post-diminished multiple visual markers
Authors:
- 29 November 2019
- journal article
- research article
- Published by Taylor & Francis in Advanced Robotics
- Vol. 33 (24) , 1264-1280
Abstract
To collect a human-annotated dataset for training deep convolutional neural networks is a very time-consuming and laborious process. To reduce this burden, we previously proposed an automated annotation by placing one visual marker above the detection target object in the training phase. However, in this approach, occasionally the marker hides the object surface. To avoid this issue, we propose placing a pedestal with multiple markers at the bottom of the object. If we use multiple markers, the object can be annotated even when the object hides some of the markers. Besides that, the simple modification of placing the markers on the bottom allows the use of simple background masking to avoid the neural network learning the remaining markers in the training image as a feature of the object. Background masking can completely remove the markers during the training process. Experiments showed the proposed vision system using our automatic object annotation outperformed the vision system using manual annotation in terms of object detection, orientation estimation, and 2D position estimation while reducing the time required for dataset collection from 16.1 hours to 7.30 hours.Keywords
This publication has 9 references indexed in Scilit:
- Fully Automated Annotation With Noise-Masked Visual Markers for Deep-Learning-Based Object DetectionIEEE Robotics and Automation Letters, 2019
- A simple, robust and fast method for the perspective-n-point ProblemPattern Recognition Letters, 2018
- RGB-D object detection and semantic segmentation for autonomous manipulation in clutterThe International Journal of Robotics Research, 2017
- CAD-based Pose Estimation Design for Random Bin Picking using a RGB-D CameraJournal of Intelligent & Robotic Systems, 2017
- RGB-D datasets using microsoft kinect or similar sensors: a surveyMultimedia Tools and Applications, 2016
- A Dataset for Improved RGBD-Based Object Detection and Pose Estimation for Warehouse Pick-and-PlaceIEEE Robotics and Automation Letters, 2016
- Automatic generation and detection of highly reliable fiducial markers under occlusionPattern Recognition, 2014
- LabelMe: A Database and Web-Based Tool for Image AnnotationInternational Journal of Computer Vision, 2007
- Random sample consensusCommunications of the ACM, 1981