Improving Robot Perception Skills Using a Fast Image-Labelling Method with Minimal Human Intervention
Open Access
- 31 January 2022
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 12 (3) , 1557
Abstract
Robot perception skills contribute to natural interfaces that enhance human–robot interactions. This can be notably improved by using convolutional neural networks. To train a convolutional neural network, the labelling process is the crucial first stage, in which image objects are marked with rectangles or masks. There are many image-labelling tools, but all require human interaction to achieve good results. Manual image labelling with rectangles or masks is labor-intensive and unappealing work, which can take months to complete, making the labelling task tedious and lengthy. This paper proposes a fast method to create labelled images with minimal human intervention, which is tested with a robot perception task. Images of objects taken with specific backgrounds are quickly and accurately labelled with rectangles or masks. In a second step, detected objects can be synthesized with different backgrounds to improve the training capabilities of the image set. Experimental results show the effectiveness of this method with an example of human–robot interaction using hand fingers. This labelling method generates a database to train convolutional networks to detect hand fingers easily with minimal labelling work. This labelling method can be applied to new image sets or used to add new samples to existing labelled image sets of any application. This proposed method improves the labelling process noticeably and reduces the time required to start the training process of a convolutional neural network model.Keywords
This publication has 23 references indexed in Scilit:
- Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Views2015
- Hyperspectral image classification via contextual deep learningEURASIP Journal on Image and Video Processing, 2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Generation of synthetic structural magnetic resonance images for deep learning pre-training2015
- Ratsnake: A Versatile Image Annotation Tool with Application to Computer-Aided DiagnosisThe Scientific World Journal, 2014
- From Virtual to Reality: Fast Adaptation of Virtual Object Detectors to Real Domains2014
- Cats and dogs2012
- Vision-based hand pose estimation: A reviewComputer Vision and Image Understanding, 2007
- Histograms of Oriented Gradients for Human Detection2005
- Shape and motion from image streams under orthography: a factorization methodInternational Journal of Computer Vision, 1992