Efficient Human-Robot Interaction using Deep Learning with Mask R-CNN: Detection, Recognition, Tracking and Segmentation
Authors:
- 1 November 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 162-167
Abstract
We address social human-robot interaction problem by proposing an integration of deep neural network with mechanical robotic system to make it robust for human-robot interactive activities. Mask R-CNN, a neural network for object detection, can effectively help localize human faces which can be manipulated to instruct movement of the robot head. Our approach is not only suitable for detection and segmentation tasks but able to integrate as well with the mechanism of parallel mini-manipulator representing the 3D dimensions, in position and orientation of workspace. It can also solve the object segmentation problem which appears to be one of the most challenging issues in computer vision nowadays.Keywords
This publication has 16 references indexed in Scilit:
- Real-Time Localization and Tracking System with Multiple-Angle Views for Human Robot Interaction2017
- Forward kinematics of a human-arm system and inverse kinematics using vector calculus2016
- Joint Face Detection and Alignment Using Multitask Cascaded Convolutional NetworksIEEE Signal Processing Letters, 2016
- Fast R-CNN2015
- From Facial Parts Responses to Face Detection: A Deep Learning Approach2015
- FaceNet: A unified embedding for face recognition and clustering2015
- Control of generalized contact motion and force in physical human-robot interaction2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Rapid object detection using a boosted cascade of simple features2005
- Probabilistic roboticsCommunications of the ACM, 2002