ThunderPunch: A bare-hand, gesture-based, large interactive display interface with upper-body-part detection in a top view
- 27 September 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Graphics and Applications
- Vol. 38 (5) , 100-111
Abstract
We present a new bare-hand gesture interface for large-screen interaction in which multiple users can participate simultaneously and interact with virtual content directly. To better reflect the intent of our new interface, we have created a new type of hardware system with a large hybrid display, named ThunderPunch. Unlike the conventional method, which involves positioning the camera in front, the cameras are mounted on the ceiling so that they avoid covering the large screen. To achieve bare-hand interaction in this hardware structure, we propose real-time algorithms that detect multiple body poses and recognize punching and touching gestures from top-view depth images. A pointing and touching test shows that the proposed algorithm is usable and that it outperforms other algorithms. In addition, we created a game to make the best use of the proposed system.Keywords
This publication has 7 references indexed in Scilit:
- On the Influence of Distance in the Interaction With Large DisplaysJournal of Display Technology, 2016
- Interaction with Large DisplaysACM Computing Surveys, 2015
- Method for User Interface of Large Displays Using Arm Pointing and Finger Counting Gesture RecognitionThe Scientific World Journal, 2014
- Multiparty Interaction Understanding Using Smart Multimodal Digital SignageIEEE Transactions on Human-Machine Systems, 2014
- Real-time 3D pointing gesture recognition for mobile robots with cascade HMM and particle filterImage and Vision Computing, 2011
- A Monocular Pointing Pose Estimator for Gestural Instruction of a Mobile RobotInternational Journal of Advanced Robotic Systems, 2007
- Detection and estimation of pointing gestures in dense disparity maps2002