HapTable: An Interactive Tabletop Providing Online Haptic Feedback for Touch Gestures
Authors:
- Senem Ezgi EmginSESenem Ezgi Emgin
- Amirreza AghakhaniAAAmirreza Aghakhani
- T. Metin SezginTST. Metin Sezgin
- Cagatay BasdoganCBCagatay Basdogan
- 11 July 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 25 (9) , 2749-2762
Abstract
We present HapTable; a multi-modal interactive tabletop that allows users to interact with digital images and objects through natural touch gestures, and receive visual and haptic feedback accordingly. In our system, hand pose is registered by an infrared camera and hand gestures are classified using a Support Vector Machine (SVM) classifier. To display a rich set of haptic effects for both static and dynamic gestures, we integrated electromechanical and electrostatic actuation techniques effectively on tabletop surface of HapTable, which is a surface capacitive touch screen. We attached four piezo patches to the edges of tabletop to display vibrotactile feedback for static gestures. For this purpose, the vibration response of the tabletop, in the form of frequency response functions (FRFs), was obtained by a laser Doppler vibrometer for 84 grid points on its surface. Using these FRFs, it is possible to display localized vibrotactile feedback on the surface for static gestures. For dynamic gestures, we utilize the electrostatic actuation technique to modulate the frictional forces between finger skin and tabletop surface by applying voltage to its conductive layer. To our knowledge, this hybrid haptic technology is one of a kind and has not been implemented or tested on a tabletop. It opens up new avenues for gesture-based haptic interaction not only on tabletop surfaces but also on touch surfaces used in mobile devices with potential applications in data visualization, user interfaces, games, entertainment, and education. Here, we present two examples of such applications, one for static and one for dynamic gestures, along with detailed user studies. In the first one, user detects the direction of a virtual flow, such as that of wind or water, by putting their hand on the tabletop surface and feeling a vibrotactile stimulus traveling underneath it. In the second example, user rotates a virtual knob on the tabletop surface to select an item from a menu while feeling the knob's detents and resistance to rotation in the form of frictional haptic feedback.Keywords
All Related Versions
Funding Information
- The Scientific and Technological Research Council of Turkey (114E0003)
This publication has 36 references indexed in Scilit:
- Design and control of a haptic knobSensors and Actuators A: Physical, 2013
- Adding Vibrotactile Feedback to Large Interactive SurfacesLecture Notes in Computer Science, 2013
- Polarity Effect in Electrovibration for Tactile DisplayIEEE Transactions on Biomedical Engineering, 2006
- Hand Gesture Recognition Via a New Self-organized Neural NetworkLecture Notes in Computer Science, 2005
- Thresholds for the perception of hand-transmitted vibration: Dependence on contact area and contact locationSomatosensory & Motor Research, 2005
- A sensing chair using pressure distribution sensorsIEEE/ASME Transactions on Mechatronics, 2001
- Support-vector networksMachine Learning, 1995
- Extracting object properties through haptic explorationActa Psychologica, 1993
- Elliptic Fourier features of a closed contourComputer Graphics and Image Processing, 1982
- Apparent haptic movementPerception & Psychophysics, 1966