Investigating Gesture Typing for Indirect Touch
Open Access
- 9 September 2019
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 3 (3) , 1-22
Abstract
With the development of ubiquitous computing, entering text on HMDs and smart TVs using handheld touchscreen devices (e.g., smartphone and controller) is becoming more and more attractive. In these indirect touch scenarios, the touch input surface is decoupled from the visual display. Compared with direct touch input, entering text using a keyboard in indirect touch is more challenging because before the finger touch, no visual feedback is available for locating the touch finger. Aiming at this problem, in this paper, we investigate the feasibility of gesture typing for indirect touch since keeping the finger in touch with the screen during typing makes it possible to provide continuous visual feedback, which is beneficial for increasing the input performance. We first examine users' gesture typing ability in terms of the appropriate keyboard size and location in motor space and then compare the typing performance in direct and indirect touch mode. We then propose an improved design to address the uncertainty and inaccuracy of the first touch. Our evaluation result shows that users can quickly acquire indirect gesture typing, and type 22.3 words per minute after 30 phases, which significantly outperforms previous numbers in literature. Our work provides the empirical support for leveraging gesture typing for indirect touch.Keywords
Funding Information
- National Key Research and Development Plan (Grant No. 2018YFB1005000)
- Natural Science Foundation of China (Grant No. 61672314, 61572276 and 61521002)
This publication has 57 references indexed in Scilit:
- Performance and User Experience of Touchscreen and Gesture Keyboards in a Lab Setting and in the Wild2015
- Effects of Language Modeling and its Personalization on Touchscreen Typing Performance2015
- How Much Faster is Fast Enough?2015
- An Empirical Investigation Into Text Input Methods for Interactive Digital Television ApplicationsInternational Journal of Human–Computer Interaction, 2014
- Touchware: a software-based technique for high-resolution multi-touch sensing devicesInternational Journal of Ad Hoc and Ubiquitous Computing, 2014
- The word-gesture keyboardCommunications of the ACM, 2012
- Using Effect Size—or Why the P Value Is Not EnoughJournal of Graduate Medical Education, 2012
- A Comparison of Direct and Indirect Multi-touch Input for Large SurfacesLecture Notes in Computer Science, 2009
- Qualitative Descriptors of Strength of Association and Effect SizeJournal of Social Service Research, 1996
- Estimation of probabilities from sparse data for the language model component of a speech recognizerIEEE Transactions on Acoustics, Speech, and Signal Processing, 1987