KeyFlow: Acoustic Motion Sensing for Cursor Control on Any Keyboard
Open Access
- 13 October 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Abstract
Despite typing being a critical operation in the digital age, users still need to frequently switch between the mouse and keyboard while typing. We introduce KeyFlow, a tool that integrates mouse functionality into the keyboard through machine learning, allowing users to glide their fingers across the keyboard surface to move the cursor. The whole process does not press the keys down to differentiate from normal typing and avoid false touches. KeyFlow uses any computer-built-in microphones to capture the acoustic features of these gliding gestures, requiring no specialized equipment and can be set up and tested independently within 5 minutes. Our user research indicates that, compared to traditional keyboard and mouse methods, this system reduces hand movement distance by 78.3%, making the typing experience more focused.Keywords
This publication has 14 references indexed in Scilit:
- SoundCraft2017
- Augmented keyboard2014
- Type-hover-swipe in 96 bytes2014
- SurfaceLink2014
- 6D hands2011
- Quasi-qwerty soft keyboard optimization2010
- Scratch input2008
- Robust computer vision-based detection of pinching for one and two-handed gesture input2006
- Touch&Type2006
- Evaluation of Mouse, Rate-Controlled Isometric Joystick, Step Keys, and Text Keys for Text Selection on a CRTErgonomics, 1978