MIME

Authors:

Abstract
Mid-air gestures are initial hand poses with a subsequent movement. Existing gesture guides reveal this dynamic part of a gesture. Initial poses, however, are either revealed by space-consuming cheat sheets or time-consuming demonstration videos. Mime is a novel interaction concept that (1) reveals how to form complex hand poses and (2) teaches pose-command mappings: Mime reduces hand poses to space-efficient line figures that users mime with their hands; these abstract lines are embedded into command icons or names to create a mnemonic. We present several applications of the Mime concept, and implemented a prototype based on mid-air back-of-device interaction on off-the-shelf mobile phones. We compared both mnemonics, iconic and textual, to a baseline without embedding to test learnability and memorability of a 12-item vocabulary. Users in the iconic condition required significantly less training than both other conditions and recalled significantly more items after one week compared to the no-cue baseline.