Sketches vs skeletons
Authors:
Open Access
- 14 August 2015
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 104-111
Abstract
Good posture is vital to successful musical performance and music teachers spend a considerable amount of effort on improving their students' posture. This paper presents a user study to evaluate a skeletal motion capture system (based on the Microsoft Kinect™) for supporting teachers as they give feedback to learners about their posture and movement whilst playing an instrument. The study identified a number of problems with skeletal motion capture that are likely to make it unsuitable for this type of feedback: glitches in the capture reduce trust in the system, particularly as the motion data is removed from other contextual cues that could help judge whether it is correct or not; automated feedback can fail to account for the diversity of playing styles required by learners of different physical proportions, and most importantly, the skeleton representation leaves out many cues that are required to detect posture problems in all but the most elementary beginners. The study also included a participatory design stage which resulted in a radically redesigned prototype, which replaced skeletal motion capture with an interface that allows teachers and learners to sketch on video with the support of computer vision tracking.Keywords
Funding Information
- EPSRC (EP/H02977X/1)
This publication has 15 references indexed in Scilit:
- Embracing calibration in body sensing2013
- Real-time annotation of video objects on tablet computers2012
- The choreographer's notebook2011
- Continuous Realtime Gesture Following and RecognitionLecture Notes in Computer Science, 2010
- Watch-and-comment as a paradigm toward ubiquitous interactive video editingACM Transactions on Multimedia Computing, Communications, and Applications, 2008
- 3d augmented mirror2007
- DeFT: A conceptual framework for considering learning with multiple representationsLearning and Instruction, 2006
- Motor training as treatment in focal hand dystoniaMovement Disorders, 2005
- Fluid interaction techniques for the control and annotation of digital video2003
- Technology probes2003