Perceptual Relevance of Haptic Feedback during Virtual Plucking, Bowing and Rubbing of Physically-Based Musical Resonators
Open Access
Abstract
The physics-based design and realization of a digital musical interface asks for the modeling and implementation of the contact-point interaction with the performer. Musical instruments always include a resonator that converts the input energy into sound, meanwhile feeding part of it back to the performer through the same point. Specifically during plucking or bowing interactions, musicians receive a handful of information from the force feedback and vibrations coming from the contact points. This paper focuses on the design and realization of digital music interfaces realizing two physical interactions along with a musically unconventional one, rubbing, rarely encountered in assimilable forms across the centuries on a few instruments. Therefore, it aims to highlight the significance of haptic rendering in improving quality during a musical experience as opposed to interfaces provided with a passive contact point. Current challenges are posed by the specific requirements of the haptic device, as well as the computational effort needed for realizing such interactions without occurrence during the performance of typical digital artifacts such as latency and model instability. Both are however seemingly transitory due to the constant evolution of computer systems for virtual reality and the progressive popularization of haptic interfaces in the sonic interaction design community. In summary, our results speak in favor of adopting nowadays haptic technologies as an essential component for digital musical interfaces affording point-wise contact interactions in the personal performance space.Keywords
This publication has 26 references indexed in Scilit:
- Influence of vibrotactile feedback on some perceptual features of violinsThe Journal of the Acoustical Society of America, 2014
- Spider King: Virtual musical instruments based on microsoft Kinect2013
- Embodied Music Cognition and Mediation Technology: A critical reviewPsychology of Music, 2013
- Haptic Illusions and Imagined Agency: Felt Resistances in Sonic ExperienceContemporary Music Review, 2013
- Ergotic Sounds: A New Way to Improve Playability, Believability and Presence of Virtual Musical InstrumentsJournal of New Music Research, 2009
- Schizophonic Performance:Guitar Hero, Rock Band, and Virtual VirtuosityJournal of the Society for American Music, 2009
- Virtual Slide GuitarComputer Music Journal, 2008
- A Camera-Based Music-Making Tool for Physical RehabilitationComputer Music Journal, 2007
- Remutualizing the Musical Instrument: Co-Design of Synthesis Algorithms and ControllersJournal of New Music Research, 2004
- Digital Synthesis of Plucked-String and Drum TimbresComputer Music Journal, 1983