ACAlfonso Perez Carrillo

Alfonso Perez Carrillo

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Alfonso Perez Carrillo has a total of 36 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Finger-String Interaction Analysis in Guitar Playing With Optical Motion Capture

    by Alfonso Perez-Carrillo

    We present a method for the analysis of the finger-string interaction in guitar performances and the computation of fine actions during the plucking gesture. The method is based on Motion Capture using high-speed cameras that can track the position of reflective markers placed on the guitar and fingers, in combination with audio analysis. A major problem inherent in optical motion capture is that of marker occlusion and, in guitar playing, it is the right hand of the guitarist that is extremely difficult to capture, especially during the plucking process, where the track of the markers at the fingertips is lost very frequently. This work presents two models that allow the reconstruction of the position of occluded markers: a rigid-body model to track the motion of the guitar strings and a flexible-body model to track the motion of the hands. In combination with audio analysis (onset and pitch detection), the method can estimate a comprehensive set of sound control features that include the plucked string, the plucking finger, and the characteristics of the plucking gesture in the phases of contact, pressure and release (e.g., position, timing, velocity, direction, or string displacement).


  • Enriched Multimodal Representations of Music Performances: Online Access and Visualization

    by Esteban Maestre, Panagiotis Papiotis, Marco Marchini, Quim Llimona, Oscar Mayor, Alfonso Perez, Marcelo M. Wanderley

    The authors provide a first-person outlook on the technical challenges involved in the recording, analysis, archiving, and cloud-based interchange of multimodal string quartet performance data as part of a collaborative research project on ensemble music making. To facilitate the sharing of their own collection of multimodal recordings and extracted descriptors and annotations, they developed a hosting platform through which multimodal data (audio, video, motion capture, and derived signals) can be stored, visualized, annotated, and selectively retrieved via a web interface and a dedicated API. This article offers a twofold contribution: the authors open their collection of enriched multimodal recordings, the Quartet dataset, to the community, and they introduce and enable access to their multimodal data exchange platform and web application, the Repovizz system. This article is part of a special issue on multimedia technologies for enriched music.


  • Statistical models for the indirect acquisition of violin bowing controls from audio analysis

    by Alfonso Perez-Carrillo

    Acoustical studies of sound production in bowed string instruments show that there is a direct relationship between bowing controls and the sound produced. During note sustains the three major bowing parameters that determine the characteristics of the sound are the bowing force (bforce), the bowing distance to the bridge (bbd) and the bowing velocity (bvel). During note attacks the third parameter is acceleration (bacc) rather than velocity. We are interested in understanding this correspondence between bowing controls and sound but in the opposite direction, i.e., mapping sound features extracted from an audio recording to the original bowing controls used. This inverse process is usually called indirect acquisition of gestures and is of great interest in different fields ranging from acoustics and sound synthesis to motor learning or augmented performances. Indirect acquisition is based on the processing of the audio signal and it is usually informed on acoustical or physical properties of the sound or sound production mechanism. In this paper, we present indirect acquisition methods of violin controls from an audio signal based on training of statistical models with a database of multimodal data (control and sound) from violin performances.

  • The Mobile Audio Ontology: Experiencing Dynamic Music Objects on Mobile Devices

    by Florian Thalmann, Alfonso Perez Carrillo, Gyorgy Fazekas, Geraint A. Wiggins, Mark Sandler

    This paper is about the Mobile Audio Ontology, a semantic audio framework for the design of novel music consumption experiences on mobile devices. The framework is based on the concept of the Dynamic Music Object which is an amalgamation of audio files, structural and analytical information extracted from the audio, and information about how it should be rendered in realtime. The Mobile Audio Ontology allows producers and distributors to specify a great variety of ways of playing back music in controlled indeterministic as well as adaptive and interactive ways. Users can map mobile sensor data, user interface controls, or autonomous control units hidden from the listener to any musical parameter exposed in the definition of a Dynamic Music Object. These mappings can also be made dependent on semantic and analytical information extracted from the audio.


  • Statistical models for the indirect acquisition of violin bowing controls from audio analysis

    by Alfonso Perez-Carrillo

    Acoustical studies of sound production in bowed string instruments show that there is a close relationship between bowing controls and the sound produced. During note sustains the three major bowing parameters that determine the characteristics of the sound are the bowing force (bforce), the bowing distance to the bridge (bbd) and the bowing velocity (bvel). During note attacks the third parameter is acceleration (bacc) rather than velocity. We are interested in understanding this correspondence between bowing controls and sound but in the opposite direction, i.e., mapping sound features extracted from an audio recording to the original bowing controls used. This inverse process is usually called indirect acquisition of gestures and is of great interest in different fields ranging from acoustics and sound synthesis to motor learning or augmented performances. Indirect acquisition is based on the processing of the audio signal and it is usually informed on acoustical or physical properties of the production mechanism. In this paper, we present indirect acquisition methods of violin bowing controls from an audio signal based on training of statistical models with a database of multimodal data (bowing controls and sound features) of violin performances.


  • Non-impulsive signal deconvolution for computation of violin sound radiation patterns and applications in sound synthesis

    by Alfonso Perez Carrillo, Jordi Bonada, Vesa Valimaki, Andres Bucci, Jukka Patynen

    This work presents a method to compute violin body impulse responses (BIR) based on deconvolution of non-impulsive signals. This newly conceived approach is based on a frame-weighted deconvolution of excitation and response signals. The excitation, consisting of bowed glissandi, is measured with piezoelectric transducers built into the violin bridge and the response is measured as sound pressure with microphones. Based on this method, several research works have been carried out in the areas of acoustics and sound synthesis. First, by placing multiple microphones at different angles around the violin, we were able to compute a dense grid of 3D sound radiation patterns without restrictions in the frequency range. Second, the computed BIRs can be convolved with a source signal (captured with the same bridge-transducer and using the same violin), obtaining a highly realistic violin sound very similar to that of a microphone recording. The multiple impulse responses at different directions make has been used to enhance sound synthesis with spatialization effects. Finally, a bowing machine was built to perform repeatable glissandi and therefore be able to compute BIRs across different violins. The bowing machine has been used to compute cross-BIRs that map the pickup signal of electric violins to the radiated acoustic sound of acoustic violins, which allows to imitate the sound of any measured acoustic violin with an electric counterpart.

  • Indirect Acquisition of Violin Instrumental Controls from Audio Signal with Hidden Markov Models

    by Alfonso Perez-Carrillo, Marcelo M. Wanderley

    Acquisition of instrumental gestures in musical performances is a field of increasing interest with applications in different areas ranging from acoustics and sound synthesis to motor learning or artistic performances. Direct acquisition approaches are based on measurements with sensors attached on the instrument or the performer, a process that usually involves the use of expensive sensing systems and complex setups that are generally intrusive in practice. An alternative is the indirect acquisition without sensors based on analysis of the audio signal. This paper reports a novel indirect acquisition method for the estimation of continuous violin controls from audio-signal analysis based on the training of statistical models with a database of previously recorded violin performances. The database contains synchronized streams of audio features and instrumental controls. Audio signal was captured with a vibration transducer built into the violin bridge, and instrumental controls were measured with sensors. The controls include bowing parameters (played string, bowing velocity, bowing force, and bowing distance to the bridge) as well as fingering position. Once the model is trained for a specific violin, we can perform indirect acquisition from analysis of the signal captured with its embedded transducer without the need for the sensors any more. The statistical methods used are Hidden Markov Models (HMM) with observation distributions parameterized as Multivariate Gaussian Mixtures (GM). HMMs provide a means for note recognition and following and parameter prediction is based on GM regression. Results show that the presented method constitutes an accurate, non-intrusive and low-cost alternative for instrumental control acquisition of a previously calibrated violin and recording device.


  • Open Access

    Measuring ensemble interdependence in a string quartet through analysis of multidimensional performance data

    by Panos Papiotis, Marco Marchini, Alfonso Perez-Carrillo, Esteban Maestre

    In a musical ensemble such as a string quartet, the musicians interact and influence each other’s actions in several aspects of the performance simultaneously in order to achieve a common aesthetic goal. In this article, we present and evaluate a computational approach for measuring the degree to which these interactions exist in a given performance. We recorded a number of string quartet exercises under two experimental conditions (solo and ensemble), acquiring both audio and bowing motion data. Numerical features in the form of time series were extracted from the data as performance descriptors representative of four distinct dimensions of the performance: Intonation, Dynamics, Timbre and Tempo. Four different interdependence estimation methods (two linear and two nonlinear) were applied to the extracted features in order to assess the overall level of interdependence between the four musicians. The obtained results suggest that it is possible to correctly discriminate between the two experimental conditions by quantifying interdependence between the musicians in each of the studied performance dimensions; the nonlinear methods appear to perform best for most of the numerical features tested. Moreover, by using the solo recordings as a reference to which the ensemble recordings are contrasted, it is feasible to compare the amount of interdependence that is established between the musicians in a given performance dimension across all exercises, and relate the results to the underlying goal of the exercise. We discuss our findings in the context of ensemble performance research, the current limitations of our approach, and the ways in which it can be expanded and consolidated.