DCDaniel Alcaraz Carrión

Daniel Alcaraz Carrión

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Daniel Alcaraz Carrión has a total of 39 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Enabling AI to Find Multimodal Signals of Storytelling Cross-Culturally: A Multi-Step Approach

    by Anna Bonifazi, Juman Al-Qaoud, Daniel Alcaraz Carrión, Giorgia Crosilla, Sandra Debreslioska, Maria Del Rosario Illan Castillo, Øyvind Eide, Madeleine Frings, Armine Garibyan, Sonja Gipper, et al.

  • Open Access

    MULTIDATA: An Interactive Web Platform for Speech-Gesture Data Extraction and Visualization

    by Raúl Sánchez, Daniel Alcaraz Carrión, Irene Bolumar Martínez, Armine Garibyan, Yassine Iabdounane, Mark Turner, Peter Uhrig, Cristóbal Pagán Cánovas

  • Disambiguating polysemy

    by Irene Bolumar Martínez, Susan Goldin-Meadow, Daniel Alcaraz-Carrión, Javier Valenzuela

    This paper examines whether observers use gestural information to decide the meaning of the polysemous verb touch in ambiguous contexts. To address this question, three studies were carried out. Study 1 tests whether observers could accurately distinguish the meaning of the verb touch just by looking at hand gestures. Study 2 explores which gesture location and handshape combinations are associated with the physical and emotional meanings of touch . Study 3 investigates whether observers decide the meaning of touch faster when they see a co-speech hand gesture and whether reaction time varies depending on the specific gesture combination observed. The main findings illustrate how the modality of gesture helps observers to disambiguate the meaning of a polysemous word such as the verb touch . Thus, this research shows that location and handshape are key components that bias the meaning of touch when the verbal message is ambiguous or absent.

  • Open Access

    A multimodal approach to polysemy: the senses of taste and smell

    by Irene Bolumar Martínez, Daniel Alcaraz-Carrión, Javier Valenzuela

    This study explored whether co-speech gestures and linguistic markers help distinguish between the literal and figurative meanings of taste and smell , building on prior findings related to the verb touch . To determine whether patterns found for touch generalize to additional verbs, we aimed to (1) compare gestures associated with taste and smell , (2) examine the motivation behind frequent gestures associated with taste and smell , and (3) describe the relation between spoken words and the meanings of taste and smell . Gesture analysis showed that while gestures help differentiate the meanings of touch , they do not exhibit distinct patterns between literal and figurative meanings of taste and smell . Linguistic analysis showed that only object quantifiers were frequent when conveying literal meanings of taste and smell . Although negation and verb modifiers were key in distinguishing the meanings of touch , they were not commonly used with either taste or smell .

  • Open Access

    Modeling the Gesture-Speech Relation Through Novel Datasets for Multimodal Signal Analysis

    by Brian Herreño Jiménez, Sánchez Sánchez Raúl, Alcaraz Carrión Daniel, López Bernal Ariadna, Pagán Cánovas Cristóbal

    We present preliminary results of a new methodology to study co-speech gesture in relation to specific linguistic structures. We draw on a large-scale video repository with time-aligned transcripts to build corpora in which the same linguistic expression is uttered by different speakers across multiple clips. We then extract dynamic coordinates of key body points to model their variation in relation with what is being said. In this paper, we present analyses of the distribution of wrist motion in gesture space for a dataset of 379 videos with utterances of 44 deictic time expressions in English (words or phrases pointing at the past, present, or future in relation to a center of temporal reference, e.g. “yesterday/today/tomorrow”). Even overall distributions of wrist positions in peripheral areas of gestural motion turn out to be influenced by these semantic distinctions. More fine-grained models are to be expected from the reconstruction of gestural trajectories, based on the chronological sequence of positions detected in each video. These initial results already suggest that so-called non-verbal behavior is deeply structured and attuned to language, quite beyond our current understanding. Once scaled up, such models have the potential to dramatically change any technologies connected to human communicative behavior.

  • Open Access

    Numbers skyrocket in English but increase in Spanish: metaphoric conceptualization and manner expression in translations

    by Daniel Alcaraz Carrión, Javier Valenzuela, Martha Alibali

    This study investigated the differences in the expression of numerical motion metaphors in English and Spanish. We evaluated 1472 English-to-Spanish translations in which a manner of motion verb (e.g., skyrocket, plummet) was used to metaphorically express numerical change (e.g., unemployment is skyrocketing). For each of the translations, we annotated (1) the type of metaphor used in Spanish, (2) whether the manner of motion and path information was present in Spanish, and (3) whether the path and manner information in Spanish were conflated in a single word or indicated via adjuncts. There were three main findings. First, Spanish translations shifted from the motion domain to a quantity domain in almost half of the translations (e.g., skyrocket translated as aumentar, Eng. increase). Second, Spanish translations omitted manner of motion in half of the cases (e.g., prices surging translated as alza de los precios, Eng. rise in prices). Third, the path of motion was always present in the Spanish translations. This translation analysis provides evidence that the typological differences reported for the encoding of literal motion are also observed in the expression of numerical, metaphorical motion and that the choice of metaphorical mappings depends on language typology.

  • Open Access

    A multimodal approach to polysemy: the senses of touch

    by Irene Bolumar Martínez, Daniel Alcaraz Carrión, Javier Valenzuela Manzanares

    This study investigated whether speakers use multimodal information (speech and gesture) to differentiate the physical and emotional meanings of the polysemous verbtouch.We analyzed 302 hand gestures that co-occurred with this perception verb. For each case, we annotated (1) the meaning oftouch(physical vs. emotional), (2) the gesture referent speakers physically touched (other-touchvs.self-touch), (3) the personal pronoun following the verb and (4) if they used intensifiers and negation. There were three main findings. First, we have seen that when speakers express the physical meaning, they are likely to reach an external referent (other-touch), but when they imply the emotional meaning, they tend to touch their own body (self-touch). Second, the most frequent co-speech gesture (chest-touchinggesture) was associated with the emotional meaning, uncovering the metaphorthe heart is container for emotions. Third, this study showed that the physical meaning oftouchusually coexists with a wide variety of personal pronouns and negation words; in contrast, the emotional meaning oftouchoccurs primarily with the pronounmeand it is usually modified by intensifiers. Thus, speakers use both speech and gesture to differentiate the meanings of the polysemous verbtouch.


  • Open Access

    RETRACTED: English temporal gestures are spatial gestures

    by Javier Valenzuela, Daniel Alcaraz-Carrión

    This article has been retracted by mutual agreement of the author and editors. After some investigation, the authors determined that unintentional error led to the presentation of theoretical conclusions that contradict important findings reported in the article, and it was determined that this could not be resolved with a minor correction.


  • The Red Hen Anonymizer and the Red Hen Protocol for de-identifying audiovisual recordings

    by Yash Khasbage, Daniel Alcaraz Carrión, Jennifer Hinnell, Frankie Robertson, Karan Singla, Peter Uhrig, Mark Turner

    Scientists of multimodal communication have no established policy or default tool for sharing de-identified audiovisual recordings. Recently, new technology has been developed that enables researchers to de-identify voice and appearance. These software tools can produce output in JSON format that specifies bodypose and face and hand keypoints in numerical form, suitable for computer search, machine learning, and sharing. The Red Hen Anonymizer is a new tool for de-identification. This article presents the Red Hen Anonymizer and discusses guidelines for its use.


  • Physical and imaginary landmarks in English time gestures

    by Daniel Alcaraz Carrión

    In this chapter I discuss several creative instances of time co-speech gestures in English obtained from a repository of television news. I argue that, even though time gestures tend to follow certain patterns in their form, speakers may deviate, giving rise to more creative instances with a more complex meaning. The chapter begins with a brief introduction to the relation between speech and gesture, with a focus on temporal cognition, and timelines. Then, I discuss the notion of creativity in gesture research. I analyze five examples of time gestures that fall under three main categories: the ad hoc creation of imaginary timelines, the inclusion of physical items to the time construal and the emotional and pragmatic component of facial gestures.