Daniel Alcaraz Carrión
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Daniel Alcaraz Carrión has a total of 39 co-authors. Here are the top co-authors by number of shared publications:
- Javier Valenzuela
University of Murcia
8 shared publications - Cristóbal Pagán Cánovas
University of Murcia, Murcia, Murcia, Spain
4 shared publications Javier Valenzuela
4 shared publications- Irene Bolumar Martínez
University of Murcia, Murcia, Spain
3 shared publications - Mark Turner
Cognitive Science, Case Western Reserve University, Cleveland, Ohio, USA
3 shared publications - Peter Uhrig
Big Data Linguistics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
3 shared publications
Latest Publications
- Open Access
- 5 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 370-374
Enabling AI to Find Multimodal Signals of Storytelling Cross-Culturally: A Multi-Step Approach
- 5 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 370-374
Open AccessEnabling AI to Find Multimodal Signals of Storytelling Cross-Culturally: A Multi-Step Approach
- Open Access
- 4 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 1458-1461
MULTIDATA: An Interactive Web Platform for Speech-Gesture Data Extraction and Visualization
- 4 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 1458-1461
Open AccessMULTIDATA: An Interactive Web Platform for Speech-Gesture Data Extraction and Visualization
- 13 November 2025
- Published by John Benjamins Publishing Company in Review of Cognitive Linguistics
Disambiguating polysemy
This paper examines whether observers use gestural information to decide the meaning of the polysemous verb touch in ambiguous contexts. To address this question, three studies were carried out. Study 1 tests whether observers could accurately distinguish the meaning of the verb touch just by looking at hand gestures. Study 2 explores which gesture location and handshape combinations are associated with the physical and emotional meanings of touch . Study 3 investigates whether observers decide the meaning of touch faster when they see a co-speech hand gesture and whether reaction time varies depending on the specific gesture combination observed. The main findings illustrate how the modality of gesture helps observers to disambiguate the meaning of a polysemous word such as the verb touch . Thus, this research shows that location and handshape are key components that bias the meaning of touch when the verbal message is ambiguous or absent.
- 13 November 2025
- Published by John Benjamins Publishing Company in Review of Cognitive Linguistics
Disambiguating polysemy
This paper examines whether observers use gestural information to decide the meaning of the polysemous verb touch in ambiguous contexts. To address this question, three studies were carried out. Study 1 tests whether observers could accurately distinguish the meaning of the verb touch just by looking at hand gestures. Study 2 explores which gesture location and handshape combinations are associated with the physical and emotional meanings of touch . Study 3 investigates whether observers decide the meaning of touch faster when they see a co-speech hand gesture and whether reaction time varies depending on the specific gesture combination observed. The main findings illustrate how the modality of gesture helps observers to disambiguate the meaning of a polysemous word such as the verb touch . Thus, this research shows that location and handshape are key components that bias the meaning of touch when the verbal message is ambiguous or absent.
- Open Access
- 1 November 2025
- Published by Walter de Gruyter GmbH in Cognitive Semiotics
- Vol. 18 (2) , 95-121
A multimodal approach to polysemy: the senses of taste and smell
This study explored whether co-speech gestures and linguistic markers help distinguish between the literal and figurative meanings of taste and smell , building on prior findings related to the verb touch . To determine whether patterns found for touch generalize to additional verbs, we aimed to (1) compare gestures associated with taste and smell , (2) examine the motivation behind frequent gestures associated with taste and smell , and (3) describe the relation between spoken words and the meanings of taste and smell . Gesture analysis showed that while gestures help differentiate the meanings of touch , they do not exhibit distinct patterns between literal and figurative meanings of taste and smell . Linguistic analysis showed that only object quantifiers were frequent when conveying literal meanings of taste and smell . Although negation and verb modifiers were key in distinguishing the meanings of touch , they were not commonly used with either taste or smell .
- 1 November 2025
- Published by Walter de Gruyter GmbH in Cognitive Semiotics
- Vol. 18 (2) , 95-121
Open AccessA multimodal approach to polysemy: the senses of taste and smell
This study explored whether co-speech gestures and linguistic markers help distinguish between the literal and figurative meanings of taste and smell , building on prior findings related to the verb touch . To determine whether patterns found for touch generalize to additional verbs, we aimed to (1) compare gestures associated with taste and smell , (2) examine the motivation behind frequent gestures associated with taste and smell , and (3) describe the relation between spoken words and the meanings of taste and smell . Gesture analysis showed that while gestures help differentiate the meanings of touch , they do not exhibit distinct patterns between literal and figurative meanings of taste and smell . Linguistic analysis showed that only object quantifiers were frequent when conveying literal meanings of taste and smell . Although negation and verb modifiers were key in distinguishing the meanings of touch , they were not commonly used with either taste or smell .
- Open Access
- 25 September 2025
- Published by MDPI AG in Preprints.org
Modeling the Gesture-Speech Relation Through Novel Datasets for Multimodal Signal Analysis
We present preliminary results of a new methodology to study co-speech gesture in relation to specific linguistic structures. We draw on a large-scale video repository with time-aligned transcripts to build corpora in which the same linguistic expression is uttered by different speakers across multiple clips. We then extract dynamic coordinates of key body points to model their variation in relation with what is being said. In this paper, we present analyses of the distribution of wrist motion in gesture space for a dataset of 379 videos with utterances of 44 deictic time expressions in English (words or phrases pointing at the past, present, or future in relation to a center of temporal reference, e.g. “yesterday/today/tomorrow”). Even overall distributions of wrist positions in peripheral areas of gestural motion turn out to be influenced by these semantic distinctions. More fine-grained models are to be expected from the reconstruction of gestural trajectories, based on the chronological sequence of positions detected in each video. These initial results already suggest that so-called non-verbal behavior is deeply structured and attuned to language, quite beyond our current understanding. Once scaled up, such models have the potential to dramatically change any technologies connected to human communicative behavior.
- 25 September 2025
- Published by MDPI AG in Preprints.org
Open AccessModeling the Gesture-Speech Relation Through Novel Datasets for Multimodal Signal Analysis
We present preliminary results of a new methodology to study co-speech gesture in relation to specific linguistic structures. We draw on a large-scale video repository with time-aligned transcripts to build corpora in which the same linguistic expression is uttered by different speakers across multiple clips. We then extract dynamic coordinates of key body points to model their variation in relation with what is being said. In this paper, we present analyses of the distribution of wrist motion in gesture space for a dataset of 379 videos with utterances of 44 deictic time expressions in English (words or phrases pointing at the past, present, or future in relation to a center of temporal reference, e.g. “yesterday/today/tomorrow”). Even overall distributions of wrist positions in peripheral areas of gestural motion turn out to be influenced by these semantic distinctions. More fine-grained models are to be expected from the reconstruction of gestural trajectories, based on the chronological sequence of positions detected in each video. These initial results already suggest that so-called non-verbal behavior is deeply structured and attuned to language, quite beyond our current understanding. Once scaled up, such models have the potential to dramatically change any technologies connected to human communicative behavior.
- Open Access
- 20 March 2025
- Published by Cambridge University Press (CUP) in Language and Cognition
- Vol. 17
Numbers skyrocket in English but increase in Spanish: metaphoric conceptualization and manner expression in translations
This study investigated the differences in the expression of numerical motion metaphors in English and Spanish. We evaluated 1472 English-to-Spanish translations in which a manner of motion verb (e.g., skyrocket, plummet) was used to metaphorically express numerical change (e.g., unemployment is skyrocketing). For each of the translations, we annotated (1) the type of metaphor used in Spanish, (2) whether the manner of motion and path information was present in Spanish, and (3) whether the path and manner information in Spanish were conflated in a single word or indicated via adjuncts. There were three main findings. First, Spanish translations shifted from the motion domain to a quantity domain in almost half of the translations (e.g., skyrocket translated as aumentar, Eng. increase). Second, Spanish translations omitted manner of motion in half of the cases (e.g., prices surging translated as alza de los precios, Eng. rise in prices). Third, the path of motion was always present in the Spanish translations. This translation analysis provides evidence that the typological differences reported for the encoding of literal motion are also observed in the expression of numerical, metaphorical motion and that the choice of metaphorical mappings depends on language typology.
- 20 March 2025
- Published by Cambridge University Press (CUP) in Language and Cognition
- Vol. 17
Open AccessNumbers skyrocket in English but increase in Spanish: metaphoric conceptualization and manner expression in translations
This study investigated the differences in the expression of numerical motion metaphors in English and Spanish. We evaluated 1472 English-to-Spanish translations in which a manner of motion verb (e.g., skyrocket, plummet) was used to metaphorically express numerical change (e.g., unemployment is skyrocketing). For each of the translations, we annotated (1) the type of metaphor used in Spanish, (2) whether the manner of motion and path information was present in Spanish, and (3) whether the path and manner information in Spanish were conflated in a single word or indicated via adjuncts. There were three main findings. First, Spanish translations shifted from the motion domain to a quantity domain in almost half of the translations (e.g., skyrocket translated as aumentar, Eng. increase). Second, Spanish translations omitted manner of motion in half of the cases (e.g., prices surging translated as alza de los precios, Eng. rise in prices). Third, the path of motion was always present in the Spanish translations. This translation analysis provides evidence that the typological differences reported for the encoding of literal motion are also observed in the expression of numerical, metaphorical motion and that the choice of metaphorical mappings depends on language typology.
- Open Access
- 23 April 2024
- Published by Cambridge University Press (CUP) in Language and Cognition
- Vol. 16 (4) , 1-21
A multimodal approach to polysemy: the senses of touch
This study investigated whether speakers use multimodal information (speech and gesture) to differentiate the physical and emotional meanings of the polysemous verbtouch.We analyzed 302 hand gestures that co-occurred with this perception verb. For each case, we annotated (1) the meaning oftouch(physical vs. emotional), (2) the gesture referent speakers physically touched (other-touchvs.self-touch), (3) the personal pronoun following the verb and (4) if they used intensifiers and negation. There were three main findings. First, we have seen that when speakers express the physical meaning, they are likely to reach an external referent (other-touch), but when they imply the emotional meaning, they tend to touch their own body (self-touch). Second, the most frequent co-speech gesture (chest-touchinggesture) was associated with the emotional meaning, uncovering the metaphorthe heart is container for emotions. Third, this study showed that the physical meaning oftouchusually coexists with a wide variety of personal pronouns and negation words; in contrast, the emotional meaning oftouchoccurs primarily with the pronounmeand it is usually modified by intensifiers. Thus, speakers use both speech and gesture to differentiate the meanings of the polysemous verbtouch.
- 23 April 2024
- Published by Cambridge University Press (CUP) in Language and Cognition
- Vol. 16 (4) , 1-21
Open AccessA multimodal approach to polysemy: the senses of touch
This study investigated whether speakers use multimodal information (speech and gesture) to differentiate the physical and emotional meanings of the polysemous verbtouch.We analyzed 302 hand gestures that co-occurred with this perception verb. For each case, we annotated (1) the meaning oftouch(physical vs. emotional), (2) the gesture referent speakers physically touched (other-touchvs.self-touch), (3) the personal pronoun following the verb and (4) if they used intensifiers and negation. There were three main findings. First, we have seen that when speakers express the physical meaning, they are likely to reach an external referent (other-touch), but when they imply the emotional meaning, they tend to touch their own body (self-touch). Second, the most frequent co-speech gesture (chest-touchinggesture) was associated with the emotional meaning, uncovering the metaphorthe heart is container for emotions. Third, this study showed that the physical meaning oftouchusually coexists with a wide variety of personal pronouns and negation words; in contrast, the emotional meaning oftouchoccurs primarily with the pronounmeand it is usually modified by intensifiers. Thus, speakers use both speech and gesture to differentiate the meanings of the polysemous verbtouch.
- Open Access
- 9 January 2023
- Published by California Digital Library (CDL) in Glossa Psycholinguistics
- Vol. 2 (1)
RETRACTED: English temporal gestures are spatial gestures
This article has been retracted by mutual agreement of the author and editors. After some investigation, the authors determined that unintentional error led to the presentation of theoretical conclusions that contradict important findings reported in the article, and it was determined that this could not be resolved with a minor correction.
- 9 January 2023
- Published by California Digital Library (CDL) in Glossa Psycholinguistics
- Vol. 2 (1)
Open AccessRETRACTED: English temporal gestures are spatial gestures
This article has been retracted by mutual agreement of the author and editors. After some investigation, the authors determined that unintentional error led to the presentation of theoretical conclusions that contradict important findings reported in the article, and it was determined that this could not be resolved with a minor correction.
- 26 December 2022
- Published by Walter de Gruyter GmbH in Linguistics Vanguard
- Vol. 9 (1) , 229-244
The Red Hen Anonymizer and the Red Hen Protocol for de-identifying audiovisual recordings
Scientists of multimodal communication have no established policy or default tool for sharing de-identified audiovisual recordings. Recently, new technology has been developed that enables researchers to de-identify voice and appearance. These software tools can produce output in JSON format that specifies bodypose and face and hand keypoints in numerical form, suitable for computer search, machine learning, and sharing. The Red Hen Anonymizer is a new tool for de-identification. This article presents the Red Hen Anonymizer and discusses guidelines for its use.
- 26 December 2022
- Published by Walter de Gruyter GmbH in Linguistics Vanguard
- Vol. 9 (1) , 229-244
The Red Hen Anonymizer and the Red Hen Protocol for de-identifying audiovisual recordings
Scientists of multimodal communication have no established policy or default tool for sharing de-identified audiovisual recordings. Recently, new technology has been developed that enables researchers to de-identify voice and appearance. These software tools can produce output in JSON format that specifies bodypose and face and hand keypoints in numerical form, suitable for computer search, machine learning, and sharing. The Red Hen Anonymizer is a new tool for de-identification. This article presents the Red Hen Anonymizer and discusses guidelines for its use.
- 1 November 2022
- Published by John Benjamins Publishing Company
- p. 187-208
Physical and imaginary landmarks in English time gestures
In this chapter I discuss several creative instances of time co-speech gestures in English obtained from a repository of television news. I argue that, even though time gestures tend to follow certain patterns in their form, speakers may deviate, giving rise to more creative instances with a more complex meaning. The chapter begins with a brief introduction to the relation between speech and gesture, with a focus on temporal cognition, and timelines. Then, I discuss the notion of creativity in gesture research. I analyze five examples of time gestures that fall under three main categories: the ad hoc creation of imaginary timelines, the inclusion of physical items to the time construal and the emotional and pragmatic component of facial gestures.
- 1 November 2022
- Published by John Benjamins Publishing Company
- p. 187-208
Physical and imaginary landmarks in English time gestures
In this chapter I discuss several creative instances of time co-speech gestures in English obtained from a repository of television news. I argue that, even though time gestures tend to follow certain patterns in their form, speakers may deviate, giving rise to more creative instances with a more complex meaning. The chapter begins with a brief introduction to the relation between speech and gesture, with a focus on temporal cognition, and timelines. Then, I discuss the notion of creativity in gesture research. I analyze five examples of time gestures that fall under three main categories: the ad hoc creation of imaginary timelines, the inclusion of physical items to the time construal and the emotional and pragmatic component of facial gestures.