Kay L. O'HAlloran
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Kay L. O'HAlloran has a total of 23 co-authors. Here are the top co-authors by number of shared publications:
- Sabine Tan
National University of Singapore
4 shared publications - Elena Musi
University of Liverpool, UK
2 shared publications - Liliane Xavier Neves
Universidade Estadual de Santa Cruz
2 shared publications - Lyndon C. S. Way
University of Liverpool
2 shared publications - Marcelo de Carvalho Borba
Sao Paulo State University
2 shared publications Xinchao Zhai
2 shared publications
Latest Publications
- Open Access
- 27 October 2026
- Published by SAGE Publications in Discourse Studies
Multimodal AI approach to platform hate
A multimodal AI approach for detecting hate speech in social media and online platforms is explored in this study. It integrates AI techniques (Natural Language Processing (NLP), image processing, video processing and moderation models) to analyse multimodal communications across media platforms. The approach is illustrated using an interactive digital platform developed for analysing communications during the COVID-19 pandemic. The platform supports (a) collecting multimedia content from online sources; (b) processing text, images and videos; and (c) visualising results through an interactive dashboard. The findings indicate that publicly available AI tools for hate speech detection, in this case OpenAI moderation models (text-moderation 2023 and omni-moderation 2026) applied to text, OCR-extracted image text and transcribed video audio, are unreliable for identifying hate speech in real-life data. It is proposed that multimodal computational approaches informed by social semiotic theory would improve methods for automated hate speech detection.
- 27 October 2026
- Published by SAGE Publications in Discourse Studies
Open AccessMultimodal AI approach to platform hate
A multimodal AI approach for detecting hate speech in social media and online platforms is explored in this study. It integrates AI techniques (Natural Language Processing (NLP), image processing, video processing and moderation models) to analyse multimodal communications across media platforms. The approach is illustrated using an interactive digital platform developed for analysing communications during the COVID-19 pandemic. The platform supports (a) collecting multimedia content from online sources; (b) processing text, images and videos; and (c) visualising results through an interactive dashboard. The findings indicate that publicly available AI tools for hate speech detection, in this case OpenAI moderation models (text-moderation 2023 and omni-moderation 2026) applied to text, OCR-extracted image text and transcribed video audio, are unreliable for identifying hate speech in real-life data. It is proposed that multimodal computational approaches informed by social semiotic theory would improve methods for automated hate speech detection.
- 24 February 2026
- Published by Taylor & Francis
- p. 274-286
Multimodal approaches to English for academic purposes
This chapter explores the implications of a multimodal approach for EAP, which is conceived as academic discourse in the broadest possible sense, involving theoretical and practical approaches to the study of English. From this perspective, the multimodal approach has significance for learning about the nature of academic discourse in the interactions of language with other modalities, in terms of enhancing students’ capacities for understanding and producing texts that employ and integrate a range of modalities, and developing pedagogical practices that facilitate these competencies in different contexts. Furthermore, recent advances in GenAI include large multimodal models (LMMs), such as GPT-4o, which are designed to process and generate combinations of text, images, audio, and videos. The ease with which students can readily access and use GenAI tools has created an environment where there is even greater urgency for critical approaches to multimodality to be integrated into EAP, given the unique challenges in this field, which focus on language and multimodal proficiency in academic contexts.
- 24 February 2026
- Published by Taylor & Francis
- p. 274-286
Multimodal approaches to English for academic purposes
This chapter explores the implications of a multimodal approach for EAP, which is conceived as academic discourse in the broadest possible sense, involving theoretical and practical approaches to the study of English. From this perspective, the multimodal approach has significance for learning about the nature of academic discourse in the interactions of language with other modalities, in terms of enhancing students’ capacities for understanding and producing texts that employ and integrate a range of modalities, and developing pedagogical practices that facilitate these competencies in different contexts. Furthermore, recent advances in GenAI include large multimodal models (LMMs), such as GPT-4o, which are designed to process and generate combinations of text, images, audio, and videos. The ease with which students can readily access and use GenAI tools has created an environment where there is even greater urgency for critical approaches to multimodality to be integrated into EAP, given the unique challenges in this field, which focus on language and multimodal proficiency in academic contexts.
- Open Access
- 9 September 2025
- Published by Taylor & Francis in Social Semiotics
- p. 1-23
Constructing the prosecution-defense relationship through multimodal positioning: a corpus-based analysis of Chinese courtroom argumentation
- 9 September 2025
- Published by Taylor & Francis in Social Semiotics
- p. 1-23
Open AccessConstructing the prosecution-defense relationship through multimodal positioning: a corpus-based analysis of Chinese courtroom argumentation
- Open Access
- 21 December 2023
- Published by Springer Nature
- p. 245-271
Developing Misinformation Immunity in a Post-Truth World: Human Computer Interaction for Data Literacy
- 21 December 2023
- Published by Springer Nature
- p. 245-271
Open AccessDeveloping Misinformation Immunity in a Post-Truth World: Human Computer Interaction for Data Literacy
- 23 October 2023
- Published by Taylor & Francis
- p. 412-425
Mapping Polylogical Discourse to Understand (Dis)Information Negotiation
The advent of the Networked Society has revolutionised the way public discourse is shaped and negotiated leading to increased access to both information and (dis)-(mis)information. With the goal of investigating the discursive roots of disinformation in crisis scenarios, we propose a scalable methodology to analyse polylogues where stakeholders (e.g. citizens, journalists, politicians) advance various positions (news claims) across multiple venues (e.g. social media, broadcast media, discussion fora). We apply this framework to the analysis of discourse(s) around the Events Research Programme (ERP) in the United Kingdom aimed at gathering evidence on the reopening of events and venues assessing the risk of SARS-CoV-2 transmission. Through the combination of qualitative (content analysis of survey results) and quantitative methods (topic modelling and sentiment analysis), we compare and contrast discourse(s) around the pilot live events from different stakeholders (UK government, official national and local media, social media users and aspiring participants at the large events) across media outlets (official website, news media outlets, Twitter and questionnaire). Drawing from attested mismatches we provide three main recommendations on how to craft effective public messages in crisis scenarios.
- 23 October 2023
- Published by Taylor & Francis
- p. 412-425
Mapping Polylogical Discourse to Understand (Dis)Information Negotiation
The advent of the Networked Society has revolutionised the way public discourse is shaped and negotiated leading to increased access to both information and (dis)-(mis)information. With the goal of investigating the discursive roots of disinformation in crisis scenarios, we propose a scalable methodology to analyse polylogues where stakeholders (e.g. citizens, journalists, politicians) advance various positions (news claims) across multiple venues (e.g. social media, broadcast media, discussion fora). We apply this framework to the analysis of discourse(s) around the Events Research Programme (ERP) in the United Kingdom aimed at gathering evidence on the reopening of events and venues assessing the risk of SARS-CoV-2 transmission. Through the combination of qualitative (content analysis of survey results) and quantitative methods (topic modelling and sentiment analysis), we compare and contrast discourse(s) around the pilot live events from different stakeholders (UK government, official national and local media, social media users and aspiring participants at the large events) across media outlets (official website, news media outlets, Twitter and questionnaire). Drawing from attested mismatches we provide three main recommendations on how to craft effective public messages in crisis scenarios.
- 7 February 2023
- Published by Taylor & Francis
- p. 143-165
Representations of architecture in children's picturebooks in Australia, Singapore and China
Using an approach inspired by critical multimodal discourse analysis and social semiotics, this chapter examines representations of architecture in children’s picturebooks from three nations in the Asia-Pacific region with diverse cultural backgrounds, physical geographies and histories, namely Australia, Singapore and China. The chapter focuses on the similarities and differences in representations of architectural domains in these books and how the social practices, depicted in various spaces defined through modern architectural design, function to instil core values in relation to the individual, family, community and society. In addition, comparisons with traditional buildings are drawn to examine how the three nations have adjusted to the pressures of modernity. The analysis shows that while the family home is central and clearly demarcated from public spaces in each case, the nature of the depicted spaces and the social activities which take place within them are different for each country. The chapter concludes with the observation that, unlike western European countries which look wistfully back at the past, children’s illustrated books from these nations in the Asia-Pacific region, regardless of their individual differences, have their eyes firmly fixed on the present with aspirations for the future.
- 7 February 2023
- Published by Taylor & Francis
- p. 143-165
Representations of architecture in children's picturebooks in Australia, Singapore and China
Using an approach inspired by critical multimodal discourse analysis and social semiotics, this chapter examines representations of architecture in children’s picturebooks from three nations in the Asia-Pacific region with diverse cultural backgrounds, physical geographies and histories, namely Australia, Singapore and China. The chapter focuses on the similarities and differences in representations of architectural domains in these books and how the social practices, depicted in various spaces defined through modern architectural design, function to instil core values in relation to the individual, family, community and society. In addition, comparisons with traditional buildings are drawn to examine how the three nations have adjusted to the pressures of modernity. The analysis shows that while the family home is central and clearly demarcated from public spaces in each case, the nature of the depicted spaces and the social activities which take place within them are different for each country. The chapter concludes with the observation that, unlike western European countries which look wistfully back at the past, children’s illustrated books from these nations in the Asia-Pacific region, regardless of their individual differences, have their eyes firmly fixed on the present with aspirations for the future.
- Top Cited PapersOpen Access
- 10 November 2022
- Published by SAGE Publications in Visual Communication
- Vol. 22 (1) , 174-201
Matter, meaning and semiotics
We inhabit two worlds – the world of matter and the world of meaning (see Halliday, ‘On matter and meaning: The two realms of human experience, 2005). In this article, these two worlds and the physical, biological, social and semiotic systems that connect them are investigated. In this respect, semiotic systems are the most complex because they involve physical systems (the material sign), biological systems (human beings), social systems (society and culture) and meaning itself. Semiotic frameworks need to take into account these various dimensions as changes in one system reverberate across the meta-system as a whole. With this in mind, the interplay between material and semiotic worlds from a social semiotic perspective, are explored with a focus on meaning and its significance in relation to human existence. Using examples from various industrial ages, the article explores how semiotic resources (in this case, in mathematics, science and computer programming languages) are organized to structure reality in specific ways, and how semiotic combinations and the technologies arising from those constructions have changed the course of human history. In this discussion, attention is paid to the role of visual communication, both in terms of visual semiotic resources (e.g. graphs, digital images) and visual aspects of multimodal texts. It thus becomes evident that the functionalities of any one semiotic resource (including language) must be viewed in relation to its collective co-deployment with other semiotic resources. Lastly, the author examines semiosis in the digital age and considers the social implications of the current digital ecosystem. In doing so, she conceptualizes digital technologies as a one-way mirror where members of society use digital media for every facet of their lives while being watched, analysed and manipulated by those who have designed and own the digital platforms. It is apparent that semiotics has a major role to play in terms of design, policymaking and activism around future digital technologies.
- 10 November 2022
- Published by SAGE Publications in Visual Communication
- Vol. 22 (1) , 174-201
Top Cited PapersOpen AccessMatter, meaning and semiotics
We inhabit two worlds – the world of matter and the world of meaning (see Halliday, ‘On matter and meaning: The two realms of human experience, 2005). In this article, these two worlds and the physical, biological, social and semiotic systems that connect them are investigated. In this respect, semiotic systems are the most complex because they involve physical systems (the material sign), biological systems (human beings), social systems (society and culture) and meaning itself. Semiotic frameworks need to take into account these various dimensions as changes in one system reverberate across the meta-system as a whole. With this in mind, the interplay between material and semiotic worlds from a social semiotic perspective, are explored with a focus on meaning and its significance in relation to human existence. Using examples from various industrial ages, the article explores how semiotic resources (in this case, in mathematics, science and computer programming languages) are organized to structure reality in specific ways, and how semiotic combinations and the technologies arising from those constructions have changed the course of human history. In this discussion, attention is paid to the role of visual communication, both in terms of visual semiotic resources (e.g. graphs, digital images) and visual aspects of multimodal texts. It thus becomes evident that the functionalities of any one semiotic resource (including language) must be viewed in relation to its collective co-deployment with other semiotic resources. Lastly, the author examines semiosis in the digital age and considers the social implications of the current digital ecosystem. In doing so, she conceptualizes digital technologies as a one-way mirror where members of society use digital media for every facet of their lives while being watched, analysed and manipulated by those who have designed and own the digital platforms. It is apparent that semiotics has a major role to play in terms of design, policymaking and activism around future digital technologies.
- 1 November 2022
- Published by Springer Nature
- p. 909-938
Multimodality, Systemic Functional-Multimodal Discourse Analysis and Production of Videos in Mathematics Education
- 1 November 2022
- Published by Springer Nature
- p. 909-938
Multimodality, Systemic Functional-Multimodal Discourse Analysis and Production of Videos in Mathematics Education
- Open Access
- 30 September 2022
- Published by Taylor & Francis
- p. 89-114
Phraseology and imagery in UK public health agency COVID-19 tweets
This chapter examines linguistic and visual communication in UK public health agency tweets as part of a wider project looking at the effectiveness of public health information about COVID-19 for speakers of English as an additional language (EAL). In this study, we use corpus linguistics and multimodal social semiotic analysis to examine the phraseology and imagery of UK public health agency tweets to understand how linguistic and visual representations combine to shape these messages. Results show that in terms of form, four-word n-grams in this data often overlapped each other or served as part of frames for longer messages. In terms of functions, the n-grams often served to give advice or instructions while presenting this more neutrally as information. Hence the message was often conveyed via implicature rather than directly expressing the intended information and directives. Results also show that the images that were combined with these frequent n-grams tended to be photographs representing members of the public and authority figures, procedural infographics and posters with cartoon images. The text in the tweets appeared at times misaligned with the intended functions of these visual representations, thus affecting the overall effectiveness of the public health communications.
- 30 September 2022
- Published by Taylor & Francis
- p. 89-114
Open AccessPhraseology and imagery in UK public health agency COVID-19 tweets
This chapter examines linguistic and visual communication in UK public health agency tweets as part of a wider project looking at the effectiveness of public health information about COVID-19 for speakers of English as an additional language (EAL). In this study, we use corpus linguistics and multimodal social semiotic analysis to examine the phraseology and imagery of UK public health agency tweets to understand how linguistic and visual representations combine to shape these messages. Results show that in terms of form, four-word n-grams in this data often overlapped each other or served as part of frames for longer messages. In terms of functions, the n-grams often served to give advice or instructions while presenting this more neutrally as information. Hence the message was often conveyed via implicature rather than directly expressing the intended information and directives. Results also show that the images that were combined with these frequent n-grams tended to be photographs representing members of the public and authority figures, procedural infographics and posters with cartoon images. The text in the tweets appeared at times misaligned with the intended functions of these visual representations, thus affecting the overall effectiveness of the public health communications.
- 10 December 2021
- Published by Springer Nature
- p. 1-30
Multimodality, Systemic Functional-Multimodal Discourse Analysis and Production of Videos in Mathematics Education
- 10 December 2021
- Published by Springer Nature
- p. 1-30
Multimodality, Systemic Functional-Multimodal Discourse Analysis and Production of Videos in Mathematics Education