KOKay L. O'HAlloran

Kay L. O'HAlloran

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Kay L. O'HAlloran has a total of 23 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Multimodal AI approach to platform hate

    by Kay L. O’HAlloran, Yang Zhang, David Boardman, Konstantin Vikhorev

    A multimodal AI approach for detecting hate speech in social media and online platforms is explored in this study. It integrates AI techniques (Natural Language Processing (NLP), image processing, video processing and moderation models) to analyse multimodal communications across media platforms. The approach is illustrated using an interactive digital platform developed for analysing communications during the COVID-19 pandemic. The platform supports (a) collecting multimedia content from online sources; (b) processing text, images and videos; and (c) visualising results through an interactive dashboard. The findings indicate that publicly available AI tools for hate speech detection, in this case OpenAI moderation models (text-moderation 2023 and omni-moderation 2026) applied to text, OCR-extracted image text and transcribed video audio, are unreliable for identifying hate speech in real-life data. It is proposed that multimodal computational approaches informed by social semiotic theory would improve methods for automated hate speech detection.

  • Multimodal approaches to English for academic purposes

    by Kay L. O'HAlloran, Sabine Tan, Bradley A. Smith

    This chapter explores the implications of a multimodal approach for EAP, which is conceived as academic discourse in the broadest possible sense, involving theoretical and practical approaches to the study of English. From this perspective, the multimodal approach has significance for learning about the nature of academic discourse in the interactions of language with other modalities, in terms of enhancing students’ capacities for understanding and producing texts that employ and integrate a range of modalities, and developing pedagogical practices that facilitate these competencies in different contexts. Furthermore, recent advances in GenAI include large multimodal models (LMMs), such as GPT-4o, which are designed to process and generate combinations of text, images, audio, and videos. The ease with which students can readily access and use GenAI tools has created an environment where there is even greater urgency for critical approaches to multimodality to be integrated into EAP, given the unique challenges in this field, which focus on language and multimodal proficiency in academic contexts.

  • Mapping Polylogical Discourse to Understand (Dis)Information Negotiation

    by Elena Musi, Kay L. O'HAlloran, Elinor Carmi, Michael Humann, Minhao Jin, Simeon Yates, Gautam Pal

    The advent of the Networked Society has revolutionised the way public discourse is shaped and negotiated leading to increased access to both information and (dis)-(mis)information. With the goal of investigating the discursive roots of disinformation in crisis scenarios, we propose a scalable methodology to analyse polylogues where stakeholders (e.g. citizens, journalists, politicians) advance various positions (news claims) across multiple venues (e.g. social media, broadcast media, discussion fora). We apply this framework to the analysis of discourse(s) around the Events Research Programme (ERP) in the United Kingdom aimed at gathering evidence on the reopening of events and venues assessing the risk of SARS-CoV-2 transmission. Through the combination of qualitative (content analysis of survey results) and quantitative methods (topic modelling and sentiment analysis), we compare and contrast discourse(s) around the pilot live events from different stakeholders (UK government, official national and local media, social media users and aspiring participants at the large events) across media outlets (official website, news media outlets, Twitter and questionnaire). Drawing from attested mismatches we provide three main recommendations on how to craft effective public messages in crisis scenarios.

  • Representations of architecture in children's picturebooks in Australia, Singapore and China

    by Sabine Tan, Xinchao Zhai, Lyndon Way, Kay L. O’halloran

    Using an approach inspired by critical multimodal discourse analysis and social semiotics, this chapter examines representations of architecture in children’s picturebooks from three nations in the Asia-Pacific region with diverse cultural backgrounds, physical geographies and histories, namely Australia, Singapore and China. The chapter focuses on the similarities and differences in representations of architectural domains in these books and how the social practices, depicted in various spaces defined through modern architectural design, function to instil core values in relation to the individual, family, community and society. In addition, comparisons with traditional buildings are drawn to examine how the three nations have adjusted to the pressures of modernity. The analysis shows that while the family home is central and clearly demarcated from public spaces in each case, the nature of the depicted spaces and the social activities which take place within them are different for each country. The chapter concludes with the observation that, unlike western European countries which look wistfully back at the past, children’s illustrated books from these nations in the Asia-Pacific region, regardless of their individual differences, have their eyes firmly fixed on the present with aspirations for the future.

  • Top Cited Papers
    Open Access

    Matter, meaning and semiotics

    by Kay L O’halloran

    We inhabit two worlds – the world of matter and the world of meaning (see Halliday, ‘On matter and meaning: The two realms of human experience, 2005). In this article, these two worlds and the physical, biological, social and semiotic systems that connect them are investigated. In this respect, semiotic systems are the most complex because they involve physical systems (the material sign), biological systems (human beings), social systems (society and culture) and meaning itself. Semiotic frameworks need to take into account these various dimensions as changes in one system reverberate across the meta-system as a whole. With this in mind, the interplay between material and semiotic worlds from a social semiotic perspective, are explored with a focus on meaning and its significance in relation to human existence. Using examples from various industrial ages, the article explores how semiotic resources (in this case, in mathematics, science and computer programming languages) are organized to structure reality in specific ways, and how semiotic combinations and the technologies arising from those constructions have changed the course of human history. In this discussion, attention is paid to the role of visual communication, both in terms of visual semiotic resources (e.g. graphs, digital images) and visual aspects of multimodal texts. It thus becomes evident that the functionalities of any one semiotic resource (including language) must be viewed in relation to its collective co-deployment with other semiotic resources. Lastly, the author examines semiosis in the digital age and considers the social implications of the current digital ecosystem. In doing so, she conceptualizes digital technologies as a one-way mirror where members of society use digital media for every facet of their lives while being watched, analysed and manipulated by those who have designed and own the digital platforms. It is apparent that semiotics has a major role to play in terms of design, policymaking and activism around future digital technologies.


  • Open Access

    Phraseology and imagery in UK public health agency COVID-19 tweets

    by David Oakey, Christian Jones, Kay L. O’hAlloran

    This chapter examines linguistic and visual communication in UK public health agency tweets as part of a wider project looking at the effectiveness of public health information about COVID-19 for speakers of English as an additional language (EAL). In this study, we use corpus linguistics and multimodal social semiotic analysis to examine the phraseology and imagery of UK public health agency tweets to understand how linguistic and visual representations combine to shape these messages. Results show that in terms of form, four-word n-grams in this data often overlapped each other or served as part of frames for longer messages. In terms of functions, the n-grams often served to give advice or instructions while presenting this more neutrally as information. Hence the message was often conveyed via implicature rather than directly expressing the intended information and directives. Results also show that the images that were combined with these frequent n-grams tended to be photographs representing members of the public and authority figures, procedural infographics and posters with cartoon images. The text in the tweets appeared at times misaligned with the intended functions of these visual representations, thus affecting the overall effectiveness of the public health communications.