Andrew Johnston
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Andrew Johnston has a total of 45 co-authors. Here are the top co-authors by number of shared publications:
- Ahmet Baki Kocaballi
University of Technology Sydney
2 shared publications - Andrew Bluff
Faculty of Transdisciplinary Innovation, University of Technology Sydney Animal Logic Academy, Sydney, New South Wales, Australia
2 shared publications Benjamin Marks
Creativity & Cognition Studios, Australasian CRC for Interaction Design, Faculty of Information Technology, University of Technology Sydney, Broadway, NSW, 2007, Australia.
2 shared publications- Chng Wei Lau
Western Sydney University
2 shared publications Chris S. Johnson
2 shared publications- Daniel Robin Catchpoole
Biomedical Research, Children's Cancer Research Unit, Kids Research, Sydney Children's Hospital Network, Westmead, NSW, Australia
2 shared publications
Latest Publications
- Open Access
- 28 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 567-577
Game-based Augmented Reality Mobile Application for Enhancing Primary School Students’ Collaborative Learning in English as a Foreign Language in Cambodia
- 28 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 567-577
Open AccessGame-based Augmented Reality Mobile Application for Enhancing Primary School Students’ Collaborative Learning in English as a Foreign Language in Cambodia
- Open Access
- 10 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 439-441
Expanding Creative Interaction: Toward a Modular Toolkit for Audio-Visual Composition and Augmented Performance
- 10 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 439-441
Open AccessExpanding Creative Interaction: Toward a Modular Toolkit for Audio-Visual Composition and Augmented Performance
- Open Access
- 30 April 2025
- Published by Wiley in Human Factors and Ergonomics in Manufacturing & Service Industries
- Vol. 35 (3)
Co‐Designing the Sound of Safety: Embracing Complexity in the Acoustic Vehicle Alerting System Sound for Zero Emission Buses
Around the world, transport organizations are transitioning their bus fleets from internal combustion engines to electrified zero emission buses (ZEBs). The quiet nature of these buses raises safety concerns for vulnerable road users. To address these concerns, new standards mandate that electric vehicles, including ZEBs, be equipped with an acoustic vehicle alerting system (AVAS) emitting sound at low speeds, to make vehicles more detectable. However, developing an effective AVAS sound requires balancing safety and technical constraints with diverse stakeholder needs. Using codesign, this study conducted a series of risk‐focused subject matter expertize workshops (n = 15), and a large user‐experience focused participatory design workshop (n = 41) to inform the AVAS sound design. The latter included empathy and user journey mapping techniques, facilitating the collection of insights from various perspectives. Results revealed stakeholder preferences for an AVAS sound that was both alerting and positive, and embodied qualities like calmness, politeness, and vibrancy. The workshops allowed for refinement of sound design requirements, although challenges emerged in balancing conflicting preferences and managing technical limitations to create a sound that could be both perceptible and nonintrusive. This study provides a framework for the development of an AVAS sound that could capture a range of stakeholder needs and preferences and lays a foundation for AVAS sounds that enhance safety while being positively received. It highlights the importance of inclusive, iterative design in advancing public transport safety and sustainability, with outcomes supporting the future sound design, testing, and implementation.
- 30 April 2025
- Published by Wiley in Human Factors and Ergonomics in Manufacturing & Service Industries
- Vol. 35 (3)
Open AccessCo‐Designing the Sound of Safety: Embracing Complexity in the Acoustic Vehicle Alerting System Sound for Zero Emission Buses
Around the world, transport organizations are transitioning their bus fleets from internal combustion engines to electrified zero emission buses (ZEBs). The quiet nature of these buses raises safety concerns for vulnerable road users. To address these concerns, new standards mandate that electric vehicles, including ZEBs, be equipped with an acoustic vehicle alerting system (AVAS) emitting sound at low speeds, to make vehicles more detectable. However, developing an effective AVAS sound requires balancing safety and technical constraints with diverse stakeholder needs. Using codesign, this study conducted a series of risk‐focused subject matter expertize workshops (n = 15), and a large user‐experience focused participatory design workshop (n = 41) to inform the AVAS sound design. The latter included empathy and user journey mapping techniques, facilitating the collection of insights from various perspectives. Results revealed stakeholder preferences for an AVAS sound that was both alerting and positive, and embodied qualities like calmness, politeness, and vibrancy. The workshops allowed for refinement of sound design requirements, although challenges emerged in balancing conflicting preferences and managing technical limitations to create a sound that could be both perceptible and nonintrusive. This study provides a framework for the development of an AVAS sound that could capture a range of stakeholder needs and preferences and lays a foundation for AVAS sounds that enhance safety while being positively received. It highlights the importance of inclusive, iterative design in advancing public transport safety and sustainability, with outcomes supporting the future sound design, testing, and implementation.
- 16 October 2024
- Published by Audio Engineering Society in Journal of the Audio Engineering Society
- Vol. 72 (10) , 630-649
Audio’s Impact on Immersive Experience in Extended Reality and Digital Games: A Systematic Review
Extended reality and digital games strive to deliver a high level of “immersion,” a complex phenomenon influenced by both perceptual and psychological factors. Audio plays a crucial role in shaping immersive experiences, yet there is no clear consensus on its impact or on the best methods to evaluate it. This paper presents a systematic literature review spanning two decades, outlining the methods and findings related to how audio influences immersion in extended reality and digital games. It reveals a strong preference for experiments using virtual reality headsets and headphones and notes a gap in research on augmented and mixed reality environments. Moreover, it underscores the need for audio-specific metrics to better assess the ways that audio variables impact immersion. The findings demonstrate that audio elements like spatial fidelity, music, and the integration of sound in multimodal environments generally contribute to the immersive experience but also highlight a threshold beyond which further enhancements may not perceptibly improve the experience. It emphasizes the need for realtime, objective measures of immersion as well as the consideration of diverse methodological approaches to deepen the understanding of audio’s role in immersive technologies.
- 16 October 2024
- Published by Audio Engineering Society in Journal of the Audio Engineering Society
- Vol. 72 (10) , 630-649
Audio’s Impact on Immersive Experience in Extended Reality and Digital Games: A Systematic Review
Extended reality and digital games strive to deliver a high level of “immersion,” a complex phenomenon influenced by both perceptual and psychological factors. Audio plays a crucial role in shaping immersive experiences, yet there is no clear consensus on its impact or on the best methods to evaluate it. This paper presents a systematic literature review spanning two decades, outlining the methods and findings related to how audio influences immersion in extended reality and digital games. It reveals a strong preference for experiments using virtual reality headsets and headphones and notes a gap in research on augmented and mixed reality environments. Moreover, it underscores the need for audio-specific metrics to better assess the ways that audio variables impact immersion. The findings demonstrate that audio elements like spatial fidelity, music, and the integration of sound in multimodal environments generally contribute to the immersive experience but also highlight a threshold beyond which further enhancements may not perceptibly improve the experience. It emphasizes the need for realtime, objective measures of immersion as well as the consideration of diverse methodological approaches to deepen the understanding of audio’s role in immersive technologies.
- Open Access
- 18 September 2024
- Published by Association for Computing Machinery (ACM)
- p. 174-180
Aural Architects: Exploring Professional Practice in Videogame Audio
The videogame medium is young and rapidly evolving, and many areas of videogame audio practice are under explored. This project utilises qualitative semi-structured interviews with current industry professionals as a means of uncovering and comparing approaches to the creation of immersive videogame audio, with a focus on game mixing approaches, compositional approaches, and the effect of middleware and game audio creation tools on audio outcomes. The findings from this research contribute to understanding the creative processes used in the creation of videogame audio and identify implications for practitioners. The interviews highlighted many trends in game audio, including the increasing multi-disciplinary nature of the industry, the pervasiveness of audio middleware, the broadening of the game composer role, how audio mixing techniques differ from other mediums, practitioner perspectives on immersion in videogames, and the influence that game audio tools have on audio outcomes.
- 18 September 2024
- Published by Association for Computing Machinery (ACM)
- p. 174-180
Open AccessAural Architects: Exploring Professional Practice in Videogame Audio
The videogame medium is young and rapidly evolving, and many areas of videogame audio practice are under explored. This project utilises qualitative semi-structured interviews with current industry professionals as a means of uncovering and comparing approaches to the creation of immersive videogame audio, with a focus on game mixing approaches, compositional approaches, and the effect of middleware and game audio creation tools on audio outcomes. The findings from this research contribute to understanding the creative processes used in the creation of videogame audio and identify implications for practitioners. The interviews highlighted many trends in game audio, including the increasing multi-disciplinary nature of the industry, the pervasiveness of audio middleware, the broadening of the game composer role, how audio mixing techniques differ from other mediums, practitioner perspectives on immersion in videogames, and the influence that game audio tools have on audio outcomes.
- Open Access
- 18 September 2024
- Published by Association for Computing Machinery (ACM)
- p. 373-384
Keeping your ears on the virtual ground: Expert insights on virtual reality audio techniques and challenges
Virtual reality (VR) audio practitioners navigate interdisciplinary spatial design decisions alongside complex interactive audio systems, resulting in novel solutions to creating immersive experiences in VR environments. Previous work has attempted to uncover these unique practitioner challenges through case studies, however direct insights from a range of VR audio professionals may provide a new understanding of how these challenges are being solved. This study employs semi-structured interviews with twelve participants identified as leading practitioners in the field to reveal several key findings on VR audio creative practice, with a focus on Head Mounted Display (HMD) content. The results aim to serve as a valuable resource for audio professionals and researchers to understand the current challenges faced by leading experts in the field. Key findings highlight the necessity for flexible design approaches due to the diverse range of VR applications, the importance of strategic audio placement and scale for immersion, and the need for highly dynamic sound object behavior to create realistic soundscapes. The difficulty of mixing audio in VR and the limitations of current tools emphasize the need for integrated and comprehensive solutions, as well as efficient auralization tools for enhancing the quality and immersive potential of VR audio production.
- 18 September 2024
- Published by Association for Computing Machinery (ACM)
- p. 373-384
Open AccessKeeping your ears on the virtual ground: Expert insights on virtual reality audio techniques and challenges
Virtual reality (VR) audio practitioners navigate interdisciplinary spatial design decisions alongside complex interactive audio systems, resulting in novel solutions to creating immersive experiences in VR environments. Previous work has attempted to uncover these unique practitioner challenges through case studies, however direct insights from a range of VR audio professionals may provide a new understanding of how these challenges are being solved. This study employs semi-structured interviews with twelve participants identified as leading practitioners in the field to reveal several key findings on VR audio creative practice, with a focus on Head Mounted Display (HMD) content. The results aim to serve as a valuable resource for audio professionals and researchers to understand the current challenges faced by leading experts in the field. Key findings highlight the necessity for flexible design approaches due to the diverse range of VR applications, the importance of strategic audio placement and scale for immersion, and the need for highly dynamic sound object behavior to create realistic soundscapes. The difficulty of mixing audio in VR and the limitations of current tools emphasize the need for integrated and comprehensive solutions, as well as efficient auralization tools for enhancing the quality and immersive potential of VR audio production.
- Open Access
- 30 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Message Bank
Message Bank is a performance made for audiences observing and navigating a public square. The performance tells the story of Charlie who, tasked with the mission of solving a small-scale crime, encounters an unidentified agent with the alias of ‘Dancing Bear.’ The audience takes on the role of Charlie and is asked to choose between the promise of safety with a state-based surveillance agency or the potential for disruption with a radical libertarian collective. Message Bank premiered in Parramatta Square as part of Sydney Festival 2023. The Sydney Festival season is referred to here as the first iteration of the performance and can be framed in the context of digital theatre [1], digital performance [2], and locative media [3]. Early examples of creative practice in this area include Teri Rueb's Trace, (1999) [4], Blast Theory's, Riderspoke, (2007) [5] and RATS Theatre's Maryam (2013) by Rebecca Forsberg [6]. More recently and locally to Australia; Leah Barclay's WIRA (2015) [7] offered audiences a geolocated audio walk along the Noosa River, Claudia Chidiac's The Village by the Kids (2022) [7] provided a neighborhood storytelling tour co-created with young people living in Bondi and Malthouse Theatre's Hour of the Wolf (2023) [9] used FM transmission to facilitate an immersive multi-room murder mystery within the interior of a theatre. The form of these works’ ranges from installation to digital performance and digital theatre but each are similar in their attempts to make meaning between place, story and an audience in motion. Message Bank builds on the practice-based knowledge generated through these works and contributes further insights to how they might enliven public spaces. The use of the term enlivening here is inspired by Auslander's work on liveness [6] as it relates to spontaneity, community, feedback, and presence. The Message Bank team consists of a director / researcher, two additional writers, a digital artist, designer, composer, outside eye, production observer, creative producer, and actors. The team collaborated intermittently over a period of five months in which the project was conceived, workshopped, drafted through script and application development, recorded as audio and video extracts, and tested through prototypes. Discoveries from the first iteration in the areas of motion, interaction, co-present audiences, and the role of time have fed into further development of the performance leading to the second iteration of Message Bank presented at MOCO. This second iteration maintains the vision while further exploring the performances capacity for linking audiences together through handheld devices and a mix of real-time spatiotemporal data to enliven public squares. Working between digital theatre, digital performance, and locative media the creative team is engaged in an ongoing process of iteration that mixes dramaturgy and technical experimentation. This manifests through the ongoing development of Message Bank's narrative and the design of the accompanying software which facilitates the experience. The second iteration presented at MOCO has a specific focus on how the performance binds co-present audiences both intended and unintended as well as how it connects motion data to the revelation of story beats.
- 30 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Open AccessMessage Bank
Message Bank is a performance made for audiences observing and navigating a public square. The performance tells the story of Charlie who, tasked with the mission of solving a small-scale crime, encounters an unidentified agent with the alias of ‘Dancing Bear.’ The audience takes on the role of Charlie and is asked to choose between the promise of safety with a state-based surveillance agency or the potential for disruption with a radical libertarian collective. Message Bank premiered in Parramatta Square as part of Sydney Festival 2023. The Sydney Festival season is referred to here as the first iteration of the performance and can be framed in the context of digital theatre [1], digital performance [2], and locative media [3]. Early examples of creative practice in this area include Teri Rueb's Trace, (1999) [4], Blast Theory's, Riderspoke, (2007) [5] and RATS Theatre's Maryam (2013) by Rebecca Forsberg [6]. More recently and locally to Australia; Leah Barclay's WIRA (2015) [7] offered audiences a geolocated audio walk along the Noosa River, Claudia Chidiac's The Village by the Kids (2022) [7] provided a neighborhood storytelling tour co-created with young people living in Bondi and Malthouse Theatre's Hour of the Wolf (2023) [9] used FM transmission to facilitate an immersive multi-room murder mystery within the interior of a theatre. The form of these works’ ranges from installation to digital performance and digital theatre but each are similar in their attempts to make meaning between place, story and an audience in motion. Message Bank builds on the practice-based knowledge generated through these works and contributes further insights to how they might enliven public spaces. The use of the term enlivening here is inspired by Auslander's work on liveness [6] as it relates to spontaneity, community, feedback, and presence. The Message Bank team consists of a director / researcher, two additional writers, a digital artist, designer, composer, outside eye, production observer, creative producer, and actors. The team collaborated intermittently over a period of five months in which the project was conceived, workshopped, drafted through script and application development, recorded as audio and video extracts, and tested through prototypes. Discoveries from the first iteration in the areas of motion, interaction, co-present audiences, and the role of time have fed into further development of the performance leading to the second iteration of Message Bank presented at MOCO. This second iteration maintains the vision while further exploring the performances capacity for linking audiences together through handheld devices and a mix of real-time spatiotemporal data to enliven public squares. Working between digital theatre, digital performance, and locative media the creative team is engaged in an ongoing process of iteration that mixes dramaturgy and technical experimentation. This manifests through the ongoing development of Message Bank's narrative and the design of the accompanying software which facilitates the experience. The second iteration presented at MOCO has a specific focus on how the performance binds co-present audiences both intended and unintended as well as how it connects motion data to the revelation of story beats.
- Open Access
- 20 December 2023
- Published by Springer Nature in BMC Medical Informatics and Decision Making
- Vol. 23 (1) , 1-15
Understanding cancer patient cohorts in virtual reality environment for better clinical decisions: a usability study
Background: Visualising patient genomic data in a cohort with embedding data analytics models can provide relevant and sensible patient comparisons to assist a clinician with treatment decisions. As immersive technology is actively used around the medical world, there is a rising demand for an efficient environment that can effectively display genomic data visualisations on immersive devices such as a Virtual Reality (VR) environment. The VR technology will allow clinicians, biologists, and computer scientists to explore a cohort of individual patients within the 3D environment. However, demonstrating the feasibility of the VR prototype needs domain users’ feedback for future user-centred design and a better cognitive model of human–computer interactions. There is limited research work for collecting and integrating domain knowledge into the prototype design. Objective: A usability study for the VR prototype–-Virtual Reality to Observe Oncology data Models (VROOM) was implemented. VROOM was designed based on a preliminary study among medical users. The goals of this usability study included establishing a baseline of user experience, validating user performance measures, and identifying potential design improvements that are to be addressed to improve efficiency, functionality, and end-user satisfaction. Methods: The study was conducted with a group of domain users (10 males, 10 females) with portable VR devices and camera equipment. These domain users included medical users such as clinicians and genetic scientists and computing domain users such as bioinformatics and data analysts. Users were asked to complete routine tasks based on a clinical scenario. Sessions were recorded and analysed to identify potential areas for improvement to the data visual analytics projects in the VR environment. The one-hour usability study included learning VR interaction gestures, running visual analytics tool, and collecting before and after feedback. The feedback was analysed with different methods to measure effectiveness. The statistical method Mann–Whitney U test was used to analyse various task performances among the different participant groups, and multiple data visualisations were created to find insights from questionnaire answers. Results: The usability study investigated the feasibility of using VR for genomic data analysis in domain users’ daily work. From the feedback, 65% of the participants, especially clinicians (75% of them), indicated that the VR prototype is potentially helpful for domain users’ daily work but needed more flexibility, such as allowing them to define their features for machine learning part, adding new patient data, and importing their datasets in a better way. We calculated the engaged time for each task and compared them among different user groups. Computing domain users spent 50% more time exploring the algorithms and datasets than medical domain users. Additionally, the medical domain users engaged in the data visual analytics parts (approximately 20%) longer than the computing domain users.
- 20 December 2023
- Published by Springer Nature in BMC Medical Informatics and Decision Making
- Vol. 23 (1) , 1-15
Open AccessUnderstanding cancer patient cohorts in virtual reality environment for better clinical decisions: a usability study
Background: Visualising patient genomic data in a cohort with embedding data analytics models can provide relevant and sensible patient comparisons to assist a clinician with treatment decisions. As immersive technology is actively used around the medical world, there is a rising demand for an efficient environment that can effectively display genomic data visualisations on immersive devices such as a Virtual Reality (VR) environment. The VR technology will allow clinicians, biologists, and computer scientists to explore a cohort of individual patients within the 3D environment. However, demonstrating the feasibility of the VR prototype needs domain users’ feedback for future user-centred design and a better cognitive model of human–computer interactions. There is limited research work for collecting and integrating domain knowledge into the prototype design. Objective: A usability study for the VR prototype–-Virtual Reality to Observe Oncology data Models (VROOM) was implemented. VROOM was designed based on a preliminary study among medical users. The goals of this usability study included establishing a baseline of user experience, validating user performance measures, and identifying potential design improvements that are to be addressed to improve efficiency, functionality, and end-user satisfaction. Methods: The study was conducted with a group of domain users (10 males, 10 females) with portable VR devices and camera equipment. These domain users included medical users such as clinicians and genetic scientists and computing domain users such as bioinformatics and data analysts. Users were asked to complete routine tasks based on a clinical scenario. Sessions were recorded and analysed to identify potential areas for improvement to the data visual analytics projects in the VR environment. The one-hour usability study included learning VR interaction gestures, running visual analytics tool, and collecting before and after feedback. The feedback was analysed with different methods to measure effectiveness. The statistical method Mann–Whitney U test was used to analyse various task performances among the different participant groups, and multiple data visualisations were created to find insights from questionnaire answers. Results: The usability study investigated the feasibility of using VR for genomic data analysis in domain users’ daily work. From the feedback, 65% of the participants, especially clinicians (75% of them), indicated that the VR prototype is potentially helpful for domain users’ daily work but needed more flexibility, such as allowing them to define their features for machine learning part, adding new patient data, and importing their datasets in a better way. We calculated the engaged time for each task and compared them among different user groups. Computing domain users spent 50% more time exploring the algorithms and datasets than medical domain users. Additionally, the medical domain users engaged in the data visual analytics parts (approximately 20%) longer than the computing domain users.
- Open Access
- 2 December 2023
- Published by Association for Computing Machinery (ACM)
- p. 191-201
Clover Connections: Visualising Character Dynamics in Novels for Non-Experts
Many literature enthusiasts join communities to discuss their favourite fictional characters and novels, but meaningful insights may be slow to achieve and share when attempting to recall or verify the textual basis of their personal perspectives. Information visualisations can present text-derived data to make its summarisation and exploration both accessible and intuitive, yet visualisations of literary works are mostly tailored to expert workflows. This design study addresses this gap, comprehensively detailing our process of uncovering the tasks, data, and visual design requirements to implement Clover Connections, a visualisation of text-derived data for non-experts. Its layout features clover-shaped glyphs, storylines, and arcs to visually represent and connect temporal, social and personal data on characters in novels, which we demonstrate using datasets built from two popular novels. A formative user evaluation study with non-expert participants showed Clover Connections supports multiple general character analysis tasks, and provided qualitative insights that encourage future work.
- 2 December 2023
- Published by Association for Computing Machinery (ACM)
- p. 191-201
Open AccessClover Connections: Visualising Character Dynamics in Novels for Non-Experts
Many literature enthusiasts join communities to discuss their favourite fictional characters and novels, but meaningful insights may be slow to achieve and share when attempting to recall or verify the textual basis of their personal perspectives. Information visualisations can present text-derived data to make its summarisation and exploration both accessible and intuitive, yet visualisations of literary works are mostly tailored to expert workflows. This design study addresses this gap, comprehensively detailing our process of uncovering the tasks, data, and visual design requirements to implement Clover Connections, a visualisation of text-derived data for non-experts. Its layout features clover-shaped glyphs, storylines, and arcs to visually represent and connect temporal, social and personal data on characters in novels, which we demonstrate using datasets built from two popular novels. A formative user evaluation study with non-expert participants showed Clover Connections supports multiple general character analysis tasks, and provided qualitative insights that encourage future work.
Reflections on Light: Developing New Methods for Producing Anamorphic Sculpture
This paper presents novel catoptric anamorphic sculptures made possible by the development of bespoke software. The authors detail the production of a catoptric anamorphic sculpture involving a concave mirror and examine the audience’s experience. The reflections the mirror creates are described as being ‘holographic’. This effect is known as a ‘real image’ and only occurs using a concave mirror. Through interviews with participants, the paper reports on the audience’s experience of the real image. This new approach to anamorphic sculptures extends past work dating back many centuries. The authors present the digital tools they have developed to facilitate anamorphic artistic production and extend the limits of what has been achieved in the past. They end with an outline of future work, including glass lenses, and propose using video projection mapping.
Reflections on Light: Developing New Methods for Producing Anamorphic Sculpture
This paper presents novel catoptric anamorphic sculptures made possible by the development of bespoke software. The authors detail the production of a catoptric anamorphic sculpture involving a concave mirror and examine the audience’s experience. The reflections the mirror creates are described as being ‘holographic’. This effect is known as a ‘real image’ and only occurs using a concave mirror. Through interviews with participants, the paper reports on the audience’s experience of the real image. This new approach to anamorphic sculptures extends past work dating back many centuries. The authors present the digital tools they have developed to facilitate anamorphic artistic production and extend the limits of what has been achieved in the past. They end with an outline of future work, including glass lenses, and propose using video projection mapping.