Tony Stockman
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Tony Stockman has a total of 30 co-authors. Here are the top co-authors by number of shared publications:
- Mariam Bahameish
College of Science and Engineering, Hamad bin Khalifa University, Doha, Qatar
2 shared publications - Nida Aziz
Queen Mary University of London
2 shared publications - Alexa Siu
Adobe Research
1 shared publication Anastasios Tombros
School of Electronic Engineering and Computer Science Queen Mary University of London Mile End road, London, E1 4NA, UK
1 shared publication- Andrew McPherson
Dyson School of Design Engineering, Imperial College London, London, United Kingdom
1 shared publication Arooj Khan
Shifa Tameer-e-Milat University
1 shared publication
Latest Publications
- Open Access
- 22 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-14
Vibration Or Voice? Enhancing EQ Information Accessibility for Blind Music Producers with Haptics
- 22 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-14
Open AccessVibration Or Voice? Enhancing EQ Information Accessibility for Blind Music Producers with Haptics
- 20 May 2024
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- Vol. 41 (8) , 4483-4499
Serious Game for Dyslexia Screening: Design and Verification
- 20 May 2024
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- Vol. 41 (8) , 4483-4499
Serious Game for Dyslexia Screening: Design and Verification
- Open Access
Strategies for Reliable Stress Recognition: A Machine Learning Approach Using Heart Rate Variability Features
Stress recognition, particularly using machine learning (ML) with physiological data such as heart rate variability (HRV), holds promise for mental health interventions. However, limited datasets in affective computing and healthcare research can lead to inaccurate conclusions regarding the ML model performance. This study employed supervised learning algorithms to classify stress and relaxation states using HRV measures. To account for limitations associated with small datasets, robust strategies were implemented based on methodological recommendations for ML with a limited dataset, including data segmentation, feature selection, and model evaluation. Our findings highlight that the random forest model achieved the best performance in distinguishing stress from non-stress states. Notably, it showed higher performance in identifying stress from relaxation (F1-score: 86.3%) compared to neutral states (F1-score: 65.8%). Additionally, the model demonstrated generalizability when tested on independent secondary datasets, showcasing its ability to distinguish between stress and relaxation states. While our performance metrics might be lower than some previous studies, this likely reflects our focus on robust methodologies to enhance the generalizability and interpretability of ML models, which are crucial for real-world applications with limited datasets.
Open AccessStrategies for Reliable Stress Recognition: A Machine Learning Approach Using Heart Rate Variability Features
Stress recognition, particularly using machine learning (ML) with physiological data such as heart rate variability (HRV), holds promise for mental health interventions. However, limited datasets in affective computing and healthcare research can lead to inaccurate conclusions regarding the ML model performance. This study employed supervised learning algorithms to classify stress and relaxation states using HRV measures. To account for limitations associated with small datasets, robust strategies were implemented based on methodological recommendations for ML with a limited dataset, including data segmentation, feature selection, and model evaluation. Our findings highlight that the random forest model achieved the best performance in distinguishing stress from non-stress states. Notably, it showed higher performance in identifying stress from relaxation (F1-score: 86.3%) compared to neutral states (F1-score: 65.8%). Additionally, the model demonstrated generalizability when tested on independent secondary datasets, showcasing its ability to distinguish between stress and relaxation states. While our performance metrics might be lower than some previous studies, this likely reflects our focus on robust methodologies to enhance the generalizability and interpretability of ML models, which are crucial for real-world applications with limited datasets.
- 4 April 2024
- Published by Springer Nature
- p. 951-971
Remote Co-design in the Digital Age
- Open Access
- 16 February 2024
- Published by Springer Nature in Applied Psychophysiology and Biofeedback
- Vol. 49 (2) , 219-231
Short-Term Effects of Heart Rate Variability Biofeedback on Working Memory
Drawing upon the well-documented impact of long-term heart rate variability biofeedback (HRVB) on psychophysiological responses, this study seeks to explore the short-term effects arising from a single HRVB session during and after paced breathing exercise. The research aligns with the neurovisceral integration model, emphasizing the link between heart rate variability (HRV) levels and cognitive performance. Therefore, a randomized controlled trial employing a between-subjects design was conducted with 38 participants. Each participant was assigned to either the paced breathing intervention group or the spontaneous breathing control group. The study assessed various parameters such as cardiac vagal tone, evaluated through vagally mediated HRV measures, and working memory, measured using the N-back task. Additionally, participants’ affective states were assessed through self-reported questionnaires, specifically targeting attentiveness, fatigue, and serenity. The results notably reveal enhancements in the working memory task and an elevated state of relaxation and attention following the HRVB session, as evidenced by higher averages of correct responses, serenity and attentiveness scores. However, the findings suggest that this observed improvement is not influenced by changes in cardiac vagal tone, as assessed using a simple mediation analysis. In conclusion, this study presents promising insights into the impact of a single HRVB session, laying the foundation for future research advancements in this domain.
- 16 February 2024
- Published by Springer Nature in Applied Psychophysiology and Biofeedback
- Vol. 49 (2) , 219-231
Open AccessShort-Term Effects of Heart Rate Variability Biofeedback on Working Memory
Drawing upon the well-documented impact of long-term heart rate variability biofeedback (HRVB) on psychophysiological responses, this study seeks to explore the short-term effects arising from a single HRVB session during and after paced breathing exercise. The research aligns with the neurovisceral integration model, emphasizing the link between heart rate variability (HRV) levels and cognitive performance. Therefore, a randomized controlled trial employing a between-subjects design was conducted with 38 participants. Each participant was assigned to either the paced breathing intervention group or the spontaneous breathing control group. The study assessed various parameters such as cardiac vagal tone, evaluated through vagally mediated HRV measures, and working memory, measured using the N-back task. Additionally, participants’ affective states were assessed through self-reported questionnaires, specifically targeting attentiveness, fatigue, and serenity. The results notably reveal enhancements in the working memory task and an elevated state of relaxation and attention following the HRVB session, as evidenced by higher averages of correct responses, serenity and attentiveness scores. However, the findings suggest that this observed improvement is not influenced by changes in cardiac vagal tone, as assessed using a simple mediation analysis. In conclusion, this study presents promising insights into the impact of a single HRVB session, laying the foundation for future research advancements in this domain.
- Open Access
- 30 August 2023
- Published by Association for Computing Machinery (ACM)
- p. 109-115
Towards a Framework of Aesthetics in Sonic Interaction
- 30 August 2023
- Published by Association for Computing Machinery (ACM)
- p. 109-115
Open AccessTowards a Framework of Aesthetics in Sonic Interaction
- Open Access
- 22 October 2022
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Accessible Computing
- Vol. 15 (4) , 1-48
Planning Your Journey in Audio: Design and Evaluation of Auditory Route Overviews
Auditory overviews of routes can provide routing and map information to blind users enabling them to preview route maps before embarking on a journey. This article investigates the usefulness of a system designed to do this through a Preliminary Survey, followed by a Design Study to gather the design requirements, development of a prototype and evaluation through a Usability Study. The design is drawn in two stages with eight audio designers and eight potential blind users. The auditory route overview is sequential and automatically generated as integrated audio. It comprises auditory icons to represent points of interest, earcons for auditory brackets encapsulating repeating points of interest, and speech for directions. A prototype based on this design is developed and evaluated with 22 sighted and eight blind participants. The software architecture of the prototype including the route information retrieval and mapping onto audio has been included. The findings show that both groups perform well in route reconstruction and recognition tasks. Moreover, the functional route information and auditory icons are effectively designed and useful in forming a mental model of the route, which improves over time. However, the design of auditory brackets needs further improvement and testing. At all stages of the system development, input has been acquired from the end-user population and the design is adapted accordingly.
- 22 October 2022
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Accessible Computing
- Vol. 15 (4) , 1-48
Open AccessPlanning Your Journey in Audio: Design and Evaluation of Auditory Route Overviews
Auditory overviews of routes can provide routing and map information to blind users enabling them to preview route maps before embarking on a journey. This article investigates the usefulness of a system designed to do this through a Preliminary Survey, followed by a Design Study to gather the design requirements, development of a prototype and evaluation through a Usability Study. The design is drawn in two stages with eight audio designers and eight potential blind users. The auditory route overview is sequential and automatically generated as integrated audio. It comprises auditory icons to represent points of interest, earcons for auditory brackets encapsulating repeating points of interest, and speech for directions. A prototype based on this design is developed and evaluated with 22 sighted and eight blind participants. The software architecture of the prototype including the route information retrieval and mapping onto audio has been included. The findings show that both groups perform well in route reconstruction and recognition tasks. Moreover, the functional route information and auditory icons are effectively designed and useful in forming a mental model of the route, which improves over time. However, the design of auditory brackets needs further improvement and testing. At all stages of the system development, input has been acquired from the end-user population and the design is adapted accordingly.
- Open Access
- 13 July 2020
- Published by Springer Nature in Journal on Multimodal User Interfaces
- Vol. 15 (1) , 45-59
Exploring crossmodal perceptual enhancement and integration in a sequence-reproducing task with cognitive priming
Crossmodal correspondence, a perceptual phenomenon which has been extensively studied in cognitive science, has been shown to play a critical role in people’s information processing performance. However, the evidence has been collected mostly based on strictly-controlled stimuli and displayed in a noise-free environment. In real-world interaction scenarios, background noise may blur crossmodal effects that designers intend to leverage. More seriously, it may induce additional crossmodal effects, which can be mutually exclusive to the intended one, leading to unexpected distractions from the task at hand. In this paper, we report two experiments designed to tackle these problems with cognitive priming techniques. The first experiment examined how to enhance the perception of specific crossmodal stimuli, namely pitch–brightness and pitch–elevation stimuli. The second experiment investigated how people perceive and respond to crossmodal stimuli that were mutually exclusive. Results showed that first, people’s crossmodal perception was affected by cognitive priming, though the effect varies according to the combination of crossmodal stimuli and the types of priming material. Second, when two crossmodal stimuli are mutually exclusive, priming on only the dominant one (Pitch–elevation) lead to improved performance. These results can help inform future design of multisensory systems by presenting details of how to enhance crossmodal information with cognitive priming.
- 13 July 2020
- Published by Springer Nature in Journal on Multimodal User Interfaces
- Vol. 15 (1) , 45-59
Open AccessExploring crossmodal perceptual enhancement and integration in a sequence-reproducing task with cognitive priming
Crossmodal correspondence, a perceptual phenomenon which has been extensively studied in cognitive science, has been shown to play a critical role in people’s information processing performance. However, the evidence has been collected mostly based on strictly-controlled stimuli and displayed in a noise-free environment. In real-world interaction scenarios, background noise may blur crossmodal effects that designers intend to leverage. More seriously, it may induce additional crossmodal effects, which can be mutually exclusive to the intended one, leading to unexpected distractions from the task at hand. In this paper, we report two experiments designed to tackle these problems with cognitive priming techniques. The first experiment examined how to enhance the perception of specific crossmodal stimuli, namely pitch–brightness and pitch–elevation stimuli. The second experiment investigated how people perceive and respond to crossmodal stimuli that were mutually exclusive. Results showed that first, people’s crossmodal perception was affected by cognitive priming, though the effect varies according to the combination of crossmodal stimuli and the types of priming material. Second, when two crossmodal stimuli are mutually exclusive, priming on only the dominant one (Pitch–elevation) lead to improved performance. These results can help inform future design of multisensory systems by presenting details of how to enhance crossmodal information with cognitive priming.
- Open Access
- 1 June 2018
- Published by International Community for Auditory Display
- p. 145-151
SoundTrAD, A Method and Tool for Prototyping Auditory Displays: Can We Apply It to an Autonomous Driving Scenario?
This paper presents SoundTrAD, a method and tool for designing auditory displays for the user interface. SoundTrAD brings together ideas from user interface design and soundtrack composition and supports novice auditory display designers in building an auditory user interface. The paper argues for the need for such a method before going on to describe the fundamental structure of the method and construction of the supporting tools. The second half of the paper applies SoundTrAD to an autonomous driving scenario and demonstrates its use in prototyping ADs for a wide range of scenarios.
- 1 June 2018
- Published by International Community for Auditory Display
- p. 145-151
Open AccessSoundTrAD, A Method and Tool for Prototyping Auditory Displays: Can We Apply It to an Autonomous Driving Scenario?
This paper presents SoundTrAD, a method and tool for designing auditory displays for the user interface. SoundTrAD brings together ideas from user interface design and soundtrack composition and supports novice auditory display designers in building an auditory user interface. The paper argues for the need for such a method before going on to describe the fundamental structure of the method and construction of the supporting tools. The second half of the paper applies SoundTrAD to an autonomous driving scenario and demonstrates its use in prototyping ADs for a wide range of scenarios.
- Open Access
- 1 May 2018
- Published by Elsevier in Applied Acoustics
- Vol. 134, 34-45
Perception of objects that move in depth, using ecologically valid audio cues
- 1 May 2018
- Published by Elsevier in Applied Acoustics
- Vol. 134, 34-45
Open AccessPerception of objects that move in depth, using ecologically valid audio cues