Temitayo Olugbade
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Temitayo Olugbade has a total of 57 co-authors. Here are the top co-authors by number of shared publications:
- Nadia Bianchi-Berthouze
Interaction Centre, University College London, London, United Kingdom
13 shared publications - Amanda C. de C. Williams
Research Department of Clinical, Educational and Health Psychology, University College London, London, UK
8 shared publications - Nicolas Gold
University College London, London, U.K.
5 shared publications - Catherine Holloway
UCL Interaction Centre, University College London, London, United Kingdom
2 shared publications - Kyrill Potapov
UCL Interaction Centre, University College London, London, United Kingdom
2 shared publications - Raffaele Andrea Buono
Department of Philosophy & Cultural Heritage Ca' Foscari University of Venice Venice Italy
2 shared publications
Latest Publications
- Open Access
- 23 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Sample entropy analysis of variability in sit-to-stand-to-sit movements of people with or without chronic pain
Sample entropy has been explored as a measure of movement variability. In this paper, we contribute analysis of its use for quantitative comparison of variations between movement repetitions within person (WPV) with variations between movements from different people (BPV). Our analysis was based on trunk flexion-extension angles in sit-to-stand-to-sit movement of people with or without chronic pain. We found the relation between WPV and BPV to vary with sample entropy parameters, and there were conditions for which sample entropy values for WPV were similar to or higher than those for BPV. The findings suggest need for caution in the use of sample entropy for capturing movement variability.
- 23 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Open AccessSample entropy analysis of variability in sit-to-stand-to-sit movements of people with or without chronic pain
Sample entropy has been explored as a measure of movement variability. In this paper, we contribute analysis of its use for quantitative comparison of variations between movement repetitions within person (WPV) with variations between movements from different people (BPV). Our analysis was based on trunk flexion-extension angles in sit-to-stand-to-sit movement of people with or without chronic pain. We found the relation between WPV and BPV to vary with sample entropy parameters, and there were conditions for which sample entropy values for WPV were similar to or higher than those for BPV. The findings suggest need for caution in the use of sample entropy for capturing movement variability.
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Movement Sonification of Familiar Music to Support the Agency of People with Chronic Pain
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Open AccessMovement Sonification of Familiar Music to Support the Agency of People with Chronic Pain
- Open Access
- 1 June 2024
- Published by Wolters Kluwer Health in Pain
- Vol. 165 (6) , 1348-1360
Sensing behavior change in chronic pain: a scoping review of sensor technology for use in daily life
Technology offers possibilities for quantification of behaviors and physiological changes of relevance to chronic pain, using wearable sensors and devices suitable for data collection in daily life contexts. We conducted a scoping review of wearable and passive sensor technologies that sample data of psychological interest in chronic pain, including in social situations. Sixty articles met our criteria from the 2783 citations retrieved from searching. Three-quarters of recruited people were with chronic pain, mostly musculoskeletal, and the remainder with acute or episodic pain; those with chronic pain had a mean age of 43 (few studies sampled adolescents or children) and 60% were women. Thirty-seven studies were performed in laboratory or clinical settings and the remainder in daily life settings. Most used only 1 type of technology, with 76 sensor types overall. The commonest was accelerometry (mainly used in daily life contexts), followed by motion capture (mainly in laboratory settings), with a smaller number collecting autonomic activity, vocal signals, or brain activity. Subjective self-report provided “ground truth” for pain, mood, and other variables, but often at a different timescale from the automatically collected data, and many studies reported weak relationships between technological data and relevant psychological constructs, for instance, between fear of movement and muscle activity. There was relatively little discussion of practical issues: frequency of sampling, missing data for human or technological reasons, and the users' experience, particularly when users did not receive data in any form. We conclude the review with some suggestions for content and process of future studies in this field.
- 1 June 2024
- Published by Wolters Kluwer Health in Pain
- Vol. 165 (6) , 1348-1360
Open AccessSensing behavior change in chronic pain: a scoping review of sensor technology for use in daily life
Technology offers possibilities for quantification of behaviors and physiological changes of relevance to chronic pain, using wearable sensors and devices suitable for data collection in daily life contexts. We conducted a scoping review of wearable and passive sensor technologies that sample data of psychological interest in chronic pain, including in social situations. Sixty articles met our criteria from the 2783 citations retrieved from searching. Three-quarters of recruited people were with chronic pain, mostly musculoskeletal, and the remainder with acute or episodic pain; those with chronic pain had a mean age of 43 (few studies sampled adolescents or children) and 60% were women. Thirty-seven studies were performed in laboratory or clinical settings and the remainder in daily life settings. Most used only 1 type of technology, with 76 sensor types overall. The commonest was accelerometry (mainly used in daily life contexts), followed by motion capture (mainly in laboratory settings), with a smaller number collecting autonomic activity, vocal signals, or brain activity. Subjective self-report provided “ground truth” for pain, mood, and other variables, but often at a different timescale from the automatically collected data, and many studies reported weak relationships between technological data and relevant psychological constructs, for instance, between fear of movement and muscle activity. There was relatively little discussion of practical issues: frequency of sampling, missing data for human or technological reasons, and the users' experience, particularly when users did not receive data in any form. We conclude the review with some suggestions for content and process of future studies in this field.
- 18 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 16 (2) , 471-484
The EmoPain@Home Dataset: Capturing Pain Level and Activity Recognition for People With Chronic Pain in Their Homes
Chronic pain is a prevalent condition where fear of movement and pain interfere with everyday functioning. Yet, there is no open body movement dataset for people with chronic pain in everyday settings. Our EmoPain@Home dataset addresses this with capture from 18 people with and without chronic pain in their homes, while they performed their routine activities. The data includes labels for pain, worry, and movement confidence continuously recorded for activity instances for the people with chronic pain. We explored baseline two-level pain detection based on this dataset and obtained 0.62 mean F1 score. However, extension of the dataset led to deterioration in performance confirming high variability in pain expressions for real world settings. We investigated baseline activity recognition for this setting as a first step in exploring the use of the activity label as contextual information for improving pain level classification performance. We obtained mean F1 score of 0.43 for 9 activity types, highlighting its feasibility. Further exploration, however, showed that data from healthy people cannot be easily leveraged for improving performance because worry and low confidence alter activity strategies for people with chronic pain. Our dataset and findings lay critical groundwork for automatic assessment of pain experience and behaviour in the wild.
- 18 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 16 (2) , 471-484
The EmoPain@Home Dataset: Capturing Pain Level and Activity Recognition for People With Chronic Pain in Their Homes
Chronic pain is a prevalent condition where fear of movement and pain interfere with everyday functioning. Yet, there is no open body movement dataset for people with chronic pain in everyday settings. Our EmoPain@Home dataset addresses this with capture from 18 people with and without chronic pain in their homes, while they performed their routine activities. The data includes labels for pain, worry, and movement confidence continuously recorded for activity instances for the people with chronic pain. We explored baseline two-level pain detection based on this dataset and obtained 0.62 mean F1 score. However, extension of the dataset led to deterioration in performance confirming high variability in pain expressions for real world settings. We investigated baseline activity recognition for this setting as a first step in exploring the use of the activity label as contextual information for improving pain level classification performance. We obtained mean F1 score of 0.43 for 9 activity types, highlighting its feasibility. Further exploration, however, showed that data from healthy people cannot be easily leveraged for improving performance because worry and low confidence alter activity strategies for people with chronic pain. Our dataset and findings lay critical groundwork for automatic assessment of pain experience and behaviour in the wild.
- 20 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 15 (3) , 1303-1314
Movement Representation Learning for Pain Level Classification
Self-supervised learning has shown value for uncovering informative movement features for human activity recognition. However, there has been minimal exploration of this approach for affect recognition where availability of large labelled datasets is particularly limited. In this paper, we propose a P-STEMR (Parallel Space-Time Encoding Movement Representation) architecture with the aim of addressing this gap and specifically leveraging the higher availability of human activity recognition datasets for pain-level classification. We evaluated and analyzed the architecture using three different datasets across four sets of experiments. We found statistically significant increase in average F1 score to 0.84 for pain level classification with two classes based on the architecture compared with the use of hand-crafted features. This suggests that it is capable of learning movement representations and transferring these from activity recognition based on data captured in lab settings to classification of pain levels with messier real-world data. We further found that the efficacy of transfer between datasets can be undermined by dissimilarities in population groups due to impairments that affect movement behaviour and in motion primitives (e.g. rotation versus flexion). Future work should investigate how the effect of these differences could be minimized so that data from healthy people can be more valuable for transfer learning.
- 20 November 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 15 (3) , 1303-1314
Movement Representation Learning for Pain Level Classification
Self-supervised learning has shown value for uncovering informative movement features for human activity recognition. However, there has been minimal exploration of this approach for affect recognition where availability of large labelled datasets is particularly limited. In this paper, we propose a P-STEMR (Parallel Space-Time Encoding Movement Representation) architecture with the aim of addressing this gap and specifically leveraging the higher availability of human activity recognition datasets for pain-level classification. We evaluated and analyzed the architecture using three different datasets across four sets of experiments. We found statistically significant increase in average F1 score to 0.84 for pain level classification with two classes based on the architecture compared with the use of hand-crafted features. This suggests that it is capable of learning movement representations and transferring these from activity recognition based on data captured in lab settings to classification of pain levels with messier real-world data. We further found that the efficacy of transfer between datasets can be undermined by dissimilarities in population groups due to impairments that affect movement behaviour and in motion primitives (e.g. rotation versus flexion). Future work should investigate how the effect of these differences could be minimized so that data from healthy people can be more valuable for transfer learning.
- Open Access
- 7 November 2023
- Published by Wiley in European journal of pain
- Vol. 28 (3) , 454-463
Guarding and flow in the movements of people with chronic pain: A qualitative study of physiotherapists’ observations
Background: Among the adaptations of movement consistently associated with disability in chronic pain, guarding is common. Based on previous work, we sought to understand better the constituents of guarding; we also used the concept of flow to explore the description of un/naturalness that emerged from physiotherapists' descriptions of movement in chronic pain. The aim was to inform the design of technical systems to support people with chronic pain in everyday activities.Methods: Sixteen physiotherapists, experts in chronic pain, were interviewed while repeatedly watching short video clips of people with chronic low back pain doing simple movements; physiotherapists described the movements, particularly in relation to guarding and flow. The transcribed interviews were analysed thematically to elaborate these constructs.Results: Moderate agreement emerged on the extent of guarding in the videos, with good agreement that guarding conveyed caution about movement, distinct from biomechanical variables of stiffness or slow speed. Physiotherapists' comments on flow showed slightly better agreement, and described the overall movement in terms of restriction (where there was no flow or only some flow), of tempo of the entire movement, and as naturalness (distinguished from normality of movement).Conclusions: These qualities of movement may be useful in designing technical systems to support self-management of chronic pain.
- 7 November 2023
- Published by Wiley in European journal of pain
- Vol. 28 (3) , 454-463
Open AccessGuarding and flow in the movements of people with chronic pain: A qualitative study of physiotherapists’ observations
Background: Among the adaptations of movement consistently associated with disability in chronic pain, guarding is common. Based on previous work, we sought to understand better the constituents of guarding; we also used the concept of flow to explore the description of un/naturalness that emerged from physiotherapists' descriptions of movement in chronic pain. The aim was to inform the design of technical systems to support people with chronic pain in everyday activities.Methods: Sixteen physiotherapists, experts in chronic pain, were interviewed while repeatedly watching short video clips of people with chronic low back pain doing simple movements; physiotherapists described the movements, particularly in relation to guarding and flow. The transcribed interviews were analysed thematically to elaborate these constructs.Results: Moderate agreement emerged on the extent of guarding in the videos, with good agreement that guarding conveyed caution about movement, distinct from biomechanical variables of stiffness or slow speed. Physiotherapists' comments on flow showed slightly better agreement, and described the overall movement in terms of restriction (where there was no flow or only some flow), of tempo of the entire movement, and as naturalness (distinguished from normality of movement).Conclusions: These qualities of movement may be useful in designing technical systems to support self-management of chronic pain.
- Open Access
- 20 July 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 15 (3) , 859-871
Multi-Rater Consensus Learning for Modeling Multiple Sparse Ratings of Affective Behaviour
The use of multiple raters to label datasets is an established practice in affective computing. The principal goal is to reduce unwanted subjective bias in the labelling process. Unfortunately, this leads to the key problem of identifying a ground truth for training the affect recognition system. This problem becomes more relevant in a sparsely-crossed annotation where each rater only labels a portion of the full dataset to ensure a manageable workload per rater. In this paper, we introduce a Multi-Rater Consensus Learning (MRCL) method which learns a representative affect recognition model that accounts for each rater's agreement with the other raters. MRCL combines a multitask learning (MTL) regularizer and a consensus loss. Unlike standard MTL, this approach allows the model to learn to predict each rater's label while explicitly accounting for the consensus among raters. We evaluated our approach on two different datasets based on spontaneous affective body movement expressions for pain behaviour detection and laughter type recognition respectively. The two naturalistic datasets were chosen for the different forms of labelling (different in affect, observation stimuli, and raters) that they together offer for evaluating our approach. Empirical results demonstrate that MRCL is effective for modelling affect from datasets with sparsely-crossed multi-rater annotation.
- 20 July 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 15 (3) , 859-871
Open AccessMulti-Rater Consensus Learning for Modeling Multiple Sparse Ratings of Affective Behaviour
The use of multiple raters to label datasets is an established practice in affective computing. The principal goal is to reduce unwanted subjective bias in the labelling process. Unfortunately, this leads to the key problem of identifying a ground truth for training the affect recognition system. This problem becomes more relevant in a sparsely-crossed annotation where each rater only labels a portion of the full dataset to ensure a manageable workload per rater. In this paper, we introduce a Multi-Rater Consensus Learning (MRCL) method which learns a representative affect recognition model that accounts for each rater's agreement with the other raters. MRCL combines a multitask learning (MTL) regularizer and a consensus loss. Unlike standard MTL, this approach allows the model to learn to predict each rater's label while explicitly accounting for the consensus among raters. We evaluated our approach on two different datasets based on spontaneous affective body movement expressions for pain behaviour detection and laughter type recognition respectively. The two naturalistic datasets were chosen for the different forms of labelling (different in affect, observation stimuli, and raters) that they together offer for evaluating our approach. Empirical results demonstrate that MRCL is effective for modelling affect from datasets with sparsely-crossed multi-rater annotation.
- 22 May 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Proceedings of the IEEE
- Vol. 111 (10) , 1333-1354
Touch Technology in Affective Human–, Robot–, and Virtual–Human Interactions: A Survey
Given the importance of affective touch in human interactions, technology designers are increasingly attempting to bring this modality to the core of interactive technology. Advances in haptics and touch-sensing technology have been critical to fostering interest in this area. In this survey, we review how affective touch is investigated to enhance and support the human experience with or through technology. We explore this question across three different research areas to highlight their epistemology, main findings, and the challenges that persist. First, we review affective touch technology through the human–computer interaction literature to understand how it has been applied to the mediation of human–human interaction and its roles in other human interactions particularly with oneself, augmented objects/media, and affect-aware devices. We further highlight the datasets and methods that have been investigated for automatic detection and interpretation of affective touch in this area. In addition, we discuss the modalities of affective touch expressions in both humans and technology in these interactions. Second, we separately review how affective touch has been explored in human–robot and real-human–virtual-human interactions where the technical challenges encountered and the types of experience aimed at are different. We conclude with a discussion of the gaps and challenges that emerge from the review to steer research in directions that are critical for advancing affective touch technology and recognition systems. In our discussion, we also raise ethical issues that should be considered for responsible innovation in this growing area.
- 22 May 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Proceedings of the IEEE
- Vol. 111 (10) , 1333-1354
Touch Technology in Affective Human–, Robot–, and Virtual–Human Interactions: A Survey
Given the importance of affective touch in human interactions, technology designers are increasingly attempting to bring this modality to the core of interactive technology. Advances in haptics and touch-sensing technology have been critical to fostering interest in this area. In this survey, we review how affective touch is investigated to enhance and support the human experience with or through technology. We explore this question across three different research areas to highlight their epistemology, main findings, and the challenges that persist. First, we review affective touch technology through the human–computer interaction literature to understand how it has been applied to the mediation of human–human interaction and its roles in other human interactions particularly with oneself, augmented objects/media, and affect-aware devices. We further highlight the datasets and methods that have been investigated for automatic detection and interpretation of affective touch in this area. In addition, we discuss the modalities of affective touch expressions in both humans and technology in these interactions. Second, we separately review how affective touch has been explored in human–robot and real-human–virtual-human interactions where the technical challenges encountered and the types of experience aimed at are different. We conclude with a discussion of the gaps and challenges that emerge from the review to steer research in directions that are critical for advancing affective touch technology and recognition systems. In our discussion, we also raise ethical issues that should be considered for responsible innovation in this growing area.
- Open Access
- 19 April 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
The EmoPain@Home Dataset: Capturing Pain Level and Activity Recognition for People with Chronic Pain in Their Homes
Chronic pain is a prevalent condition where fear of movement and pain interferes with everyday functioning. Yet, there is no open body movement dataset for people with chronic pain in everyday settings. Our EmoPain@Home dataset addresses this with capture from people with and without chronic pain in their homes, while they performed their routine activities. The data includes labels for pain, worry, and movement confidence continuously recorded for activity instances for the people with chronic pain. We explored two-level pain detection based on this dataset and obtained 0.62 mean F1 score. However, extension of the dataset led to deterioration in performance confirming high variability in pain expressions for real world settings. We investigated activity recognition for this setting as a first step in exploring the use of the activity label as contextual information for improving pain level classification performance. We obtained mean F1 score of 0.43 for 9 activity types, highlighting its feasibility. Further exploration, however, showed that data from healthy people cannot be easily leveraged for improving performance because worry and low confidence alter activity strategies for people with chronic pain. Our dataset and findings lay critical groundwork for automatic assessment of pain experience and behaviour in the wild.
- 19 April 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Open AccessThe EmoPain@Home Dataset: Capturing Pain Level and Activity Recognition for People with Chronic Pain in Their Homes
Chronic pain is a prevalent condition where fear of movement and pain interferes with everyday functioning. Yet, there is no open body movement dataset for people with chronic pain in everyday settings. Our EmoPain@Home dataset addresses this with capture from people with and without chronic pain in their homes, while they performed their routine activities. The data includes labels for pain, worry, and movement confidence continuously recorded for activity instances for the people with chronic pain. We explored two-level pain detection based on this dataset and obtained 0.62 mean F1 score. However, extension of the dataset led to deterioration in performance confirming high variability in pain expressions for real world settings. We investigated activity recognition for this setting as a first step in exploring the use of the activity label as contextual information for improving pain level classification performance. We obtained mean F1 score of 0.43 for 9 activity types, highlighting its feasibility. Further exploration, however, showed that data from healthy people cannot be easily leveraged for improving performance because worry and low confidence alter activity strategies for people with chronic pain. Our dataset and findings lay critical groundwork for automatic assessment of pain experience and behaviour in the wild.
- 28 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Signal Processing
- Vol. 17 (3) , 677-688
Pain Level and Pain-Related Behaviour Classification Using GRU-Based Sparsely-Connected RNNs
There is a growing body of studies on applying deep learning to biometrics analysis. Certain circumstances, however, could impair the objective measures and accuracy of the proposed biometric data analysis methods. For instance, people with chronic pain (CP) unconsciously adapt specific body movements to protect themselves from injury or additional pain. Because there is no dedicated benchmark database to analyse this correlation, we considered one of the specific circumstances that potentially influence a person's biometrics during daily activities in this study and classified pain level and pain-related behaviour in the EmoPain database. To achieve this, we proposed a sparsely-connected recurrent neural networks (s-RNNs) ensemble with the gated recurrent unit (GRU) that incorporates multiple autoencoders using a shared training framework. This architecture is fed by multidimensional data collected from inertial measurement unit (IMU) and surface electromyography (sEMG) sensors. Furthermore, to compensate for variations in the temporal dimension that may not be perfectly represented in the latent space of s-RNNs, we fused hand-crafted features derived from information-theoretic approaches with represented features in the shared hidden state. We conducted several experiments which indicate that the proposed method outperforms the state-of-the-art approaches in classifying both pain level and pain-related behaviour.
- 28 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Signal Processing
- Vol. 17 (3) , 677-688
Pain Level and Pain-Related Behaviour Classification Using GRU-Based Sparsely-Connected RNNs
There is a growing body of studies on applying deep learning to biometrics analysis. Certain circumstances, however, could impair the objective measures and accuracy of the proposed biometric data analysis methods. For instance, people with chronic pain (CP) unconsciously adapt specific body movements to protect themselves from injury or additional pain. Because there is no dedicated benchmark database to analyse this correlation, we considered one of the specific circumstances that potentially influence a person's biometrics during daily activities in this study and classified pain level and pain-related behaviour in the EmoPain database. To achieve this, we proposed a sparsely-connected recurrent neural networks (s-RNNs) ensemble with the gated recurrent unit (GRU) that incorporates multiple autoencoders using a shared training framework. This architecture is fed by multidimensional data collected from inertial measurement unit (IMU) and surface electromyography (sEMG) sensors. Furthermore, to compensate for variations in the temporal dimension that may not be perfectly represented in the latent space of s-RNNs, we fused hand-crafted features derived from information-theoretic approaches with represented features in the shared hidden state. We conducted several experiments which indicate that the proposed method outperforms the state-of-the-art approaches in classifying both pain level and pain-related behaviour.