AnnoSense: A Framework for Physiological Emotion Data Collection in Everyday Settings for AI
Open Access
- 3 September 2025
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (3) , 1-47
Abstract
Emotional and mental well-being are vital components of quality of life, and with the rise of smart devices like smartphones, wearables, and artificial intelligence (AI), new opportunities for monitoring emotions in everyday settings have emerged. However, for AI algorithms to be effective, they require high-quality data and accurate annotations. As the focus shifts towards collecting emotion data in real-world environments to capture more authentic emotional experiences, the process of gathering emotion annotations has become increasingly complex. This work explores the challenges of everyday emotion data collection from the perspectives of key stakeholders. We collected 75 survey responses, performed 32 interviews with the public, and 3 focus group discussions (FGDs) with 12 mental health professionals. The insights gathered from a total of 119 stakeholders informed the development of our framework, AnnoSense, which comprises 15 actionable guidelines designed to support everyday emotion data collection for AI systems. This framework was then evaluated by 25 emotion AI experts for its clarity, usefulness, and adaptability. Lastly, we discuss the potential next steps and implications of AnnoSense for future research in emotion AI, highlighting its potential to enhance the collection and analysis of emotion data in real-world contexts.Keywords
All Related Versions
This publication has 109 references indexed in Scilit:
- AWARE-Light: a smartphone tool for experience sampling and digital phenotypingPersonal and Ubiquitous Computing, 2022
- Effect of experience sampling schedules on response rate and recall accuracy of objective self-reportsInternational Journal of Human-Computer Studies, 2019
- The psychometric assessment of alexithymia: Development and validation of the Perth Alexithymia QuestionnairePersonality and Individual Differences, 2018
- Engagement in mobile phone app for self-monitoring of emotional wellbeing predicts changes in mental health: MoodPrismJournal of Affective Disorders, 2018
- Putting the ‘app’ in Happiness: A Randomised Controlled Trial of a Smartphone-Based Mindfulness Intervention to Enhance WellbeingJournal of Happiness Studies, 2014
- Emotion Twenty Questions: Toward a Crowd-Sourced Theory of Emotions2011
- Measuring emotion: The self-assessment manikin and the semantic differentialJournal of Behavior Therapy and Experimental Psychiatry, 1994
- Are there basic emotions?Psychological Review, 1992
- Affect Grid: A single-item scale of pleasure and arousal.Journal of Personality and Social Psychology, 1989
- Development and validation of brief measures of positive and negative affect: The PANAS scales.Journal of Personality and Social Psychology, 1988