EmoFriends: A Modular Toolkit for Prototyping Customizable Emotion-Aware Companions
Open Access
- 13 April 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Abstract
This work presents EmoFriends, a modular prototyping toolkit designed to lower the barrier for creating customizable, emotion-aware companions from familiar physical artifacts. The toolkit integrates three interchangeable modules: (1) a touch-based sensing unit for capturing affective interaction proxies, (2) an LLM-powered engine for empathetic dialogue, and (3) an embodied feedback module providing haptic and visual cues. By modularizing these components, EmoFriends supports the rapid exploration of diverse companion configurations and foregrounds technological transparency as a design resource for embodied AI. We evaluate the system through technical feasibility metrics (e.g., actuation latency and classification robustness) and an exploratory “first-contact” deployment at a public exhibition (N = 45). Our findings demonstrate the toolkit’s functional reliability in high-traffic settings and reveal a strong user valuation of customization. However, the study also highlights critical social tensions regarding sensing credibility, privacy, and the social appropriateness of toy-like form factors. We conclude by outlining how modular frameworks can advance the design and research of future embodied affective companions.Keywords
Funding Information
- the University’s Research Centre for Future (Caring) Mobility (P0042701)
- the SD/COMP Joint Research Scheme (P0042739)
- the Funding for Collaborative Research with World-leading Research Groups (P0039528)
This publication has 33 references indexed in Scilit:
- No Transparency for Smart Toys2024
- Emo-MG Framework: LSTM-based Multi-modal Emotion Detection through Electroencephalography Signals and Micro GesturesInternational Journal of Human–Computer Interaction, 2023
- EmoSense: Revealing True Emotions Through MicrogesturesAdvanced Intelligent Systems, 2023
- A review of deep learning techniques for speech processingInformation Fusion, 2023
- Subtle interactions for distress regulation: Efficiency of a haptic wearable according to personalityInternational Journal of Human-Computer Studies, 2022
- The Role of Empathic Traits in Emotion Recognition and Emotion Contagion of Cozmo Robots2022
- iMiGUE: An Identity-free Video Dataset for Micro-Gesture Understanding and Emotion Analysis2021
- Determining optimum flash patterns for emergency service vehicles: An experimental investigation using high definition filmApplied Ergonomics, 2014
- Designing Interfaces in Public Settings2011
- A GENERAL PSYCHOEVOLUTIONARY THEORY OF EMOTION1980