Affective computing methods for multimodal embodied AI human–computer interaction
- 4 August 2025
- journal article
- Published by Emerald Publishing in Aslib Journal of Information Management
- p. 1-25
Abstract
Purpose: In the context of rapid innovation in computing technology, the Embodied Artificial Intelligence (EAI) design methods and key research issues continuously evolve. Affective computing is now becoming a core means to assits in EAI design research, enriching the emotional connotations of EAI design and promoting more natural and harmonious human–computer interaction. Design/methodology/approach: This paper adopted a systematic literature review approach and ultimately selected 36 high-quality papers related to affective computing methods in multimodal EAI human–computer interaction. The analysis is conducted on the temporal migration of research topics and the distribution of four aspects: research content, application areas, data collection form and algorithm. Findings: Three key steps were outlined in the study of affective computing methods in multimodal EAI human–computer interaction: Emotional recognition in human–computer interaction, evolutionary learning of user characteristic emotional classification, emotional analysis and behavioral feedback. Practical implications: The paper prospects the application scenarios of affective computing assistance in embodied intelligent human–computer interaction, deriving trends in enhancing emotional experience in medical service design, providing simulation training for dangerous engineering environments, supplying social design with safety perception and mitigating the socio-ethical challenges raised by the new technology. Social implications: Four challenges in the emotional data collection process were summarized: privacy protection issues, questions about the accuracy and credibility of generative design, embodiment interaction dilemmas in cross-cultural contexts and social-ethical issues surrounding affective computing assistance in EAI. Originality/value: Previous studies mainly focused on the algorithmic effects of EAI and the design of a single modality experience. This paper offers an in-depth analysis from a multimodal viewpoint, following the research framework of affective computing. It presents a thorough examination of the human-centered interaction experience facilitated by embodied intelligent design.Keywords
This publication has 91 references indexed in Scilit:
- Affective Computing for Health Management via Recommender Systems: Exploring Challenges and Opportunities2024
- The Role of Affective Computing in Social Justice: Harnessing Equity and Inclusion2024
- Converging Affective Computing and Ethical Challenges: The Quest for Universal Access in Human-Machine Cooperation2024
- Challenges of Machine Learning and AI (What Is Next?), Responsible and Ethical AI2023
- Detecting Public Speaking Stress via Real-Time Voice Analysis in Virtual Reality: A Review2023
- Legal Considerations and Ethical Challenges of Artificial Intelligence on Internet of Things and Smart Cities2023
- Deep Convolutional Neural Network for Emotion Recognition Using EEG and Peripheral Physiological Signal2017
- Face and Emotion Recognition on Commercial Property under EU Data Protection LawPsychology & Marketing, 2016
- The Hourglass of Emotions2012
- Affective Computing: A Review2005