A Deep Learning-Based Model for User Emotion Recognition and Behavior Guidance Design
Open Access
- 1 January 2026
- journal article
- research article
- Published by IGI Global Scientific Publishing in Journal of Organizational and End User Computing
- Vol. 38 (1) , 1-30
Abstract
EMoGuideNet is a deep-learning model that integrates user emotion and behavior in multi-turn interactions, overcoming the current limitation of treating them as separate processes. By simultaneously streaming emotional conditions and behavioral responses, it captures their interactive dynamics. The model processes multimodal inputs (textual/acoustic) through a recurrent emotion tracking mechanism, enabling temporal emotion modeling, and uses multi-task learning to predict behavior. Evaluated on four benchmarks (MELD, IEMOCAP, DailyDialog, ReDial), it outperforms CoCoLM, SER-Meta, and BERT4Rec, achieving a statistically significant 3.9% improvement in emotion-recognition accuracy and 4.6% in behavioral Hit@10 on MELD (p < 0.01). The model also demonstrates robustness to noise and generalizes well to unseen settings, highlighting the effectiveness of emotion-conditioned behavior modeling. These advancements enhance adaptive dialogue systems by enabling responses with greater emotional relevance and situational awareness.Keywords
This publication has 30 references indexed in Scilit:
- Student Behaviour Modelling and Adaptive Techniques for Social Robots: Data-driven and Teacher-Perceived EvaluationsInternational Journal of Social Robotics, 2025
- Affective computing methods for multimodal embodied AI human–computer interactionAslib Journal of Information Management, 2025
- Evaluating CNN, RNN, and Vision Transformer for Emotion Recognition: Strengths and Weaknesses2025
- Speech emotion recognition in conversations using artificial intelligence: a systematic review and meta-analysisArtificial Intelligence Review, 2025
- A context and sequence-based recommendation framework using GRU networksArtificial Intelligence Review, 2025
- A Reproducible Analysis of Sequential Recommender SystemsIEEE Access, 2024
- An Innovative Method for Speech Signal Emotion Recognition Based on Spectral Features Using GMM and HMM TechniquesWireless Personal Communications, 2024
- How to e-mental health: a guideline for researchers and practitioners using digital technology in the context of mental healthNature Mental Health, 2023
- Intelligent Digital Human Agent Service With Deep Learning Based-Face RecognitionIEEE Access, 2022
- Sentiment analysis in textual, visual and multimodal inputs using recurrent neural networksMultimedia Tools and Applications, 2020