Abstract
EMoGuideNet is a deep-learning model that integrates user emotion and behavior in multi-turn interactions, overcoming the current limitation of treating them as separate processes. By simultaneously streaming emotional conditions and behavioral responses, it captures their interactive dynamics. The model processes multimodal inputs (textual/acoustic) through a recurrent emotion tracking mechanism, enabling temporal emotion modeling, and uses multi-task learning to predict behavior. Evaluated on four benchmarks (MELD, IEMOCAP, DailyDialog, ReDial), it outperforms CoCoLM, SER-Meta, and BERT4Rec, achieving a statistically significant 3.9% improvement in emotion-recognition accuracy and 4.6% in behavioral Hit@10 on MELD (p < 0.01). The model also demonstrates robustness to noise and generalizes well to unseen settings, highlighting the effectiveness of emotion-conditioned behavior modeling. These advancements enhance adaptive dialogue systems by enabling responses with greater emotional relevance and situational awareness.

This publication has 30 references indexed in Scilit: