Enhanced Emotion Recognition in Conversations Through Hybrid Context Encoding and Latent Dependency Mining
- 21 August 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 16 (4) , 3329-3341
Abstract
Emotion recognition in conversations (ERC) is a pivotal component of affective computing, involving a common two-stage paradigm where pre-trained language models first extract context-independent features, followed by the encoding of contextual information and the modeling of emotional dependencies. This paradigm faces two challenges: (1) Existing methods struggle to capture both the intra-dialogue emotional continuity and the inter-dialogue semantic similarity. (2) The complexity of emotional elicitation processes gives rise to entangled dependencies, termed “latent dependencies”, which are difficult for current methods to detect and analyze. To overcome these challenges, we propose a Hybrid-Context Encoder with an Automated Latent Dependency Mining model for ERC. Specifically, we examine the emotional continuity and the semantic similarity from the standpoint of context encoders. We experimentally find that context encoders with different architectures exhibit distinct benefits. Based on these findings, we design a hybrid contextual encoding module that effectively combines the strengths of various encoders. Additionally, we design a lightweight generative module for latent dependency mining that autonomously generates a context mask, enabling the effective discovery of latent dependencies. We conduct extensive experiments on three datasets in the text modality. Our model achieves the best performance, which validates the superiority of our approach.Keywords
Funding Information
- National Natural Science Foundation of China (U24A20250, 62176048, T2293771, 61673086)
- Ministry of Education of Humanities and Social Science Project (21JZD055)
- Sichuan Science and Technology Program (2023NSFSC1919)
- Natural Science Foundation of Sichuan Province (2024NSFTD0042, 2024YFG0006, 2024NSFSC0506, 2025ZNSFSC1487)
This publication has 36 references indexed in Scilit:
- A multi-message passing framework based on heterogeneous graphs in conversational emotion recognitionNeurocomputing, 2023
- Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis ResearchIEEE Transactions on Affective Computing, 2023
- State of the art: a review of sentiment analysis based on sequential transfer learningArtificial Intelligence Review, 2022
- A multi-view network for real-time emotion recognition in conversationsKnowledge-Based Systems, 2022
- Recognizing Emotion Cause in ConversationsCognitive Computation, 2021
- Adapted Dynamic Memory Network for Emotion Recognition in ConversationIEEE Transactions on Affective Computing, 2020
- A survey of state-of-the-art approaches for emotion recognition in textKnowledge and Information Systems, 2020
- Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent AdvancesIEEE Access, 2019
- IEMOCAP: interactive emotional dyadic motion capture databaseLanguage Resources and Evaluation, 2008
- How Emotions Work: The Social Functions of Emotional Expression in NegotiationsResearch in Organizational Behavior, 2000