Jinyi Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Jinyi Zhang has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
- Hangyu Xiong
Department of Computer Science, Technical University of Denmark (DTU), 2800 Copenhagen, Denmark
2 shared publications - Kai Liu
Wuhan University
2 shared publications - Min Peng
School of Computer Science, Wuhan University, Wuhan, China
2 shared publications
Latest Publications
- Open Access
- 13 May 2026
- Published by MDPI AG in Electronics
- Vol. 15 (10) , 2078
MOSAIC: A Cognitively Motivated Multi-Agent Framework for Interpretable and Training-Free Empathetic Dialogue
Empathetic dialogue systems built upon large language models overwhelmingly adopt a monolithic inference paradigm that processes emotion perception, causal reasoning, memory retrieval, and response planning within a single forward pass without architecturally enforced intermediate representations, forfeiting intermediate-state transparency and long-horizon personalization. Drawing on neuroscientific and cognitive–psychological evidence that human empathy is functionally dissociable, we present MOSAIC (Multi-agent Orchestration with Structured Affective memory for Interpretable empathiC dialogue), a training-free framework that operationalizes empathetic dialogue as a four-stage cognitive pipeline: affective perception, causal appraisal, episodic memory retrieval, and response synthesis. Three innovations distinguish MOSAIC from prior work: (1) a cognitively motivated modular architecture whose functionally dissociable stages enable post hoc failure attribution through logged intermediate states; (2) a hierarchical three-tier emotional memory—perceptual, semantic, and episodic—coupled with adaptive three-dimensional retrieval over emotion, situation, and coping-strategy cues; and (3) a heterogeneous model orchestration strategy coordinating open-source and API-accessible models through role-specific chain-of-thought prompts, requiring no task-specific fine-tuning. We note that the EmpatheticDialogues evaluation pre-populates the memory store with 200 training-split episodes prior to test-set interaction, a data-access asymmetry relative to single-model baselines that must be borne in mind when interpreting comparative results. Experiments on EmpatheticDialogues and ESConv show that MOSAIC achieves a 76.4% weighted F1 and an empathy score of 3.87 (on a 1–5 Likert scale) and that it improves over single-model, training-free baselines on aggregate empathy and—most prominently—on human-rated personalization (3.67 vs. 3.24 against Claude-3.5 five-shot, ). We caution that the comparison against training-free baselines is not data access-controlled (see the cold-start discussion in Methods); the personalization advantage, supported by the ablation without the Event Agent, is the result we treat as the primary practical contribution of this work.- 13 May 2026
- Published by MDPI AG in Electronics
- Vol. 15 (10) , 2078
Open AccessMOSAIC: A Cognitively Motivated Multi-Agent Framework for Interpretable and Training-Free Empathetic Dialogue
Empathetic dialogue systems built upon large language models overwhelmingly adopt a monolithic inference paradigm that processes emotion perception, causal reasoning, memory retrieval, and response planning within a single forward pass without architecturally enforced intermediate representations, forfeiting intermediate-state transparency and long-horizon personalization. Drawing on neuroscientific and cognitive–psychological evidence that human empathy is functionally dissociable, we present MOSAIC (Multi-agent Orchestration with Structured Affective memory for Interpretable empathiC dialogue), a training-free framework that operationalizes empathetic dialogue as a four-stage cognitive pipeline: affective perception, causal appraisal, episodic memory retrieval, and response synthesis. Three innovations distinguish MOSAIC from prior work: (1) a cognitively motivated modular architecture whose functionally dissociable stages enable post hoc failure attribution through logged intermediate states; (2) a hierarchical three-tier emotional memory—perceptual, semantic, and episodic—coupled with adaptive three-dimensional retrieval over emotion, situation, and coping-strategy cues; and (3) a heterogeneous model orchestration strategy coordinating open-source and API-accessible models through role-specific chain-of-thought prompts, requiring no task-specific fine-tuning. We note that the EmpatheticDialogues evaluation pre-populates the memory store with 200 training-split episodes prior to test-set interaction, a data-access asymmetry relative to single-model baselines that must be borne in mind when interpreting comparative results. Experiments on EmpatheticDialogues and ESConv show that MOSAIC achieves a 76.4% weighted F1 and an empathy score of 3.87 (on a 1–5 Likert scale) and that it improves over single-model, training-free baselines on aggregate empathy and—most prominently—on human-rated personalization (3.67 vs. 3.24 against Claude-3.5 five-shot, ). We caution that the comparison against training-free baselines is not data access-controlled (see the cold-start discussion in Methods); the personalization advantage, supported by the ablation without the Event Agent, is the result we treat as the primary practical contribution of this work. - Open Access
- 22 January 2026
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 10 (1) , 37
Unifying Aesthetic Evaluation via Multimodal Annotation and Fine-Grained Sentiment Analysis
With the rapid growth of visual content, automated aesthetic evaluation has become increasingly important. However, existing research faces three key challenges: (1) the absence of datasets combining Image Aesthetic Assessment (IAA) scores and Image Aesthetic Captioning (IAC) descriptions; (2) limited integration of quantitative scores and qualitative text, hindering comprehensive modeling; (3) the subjective nature of aesthetics, which complicates consistent fine-grained evaluation. To tackle these issues, we propose a unified multimodal framework. To address the lack of data, we develop the Textual Aesthetic Sentiment Labeling Pipeline (TASLP) for automatic annotation and construct the Reddit Multimodal Sentiment Dataset (RMSD) with paired IAA and IAC labels. To improve annotation integration, we introduce the Aesthetic Category Sentiment Analysis (ACSA) task, which models fine-grained aesthetic attributes across modalities. To handle subjectivity, we design two models—LAGA for IAA and ACSFM for IAC—that leverage ACSA features to enhance consistency and interpretability. Experiments on RMSD and public benchmarks show that our approach alleviates data limitations and delivers competitive performance, highlighting the effectiveness of fine-grained sentiment modeling and multimodal learning in aesthetic evaluation.
- 22 January 2026
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 10 (1) , 37
Open AccessUnifying Aesthetic Evaluation via Multimodal Annotation and Fine-Grained Sentiment Analysis
With the rapid growth of visual content, automated aesthetic evaluation has become increasingly important. However, existing research faces three key challenges: (1) the absence of datasets combining Image Aesthetic Assessment (IAA) scores and Image Aesthetic Captioning (IAC) descriptions; (2) limited integration of quantitative scores and qualitative text, hindering comprehensive modeling; (3) the subjective nature of aesthetics, which complicates consistent fine-grained evaluation. To tackle these issues, we propose a unified multimodal framework. To address the lack of data, we develop the Textual Aesthetic Sentiment Labeling Pipeline (TASLP) for automatic annotation and construct the Reddit Multimodal Sentiment Dataset (RMSD) with paired IAA and IAC labels. To improve annotation integration, we introduce the Aesthetic Category Sentiment Analysis (ACSA) task, which models fine-grained aesthetic attributes across modalities. To handle subjectivity, we design two models—LAGA for IAA and ACSFM for IAC—that leverage ACSA features to enhance consistency and interpretability. Experiments on RMSD and public benchmarks show that our approach alleviates data limitations and delivers competitive performance, highlighting the effectiveness of fine-grained sentiment modeling and multimodal learning in aesthetic evaluation.