Ziyu Lin
Ziyu Lin has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Hongwu Yang
Northwest Normal University
1 shared publication - Sifu Zhang1 shared publication
- Weitong Guo
Northwest Normal University
1 shared publication - Xiangguo Li1 shared publication
- Yaping Xu
Northwest Normal University
1 shared publication
Latest Publications
- Open Access
- 14 January 2026
- Published by Wiley in International Journal of Intelligent Systems
- Vol. 2026 (1)
A Transformer‐Based Cross‐Modal Coattention Framework for Multimodal Depression Detection
This study introduces an innovative cross‐modal coattention network (CMCAN) framework, specifically designed to tackle the challenges of temporal misalignment and modality‐specific feature preservation in multimodal depression detection. The architecture comprises two fundamental components: (1) guided multihead attention, which facilitates context‐aware interactions across modalities, and (2) dedicated self‐attention pathways that ensure the preservation of key unimodal features. To enhance the estimation of depression severity, a cascaded fusion strategy is employed, combining feature superposition with hierarchical stacking. When evaluated on a Chinese localized depression dataset, CMCAN demonstrates exceptional performance, achieving optimal results (accuracy: 0.839; precision: 0.829; recall: 0.863) with its audiovisual guided coattention module (AVGA (SA (V), SA (A))) comprising three cascaded layers. The framework consistently surpasses unimodal baselines across various emotional valence stimuli (positive, neutral, and negative) and achieves state‐of‐the‐art performance on AVEC 2014 (MAE: 5.38). Comprehensive ablation studies validate the effectiveness of individual components, whereas comparative analyses demonstrate significant improvements over existing multimodal fusion approaches. These findings underscore the robustness and generalizability of CMCAN, validating its effectiveness in harmonizing cross‐modal synergy while preserving modality‐specific features, thereby advancing practical solutions for automated depression detection.
- 14 January 2026
- Published by Wiley in International Journal of Intelligent Systems
- Vol. 2026 (1)
Open AccessA Transformer‐Based Cross‐Modal Coattention Framework for Multimodal Depression Detection
This study introduces an innovative cross‐modal coattention network (CMCAN) framework, specifically designed to tackle the challenges of temporal misalignment and modality‐specific feature preservation in multimodal depression detection. The architecture comprises two fundamental components: (1) guided multihead attention, which facilitates context‐aware interactions across modalities, and (2) dedicated self‐attention pathways that ensure the preservation of key unimodal features. To enhance the estimation of depression severity, a cascaded fusion strategy is employed, combining feature superposition with hierarchical stacking. When evaluated on a Chinese localized depression dataset, CMCAN demonstrates exceptional performance, achieving optimal results (accuracy: 0.839; precision: 0.829; recall: 0.863) with its audiovisual guided coattention module (AVGA (SA (V), SA (A))) comprising three cascaded layers. The framework consistently surpasses unimodal baselines across various emotional valence stimuli (positive, neutral, and negative) and achieves state‐of‐the‐art performance on AVEC 2014 (MAE: 5.38). Comprehensive ablation studies validate the effectiveness of individual components, whereas comparative analyses demonstrate significant improvements over existing multimodal fusion approaches. These findings underscore the robustness and generalizability of CMCAN, validating its effectiveness in harmonizing cross‐modal synergy while preserving modality‐specific features, thereby advancing practical solutions for automated depression detection.