Yusong Wang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Yusong Wang has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Kotaro Funakoshi
Laboratory for Future Interdisciplinary Research of Science and Technology, Institute of Integrated Research, Institute of Science Tokyo, Tokyo, Japan
2 shared publications - Dongyuan Li
Center for Spatial Information Science, The University of Tokyo, Tokyo, Japan
1 shared publication Keyu Mao
Department of Information and Communications Engineering, School of Engineering, Institute of Science Tokyo, Tokyo, Japan
1 shared publicationManabu Okumura
Laboratory for Future Interdisciplinary Research of Science and Technology, Institute of Integrated Research, Institute of Science Tokyo, Tokyo, Japan
1 shared publication- Minghao Shao
New York University, Brooklyn, NY, USA
1 shared publication Qingsong Zhao
College of Computer Science and Technology, Tongji University, Shanghai, China
1 shared publication
Latest Publications
- Open Access
- 1 June 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 14, 83705-83723
Unlocking High-Frequency Temporal Visual Cues for Personality Traits Recognition
Personality traits recognition (PTR) plays a pivotal role in developing intuitive human-computer interaction systems. Visual-based PTR methods have achieved notable success by leveraging dynamic cues such as facial expressions and body movements. However, they typically rely on sparse frame sampling to maintain computational efficiency. This strategy inherently discards high-frequency temporal visual cues such as micro-expressions and instantaneous gaze shifts, which are important for accurate personality traits recognition. To address this limitation, we propose FrePTR, a framework that captures and integrates high-frequency temporal visual cues for visual-based PTR. Unlike existing motion- or event-based representations, which mainly quantify geometric displacement or generic intensity variation, FrePTR introduces a retina-inspired dual-pathway extractor to model high-frequency cues for PTR. Motivated by the observation that personality impressions from visual behavior are formed through the eye, whose retina captures rapid temporal transients, the extractor decomposes high-frequency PTR cues into two complementary types: cone-inspired chromatic physiological transients and rod-inspired achromatic motion dynamics. Since the high-frequency and low-frequency streams originate from different signal sources, they exhibit heterogeneous feature distributions and reliability patterns, which makes feature-level fusion difficult. We therefore develop a heteroscedastic uncertainty-guided late fusion mechanism for reliability-aware integration at the decision level. Extensive experiments on the ChaLearn First Impressions and ELEA datasets show that FrePTR outperforms advanced visual-only methods and remains competitive with multimodal methods, indicating the benefit of incorporating high-frequency temporal visual cues into PTR.
- 1 June 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 14, 83705-83723
Open AccessUnlocking High-Frequency Temporal Visual Cues for Personality Traits Recognition
Personality traits recognition (PTR) plays a pivotal role in developing intuitive human-computer interaction systems. Visual-based PTR methods have achieved notable success by leveraging dynamic cues such as facial expressions and body movements. However, they typically rely on sparse frame sampling to maintain computational efficiency. This strategy inherently discards high-frequency temporal visual cues such as micro-expressions and instantaneous gaze shifts, which are important for accurate personality traits recognition. To address this limitation, we propose FrePTR, a framework that captures and integrates high-frequency temporal visual cues for visual-based PTR. Unlike existing motion- or event-based representations, which mainly quantify geometric displacement or generic intensity variation, FrePTR introduces a retina-inspired dual-pathway extractor to model high-frequency cues for PTR. Motivated by the observation that personality impressions from visual behavior are formed through the eye, whose retina captures rapid temporal transients, the extractor decomposes high-frequency PTR cues into two complementary types: cone-inspired chromatic physiological transients and rod-inspired achromatic motion dynamics. Since the high-frequency and low-frequency streams originate from different signal sources, they exhibit heterogeneous feature distributions and reliability patterns, which makes feature-level fusion difficult. We therefore develop a heteroscedastic uncertainty-guided late fusion mechanism for reliability-aware integration at the decision level. Extensive experiments on the ChaLearn First Impressions and ELEA datasets show that FrePTR outperforms advanced visual-only methods and remains competitive with multimodal methods, indicating the benefit of incorporating high-frequency temporal visual cues into PTR.
- Open Access
- 31 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 14, 50516-50536
E²MP: Emotion-Enhanced Modality Fusion With Contrastive Learning for Multi-Modal Personality Traits Recognition
Multi-modal personality traits recognition is crucial for advancing human-computer interaction, yet current methods struggle with extracting distinguishable features, mitigating inter-modal noise, and aligning heterogeneous modalities, thereby limiting accuracy. To address these challenges, we propose an emotion-enhanced multi-modal fusion model leveraging supervised contrastive learning for personality traits recognition. Specifically, we use supervised contrastive learning to learn highly distinguishable representations of modalities. Capitalizing on the intrinsic link between emotions and personality, we introduce a novel emotion-enhanced multi-modal fusion mechanism. This mechanism strategically guides the fusion process, reducing inter-modal noise and sharpening feature alignment across modalities. Each mechanism provides flexible designs for diverse personality traits recognition scenarios, optimizing both feature extraction and fusion for superior accuracy. In addition, we explore the interrelations among cultural contexts, emotions, and personality traits. Extensive experiments on three diverse datasets validate the superior performance and generalization of our proposed method.
- 31 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 14, 50516-50536
Open AccessE²MP: Emotion-Enhanced Modality Fusion With Contrastive Learning for Multi-Modal Personality Traits Recognition
Multi-modal personality traits recognition is crucial for advancing human-computer interaction, yet current methods struggle with extracting distinguishable features, mitigating inter-modal noise, and aligning heterogeneous modalities, thereby limiting accuracy. To address these challenges, we propose an emotion-enhanced multi-modal fusion model leveraging supervised contrastive learning for personality traits recognition. Specifically, we use supervised contrastive learning to learn highly distinguishable representations of modalities. Capitalizing on the intrinsic link between emotions and personality, we introduce a novel emotion-enhanced multi-modal fusion mechanism. This mechanism strategically guides the fusion process, reducing inter-modal noise and sharpening feature alignment across modalities. Each mechanism provides flexible designs for diverse personality traits recognition scenarios, optimizing both feature extraction and fusion for superior accuracy. In addition, we explore the interrelations among cultural contexts, emotions, and personality traits. Extensive experiments on three diverse datasets validate the superior performance and generalization of our proposed method.