Tianyu Fu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Tianyu Fu has a total of 28 co-authors. Here are the top co-authors by number of shared publications:
- Anyang Su
Mininglamp Technology, Beijing, China
5 shared publications - Chenxu Zhao
Mininglamp Technology, Beijing, China
5 shared publications - Minghui Wu
Mininglamp
5 shared publications - Ping Jiang
Mininglamp
3 shared publications - Beiping Tan
Mininglamp Technology, Beijing, China
2 shared publications - Kun Yan
Peking University, Beijing, China
2 shared publications
Latest Publications
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 11613-11622
Learning Explainable Video Saliency Prediction from Reasoning-Annotated Eye-Tracking Supervision
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 11613-11622
Open AccessLearning Explainable Video Saliency Prediction from Reasoning-Annotated Eye-Tracking Supervision
- 2 October 2026
- Published by Springer Nature
- p. 240-258
Dive Into the Implicit Biases of Low-Rank Vision-Language Alignment
- 2 October 2026
- Published by Springer Nature
- p. 240-258
Dive Into the Implicit Biases of Low-Rank Vision-Language Alignment
- 9 September 2026
- Published by Springer Nature
- p. 507-524
WebRetriever: A Large-Scale Comprehensive Benchmark for Efficient Web Agent Evaluation
- 9 September 2026
- Published by Springer Nature
- p. 507-524
WebRetriever: A Large-Scale Comprehensive Benchmark for Efficient Web Agent Evaluation
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 8174-8183
PRE-MAP: Personalized Reinforced Eye-tracking Multimodal LLM for High-Resolution Multi-Attribute Point Prediction
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 8174-8183
Open AccessPRE-MAP: Personalized Reinforced Eye-tracking Multimodal LLM for High-Resolution Multi-Attribute Point Prediction
- Open Access
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 7316-7325
Hypergraph Multi-modal Large Language Model: Exploiting EEG and Eye-tracking Modalities to Evaluate Heterogeneous Responses for Video Understanding
Understanding of video creativity and content often varies among individuals, with differences in focal points and cognitive levels across different ages, experiences, and genders. There is currently a lack of research in this area, and most existing benchmarks suffer from several drawbacks: 1) a limited number of modalities and answers with restrictive length; 2) the content and scenarios within the videos are excessively monotonous, transmitting allegories and emotions that are overly simplistic. To bridge the gap to real-world applications, we introduce a large-scale Video Subjective Multi-modal Evaluation dataset, namely Video-SME. Specifically, we collected real changes in Electroencephalographic (EEG) and eye-tracking regions from different demographics while they viewed identical video content. Utilizing this multi-modal dataset, we developed tasks and protocols to analyze and evaluate the extent of cognitive understanding of video content among different users. Along with the dataset, we designed a Hypergraph Multi-modal Large Language Model (HMLLM) to explore the associations among different demographics, video elements, EEG and eye-tracking indicators. HMLLM could bridge semantic gaps across rich modalities and integrate information beyond different modalities to perform logical reasoning. Extensive experimental evaluations on Video-SME and other additional video-based generative performance benchmarks demonstrate the effectiveness of our method. The code and dataset are available at https://github.com/mininglamp-MLLM/HMLLM
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 7316-7325
Open AccessHypergraph Multi-modal Large Language Model: Exploiting EEG and Eye-tracking Modalities to Evaluate Heterogeneous Responses for Video Understanding
Understanding of video creativity and content often varies among individuals, with differences in focal points and cognitive levels across different ages, experiences, and genders. There is currently a lack of research in this area, and most existing benchmarks suffer from several drawbacks: 1) a limited number of modalities and answers with restrictive length; 2) the content and scenarios within the videos are excessively monotonous, transmitting allegories and emotions that are overly simplistic. To bridge the gap to real-world applications, we introduce a large-scale Video Subjective Multi-modal Evaluation dataset, namely Video-SME. Specifically, we collected real changes in Electroencephalographic (EEG) and eye-tracking regions from different demographics while they viewed identical video content. Utilizing this multi-modal dataset, we developed tasks and protocols to analyze and evaluate the extent of cognitive understanding of video content among different users. Along with the dataset, we designed a Hypergraph Multi-modal Large Language Model (HMLLM) to explore the associations among different demographics, video elements, EEG and eye-tracking indicators. HMLLM could bridge semantic gaps across rich modalities and integrate information beyond different modalities to perform logical reasoning. Extensive experimental evaluations on Video-SME and other additional video-based generative performance benchmarks demonstrate the effectiveness of our method. The code and dataset are available at https://github.com/mininglamp-MLLM/HMLLM