Weijie Shi
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Weijie Shi has a total of 28 co-authors. Here are the top co-authors by number of shared publications:
- Hao Chen
Tencent Inc., Shenzhen, China
4 shared publications - Jia Zhu
Zhejiang Key Laboratory of Intelligent Education Technology and Application, Zhejiang Normal University, Jinhua, China
4 shared publications - Fuyuan Lyu
McGill University, Montreal, Canada
2 shared publications - Hanghui Guo
Zhejiang Key Laboratory of Intelligent Education Technology and Application, Zhejiang Normal University, Jinhua, China
2 shared publications - Jiajie Xu
Soochow University
2 shared publications - Pasquale De Meo
University of Messina
2 shared publications
Latest Publications
- Open Access
- 8 August 2026
- Published by Association for Computing Machinery (ACM)
- p. 7082-7093
Fighting Numerical Hallucinations via Data-centric Compilation for Online Financial QA
- 8 August 2026
- Published by Association for Computing Machinery (ACM)
- p. 7082-7093
Open AccessFighting Numerical Hallucinations via Data-centric Compilation for Online Financial QA
- 1 August 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 38 (8) , 5507-5518
Zero-Shot Cellular Trajectory Map Matching
- 1 August 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 38 (8) , 5507-5518
Zero-Shot Cellular Trajectory Map Matching
- Open Access
- 12 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 7821-7832
Data-Driven Function Calling Improvements in Large Language Model for Online Financial QA
Large language models (LLMs) have been incorporated into numerous industrial applications. Meanwhile, a vast array of API assets is scattered across various functions in the financial domain. An online financial question-answering system can leverage both LLMs and private APIs to provide timely financial analysis and information. The key is equipping the LLM model with function calling capability tailored to a financial scenario. However, a generic LLM requires customized financial APIs to call and struggles to adapt to the financial domain. Additionally, online user queries are diverse and contain out-of-distribution parameters compared with the required function input parameters, which makes it more difficult for a generic LLM to serve online users. In this paper, we propose a data-driven pipeline to enhance function calling in LLM for our online, deployed financial QA, comprising dataset construction, data augmentation, and model training. Specifically, we construct a dataset based on a previous study and update it periodically, incorporating queries and an augmentation method named AugFC. The addition of user query-related samples will exploit our financial toolset in a data-driven manner, and AugFC explores the possible parameter values to enhance the diversity of our updated dataset. Then, we train an LLM with a two-step method, which enables the use of our financial functions. Extensive experiments on existing offline datasets, as well as the deployment of an online scenario, illustrate the superiority of our pipeline. The related pipeline has been adopted in the financial QA of YuanBao. https://yuanbao.tencent.com/chat/, one of the largest chat platforms in China.
- 12 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 7821-7832
Open AccessData-Driven Function Calling Improvements in Large Language Model for Online Financial QA
Large language models (LLMs) have been incorporated into numerous industrial applications. Meanwhile, a vast array of API assets is scattered across various functions in the financial domain. An online financial question-answering system can leverage both LLMs and private APIs to provide timely financial analysis and information. The key is equipping the LLM model with function calling capability tailored to a financial scenario. However, a generic LLM requires customized financial APIs to call and struggles to adapt to the financial domain. Additionally, online user queries are diverse and contain out-of-distribution parameters compared with the required function input parameters, which makes it more difficult for a generic LLM to serve online users. In this paper, we propose a data-driven pipeline to enhance function calling in LLM for our online, deployed financial QA, comprising dataset construction, data augmentation, and model training. Specifically, we construct a dataset based on a previous study and update it periodically, incorporating queries and an augmentation method named AugFC. The addition of user query-related samples will exploit our financial toolset in a data-driven manner, and AugFC explores the possible parameter values to enhance the diversity of our updated dataset. Then, we train an LLM with a two-step method, which enables the use of our financial functions. Extensive experiments on existing offline datasets, as well as the deployment of an online scenario, illustrate the superiority of our pipeline. The related pipeline has been adopted in the financial QA of YuanBao. https://yuanbao.tencent.com/chat/, one of the largest chat platforms in China.
- 12 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. PP (15209210) , 1-11
Video-Seer: A Hierarchical Scene Selection and Multi-View Analysis Approach for Zero-Shot Video Question Answering
Video Question Answering (VideoQA) is the task of answering a question in natural language by analyzing and understanding a video sequence. VideoQA is a typical manifestation of human intelligence, but it is one of the most complex activities for an artificial intelligence system. While vision-language large models excel in multi-modal understanding, they often struggle to capture causal and temporal dependencies in VideoQA. In this paper, we introduce Video-Seer, a novel training-free model inspired by human cognition for zero-shot video question answering. Video-Seer employs hierarchical scene selection through dynamic segmentation and multi-modal relevance scoring to identify question-relevant scenes. It dynamically allocates keyframes based on scene importance, prioritizing high-relevance regions, and integrates fine-grained keyframe grids with global sparse sampling for comprehensive multi-view modeling. Evaluated on challenging multiple-choice (NExT-QA, IntentQA, EgoSchema) and open-ended (MSVD-QA, MSRVTT-QA) VideoQA datasets, Video-Seer achieves accuracies of 71.4%, 65.5%, and 58.6% on multiple-choice tasks, surpassing comparable trained and zero-shot models using a lightweight 7B-parameter language model. These results demonstrate Video-Seer's robust video understanding, reasoning capabilities, and strong generalization without requiring extensive video-question pair training.
- 12 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. PP (15209210) , 1-11
Video-Seer: A Hierarchical Scene Selection and Multi-View Analysis Approach for Zero-Shot Video Question Answering
Video Question Answering (VideoQA) is the task of answering a question in natural language by analyzing and understanding a video sequence. VideoQA is a typical manifestation of human intelligence, but it is one of the most complex activities for an artificial intelligence system. While vision-language large models excel in multi-modal understanding, they often struggle to capture causal and temporal dependencies in VideoQA. In this paper, we introduce Video-Seer, a novel training-free model inspired by human cognition for zero-shot video question answering. Video-Seer employs hierarchical scene selection through dynamic segmentation and multi-modal relevance scoring to identify question-relevant scenes. It dynamically allocates keyframes based on scene importance, prioritizing high-relevance regions, and integrates fine-grained keyframe grids with global sparse sampling for comprehensive multi-view modeling. Evaluated on challenging multiple-choice (NExT-QA, IntentQA, EgoSchema) and open-ended (MSVD-QA, MSRVTT-QA) VideoQA datasets, Video-Seer achieves accuracies of 71.4%, 65.5%, and 58.6% on multiple-choice tasks, surpassing comparable trained and zero-shot models using a lightweight 7B-parameter language model. These results demonstrate Video-Seer's robust video understanding, reasoning capabilities, and strong generalization without requiring extensive video-question pair training.
- Top Cited PapersOpen Access
- 9 January 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Information Systems
- Vol. 44 (2) , 1-28
KnowPath: An LLM-Supported Knowledge Graph Construction and Path Finding Framework to Explainable MOOC Recommendations
The proliferation of Massive Open Online Courses (MOOCs) has created an urgent need for advanced course recommendation systems (RS). Course recommendations in MOOCs require transparent motivations to justify course selection, as there are often many courses with the same title, but which vary widely in content, duration, learning resources provided, and the academic authority of the instructor. Explainable recommendations are crucial to ensure that recommended courses fit well with learners’ needs and increase the chance of successful course completion, but unfortunately existing RS for MOOCs struggle to provide explainable recommendations. In this article, we present KnowPath , a novel RS for MOOCs, which generates effective and explainable recommendations. KnowPath uses open source Large Language Models (LLMs) to construct knowledge graphs (KGs) capable of accurately capturing complex relationships between MOOC entities (e.g., learners, instructors, educational resources) and employs Reinforcement Learning to align the output of an LLM with learner preferences. Extensive experiments on two public datasets (XueTang and COCO) demonstrate the superior performance and generalizability of KnowPath , underlining its potential to revolutionize the field of personalized online education.
- 9 January 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Information Systems
- Vol. 44 (2) , 1-28
Top Cited PapersOpen AccessKnowPath: An LLM-Supported Knowledge Graph Construction and Path Finding Framework to Explainable MOOC Recommendations
The proliferation of Massive Open Online Courses (MOOCs) has created an urgent need for advanced course recommendation systems (RS). Course recommendations in MOOCs require transparent motivations to justify course selection, as there are often many courses with the same title, but which vary widely in content, duration, learning resources provided, and the academic authority of the instructor. Explainable recommendations are crucial to ensure that recommended courses fit well with learners’ needs and increase the chance of successful course completion, but unfortunately existing RS for MOOCs struggle to provide explainable recommendations. In this article, we present KnowPath , a novel RS for MOOCs, which generates effective and explainable recommendations. KnowPath uses open source Large Language Models (LLMs) to construct knowledge graphs (KGs) capable of accurately capturing complex relationships between MOOC entities (e.g., learners, instructors, educational resources) and employs Reinforcement Learning to align the output of an LLM with learner preferences. Extensive experiments on two public datasets (XueTang and COCO) demonstrate the superior performance and generalizability of KnowPath , underlining its potential to revolutionize the field of personalized online education.
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 2254-2263
Consistent and Invariant Generalization Learning for Short-video Misinformation Detection
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 2254-2263
Open AccessConsistent and Invariant Generalization Learning for Short-video Misinformation Detection