WSWeijie Shi

Weijie Shi

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Weijie Shi has a total of 28 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Fighting Numerical Hallucinations via Data-centric Compilation for Online Financial QA

    by Hao Chen, Xing Tang, Qirui Liu, Weijie Shi, Shiwei Li, Fuyuan Lyu, Weihong Luo, Xiku Du, Xiuqiang He

  • Zero-Shot Cellular Trajectory Map Matching

    by Weijie Shi, Yue Cui, Hao Chen, Jiaming Li, Mengze Li, Jia Zhu, Jiajie Xu, Xiaofang Zhou


  • Open Access

    Data-Driven Function Calling Improvements in Large Language Model for Online Financial QA

    by Xing Tang, Hao Chen, Shiwei Li, Fuyuan Lyu, Weijie Shi, Lingjie Li, Dugang Liu, Weihong Luo, Xiku Du, Xiuqiang He

    Large language models (LLMs) have been incorporated into numerous industrial applications. Meanwhile, a vast array of API assets is scattered across various functions in the financial domain. An online financial question-answering system can leverage both LLMs and private APIs to provide timely financial analysis and information. The key is equipping the LLM model with function calling capability tailored to a financial scenario. However, a generic LLM requires customized financial APIs to call and struggles to adapt to the financial domain. Additionally, online user queries are diverse and contain out-of-distribution parameters compared with the required function input parameters, which makes it more difficult for a generic LLM to serve online users. In this paper, we propose a data-driven pipeline to enhance function calling in LLM for our online, deployed financial QA, comprising dataset construction, data augmentation, and model training. Specifically, we construct a dataset based on a previous study and update it periodically, incorporating queries and an augmentation method named AugFC. The addition of user query-related samples will exploit our financial toolset in a data-driven manner, and AugFC explores the possible parameter values to enhance the diversity of our updated dataset. Then, we train an LLM with a two-step method, which enables the use of our financial functions. Extensive experiments on existing offline datasets, as well as the deployment of an online scenario, illustrate the superiority of our pipeline. The related pipeline has been adopted in the financial QA of YuanBao. https://yuanbao.tencent.com/chat/, one of the largest chat platforms in China.


  • Video-Seer: A Hierarchical Scene Selection and Multi-View Analysis Approach for Zero-Shot Video Question Answering

    by Chenglei Huang, Jia Zhu, Zilong Li, Hanghui Guo, Jiajun Liu, Pasquale De Meo, Weijie Shi

    Video Question Answering (VideoQA) is the task of answering a question in natural language by analyzing and understanding a video sequence. VideoQA is a typical manifestation of human intelligence, but it is one of the most complex activities for an artificial intelligence system. While vision-language large models excel in multi-modal understanding, they often struggle to capture causal and temporal dependencies in VideoQA. In this paper, we introduce Video-Seer, a novel training-free model inspired by human cognition for zero-shot video question answering. Video-Seer employs hierarchical scene selection through dynamic segmentation and multi-modal relevance scoring to identify question-relevant scenes. It dynamically allocates keyframes based on scene importance, prioritizing high-relevance regions, and integrates fine-grained keyframe grids with global sparse sampling for comprehensive multi-view modeling. Evaluated on challenging multiple-choice (NExT-QA, IntentQA, EgoSchema) and open-ended (MSVD-QA, MSRVTT-QA) VideoQA datasets, Video-Seer achieves accuracies of 71.4%, 65.5%, and 58.6% on multiple-choice tasks, surpassing comparable trained and zero-shot models using a lightweight 7B-parameter language model. These results demonstrate Video-Seer's robust video understanding, reasoning capabilities, and strong generalization without requiring extensive video-question pair training.

  • Top Cited Papers
    Open Access

    KnowPath: An LLM-Supported Knowledge Graph Construction and Path Finding Framework to Explainable MOOC Recommendations

    by Jia Zhu, Zhangze Chen, Pasquale De Meo, Jueqi Guan, Zhongmei Han, Weijie Shi

    The proliferation of Massive Open Online Courses (MOOCs) has created an urgent need for advanced course recommendation systems (RS). Course recommendations in MOOCs require transparent motivations to justify course selection, as there are often many courses with the same title, but which vary widely in content, duration, learning resources provided, and the academic authority of the instructor. Explainable recommendations are crucial to ensure that recommended courses fit well with learners’ needs and increase the chance of successful course completion, but unfortunately existing RS for MOOCs struggle to provide explainable recommendations. In this article, we present KnowPath , a novel RS for MOOCs, which generates effective and explainable recommendations. KnowPath uses open source Large Language Models (LLMs) to construct knowledge graphs (KGs) capable of accurately capturing complex relationships between MOOC entities (e.g., learners, instructors, educational resources) and employs Reinforcement Learning to align the output of an LLM with learner preferences. Extensive experiments on two public datasets (XueTang and COCO) demonstrate the superior performance and generalizability of KnowPath , underlining its potential to revolutionize the field of personalized online education.


  • Open Access

    Consistent and Invariant Generalization Learning for Short-video Misinformation Detection

    by Hanghui Guo, Weijie Shi, Mengze Li, Juncheng Li, Hao Chen, Yue Cui, Jiajie Xu, Jia Zhu, Jiawei Shen, Zhangze Chen, et al.