Zhaobin Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Zhaobin Liu has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
Jian Ma
2 shared publicationsGuohe Feng
School of Economics and Management, South China Normal University, China
1 shared publicationHan Chen
College of Teacher Education, South China Normal University, China
1 shared publicationPeihu Zhu
InnoCity.com Ltd., Hong Kong
1 shared publication- Peihu Zhu
Department of Information Systems, City University of Hong Kong, Hong Kong, China
1 shared publication - Qingyu Xu
City University of Hong Kong, Hong Kong, China
1 shared publication
Latest Publications
- 8 September 2025
- Published by Elsevier in Information Processing & Management
- Vol. 63 (2)
Meeting companies’ innovative requirements on online technology trading platforms: A novel large language model-based framework
- 8 September 2025
- Published by Elsevier in Information Processing & Management
- Vol. 63 (2)
Meeting companies’ innovative requirements on online technology trading platforms: A novel large language model-based framework
- 1 April 2025
- Published by SAGE Publications in Digital Health
- Vol. 11
Reference decisions enhance LLM performance, amplified by source disclosure
Objective: The rapid integration of large language models (LLMs) has propelled advancements in automated dialog technologies, improving the public's access to healthcare services. Drawing inspiration from the collaborative decision-making practices of medical professionals in complex cases, we investigated whether LLMs could enhance their diagnostic accuracy through interaction. Methods: An experimental study was conducted in China (September–December 2024) to investigate the impact of LLM-generated reference decisions and source disclosure on LLMs’ diagnostic performance. We used a Chinese clinical diagnostic task in a controlled comparative design, where three Chinese LLMs interpreted symptoms and conditions based on patient queries. LLMs’ outcomes were evaluated through accuracy and weighted F1 score metrics, with statistical analysis to determine significance. Results: Analysis of variance on LLMs’ diagnostic accuracy scores demonstrated that incorporating LLM-generated decisions as a reference significantly improved diagnostic outcomes, with source disclosure amplifying this improvement. Conclusion: Our findings underscore the potential of LLM collaboration in healthcare, offering strategies to refine response generation and decision-making across various applications.
- 1 April 2025
- Published by SAGE Publications in Digital Health
- Vol. 11
Reference decisions enhance LLM performance, amplified by source disclosure
Objective: The rapid integration of large language models (LLMs) has propelled advancements in automated dialog technologies, improving the public's access to healthcare services. Drawing inspiration from the collaborative decision-making practices of medical professionals in complex cases, we investigated whether LLMs could enhance their diagnostic accuracy through interaction. Methods: An experimental study was conducted in China (September–December 2024) to investigate the impact of LLM-generated reference decisions and source disclosure on LLMs’ diagnostic performance. We used a Chinese clinical diagnostic task in a controlled comparative design, where three Chinese LLMs interpreted symptoms and conditions based on patient queries. LLMs’ outcomes were evaluated through accuracy and weighted F1 score metrics, with statistical analysis to determine significance. Results: Analysis of variance on LLMs’ diagnostic accuracy scores demonstrated that incorporating LLM-generated decisions as a reference significantly improved diagnostic outcomes, with source disclosure amplifying this improvement. Conclusion: Our findings underscore the potential of LLM collaboration in healthcare, offering strategies to refine response generation and decision-making across various applications.
- 13 November 2024
- Published by SAGE Publications in Journal of Information Science
Recommending physicians with multimodal data and medical knowledge graph on healthcare platforms
Healthcare platforms have attracted many physicians and provided convenient medical services to patients. However, the large number of physicians brings the difficulty of finding suitable physicians for the patients. Despite attempts to develop recommendation methods to address this challenge, they fail to leverage multimodal medical data, which contain numerical, categorical, textual and visual data valuable for inferring patients’ preferences for physicians. Besides, previous methods ignore the semantic gap between patients’ health conditions and physicians’ specialties. The conditions describe the patients’ symptoms, while the specialties indicate the diseases the physicians can treat. They have different vocabularies and cannot be directly compared for generating recommendations. We put forward an innovative physician recommendation approach to effectively address the above research gaps. Our approach entails merging multimodal data with multiple network modules and employing a medical knowledge graph to fill the semantic gap. To assess the validity of our suggested approach, we perform comprehensive trials on real-world data. The trial outcomes indicate that our approach surpasses its variants and existing methods in the aspects of HR@k, MRR@k and NDCG@k.
- 13 November 2024
- Published by SAGE Publications in Journal of Information Science
Recommending physicians with multimodal data and medical knowledge graph on healthcare platforms
Healthcare platforms have attracted many physicians and provided convenient medical services to patients. However, the large number of physicians brings the difficulty of finding suitable physicians for the patients. Despite attempts to develop recommendation methods to address this challenge, they fail to leverage multimodal medical data, which contain numerical, categorical, textual and visual data valuable for inferring patients’ preferences for physicians. Besides, previous methods ignore the semantic gap between patients’ health conditions and physicians’ specialties. The conditions describe the patients’ symptoms, while the specialties indicate the diseases the physicians can treat. They have different vocabularies and cannot be directly compared for generating recommendations. We put forward an innovative physician recommendation approach to effectively address the above research gaps. Our approach entails merging multimodal data with multiple network modules and employing a medical knowledge graph to fill the semantic gap. To assess the validity of our suggested approach, we perform comprehensive trials on real-world data. The trial outcomes indicate that our approach surpasses its variants and existing methods in the aspects of HR@k, MRR@k and NDCG@k.
- Open Access
- 1 January 2024
- Published by IGI Global Scientific Publishing in Journal of Database Management
- Vol. 35 (1) , 1-14
A Machine Learning and Large Language Model-Integrated Approach to Research Project Evaluation
Research project evaluation upon completion is one of the important tasks for research management in government funding agencies and research institutions. Due to the increased number of funded projects, it is hard to find qualified reviewers in the same research disciplines. This paper proposes a machine learning and large language model integrated approach to provide decision support for research project evaluation. Machine learning algorithms are proposed to compute the weights of key performance indicators (KPIs) and scores of KPIs based on the evaluation results of completed projects, large language models are used to summarize research contributions or findings on project reports. Then domain experts are invited to consolidate the weights and scores for the KPIs and assess the novelty and impact of research contribution or findings. Experiments have been conducted in practical settings and the results have shown that the proposed method can greatly improve research management efficiency and provide more consistent evaluation results on funded research projects.
- 1 January 2024
- Published by IGI Global Scientific Publishing in Journal of Database Management
- Vol. 35 (1) , 1-14
Open AccessA Machine Learning and Large Language Model-Integrated Approach to Research Project Evaluation
Research project evaluation upon completion is one of the important tasks for research management in government funding agencies and research institutions. Due to the increased number of funded projects, it is hard to find qualified reviewers in the same research disciplines. This paper proposes a machine learning and large language model integrated approach to provide decision support for research project evaluation. Machine learning algorithms are proposed to compute the weights of key performance indicators (KPIs) and scores of KPIs based on the evaluation results of completed projects, large language models are used to summarize research contributions or findings on project reports. Then domain experts are invited to consolidate the weights and scores for the KPIs and assess the novelty and impact of research contribution or findings. Experiments have been conducted in practical settings and the results have shown that the proposed method can greatly improve research management efficiency and provide more consistent evaluation results on funded research projects.