Shubo Tian
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Shubo Tian has a total of 144 co-authors. Here are the top co-authors by number of shared publications:
- Zhiyong Lu
National Library of Medicine, National Institutes of Health
12 shared publications - Qiao Jin
National Library of Medicine, National Institutes of Health, Bethesda, USA
8 shared publications - Zhe He
Florida State University, Tallahassee, FL, USA
6 shared publications - Jinfeng Zhang
Department of Statistics, Florida State University, Tallahassee, USA
5 shared publications Qingqing Zhu
National Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, USA
5 shared publications- Robert Leaman
Division of Intramural Research, National Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, USA
5 shared publications
Latest Publications
- Open Access
- 28 July 2026
- Published by Elsevier in SSRN Electronic Journal
Artificial Intelligence for Clinical Trials: Current Applications and Future Opportunities
Clinical trials are essential for generating evidence in drug development, yet they continue to face persistent challenges including high costs, lengthy timelines, and low success rates. Recent advances in artificial intelligence (AI) and its transformative impact across medicine have highlighted its potential to address these limitations. Accordingly, AI is being increasingly integrated throughout the clinical trial lifecycle, enabling innovations in study design, patient recruitment, trial monitoring, data analysis, outcome prediction, and operational decisionmaking. In this review, we provide a comprehensive overview of current and emerging AI applications in clinical trials, emphasizing their potential to improve efficiency, enhance trial quality, and accelerate evidence generation. We further examine key practical considerations for implementation, including data quality, model interpretability, regulatory requirements, ethical concerns, and barriers to real-world adoption. Finally, we discuss future directions for AIenabled clinical trials, highlighting opportunities for improved scalability, generalizability, and clinical impact. By synthesizing recent advances and ongoing challenges, this review aims to guide researchers and practitioners navigating the rapidly evolving landscape of AI in clinical trials and to provide actionable insights for AI researchers, clinicians, patient advocates, trial investigators, and drug developers seeking to integrate AI into clinical research practice.
- 28 July 2026
- Published by Elsevier in SSRN Electronic Journal
Open AccessArtificial Intelligence for Clinical Trials: Current Applications and Future Opportunities
Clinical trials are essential for generating evidence in drug development, yet they continue to face persistent challenges including high costs, lengthy timelines, and low success rates. Recent advances in artificial intelligence (AI) and its transformative impact across medicine have highlighted its potential to address these limitations. Accordingly, AI is being increasingly integrated throughout the clinical trial lifecycle, enabling innovations in study design, patient recruitment, trial monitoring, data analysis, outcome prediction, and operational decisionmaking. In this review, we provide a comprehensive overview of current and emerging AI applications in clinical trials, emphasizing their potential to improve efficiency, enhance trial quality, and accelerate evidence generation. We further examine key practical considerations for implementation, including data quality, model interpretability, regulatory requirements, ethical concerns, and barriers to real-world adoption. Finally, we discuss future directions for AIenabled clinical trials, highlighting opportunities for improved scalability, generalizability, and clinical impact. By synthesizing recent advances and ongoing challenges, this review aims to guide researchers and practitioners navigating the rapidly evolving landscape of AI in clinical trials and to provide actionable insights for AI researchers, clinicians, patient advocates, trial investigators, and drug developers seeking to integrate AI into clinical research practice.
- 24 July 2026
- Published by Springer Nature in Nature Protocols
- p. 1-12
Tutorial: guidance on the use of large language models for medical research
- 24 July 2026
- Published by Springer Nature in Nature Protocols
- p. 1-12
Tutorial: guidance on the use of large language models for medical research
- Open Access
- 1 July 2026
- Published by Oxford University Press (OUP) in Bioinformatics
- Vol. 42 (Supplement)
Knowledge-guided contextual gene set analysis with large language models.
Gene set analysis (GSA) is a foundational approach for interpreting genomic data of diseases by linking genes to biological processes. However, conventional GSA methods overlook clinical context of the analyses, often generating long lists of enriched pathways with redundant, nonspecific, or irrelevant results. Interpreting these requires extensive, ad-hoc manual effort, reducing both reliability and reproducibility. We introduce cGSA, a novel AI-driven framework that enhances GSA by incorporating context-aware pathway prioritization. cGSA integrates gene cluster detection, enrichment analysis, and large language models to identify pathways that are not only statistically significant but also biologically meaningful. Benchmarking on 102 curated gene sets across 19 diseases and ten disease-related biological mechanisms shows that cGSA outperforms baseline methods by over 30%, with expert validation confirming its increased precision and interpretability. Two independent case studies in melanoma and breast cancer further demonstrate its potential to uncover context-specific insights and support targeted hypothesis. The demo website is publicly available at https://www.ncbi.nlm.nih.gov/CBBresearch/Lu/Demo/cGSA/, while the data and code can be accessed at https://github.com/ncbi-nlp/cGSA.
- 1 July 2026
- Published by Oxford University Press (OUP) in Bioinformatics
- Vol. 42 (Supplement)
Open AccessKnowledge-guided contextual gene set analysis with large language models.
Gene set analysis (GSA) is a foundational approach for interpreting genomic data of diseases by linking genes to biological processes. However, conventional GSA methods overlook clinical context of the analyses, often generating long lists of enriched pathways with redundant, nonspecific, or irrelevant results. Interpreting these requires extensive, ad-hoc manual effort, reducing both reliability and reproducibility. We introduce cGSA, a novel AI-driven framework that enhances GSA by incorporating context-aware pathway prioritization. cGSA integrates gene cluster detection, enrichment analysis, and large language models to identify pathways that are not only statistically significant but also biologically meaningful. Benchmarking on 102 curated gene sets across 19 diseases and ten disease-related biological mechanisms shows that cGSA outperforms baseline methods by over 30%, with expert validation confirming its increased precision and interpretability. Two independent case studies in melanoma and breast cancer further demonstrate its potential to uncover context-specific insights and support targeted hypothesis. The demo website is publicly available at https://www.ncbi.nlm.nih.gov/CBBresearch/Lu/Demo/cGSA/, while the data and code can be accessed at https://github.com/ncbi-nlp/cGSA.
- Open Access
- 15 January 2026
- Published by Oxford University Press (OUP) in Database: The Journal of Biological Databases and Curation
- Vol. 2026
MedHopQA: a disease-centred multi-hop reasoning benchmark and evaluation framework for LLM-based biomedical question answering
Evaluating large language models (LLMs) in the biomedical domain requires benchmarks that can distinguish genuine reasoning from pattern matching and that remain discriminative as model capabilities improve. Existing biomedical question answering (QA) benchmarks are limited in this respect: multiple-choice formats allow models to succeed by answer elimination rather than inference, and widely circulated exam-style datasets are subject to performance saturation and training data contamination. Multi-hop reasoning, i.e. the ability to integrate information across multiple sources to derive an answer, is central to clinically meaningful tasks such as diagnosis support, literature-based discovery, and hypothesis generation, yet remains underrepresented in current biomedical QA benchmarks. We present MedHopQA, a disease-centred multi-hop reasoning benchmark of 1000 expert-curated question–answer pairs introduced as a shared task at BioCreative IX. Each question requires synthesis of information across two distinct Wikipedia articles, and answers are provided in open-ended free-text format rather than as multiple-choice selections. Gold annotations are augmented with ontology-grounded synonym sets (MONDO, NCBI Gene, and NCBI Taxonomy) to support both lexical and concept-level evaluation. The dataset was constructed through a multi-stage human–AI pipeline combining structured human annotation, triage, iterative verification, and LLM-as-a-judge validation. To reduce leaderboard gaming and contamination risk, the 1000 scored questions are embedded within a publicly downloadable set of 10 000 questions, with answers withheld, on a CodaBench leaderboard. Evaluation of four frontier LLMs under a zero-shot setting (GPT-5.1, Gemini 2.5 Pro, Claude Sonnet 4.5, and GPT-4o) reveals performance variation across answer types, with overall accuracy ranging from 66.3% to 83.4%. Performance is strongest on chemical and anatomical questions and most variable on disease and gene/protein categories, where fine-grained semantic discrimination is required. MedHopQA provides both a benchmark and a reusable framework for constructing future biomedical QA datasets that prioritize compositional reasoning, saturation resistance, and contamination mitigation as design constraints.
- 15 January 2026
- Published by Oxford University Press (OUP) in Database: The Journal of Biological Databases and Curation
- Vol. 2026
Open AccessMedHopQA: a disease-centred multi-hop reasoning benchmark and evaluation framework for LLM-based biomedical question answering
Evaluating large language models (LLMs) in the biomedical domain requires benchmarks that can distinguish genuine reasoning from pattern matching and that remain discriminative as model capabilities improve. Existing biomedical question answering (QA) benchmarks are limited in this respect: multiple-choice formats allow models to succeed by answer elimination rather than inference, and widely circulated exam-style datasets are subject to performance saturation and training data contamination. Multi-hop reasoning, i.e. the ability to integrate information across multiple sources to derive an answer, is central to clinically meaningful tasks such as diagnosis support, literature-based discovery, and hypothesis generation, yet remains underrepresented in current biomedical QA benchmarks. We present MedHopQA, a disease-centred multi-hop reasoning benchmark of 1000 expert-curated question–answer pairs introduced as a shared task at BioCreative IX. Each question requires synthesis of information across two distinct Wikipedia articles, and answers are provided in open-ended free-text format rather than as multiple-choice selections. Gold annotations are augmented with ontology-grounded synonym sets (MONDO, NCBI Gene, and NCBI Taxonomy) to support both lexical and concept-level evaluation. The dataset was constructed through a multi-stage human–AI pipeline combining structured human annotation, triage, iterative verification, and LLM-as-a-judge validation. To reduce leaderboard gaming and contamination risk, the 1000 scored questions are embedded within a publicly downloadable set of 10 000 questions, with answers withheld, on a CodaBench leaderboard. Evaluation of four frontier LLMs under a zero-shot setting (GPT-5.1, Gemini 2.5 Pro, Claude Sonnet 4.5, and GPT-4o) reveals performance variation across answer types, with overall accuracy ranging from 66.3% to 83.4%. Performance is strongest on chemical and anatomical questions and most variable on disease and gene/protein categories, where fine-grained semantic discrimination is required. MedHopQA provides both a benchmark and a reusable framework for constructing future biomedical QA datasets that prioritize compositional reasoning, saturation resistance, and contamination mitigation as design constraints.
- Top Cited PapersOpen Access
- 28 July 2025
- Published by Springer Nature in Nature Methods
- Vol. 22 (8) , 1677-1685
GeneAgent: self-verification language agent for gene-set analysis using domain databases
Gene-set analysis seeks to identify the biological mechanisms underlying groups of genes with shared functions. Large language models (LLMs) have recently shown promise in generating functional descriptions for input gene sets but may produce factually incorrect statements, commonly referred to as hallucinations in LLMs. Here we present GeneAgent, an LLM-based AI agent for gene-set analysis that reduces hallucinations by autonomously interacting with biological databases to verify its own output. Evaluation of 1,106 gene sets collected from different sources demonstrates that GeneAgent is consistently more accurate than GPT-4 by a significant margin. We further applied GeneAgent to seven novel gene sets derived from mouse B2905 melanoma cell lines. Expert review confirmed that GeneAgent produces more relevant and comprehensive functional descriptions than GPT-4, providing valuable insights into gene functions and expediting knowledge discovery.
- 28 July 2025
- Published by Springer Nature in Nature Methods
- Vol. 22 (8) , 1677-1685
Top Cited PapersOpen AccessGeneAgent: self-verification language agent for gene-set analysis using domain databases
Gene-set analysis seeks to identify the biological mechanisms underlying groups of genes with shared functions. Large language models (LLMs) have recently shown promise in generating functional descriptions for input gene sets but may produce factually incorrect statements, commonly referred to as hallucinations in LLMs. Here we present GeneAgent, an LLM-based AI agent for gene-set analysis that reduces hallucinations by autonomously interacting with biological databases to verify its own output. Evaluation of 1,106 gene sets collected from different sources demonstrates that GeneAgent is consistently more accurate than GPT-4 by a significant margin. We further applied GeneAgent to seven novel gene sets derived from mouse B2905 melanoma cell lines. Expert review confirmed that GeneAgent produces more relevant and comprehensive functional descriptions than GPT-4, providing valuable insights into gene functions and expediting knowledge discovery.
- Open Access
- 1 July 2025
- Published by Oxford University Press (OUP) in Bioinformatics
- Vol. 41 (Supplement) , i68-i76
Enhancing biomedical relation extraction with directionality
Summary: Biological relation networks contain rich information for understanding the biological mechanisms behind the relationship of entities such as genes, proteins, diseases, and chemicals. The vast growth of biomedical literature poses significant challenges in updating the network knowledge. The recent Biomedical Relation Extraction Dataset (BioRED) provides valuable manual annotations, facilitating the development of machine learning and pre-trained language model approaches for automatically identifying novel document-level (inter-sentence context) relationships. Nonetheless, its annotations lack directionality (subject/object) for the entity roles, which is essential for studying complex biological networks. Herein, we annotate the entity roles of the relationships in the BioRED corpus and subsequently propose a novel multi-task language model with soft-prompt learning to jointly identify the relationship, novel findings, and entity roles. Our results include an enriched BioRED corpus with 10 864 directionality annotations. Moreover, our proposed method outperforms existing large language models, such as the state-of-the-art GPT-4 and Llama-3, on two benchmarking tasks. Availability and implementation: Our source code and dataset are available at https://github.com/ncbi-nlp/BioREDirect.
- 1 July 2025
- Published by Oxford University Press (OUP) in Bioinformatics
- Vol. 41 (Supplement) , i68-i76
Open AccessEnhancing biomedical relation extraction with directionality
Summary: Biological relation networks contain rich information for understanding the biological mechanisms behind the relationship of entities such as genes, proteins, diseases, and chemicals. The vast growth of biomedical literature poses significant challenges in updating the network knowledge. The recent Biomedical Relation Extraction Dataset (BioRED) provides valuable manual annotations, facilitating the development of machine learning and pre-trained language model approaches for automatically identifying novel document-level (inter-sentence context) relationships. Nonetheless, its annotations lack directionality (subject/object) for the entity roles, which is essential for studying complex biological networks. Herein, we annotate the entity roles of the relationships in the BioRED corpus and subsequently propose a novel multi-task language model with soft-prompt learning to jointly identify the relationship, novel findings, and entity roles. Our results include an enriched BioRED corpus with 10 864 directionality annotations. Moreover, our proposed method outperforms existing large language models, such as the state-of-the-art GPT-4 and Llama-3, on two benchmarking tasks. Availability and implementation: Our source code and dataset are available at https://github.com/ncbi-nlp/BioREDirect.
- 16 May 2025
- Published by Oxford University Press (OUP) in Nucleic Acids Research
- Vol. 53 (W1) , W361-W368
LitSense 2.0: AI-powered biomedical information retrieval with sentence and passage level knowledge discovery
LitSense 2.0 (https://www.ncbi.nlm.nih.gov/research/litsense2/) is an advanced biomedical search system enhanced with dense vector semantic retrieval, designed for accessing literature on sentence and paragraph levels. It provides unified access to 38 million PubMed abstracts and 6.6 million full-length articles in the PubMed Central (PMC) Open Access subset, encompassing 1.4 billion sentences and ∼300 million paragraphs, and is updated weekly. Compared to PubMed and PMC, the primary platforms for biomedical information search, LitSense offers cross-platform functionality by searching seamlessly across both PubMed and PMC and returning relevant results at a more granular level. Building on the success of the original LitSense launched in 2018, LitSense 2.0 introduces two major enhancements. The first is the addition of paragraph-level search: users can now choose to search either against sentences or against paragraphs. The second is improved retrieval accuracy via a state-of-the-art biomedical text encoder, ensuring more reliable identification of relevant results across the entire biomedical literature.
- 16 May 2025
- Published by Oxford University Press (OUP) in Nucleic Acids Research
- Vol. 53 (W1) , W361-W368
LitSense 2.0: AI-powered biomedical information retrieval with sentence and passage level knowledge discovery
LitSense 2.0 (https://www.ncbi.nlm.nih.gov/research/litsense2/) is an advanced biomedical search system enhanced with dense vector semantic retrieval, designed for accessing literature on sentence and paragraph levels. It provides unified access to 38 million PubMed abstracts and 6.6 million full-length articles in the PubMed Central (PMC) Open Access subset, encompassing 1.4 billion sentences and ∼300 million paragraphs, and is updated weekly. Compared to PubMed and PMC, the primary platforms for biomedical information search, LitSense offers cross-platform functionality by searching seamlessly across both PubMed and PMC and returning relevant results at a more granular level. Building on the success of the original LitSense launched in 2018, LitSense 2.0 introduces two major enhancements. The first is the addition of paragraph-level search: users can now choose to search either against sentences or against paragraphs. The second is improved retrieval accuracy via a state-of-the-art biomedical text encoder, ensuring more reliable identification of relevant results across the entire biomedical literature.
- Open Access
- 1 November 2024
- Published by Oxford University Press (OUP) in Bioinformatics
- Vol. 40 (11)
PubMed Computed Authors in 2024: an open resource of disambiguated author names in biomedical literature
Over 55% of author names in PubMed are ambiguous: the same name is shared by different individual researchers. This poses significant challenges on precise literature retrieval for author name queries, a common behavior in biomedical literature search. In response, we present a comprehensive dataset of disambiguated authors. Specifically, we complement the automatic PubMed Computed Authors algorithm with the latest ORCID data for improved accuracy. As a result, the enhanced algorithm achieves high performance in author name disambiguation, and subsequently our dataset contains more than 21 million disambiguated authors for over 35 million PubMed articles and is incrementally updated on a weekly basis. More importantly, we make the dataset publicly available for the community such that it can be utilized in a wide variety of potential applications beyond assisting PubMed's author name queries. Finally, we propose a set of guidelines for best practices of authors pertaining to use of their names. The PubMed Computed Authors dataset is publicly available for bulk download at: https://ftp.ncbi.nlm.nih.gov/pub/lu/ComputedAuthors/. Additionally, it is available for query through web API at: https://www.ncbi.nlm.nih.gov/research/bionlp/APIs/authors/ Supplementary data are available at Bioinformatics online.
- 1 November 2024
- Published by Oxford University Press (OUP) in Bioinformatics
- Vol. 40 (11)
Open AccessPubMed Computed Authors in 2024: an open resource of disambiguated author names in biomedical literature
Over 55% of author names in PubMed are ambiguous: the same name is shared by different individual researchers. This poses significant challenges on precise literature retrieval for author name queries, a common behavior in biomedical literature search. In response, we present a comprehensive dataset of disambiguated authors. Specifically, we complement the automatic PubMed Computed Authors algorithm with the latest ORCID data for improved accuracy. As a result, the enhanced algorithm achieves high performance in author name disambiguation, and subsequently our dataset contains more than 21 million disambiguated authors for over 35 million PubMed articles and is incrementally updated on a weekly basis. More importantly, we make the dataset publicly available for the community such that it can be utilized in a wide variety of potential applications beyond assisting PubMed's author name queries. Finally, we propose a set of guidelines for best practices of authors pertaining to use of their names. The PubMed Computed Authors dataset is publicly available for bulk download at: https://ftp.ncbi.nlm.nih.gov/pub/lu/ComputedAuthors/. Additionally, it is available for query through web API at: https://www.ncbi.nlm.nih.gov/research/bionlp/APIs/authors/ Supplementary data are available at Bioinformatics online.
- Top Cited PapersOpen Access
- 22 August 2024
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 31 (9) , 1801-1811
Large language models in biomedicine and health: current research landscape and future directions
Large language models (LLMs) are a specialized type of generative artificial intelligence (AI) focused on generating natural language text. These models are developed through extensive training on massive amounts of text data and use deep learning algorithms to generate new text that closely resembles human-generated text. Generative AI methods, including LLMs, are rapidly transforming various domains, including biomedicine and healthcare. 1–6 They have already demonstrated remarkable potential as a means to process and analyze large amounts of text, interpret natural language, and generate new content in these domains. For example, Nori et al reported that GPT-4 is able to correctly answer the majority of questions from medical practice licensing exams, comfortably obtaining a passing grade. 7 Similarly, Stribling et al found that this model exceeded the average performance of students in the graduate medical sciences on the majority of examinations, including strong performance on short answer and essay questions. 8 Even though passing the exam is not the same as applying the knowledge in a real-world setting, these results demonstrate that LLMs can generate appropriate multiple-choice and narrative responses to questions framed in natural language.
- 22 August 2024
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 31 (9) , 1801-1811
Top Cited PapersOpen AccessLarge language models in biomedicine and health: current research landscape and future directions
Large language models (LLMs) are a specialized type of generative artificial intelligence (AI) focused on generating natural language text. These models are developed through extensive training on massive amounts of text data and use deep learning algorithms to generate new text that closely resembles human-generated text. Generative AI methods, including LLMs, are rapidly transforming various domains, including biomedicine and healthcare. 1–6 They have already demonstrated remarkable potential as a means to process and analyze large amounts of text, interpret natural language, and generate new content in these domains. For example, Nori et al reported that GPT-4 is able to correctly answer the majority of questions from medical practice licensing exams, comfortably obtaining a passing grade. 7 Similarly, Stribling et al found that this model exceeded the average performance of students in the graduate medical sciences on the majority of examinations, including strong performance on short answer and essay questions. 8 Even though passing the exam is not the same as applying the knowledge in a real-world setting, these results demonstrate that LLMs can generate appropriate multiple-choice and narrative responses to questions framed in natural language.
- 13 August 2024
- Published by Elsevier in International Journal of Disaster Risk Reduction
- Vol. 111
Information retrieval and classification of real-time multi-source hurricane evacuation notices
- 13 August 2024
- Published by Elsevier in International Journal of Disaster Risk Reduction
- Vol. 111
Information retrieval and classification of real-time multi-source hurricane evacuation notices