The McMaster Health Information Research Unit: Over a Quarter-Century of Health Informatics Supporting Evidence-Based Medicine
Open Access
- 31 July 2024
- journal article
- research article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 26 (1) , e58764
Abstract
Evidence-based medicine (EBM) emerged from McMaster University in the 1980-1990s, which emphasizes the integration of the best research evidence with clinical expertise and patient values. The Health Information Research Unit (HiRU) was created at McMaster University in 1985 to support EBM. Early on, digital health informatics took the form of teaching clinicians how to search MEDLINE with modems and phone lines. Searching and retrieval of published articles were transformed as electronic platforms provided greater access to clinically relevant studies, systematic reviews, and clinical practice guidelines, with PubMed playing a pivotal role. In the early 2000s, the HiRU introduced Clinical Queries—validated search filters derived from the curated, gold-standard, human-appraised Hedges dataset—to enhance the precision of searches, allowing clinicians to hone their queries based on study design, population, and outcomes. Currently, almost 1 million articles are added to PubMed annually. To filter through this volume of heterogenous publications for clinically important articles, the HiRU team and other researchers have been applying classical machine learning, deep learning, and, increasingly, large language models (LLMs). These approaches are built upon the foundation of gold-standard annotated datasets and humans in the loop for active machine learning. In this viewpoint, we explore the evolution of health informatics in supporting evidence search and retrieval processes over the past 25+ years within the HiRU, including the evolving roles of LLMs and responsible artificial intelligence, as we continue to facilitate the dissemination of knowledge, enabling clinicians to integrate the best available evidence into their clinical practice.Keywords
All Related Versions
This publication has 35 references indexed in Scilit:
- Interpreting Black-box Machine Learning Models for High Dimensional Datasets2023
- Evaluating large language models on medical evidence summarizationnpj Digital Medicine, 2023
- Deep learning to refine the identification of high-quality clinical research articles from the biomedical literature: Performance evaluationJournal of Biomedical Informatics, 2023
- Responsible AI for Digital Health: a Synthesis and a Research AgendaInformation Systems Frontiers, 2021
- Second-Order Peer Review of the Medical Literature for Clinical PractitionersJAMA, 2006
- Optimal search strategies for retrieving scientifically strong studies of treatment from Medline: analytical surveyBMJ, 2005
- Optimal search strategies for retrieving systematic reviews from Medline: analytical surveyBMJ, 2004
- Users' Guides to the Medical LiteratureJAMA, 1993
- How good are clinical MEDLINE searches? A comparative study of clinical end-user and librarian searchesComputers and Biomedical Research, 1990
- A Critical Appraisal of the Efficacy of Continuing Medical EducationJAMA, 1984