Risk of Bias Mitigation for Vulnerable and Diverse Groups in Community-Based Primary Health Care Artificial Intelligence Models: Protocol for a Rapid Review
Authors:
- Maxime SassevilleMSMaxime Sasseville
- Steven OuelletSOSteven Ouellet
- Caroline RhéaumeCaroline Rhéaume
- Vincent CoutureVCVincent Couture
- Philippe DesprésPDPhilippe Després
- Jean-Sébastien PaquetteJPJean-Sébastien Paquette
- Karine GenteletKGKarine Gentelet
- David DarmonDDDavid Darmon
- Frédéric BergeronFBFrédéric Bergeron
- Marie-Pierre GagnonMGMarie-Pierre Gagnon
Open Access
- 26 June 2023
- journal article
- review article
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 12 (1) , e46684
Abstract
Background: The current literature identifies several potential benefits of artificial intelligence models for populations’ health and health care systems' efficiency. However, there is a lack of understanding on how the risk of bias is considered in the development of primary health care and community health service artificial intelligence algorithms and to what extent they perpetuate or introduce potential biases toward groups that could be considered vulnerable in terms of their characteristics. To the best of our knowledge, no reviews are currently available to identify relevant methods to assess the risk of bias in these algorithms. The primary research question of this review is which strategies can assess the risk of bias in primary health care algorithms toward vulnerable or diverse groups? Objective: This review aims to identify relevant methods to assess the risk of bias toward vulnerable or diverse groups in the development or deployment of algorithms in community-based primary health care and mitigation interventions deployed to promote and increase equity, diversity, and inclusion. This review looks at what attempts to mitigate bias have been documented and which vulnerable or diverse groups have been considered. Methods: A rapid systematic review of the scientific literature will be conducted. In November 2022, an information specialist developed a specific search strategy based on the main concepts of our primary review question in 4 relevant databases in the last 5 years. We completed the search strategy in December 2022, and 1022 sources were identified. Since February 2023, two reviewers independently screened the titles and abstracts on the Covidence systematic review software. Conflicts are solved through consensus and discussion with a senior researcher. We include all studies on methods developed or tested to assess the risk of bias in algorithms that are relevant in community-based primary health care. Results: In early May 2023, almost 47% (479/1022) of the titles and abstracts have been screened. We completed this first stage in May 2023. In June and July 2023, two reviewers will independently apply the same criteria to full texts, and all exclusion motives will be recorded. Data from selected studies will be extracted using a validated grid in August and analyzed in September 2023. Results will be presented using structured qualitative narrative summaries and submitted for publication by the end of 2023. Conclusions: The approach to identifying methods and target populations of this review is primarily qualitative. However, we will consider a meta-analysis if quantitative data and results are sufficient. This review will develop structured qualitative summaries of strategies to mitigate bias toward vulnerable populations and diverse groups in artificial intelligence models. This could be useful to researchers and other stakeholders to identify potential sources of bias in algorithms and try to reduce or eliminate them. Trial Registration: OSF Registries qbph8; https://osf.io/qbph8 International Registered Report Identifier (IRRID): DERR1-10.2196/46684Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Cochrane Rapid Reviews Methods Group offers evidence-informed guidance to conduct rapid reviewsJournal of Clinical Epidemiology, 2021
- Artificial Intelligence and Primary Care Research: A Scoping ReviewThe Annals of Family Medicine, 2020
- Dissecting racial bias in an algorithm used to manage the health of populationsScience, 2019
- Ensuring Fairness in Machine Learning to Advance Health EquityAnnals of Internal Medicine, 2018
- Health intelligence: how artificial intelligence transforms population and personalized healthnpj Digital Medicine, 2018
- Implementing Machine Learning in Health Care — Addressing Ethical ChallengesNew England Journal of Medicine, 2018
- Dermatologist-level classification of skin cancer with deep neural networksNature, 2017
- Predicting the Future — Big Data, Machine Learning, and Clinical MedicineNew England Journal of Medicine, 2016
- Applying an equity lens to interventions: using PROGRESS ensures consideration of socially stratifying factors to illuminate inequities in healthJournal of Clinical Epidemiology, 2014
- Computer-Aided Diagnosis and Artificial Intelligence in Clinical ImagingSeminars in Nuclear Medicine, 2011