Leveraging artificial intelligence to detect ethical concerns in medical research: a case study
- 26 February 2024
- journal article
- research article
- Published by BMJ in Journal of Medical Ethics
- Vol. 51 (2) , 126-134
Abstract
Background Institutional review boards (IRBs) have been criticised for delays in approvals for research proposals due to inadequate or inexperienced IRB staff. Artificial intelligence (AI), particularly large language models (LLMs), has significant potential to assist IRB members in a prompt and efficient reviewing process. Methods Four LLMs were evaluated on whether they could identify potential ethical issues in seven validated case studies. The LLMs were prompted with queries related to the proposed eligibility criteria of the study participants, vulnerability issues, information to be disclosed in the informed consent document (ICD), risk–benefit assessment and justification of the use of a placebo. Another query was issued to the LLMs to generate ICDs for these case scenarios. Results All four LLMs were able to provide answers to the queries related to all seven cases. In general, the responses were homogeneous with respect to most elements. LLMs performed suboptimally in identifying the suitability of the placebo arm, risk mitigation strategies and potential risks to study participants in certain case studies with a single prompt. However, multiple prompts led to better outputs in all of these domains. Each of the LLMs included all of the fundamental elements of the ICD for all case scenarios. Use of jargon, understatement of benefits and failure to state potential risks were the key observations in the AI-generated ICD. Conclusion It is likely that LLMs can enhance the identification of potential ethical issues in clinical research, and they can be used as an adjunct tool to prescreen research proposals and enhance the efficiency of an IRB.Keywords
This publication has 21 references indexed in Scilit:
- Local Knowledge and Single IRBs for Multisite Studies: Challenges and SolutionsEthics & Human Research, 2019
- High-performance medicine: the convergence of human and artificial intelligenceNature Medicine, 2019
- Machine Learning and Prediction in Medicine — Beyond the Peak of Inflated ExpectationsNew England Journal of Medicine, 2017
- Research ethics committees in the regulation of clinical research: comparison of Finland to England, Canada, and the United StatesHealth Research Policy and Systems, 2016
- IRB practices and policies regarding the secondary research use of biospecimensBMC Medical Ethics, 2015
- Institutional review boards: Challenges and opportunitiesPerspectives in Clinical Research, 2014
- How IRBs View and Make Decisions about Social RisksJournal of Empirical Research on Human Research Ethics, 2013
- IRB Decision-Making with Imperfect Knowledge: A Framework for Evidence-Based Research Ethics ReviewJournal of Law, Medicine & Ethics, 2012
- Burdens on Research Imposed by Institutional Review Boards: The State of the Evidence and Its Implications for Regulatory ReformThe Milbank Quarterly, 2011
- Consent Documents for Oncology Trials: Does Anybody Read These Things?American Journal of Clinical Oncology, 2004