A prospective pragmatic evaluation of automatic trial matching tools in a molecular tumor board
Authors:
Open Access
- 27 January 2025
- journal article
- research article
- Published by Springer Nature in npj Precision Oncology
- Vol. 9 (1) , 1-10
Abstract
Publicly available trial matching tools can improve the access to therapeutic innovations, but errors may expose to over-solicitation and disappointment. We performed a pragmatic non-interventional prospective evaluation on sequential patients at the Molecular Tumor Board of Centre Leon Berard. During 10 weeks in 2024, we analysed 157 patients with four clinical trial matching tools from the 19 screened: Klineo, ScreenAct, Trialing and DigitalECMT. Each patient had 2.19 trials proposed on average, and 38% had no trials suggested. The mean performances were precision = 0.33, recall = 0.32, AP@3 = 0.45, and NDCG@3 = 0.34. Using all the tools can increase to 26% the clinical trial options. The most frequent error concerned the type of gene variants required by the selection criteria. We showed that using a Large Language Model on the patients’ molecular reports could improve the performance by up to 5%. We recommend that experts supervise the results and we advocate for improved technologies.Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- Matching patients to clinical trials with large language modelsNature Communications, 2024
- Artificial intelligence in oncology: ensuring safe and effective integration of language models in clinical practiceThe Lancet Regional Health - Europe, 2024
- Patients’ selection and trial matching in early-phase oncology clinical trialsCritical Reviews in Oncology/Hematology, 2024
- Equitable access to oncology clinical trials: harnessing technology to reduce geographic disparitiesESMO Real World Data and Digital Oncology, 2023
- Molecular tumour boards — current and future considerations for precision oncologyNature Reviews Clinical Oncology, 2023
- Inequality factors in access to early-phase clinical trials in oncology in France: results of the EGALICAN-2 studyESMO Open, 2023
- Searching for clinical trials in oncology: finding a path through the mazeAnnals of Oncology, 2023
- Trends in the approval of cancer therapies by the FDA in the twenty-first centuryNature Reviews Drug Discovery, 2023
- Phase I trials as valid therapeutic options for patients with cancerNature Reviews Clinical Oncology, 2019
- Introduction to Information Retrieval2008