Trustworthiness assessment of published clinical trials: Literature review of domains and questions
Open Access
- 20 August 2024
- journal article
- review article
- Published by Wiley in Cochrane Evidence Synthesis and Methods
- Vol. 2 (8) , e12099
Abstract
Background: Historically, peer reviewing has focused on the importance of research questions/hypotheses, appropriateness of research methods, risk of bias, and quality of writing. Until recently, the issues related to trustworthiness—including but not limited to plagiarism and fraud—have been largely neglected because of lack of awareness and lack of adequate tools/training. We set out to identify all relevant papers that have tackled the issue of trustworthiness assessment to identify key domains that have been suggested as an integral part of any such assessment.Methods: We searched the literature for publications of tools, checklists, or methods used or proposed for the assessment of trustworthiness of randomized trials. Data items (questions) were extracted from the included publications and transcribed on Excel including the assessment domain. Both authors then independently recategorised each data item in five domains (governance, plausibility, plagiarism, reporting, and statistics).Results: From the 41 publications we extracted a total of 284 questions and framed 77 summary questions grouped in five domains: governance (13 questions), plausibility (17 questions), plagiarism (4 questions), reporting (29 questions), and statistics (14 questions).Conclusion: The proposed menu of domains and questions should encourage peer reviewers, editors, systematic reviewers and developers of guidelines to engage in a more formal trustworthiness assessment. Methodologists should aim to identify the domains and questions that should be considered mandatory, those that are optional depending on the resources available, and those that could be discarded because of lack of discriminatory power.Keywords
All Related Versions
This publication has 49 references indexed in Scilit:
- Trustworthiness assessment as an inclusion criterion for systematic reviews—What is the impact on results?Cochrane Evidence Synthesis and Methods, 2023
- Putting your trust in ICU clinical trials: the journal’s roleIntensive Care Medicine, 2023
- Integrity of randomized clinical trials: Performance of integrity tests and checklists requires assessmentInternational Journal of Gynecology & Obstetrics, 2023
- Standard quality criteria in retracted vs nonretracted obstetrical randomized controlled trialsAmerican Journal of Obstetrics & Gynecology MFM, 2023
- Identifying and managing problematic trials: A research integrity assessment tool for randomized controlled trials in evidence synthesisResearch Synthesis Methods, 2022
- When beauty is but skin deep: dealing with problematic studies in systematic reviewsCochrane Database of Systematic Reviews, 2021
- Retracted papers are only the tip of the iceberg of untrustworthy evidenceAmerican Journal of Obstetrics & Gynecology MFM, 2020
- Digital magic, or the dark arts of the 21stcentury—how can journals and peer reviewers detect manuscripts and publications from paper mills?FEBS Letters, 2020
- Application of Benford’s law: a valuable tool for detecting scientific papers with fabricated data?Der Anaesthesist, 2017
- Adaptive Fraud Detection Using Benford’s LawLecture Notes in Computer Science, 2006