“Trustworthiness,” confidence in estimated effects, and confidently translating research into clinical practice
Open Access
- 6 April 2023
- journal article
- research article
- Published by Aboutscience Srl in Archives of Physiotherapy
- Vol. 13 (1) , 1-5
Abstract
Trustworthy, preprocessed sources of evidence, such as systematic reviews and clinical practice guidelines, are crucial for practicing clinicians. Confidence in estimated effects is related to how different the outcome data were between the two groups. Factors including the effect size, variability of the effect, research integrity, research methods, and selected outcome measures impact confidence in the estimated effect. The current evidence suggests that post-randomization biases cannot be ruled out with a high degree of certainty in published research, limiting the utility of preprocessed sources for clinicians. Research should be prospectively registered to improve this situation, and fidelity with prospective intent should be verified to minimize biases and strengthen confidence in estimated effects. Otherwise, discussions related to preprocessed literature, including P-values, point estimates of effect, confidence intervals, post-randomization biases, external and internal validity measures, and the confidence in estimated effects required to translate research into practice confidently, are all moot points.Keywords
This publication has 8 references indexed in Scilit:
- Is the quality of systematic reviews influenced by prospective registration: a methods review of systematic musculoskeletal physical therapy reviewsJournal of Manual & Manipulative Therapy, 2022
- All MCIDs Are Wrong, But Some May be UsefulJournal of Orthopaedic & Sports Physical Therapy, 2022
- Statistical inference through estimation: recommendations from the International Society of Physiotherapy Journal EditorsJournal of Manual & Manipulative Therapy, 2022
- The Unknown Prevalence of Postrandomization Bias in 15 Physical Therapy Journals: A Methods ReviewJournal of Orthopaedic & Sports Physical Therapy, 2021
- Understanding of research results, evidence summaries and their applicability—not critical appraisal—are core skills of medical curriculumBMJ Evidence-Based Medicine, 2021
- HARKing, Cherry-Picking, P-Hacking, Fishing Expeditions, and Data Dredging and Mining as Questionable Research PracticesThe Journal of Clinical Psychiatry, 2021
- The American Statistical Association statement on P- values explainedJournal of Anaesthesiology Clinical Pharmacology, 2016
- GRADE guidelines: 15. Going from evidence to recommendation—determinants of a recommendation's direction and strengthJournal of Clinical Epidemiology, 2013