Low Concordance of Patient-Reported Outcomes With Clinical and Clinical Trial Documentation
Open Access
- 1 December 2018
- journal article
- research article
- Published by American Society of Clinical Oncology (ASCO) in JCO Clinical Cancer Informatics
- Vol. 2 (2) , 1-12
Abstract
Purpose: Health care research increasingly relies on assessment of data extracted from electronic medical records (EMRs). Clinical trial adverse event (AE) logs and patient-reported outcomes (PROs) are sources of data often available in the context of specific research projects. The aim of this study was to evaluate the extent of data concordance from these sources. Patients and Methods: Patients enrolled in clinical trials or receiving standard treatment for lung cancer (n = 62) completed validated questionnaires on physical and psychological symptoms at up to three assessment points. Temporally matched documentation was extracted from EMR notes and, for clinical trial participants (n = 41), AE logs. Evaluated data included symptom assessment, vital signs, medication logs, and laboratory values. Agreement (positive, negative) and Cohen’s κ coefficients were calculated to assess concordance of symptoms among sources, with PROs considered the gold standard. Results: Patient-reported weight loss correlated significantly with clinical measurements ( t = 2.90; P = .02), and average number of PROs correlated negatively with albumin concentration, supporting PROs as the gold standard. Comparisons of PROs versus EMR yielded poor concordance across 11 physical symptoms, anxiety, and depressive symptoms (all κ < 0.40). Providers under-reported the presence of each symptom in the EMR compared with PROs. AE logs showed similarly poor concordance with PROs (all κ < 0.40, except shortness of breath). Negative agreement among sources was higher than positive agreement for all symptoms except pain. Conclusion: There was poor concordance between EMR notes and AE logs with PROs. Findings suggest that EMR notes and AE logs may not be reliable sources for capturing physical and psychological symptoms experienced by patients with lung cancer, supporting use of PRO assessments in oncology practices.Keywords
This publication has 53 references indexed in Scilit:
- Anxiety and depression after cancer diagnosis: Prevalence rates by cancer type, gender, and ageJournal of Affective Disorders, 2012
- Uncertainty and psychological adjustment in patients with lung cancerPsycho-Oncology, 2012
- Temporal and within practice variability in the health improvement networkPharmacoepidemiology and Drug Safety, 2011
- Adverse Symptom Event Reporting by Patients vs Clinicians: Relationships With Clinical OutcomesJNCI: Journal of the National Cancer Institute, 2009
- Clinician versus nurse symptom reporting using the National Cancer Institute—Common Terminology Criteria for Adverse Events during chemotherapy: results of a comparison based on patient's self-reported questionnaireAnnals of Oncology, 2009
- Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics supportJournal of Biomedical Informatics, 2009
- Self-reported quality of life (QL) of individual cancer patients — Concordance of results with clinical course and medical recordsEuropean Journal of Cancer, 1999
- The Memorial Symptom Assessment Scale: an instrument for the evaluation of symptom prevalence, characteristics and distressEuropean Journal of Cancer, 1994
- The CES-D ScaleApplied Psychological Measurement, 1977
- Appraisal of methods for the study of chemotherapy of cancer in man: Comparative therapeutic trial of nitrogen mustard and triethylene thiophosphoramideJournal of Chronic Diseases, 1960