Comparing medical history data derived from electronic health records and survey answers in the All of Us Research Program
Open Access
- 9 April 2022
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 29 (7) , 1131-1141
Abstract
A participant’s medical history is important in clinical research and can be captured from electronic health records (EHRs) and self-reported surveys. Both can be incomplete, EHR due to documentation gaps or lack of interoperability and surveys due to recall bias or limited health literacy. This analysis compares medical history collected in the All of Us Research Program through both surveys and EHRs. The All of Us medical history survey includes self-report questionnaire that asks about diagnoses to over 150 medical conditions organized into 12 disease categories. In each category, we identified the 3 most and least frequent self-reported diagnoses and retrieved their analogues from EHRs. We calculated agreement scores and extracted participant demographic characteristics for each comparison set. The 4th All of Us dataset release includes data from 314 994 participants; 28.3% of whom completed medical history surveys, and 65.5% of whom had EHR data. Hearing and vision category within the survey had the highest number of responses, but the second lowest positive agreement with the EHR (0.21). The Infectious disease category had the lowest positive agreement (0.12). Cancer conditions had the highest positive agreement (0.45) between the 2 data sources. Our study quantified the agreement of medical history between 2 sources—EHRs and self-reported surveys. Conditions that are usually undocumented in EHRs had low agreement scores, demonstrating that survey data can supplement EHR data. Disagreement between EHR and survey can help identify possible missing records and guide researchers to adjust for biases.Keywords
Funding Information
- National Institutes of Health Office of the Director: Data and Research Center (5 U2C OD023196)
This publication has 35 references indexed in Scilit:
- Phenome-wide association studies demonstrating pleiotropy of genetic variants within FTO with and without adjustment for body mass indexFrontiers in Genetics, 2014
- Assessment of administrative claims data for public health reporting of Salmonella in TennesseeJournal of the American Medical Informatics Association, 2014
- Systematic comparison of phenome-wide association study of electronic medical record data and genome-wide association study dataNature Biotechnology, 2013
- The Relationship Between Health, Education, and Health Literacy: Results From the Dutch Adult Literacy and Life Skills SurveyJournal of Health Communication, 2013
- Defining and measuring completeness of electronic health records for secondary useJournal of Biomedical Informatics, 2013
- Extracting medical information from narrative patient records: the case of medication-related informationJournal of the American Medical Informatics Association, 2010
- Automating the Assignment of Diagnosis Codes to Patient Encounters Using Example-based and Machine Learning TechniquesJournal of the American Medical Informatics Association, 2006
- Missing Clinical Information During Primary Care VisitsJAMA, 2005
- High agreement but low kappa: II. Resolving the paradoxesJournal of Clinical Epidemiology, 1990
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960