Locating Youth Exposed to Parental Justice Involvement in the Electronic Health Record: Development of a Natural Language Processing Model
Open Access
- 21 March 2022
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Pediatrics and Parenting
- Vol. 5 (1) , e33614
Abstract
Background: Parental justice involvement (eg, prison, jail, parole, or probation) is an unfortunately common and disruptive household adversity for many US youths, disproportionately affecting families of color and rural families. Data on this adversity has not been captured routinely in pediatric health care settings, and if it is, it is not discrete nor able to be readily analyzed for purposes of research. Objective: In this study, we outline our process training a state-of-the-art natural language processing model using unstructured clinician notes of one large pediatric health system to identify patients who have experienced a justice-involved parent. Methods: Using the electronic health record database of a large Midwestern pediatric hospital-based institution from 2011-2019, we located clinician notes (of any type and written by any type of provider) that were likely to contain such evidence of family justice involvement via a justice-keyword search (eg, prison and jail). To train and validate the model, we used a labeled data set of 7500 clinician notes identifying whether the patient was ever exposed to parental justice involvement. We calculated the precision and recall of the model and compared those rates to the keyword search. Results: The development of the machine learning model increased the precision (positive predictive value) of locating children affected by parental justice involvement in the electronic health record from 61% (a simple keyword search) to 92%. Conclusions: The use of machine learning may be a feasible approach to addressing the gaps in our understanding of the health and health services of underrepresented youth who encounter childhood adversities not routinely captured—particularly for children of justice-involved parents.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Value of Neighborhood Socioeconomic Status in Predicting Risk of Outcomes in Studies That Use Electronic Health Record DataJAMA Network Open, 2018
- Risk Assessment for Parents Who Suspect Their Child Has Autism Spectrum Disorder: Machine Learning ApproachJournal of Medical Internet Research, 2018
- Parental Incarceration and Child Health in the United StatesEpidemiologic Reviews, 2018
- Mining 100 million notes to find homelessness and adverse childhood experiences: 2 case studies of rare and severe social determinants of health in electronic health recordsJournal of the American Medical Informatics Association, 2017
- Performance evaluation of classification algorithms by k-fold and leave-one-out cross validationPattern Recognition, 2015
- Child welfare outcomes for youth in care as a result of parental death or parental incarcerationChild Abuse & Neglect, 2015
- C-Reactive Protein Levels Among U.S. Adults Exposed to Parental IncarcerationBiological Research For Nursing, 2014
- PEDSnet: a National Pediatric Learning Health SystemJournal of the American Medical Informatics Association, 2014
- The Impact of Parental Incarceration on the Physical and Mental Health of Young AdultsPediatrics, 2013
- Parental Incarceration and Multiple Risk Experiences: Effects on Family Dynamics and Children’s DelinquencyJournal of Youth and Adolescence, 2009