Daniella Park
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Daniella Park has a total of 15 co-authors. Here are the top co-authors by number of shared publications:
- Darios Getahun
Department of Research & Evaluation Kaiser Permanente Southern California Pasadena CA USA
6 shared publications - Jiaxiao Shi
Department of Research & Evaluation, Kaiser Permanente Southern California, Pasadena, CA, United States
6 shared publications - Vicki Y. Chiu
Department of Research & Evaluation, Kaiser Permanente Southern California, Pasadena, CA, United States
6 shared publications - Carol Mao
Johnson & Johnson, Horsham, PA, United States
4 shared publications - Fagen Xie
Department of Research & Evaluation, Kaiser Permanente Southern California, Pasadena, CA, United States
4 shared publications - Michael J. Fassett
Department of Obstetrics and Gynecology, Kaiser Permanente West Los Angeles Medical Center, Los Angeles, CA, United States
4 shared publications
Latest Publications
- Open Access
- 5 June 2026
- Published by JMIR Publications Inc. in JMIR Pediatrics and Parenting
- Vol. 9, e88772
Health Care Use and Recurrence Rate in Hemolytic Disease of the Fetus and Newborn: Retrospective Cohort Study
Background: Hemolytic disease of the fetus and newborn (HDFN) is a life-threatening condition resulting from maternal-fetal erythrocyte antigen incompatibility. Although anti–Rhesus D (RhD) prophylaxis has reduced RhD-associated cases, HDFN persists due to non-RhD antibodies and gaps in prevention. Population-based data on maternal and neonatal outcomes and recurrence patterns are limited. Objective: This study aimed to characterize maternal and neonatal outcomes, health care use patterns, and recurrence rates of HDFN across pregnancies. Methods: We conducted a retrospective cohort study of 464,711 pregnancies within the Kaiser Permanente Southern California system from January 1, 2008, to June 30, 2022. HDFN diagnoses were confirmed using validated natural language processing–assisted manual chart review and followed through 2023. Maternal characteristics, neonatal outcomes, and health care use were compared by HDFN status, and recurrence patterns were evaluated among individuals with ≥2 pregnancies. Chi-square tests and Wilcoxon rank-sum tests were used to compare characteristics between HDFN and non-HDFN pregnancies. Statistical significance was defined as P<.05. Results: Among all pregnancies, 139 of 464,711 (0.03%) were diagnosed with HDFN. Women with HDFN were more likely than those without HDFN to be older (aged ≥35 years; n=42, 30.2% vs n=97,146, 20.9%) and multiparous (n=121, 87.1% vs n=264,766, 57%). Infants affected by HDFN had higher rates of preterm birth (n=40, 28.4% vs n=42,240, 9.5%), low birth weight (<2500 g; n=22, 15.6% vs n=31,740, 7.1%), and neonatal jaundice (n=92, 65.2% vs n=162,465, 36.4%) than non-HDFN infants. Delivery hospitalizations (median 5.0, IQR 2.0-7.5 days vs median 2.0, IQR 1.0-2.0 days) and neonatal intensive care unit stays (median 4.0, IQR 0.0-7.0 days vs median 0.0, IQR 0.0-0.0 days) were longer, and maternal nondelivery hospitalizations were more frequent (n=27, 19.4% vs n=23,228, 5%) among pregnancies complicated by HDFN. Among women with a prior HDFN-affected pregnancy, 83.3% (n=25) experienced recurrence in a subsequent pregnancy. Of these recurrent cases, 32% (n=8) were severe, and 75% (n=6) involved fetal anemia requiring at least 1 intrauterine transfusion. Conclusions: HDFN was rare but was associated with substantial maternal and neonatal morbidity, including higher rates of preterm birth, increased neonatal intensive care unit admissions, and greater health care use. Recurrence was frequent and clinically significant, underscoring the importance of early surveillance and proactive management strategies.
- 5 June 2026
- Published by JMIR Publications Inc. in JMIR Pediatrics and Parenting
- Vol. 9, e88772
Open AccessHealth Care Use and Recurrence Rate in Hemolytic Disease of the Fetus and Newborn: Retrospective Cohort Study
Background: Hemolytic disease of the fetus and newborn (HDFN) is a life-threatening condition resulting from maternal-fetal erythrocyte antigen incompatibility. Although anti–Rhesus D (RhD) prophylaxis has reduced RhD-associated cases, HDFN persists due to non-RhD antibodies and gaps in prevention. Population-based data on maternal and neonatal outcomes and recurrence patterns are limited. Objective: This study aimed to characterize maternal and neonatal outcomes, health care use patterns, and recurrence rates of HDFN across pregnancies. Methods: We conducted a retrospective cohort study of 464,711 pregnancies within the Kaiser Permanente Southern California system from January 1, 2008, to June 30, 2022. HDFN diagnoses were confirmed using validated natural language processing–assisted manual chart review and followed through 2023. Maternal characteristics, neonatal outcomes, and health care use were compared by HDFN status, and recurrence patterns were evaluated among individuals with ≥2 pregnancies. Chi-square tests and Wilcoxon rank-sum tests were used to compare characteristics between HDFN and non-HDFN pregnancies. Statistical significance was defined as P<.05. Results: Among all pregnancies, 139 of 464,711 (0.03%) were diagnosed with HDFN. Women with HDFN were more likely than those without HDFN to be older (aged ≥35 years; n=42, 30.2% vs n=97,146, 20.9%) and multiparous (n=121, 87.1% vs n=264,766, 57%). Infants affected by HDFN had higher rates of preterm birth (n=40, 28.4% vs n=42,240, 9.5%), low birth weight (<2500 g; n=22, 15.6% vs n=31,740, 7.1%), and neonatal jaundice (n=92, 65.2% vs n=162,465, 36.4%) than non-HDFN infants. Delivery hospitalizations (median 5.0, IQR 2.0-7.5 days vs median 2.0, IQR 1.0-2.0 days) and neonatal intensive care unit stays (median 4.0, IQR 0.0-7.0 days vs median 0.0, IQR 0.0-0.0 days) were longer, and maternal nondelivery hospitalizations were more frequent (n=27, 19.4% vs n=23,228, 5%) among pregnancies complicated by HDFN. Among women with a prior HDFN-affected pregnancy, 83.3% (n=25) experienced recurrence in a subsequent pregnancy. Of these recurrent cases, 32% (n=8) were severe, and 75% (n=6) involved fetal anemia requiring at least 1 intrauterine transfusion. Conclusions: HDFN was rare but was associated with substantial maternal and neonatal morbidity, including higher rates of preterm birth, increased neonatal intensive care unit admissions, and greater health care use. Recurrence was frequent and clinically significant, underscoring the importance of early surveillance and proactive management strategies.
- Open Access
- 9 December 2025
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 14, e77836
Feasibility of Hemolytic Disease of the Fetus and Newborn Case Ascertainment and Assessing Its Impact on Prenatal and Postnatal Outcomes: Protocol for Observational Studies
Background: Hemolytic disease of the fetus and newborn (HDFN) is a rare but serious condition caused by maternal-fetal red blood cell antigen incompatibility. In an affected pregnancy, maternal immunoglobulin G antibodies cross the placenta and target fetal or neonatal red blood cells, leading to hemolysis, hyperbilirubinemia, and anemia. Although routine screening and alloimmunization prevention programs have contributed to the decline in HDFN in the United States, further understanding of its epidemiology is still needed. Objective: This protocol aims to provide an overview of the study design, methodology, and analytical approach used to investigate the epidemiology, treatment, and health care resource use of HDFN within a large integrated health care system. Methods: We conducted a retrospective cohort study of pregnant women who received obstetric care in the Kaiser Permanente Southern California (KPSC) health care system from January 1, 2008, to June 30, 2022. To identify HDFN cases, we used a novel methodology developed by KPSC researchers combining structured data and detailed clinical information extracted from unstructured records via a natural language processing–assisted chart review process. Chi-square and Wilcoxon rank sum tests were used to compare the distributions of maternal and infant demographic characteristics, as well as medical and perinatal conditions, by HDFN status. We also evaluated the association between HDFN and adverse perinatal outcomes using logistic regression models. Planned analyses using this unique cohort will include describing the annual prevalence, health care resource use, and treatment patterns of mothers and infants by HDFN status. Results: The study population consisted of 464,711 pregnancies, of which 136 (0.03%) were HDFN cases confirmed by chart review, resulting in 138 (0.03%) births (n=137, 0.99% live births and n=1, 0.01% stillbirth). The mean age at pregnancy was 29.8 (SD 5.7) years, and the population was racially and ethnically diverse. Conclusions: We present an overview of the methodology developed by KPSC clinicians and researchers on the epidemiology, treatment, and health care resource use of HDFN within a large and demographically diverse population of pregnant women. Our novel methodology, combining both structured and unstructured data and a natural language processing–assisted chart review process, ensures the successful identification of true cases to carry out pharmaco-epidemiological studies. International Registered Report Identifier (IRRID): DERR1-10.2196/77836
- 9 December 2025
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 14, e77836
Open AccessFeasibility of Hemolytic Disease of the Fetus and Newborn Case Ascertainment and Assessing Its Impact on Prenatal and Postnatal Outcomes: Protocol for Observational Studies
Background: Hemolytic disease of the fetus and newborn (HDFN) is a rare but serious condition caused by maternal-fetal red blood cell antigen incompatibility. In an affected pregnancy, maternal immunoglobulin G antibodies cross the placenta and target fetal or neonatal red blood cells, leading to hemolysis, hyperbilirubinemia, and anemia. Although routine screening and alloimmunization prevention programs have contributed to the decline in HDFN in the United States, further understanding of its epidemiology is still needed. Objective: This protocol aims to provide an overview of the study design, methodology, and analytical approach used to investigate the epidemiology, treatment, and health care resource use of HDFN within a large integrated health care system. Methods: We conducted a retrospective cohort study of pregnant women who received obstetric care in the Kaiser Permanente Southern California (KPSC) health care system from January 1, 2008, to June 30, 2022. To identify HDFN cases, we used a novel methodology developed by KPSC researchers combining structured data and detailed clinical information extracted from unstructured records via a natural language processing–assisted chart review process. Chi-square and Wilcoxon rank sum tests were used to compare the distributions of maternal and infant demographic characteristics, as well as medical and perinatal conditions, by HDFN status. We also evaluated the association between HDFN and adverse perinatal outcomes using logistic regression models. Planned analyses using this unique cohort will include describing the annual prevalence, health care resource use, and treatment patterns of mothers and infants by HDFN status. Results: The study population consisted of 464,711 pregnancies, of which 136 (0.03%) were HDFN cases confirmed by chart review, resulting in 138 (0.03%) births (n=137, 0.99% live births and n=1, 0.01% stillbirth). The mean age at pregnancy was 29.8 (SD 5.7) years, and the population was racially and ethnically diverse. Conclusions: We present an overview of the methodology developed by KPSC clinicians and researchers on the epidemiology, treatment, and health care resource use of HDFN within a large and demographically diverse population of pregnant women. Our novel methodology, combining both structured and unstructured data and a natural language processing–assisted chart review process, ensures the successful identification of true cases to carry out pharmaco-epidemiological studies. International Registered Report Identifier (IRRID): DERR1-10.2196/77836
- Open Access
- 2 December 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Health Care Use and Recurrence Rate in Hemolytic Disease of the Fetus and Newborn: Retrospective Cohort Study (Preprint)
BACKGROUND Hemolytic disease of the fetus and newborn (HDFN) is a life-threatening condition resulting from maternal-fetal erythrocyte antigen incompatibility. Although anti–Rhesus D (RhD) prophylaxis has reduced RhD-associated cases, HDFN persists due to non-RhD antibodies and gaps in prevention. Population-based data on maternal and neonatal outcomes and recurrence patterns are limited. OBJECTIVE This study aimed to characterize maternal and neonatal outcomes, health care use patterns, and recurrence rates of HDFN across pregnancies. METHODS We conducted a retrospective cohort study of 464,711 pregnancies within the Kaiser Permanente Southern California system from January 1, 2008, to June 30, 2022. HDFN diagnoses were confirmed using validated natural language processing–assisted manual chart review and followed through 2023. Maternal characteristics, neonatal outcomes, and health care use were compared by HDFN status, and recurrence patterns were evaluated among individuals with ≥2 pregnancies. Chi-square tests and Wilcoxon rank-sum tests were used to compare characteristics between HDFN and non-HDFN pregnancies. Statistical significance was defined as P<.05. RESULTS Among all pregnancies, 139 of 464,711 (0.03%) were diagnosed with HDFN. Women with HDFN were more likely than those without HDFN to be older (aged ≥35 years; n=42, 30.2% vs n=97,146, 20.9%) and multiparous (n=121, 87.1% vs n=264,766, 57%). Infants affected by HDFN had higher rates of preterm birth (n=40, 28.4% vs n=42,240, 9.5%), low birth weight (<2500 g; n=22, 15.6% vs n=31,740, 7.1%), and neonatal jaundice (n=92, 65.2% vs n=162,465, 36.4%) than non-HDFN infants. Delivery hospitalizations (median 5.0, IQR 2.0-7.5 days vs median 2.0, IQR 1.0-2.0 days) and neonatal intensive care unit stays (median 4.0, IQR 0.0-7.0 days vs median 0.0, IQR 0.0-0.0 days) were longer, and maternal nondelivery hospitalizations were more frequent (n=27, 19.4% vs n=23,228, 5%) among pregnancies complicated by HDFN. Among women with a prior HDFN-affected pregnancy, 83.3% (n=25) experienced recurrence in a subsequent pregnancy. Of these recurrent cases, 32% (n=8) were severe, and 75% (n=6) involved fetal anemia requiring at least 1 intrauterine transfusion. CONCLUSIONS HDFN was rare but was associated with substantial maternal and neonatal morbidity, including higher rates of preterm birth, increased neonatal intensive care unit admissions, and greater health care use. Recurrence was frequent and clinically significant, underscoring the importance of early surveillance and proactive management strategies.
- 2 December 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessHealth Care Use and Recurrence Rate in Hemolytic Disease of the Fetus and Newborn: Retrospective Cohort Study (Preprint)
BACKGROUND Hemolytic disease of the fetus and newborn (HDFN) is a life-threatening condition resulting from maternal-fetal erythrocyte antigen incompatibility. Although anti–Rhesus D (RhD) prophylaxis has reduced RhD-associated cases, HDFN persists due to non-RhD antibodies and gaps in prevention. Population-based data on maternal and neonatal outcomes and recurrence patterns are limited. OBJECTIVE This study aimed to characterize maternal and neonatal outcomes, health care use patterns, and recurrence rates of HDFN across pregnancies. METHODS We conducted a retrospective cohort study of 464,711 pregnancies within the Kaiser Permanente Southern California system from January 1, 2008, to June 30, 2022. HDFN diagnoses were confirmed using validated natural language processing–assisted manual chart review and followed through 2023. Maternal characteristics, neonatal outcomes, and health care use were compared by HDFN status, and recurrence patterns were evaluated among individuals with ≥2 pregnancies. Chi-square tests and Wilcoxon rank-sum tests were used to compare characteristics between HDFN and non-HDFN pregnancies. Statistical significance was defined as P<.05. RESULTS Among all pregnancies, 139 of 464,711 (0.03%) were diagnosed with HDFN. Women with HDFN were more likely than those without HDFN to be older (aged ≥35 years; n=42, 30.2% vs n=97,146, 20.9%) and multiparous (n=121, 87.1% vs n=264,766, 57%). Infants affected by HDFN had higher rates of preterm birth (n=40, 28.4% vs n=42,240, 9.5%), low birth weight (<2500 g; n=22, 15.6% vs n=31,740, 7.1%), and neonatal jaundice (n=92, 65.2% vs n=162,465, 36.4%) than non-HDFN infants. Delivery hospitalizations (median 5.0, IQR 2.0-7.5 days vs median 2.0, IQR 1.0-2.0 days) and neonatal intensive care unit stays (median 4.0, IQR 0.0-7.0 days vs median 0.0, IQR 0.0-0.0 days) were longer, and maternal nondelivery hospitalizations were more frequent (n=27, 19.4% vs n=23,228, 5%) among pregnancies complicated by HDFN. Among women with a prior HDFN-affected pregnancy, 83.3% (n=25) experienced recurrence in a subsequent pregnancy. Of these recurrent cases, 32% (n=8) were severe, and 75% (n=6) involved fetal anemia requiring at least 1 intrauterine transfusion. CONCLUSIONS HDFN was rare but was associated with substantial maternal and neonatal morbidity, including higher rates of preterm birth, increased neonatal intensive care unit admissions, and greater health care use. Recurrence was frequent and clinically significant, underscoring the importance of early surveillance and proactive management strategies.
- Open Access
- 21 May 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Feasibility of Hemolytic Disease of the Fetus and Newborn Case Ascertainment and Assessing Its Impact on Prenatal and Postnatal Outcomes: Protocol for Observational Studies (Preprint)
BACKGROUND Hemolytic disease of the fetus and newborn (HDFN) is a rare but serious condition caused by maternal-fetal red blood cell antigen incompatibility. In an affected pregnancy, maternal immunoglobulin G antibodies cross the placenta and target fetal or neonatal red blood cells, leading to hemolysis, hyperbilirubinemia, and anemia. Although routine screening and alloimmunization prevention programs have contributed to the decline in HDFN in the United States, further understanding of its epidemiology is still needed. OBJECTIVE This protocol aims to provide an overview of the study design, methodology, and analytical approach used to investigate the epidemiology, treatment, and health care resource use of HDFN within a large integrated health care system. METHODS We conducted a retrospective cohort study of pregnant women who received obstetric care in the Kaiser Permanente Southern California (KPSC) health care system from January 1, 2008, to June 30, 2022. To identify HDFN cases, we used a novel methodology developed by KPSC researchers combining structured data and detailed clinical information extracted from unstructured records via a natural language processing–assisted chart review process. Chi-square and Wilcoxon rank sum tests were used to compare the distributions of maternal and infant demographic characteristics, as well as medical and perinatal conditions, by HDFN status. We also evaluated the association between HDFN and adverse perinatal outcomes using logistic regression models. Planned analyses using this unique cohort will include describing the annual prevalence, health care resource use, and treatment patterns of mothers and infants by HDFN status. RESULTS The study population consisted of 464,711 pregnancies, of which 136 (0.03%) were HDFN cases confirmed by chart review, resulting in 138 (0.03%) births (n=137, 0.99% live births and n=1, 0.01% stillbirth). The mean age at pregnancy was 29.8 (SD 5.7) years, and the population was racially and ethnically diverse. CONCLUSIONS We present an overview of the methodology developed by KPSC clinicians and researchers on the epidemiology, treatment, and health care resource use of HDFN within a large and demographically diverse population of pregnant women. Our novel methodology, combining both structured and unstructured data and a natural language processing–assisted chart review process, ensures the successful identification of true cases to carry out pharmaco-epidemiological studies. INTERNATIONAL REGISTERED REPORT DERR1-10.2196/77836
- 21 May 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessFeasibility of Hemolytic Disease of the Fetus and Newborn Case Ascertainment and Assessing Its Impact on Prenatal and Postnatal Outcomes: Protocol for Observational Studies (Preprint)
BACKGROUND Hemolytic disease of the fetus and newborn (HDFN) is a rare but serious condition caused by maternal-fetal red blood cell antigen incompatibility. In an affected pregnancy, maternal immunoglobulin G antibodies cross the placenta and target fetal or neonatal red blood cells, leading to hemolysis, hyperbilirubinemia, and anemia. Although routine screening and alloimmunization prevention programs have contributed to the decline in HDFN in the United States, further understanding of its epidemiology is still needed. OBJECTIVE This protocol aims to provide an overview of the study design, methodology, and analytical approach used to investigate the epidemiology, treatment, and health care resource use of HDFN within a large integrated health care system. METHODS We conducted a retrospective cohort study of pregnant women who received obstetric care in the Kaiser Permanente Southern California (KPSC) health care system from January 1, 2008, to June 30, 2022. To identify HDFN cases, we used a novel methodology developed by KPSC researchers combining structured data and detailed clinical information extracted from unstructured records via a natural language processing–assisted chart review process. Chi-square and Wilcoxon rank sum tests were used to compare the distributions of maternal and infant demographic characteristics, as well as medical and perinatal conditions, by HDFN status. We also evaluated the association between HDFN and adverse perinatal outcomes using logistic regression models. Planned analyses using this unique cohort will include describing the annual prevalence, health care resource use, and treatment patterns of mothers and infants by HDFN status. RESULTS The study population consisted of 464,711 pregnancies, of which 136 (0.03%) were HDFN cases confirmed by chart review, resulting in 138 (0.03%) births (n=137, 0.99% live births and n=1, 0.01% stillbirth). The mean age at pregnancy was 29.8 (SD 5.7) years, and the population was racially and ethnically diverse. CONCLUSIONS We present an overview of the methodology developed by KPSC clinicians and researchers on the epidemiology, treatment, and health care resource use of HDFN within a large and demographically diverse population of pregnant women. Our novel methodology, combining both structured and unstructured data and a natural language processing–assisted chart review process, ensures the successful identification of true cases to carry out pharmaco-epidemiological studies. INTERNATIONAL REGISTERED REPORT DERR1-10.2196/77836
- Open Access
- 14 May 2024
- Published by JMIR Publications Inc. in JMIR Mental Health
- Vol. 11 (1) , e56812
Coding of Childhood Psychiatric and Neurodevelopmental Disorders in Electronic Health Records of a Large Integrated Health Care System: Validation Study
Background: Mental, emotional, and behavioral disorders are chronic pediatric conditions, and their prevalence has been on the rise over recent decades. Affected children have long-term health sequelae and a decline in health-related quality of life. Due to the lack of a validated database for pharmacoepidemiological research on selected mental, emotional, and behavioral disorders, there is uncertainty in their reported prevalence in the literature. Objectives: We aimed to evaluate the accuracy of coding related to pediatric mental, emotional, and behavioral disorders in a large integrated health care system’s electronic health records (EHRs) and compare the coding quality before and after the implementation of the International Classification of Diseases, Tenth Revision, Clinical Modification ( ICD-10-CM ) coding as well as before and after the COVID-19 pandemic. Methods: Medical records of 1200 member children aged 2-17 years with at least 1 clinical visit before the COVID-19 pandemic (January 1, 2012, to December 31, 2014, the ICD-9-CM coding period; and January 1, 2017, to December 31, 2019, the ICD-10-CM coding period) and after the COVID-19 pandemic (January 1, 2021, to December 31, 2022) were selected with stratified random sampling from EHRs for chart review. Two trained research associates reviewed the EHRs for all potential cases of autism spectrum disorder (ASD), attention-deficit hyperactivity disorder (ADHD), major depression disorder (MDD), anxiety disorder (AD), and disruptive behavior disorders (DBD) in children during the study period. Children were considered cases only if there was a mention of any one of the conditions (yes for diagnosis) in the electronic chart during the corresponding time period. The validity of diagnosis codes was evaluated by directly comparing them with the gold standard of chart abstraction using sensitivity, specificity, positive predictive value, negative predictive value, the summary statistics of the F -score, and Youden J statistic. κ statistic for interrater reliability among the 2 abstractors was calculated. Results: The overall agreement between the identification of mental, behavioral, and emotional conditions using diagnosis codes compared to medical record abstraction was strong and similar across the ICD-9-CM and ICD-10-CM coding periods as well as during the prepandemic and pandemic time periods. The performance of AD coding, while strong, was relatively lower compared to the other conditions. The weighted sensitivity, specificity, positive predictive value, and negative predictive value for each of the 5 conditions were as follows: 100%, 100%, 99.2%, and 100%, respectively, for ASD; 100%, 99.9%, 99.2%, and 100%, respectively, for ADHD; 100%, 100%, 100%, and 100%, respectively for DBD; 87.7%, 100%, 100%, and 99.2%, respectively, for AD; and 100%, 100%, 99.2%, and 100%, respectively, for MDD. The F -score and Youden J statistic ranged between 87.7% and 100%. The overall agreement between abstractors was almost perfect (κ=95%). Conclusions: Diagnostic codes are quite reliable for identifying selected childhood mental, behavioral, and emotional conditions. The findings remained similar during the pandemic and after the implementation of the ICD-10-CM coding in the EHR system.
- 14 May 2024
- Published by JMIR Publications Inc. in JMIR Mental Health
- Vol. 11 (1) , e56812
Open AccessCoding of Childhood Psychiatric and Neurodevelopmental Disorders in Electronic Health Records of a Large Integrated Health Care System: Validation Study
Background: Mental, emotional, and behavioral disorders are chronic pediatric conditions, and their prevalence has been on the rise over recent decades. Affected children have long-term health sequelae and a decline in health-related quality of life. Due to the lack of a validated database for pharmacoepidemiological research on selected mental, emotional, and behavioral disorders, there is uncertainty in their reported prevalence in the literature. Objectives: We aimed to evaluate the accuracy of coding related to pediatric mental, emotional, and behavioral disorders in a large integrated health care system’s electronic health records (EHRs) and compare the coding quality before and after the implementation of the International Classification of Diseases, Tenth Revision, Clinical Modification ( ICD-10-CM ) coding as well as before and after the COVID-19 pandemic. Methods: Medical records of 1200 member children aged 2-17 years with at least 1 clinical visit before the COVID-19 pandemic (January 1, 2012, to December 31, 2014, the ICD-9-CM coding period; and January 1, 2017, to December 31, 2019, the ICD-10-CM coding period) and after the COVID-19 pandemic (January 1, 2021, to December 31, 2022) were selected with stratified random sampling from EHRs for chart review. Two trained research associates reviewed the EHRs for all potential cases of autism spectrum disorder (ASD), attention-deficit hyperactivity disorder (ADHD), major depression disorder (MDD), anxiety disorder (AD), and disruptive behavior disorders (DBD) in children during the study period. Children were considered cases only if there was a mention of any one of the conditions (yes for diagnosis) in the electronic chart during the corresponding time period. The validity of diagnosis codes was evaluated by directly comparing them with the gold standard of chart abstraction using sensitivity, specificity, positive predictive value, negative predictive value, the summary statistics of the F -score, and Youden J statistic. κ statistic for interrater reliability among the 2 abstractors was calculated. Results: The overall agreement between the identification of mental, behavioral, and emotional conditions using diagnosis codes compared to medical record abstraction was strong and similar across the ICD-9-CM and ICD-10-CM coding periods as well as during the prepandemic and pandemic time periods. The performance of AD coding, while strong, was relatively lower compared to the other conditions. The weighted sensitivity, specificity, positive predictive value, and negative predictive value for each of the 5 conditions were as follows: 100%, 100%, 99.2%, and 100%, respectively, for ASD; 100%, 99.9%, 99.2%, and 100%, respectively, for ADHD; 100%, 100%, 100%, and 100%, respectively for DBD; 87.7%, 100%, 100%, and 99.2%, respectively, for AD; and 100%, 100%, 99.2%, and 100%, respectively, for MDD. The F -score and Youden J statistic ranged between 87.7% and 100%. The overall agreement between abstractors was almost perfect (κ=95%). Conclusions: Diagnostic codes are quite reliable for identifying selected childhood mental, behavioral, and emotional conditions. The findings remained similar during the pandemic and after the implementation of the ICD-10-CM coding in the EHR system.
- Open Access
- 31 January 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Coding of Childhood Psychiatric and Neurodevelopmental Disorders in Electronic Health Records of a Large Integrated Healthcare System: A Validation Study (Preprint)
BACKGROUND Mental, emotional, and behavioral disorders are chronic pediatric conditions, and their prevalence has been on the rise over recent decades. Affected children have long-term health sequelae and a decline in health-related quality of life. Due to the lack of a validated database for pharmacoepidemiological research on selected mental, emotional, and behavioral disorders, there is uncertainty in the reported prevalence in the literature. OBJECTIVE To evaluate the accuracy of pediatric mental, emotional, and behavioral disorders-related coding in a large integrated healthcare system’s electronic health records (EHR) and compare the coding quality before and after implementation of the International Classification of Diseases-Clinical Modification [ICD]-10-CM coding and pre- and post-COVID-19 pandemic era. METHODS Medical records of 1200 member children aged 2-17 years with at least one clinical visit during pre-COVID-19 (01/01/2012 - 12/31/2014 [ICD-9-CM coding period] and 01/01/2017 - 12/31/2019 [ICD-10-CM coding period]) and post-COVID-19 (01/01/2021 - 12/31/2022) pandemic era were selected with stratified random sampling from EHR for chart review. Two trained Research Associates (RA) reviewed EHR for all potential cases of autism spectrum disorders (ASD), attention-deficit hyperactivity disorder (ADHD), major depression disorder (MDD), anxiety disorders (AD), and disruptive behavior disorders (DBD) in children during the study period. Children were considered cases only if there was a mention of any one of the conditions (Yes for diagnosis) in the electronic chart during the corresponding time period. The validity of diagnosis codes was evaluated by directly comparing it with the gold standard of chart abstraction using sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), the summary statistics of F-score (F), and Youden’s J Statistic (J). Kappa statistic (K) for interrater reliability (IRR) among the two abstractors was calculated. RESULTS The overall agreement between the identification of mental, behavioral, and emotional conditions using diagnosis codes compared to medical record abstraction was strong and similar across the ICD-9-CM and ICD-10-CM coding periods as well as during the pre- pandemic and pandemic time periods. Performance of AD coding, while strong, was relatively lower compared to the other conditions. The weighted sensitivity, specificity, PPV and NPV for each of the 5 conditions were as follows: ASD (100.0%, 100.0%, 99.2%, 100.0%), ADHD (100.0%, 99.9%, 99.2%, 100.0%), DBD (100.0%, 100.0%, 100.0%, 100.0%), AD (87.7%, 100.0%, 100.0%, 99.2%) and MDD (100.0%, 100.0%, 99.2%, 100.0%). The F-score and Youden’s J Statistic ranged between 87.7 and 100.0%. The overall agreement between abstractors was almost perfect (K=95%). CONCLUSIONS Diagnostic codes are quite reliable for identifying selected childhood mental, behavioral, and emotional conditions. The findings remained similar during the pandemic and after the implementation of the ICD-10-CM coding in the EHR system. CLINICALTRIAL Not Applicable
- 31 January 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessCoding of Childhood Psychiatric and Neurodevelopmental Disorders in Electronic Health Records of a Large Integrated Healthcare System: A Validation Study (Preprint)
BACKGROUND Mental, emotional, and behavioral disorders are chronic pediatric conditions, and their prevalence has been on the rise over recent decades. Affected children have long-term health sequelae and a decline in health-related quality of life. Due to the lack of a validated database for pharmacoepidemiological research on selected mental, emotional, and behavioral disorders, there is uncertainty in the reported prevalence in the literature. OBJECTIVE To evaluate the accuracy of pediatric mental, emotional, and behavioral disorders-related coding in a large integrated healthcare system’s electronic health records (EHR) and compare the coding quality before and after implementation of the International Classification of Diseases-Clinical Modification [ICD]-10-CM coding and pre- and post-COVID-19 pandemic era. METHODS Medical records of 1200 member children aged 2-17 years with at least one clinical visit during pre-COVID-19 (01/01/2012 - 12/31/2014 [ICD-9-CM coding period] and 01/01/2017 - 12/31/2019 [ICD-10-CM coding period]) and post-COVID-19 (01/01/2021 - 12/31/2022) pandemic era were selected with stratified random sampling from EHR for chart review. Two trained Research Associates (RA) reviewed EHR for all potential cases of autism spectrum disorders (ASD), attention-deficit hyperactivity disorder (ADHD), major depression disorder (MDD), anxiety disorders (AD), and disruptive behavior disorders (DBD) in children during the study period. Children were considered cases only if there was a mention of any one of the conditions (Yes for diagnosis) in the electronic chart during the corresponding time period. The validity of diagnosis codes was evaluated by directly comparing it with the gold standard of chart abstraction using sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), the summary statistics of F-score (F), and Youden’s J Statistic (J). Kappa statistic (K) for interrater reliability (IRR) among the two abstractors was calculated. RESULTS The overall agreement between the identification of mental, behavioral, and emotional conditions using diagnosis codes compared to medical record abstraction was strong and similar across the ICD-9-CM and ICD-10-CM coding periods as well as during the pre- pandemic and pandemic time periods. Performance of AD coding, while strong, was relatively lower compared to the other conditions. The weighted sensitivity, specificity, PPV and NPV for each of the 5 conditions were as follows: ASD (100.0%, 100.0%, 99.2%, 100.0%), ADHD (100.0%, 99.9%, 99.2%, 100.0%), DBD (100.0%, 100.0%, 100.0%, 100.0%), AD (87.7%, 100.0%, 100.0%, 99.2%) and MDD (100.0%, 100.0%, 99.2%, 100.0%). The F-score and Youden’s J Statistic ranged between 87.7 and 100.0%. The overall agreement between abstractors was almost perfect (K=95%). CONCLUSIONS Diagnostic codes are quite reliable for identifying selected childhood mental, behavioral, and emotional conditions. The findings remained similar during the pandemic and after the implementation of the ICD-10-CM coding in the EHR system. CLINICALTRIAL Not Applicable