Improving domain adaptation in de-identification of electronic health records through self-training
Authors:
- 7 August 2021
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 28 (10) , 2093-2100
Abstract
Objective: De-identification is a fundamental task in electronic health records to remove protected health information entities. Deep learning models have proven to be promising tools to automate de-identification processes. However, when the target domain (where the model is applied) is different from the source domain (where the model is trained), the model often suffers a significant performance drop, commonly referred to as domain adaptation issue. In de-identification, domain adaptation issues can make the model vulnerable for deployment. In this work, we aim to close the domain gap by leveraging unlabeled data from the target domain. Materials and Methods: We introduce a self-training framework to address the domain adaptation issue by leveraging unlabeled data from the target domain. We validate the effectiveness on 4 standard de-identification datasets. In each experiment, we use a pair of datasets: labeled data from the source domain and unlabeled data from the target domain. We compare the proposed self-training framework with supervised learning that directly deploys the model trained on the source domain. Results: In summary, our proposed framework improves the F1-score by 5.38 (on average) when compared with direct deployment. For example, using i2b2-2014 as the training dataset and i2b2-2006 as the test, the proposed framework increases the F1-score from 76.61 to 85.41 (+8.8). The method also increases the F1-score by 10.86 for mimic-radiology and mimic-discharge. Conclusion: Our work demonstrates an effective self-training framework to boost the domain adaptation performance for the de-identification task for electronic health records.Keywords
This publication has 18 references indexed in Scilit:
- De-identification of clinical notes via recurrent neural network and conditional random fieldJournal of Biomedical Informatics, 2017
- De-identification of patient notes with recurrent neural networksJournal of the American Medical Informatics Association, 2016
- MIMIC-III, a freely accessible critical care databaseScientific Data, 2016
- Deep learning for visual understanding: A reviewNeurocomputing, 2016
- Automatic de-identification of French clinical records: comparison of rule-based and machine-learning approaches.2013
- Large-scale evaluation of automated clinical note de-identification and its impact on information extractionJournal of the American Medical Informatics Association, 2013
- Automatic de-identification of textual documents in the electronic health record: a review of recent researchBMC Medical Research Methodology, 2010
- Serving the enterprise and beyond with informatics for integrating biology and the bedside (i2b2)Journal of the American Medical Informatics Association, 2010
- Automated de-identification of free-text medical recordsBMC Medical Informatics and Decision Making, 2008
- Evaluating the State-of-the-Art in Automatic De-identificationJournal of the American Medical Informatics Association, 2007