Exploring the Privacy-Preserving Properties of Word Embeddings: Algorithmic Validation Study
Open Access
- 15 July 2020
- journal article
- research article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 22 (7) , e18055
Abstract
Background: Word embeddings are dense numeric vectors used to represent language in neural networks. Until recently, there had been no publicly released embeddings trained on clinical data. Our work is the first to study the privacy implications of releasing these models. Objective: This paper aims to demonstrate that traditional word embeddings created on clinical corpora that have been deidentified by removing personal health information (PHI) can nonetheless be exploited to reveal sensitive patient information. Methods: We used embeddings created from 400,000 doctor-written consultation notes and experimented with 3 common word embedding methods to explore the privacy-preserving properties of each. Results: We found that if publicly released embeddings are trained from a corpus anonymized by PHI removal, it is possible to reconstruct up to 68.5% (n=411/600) of the full names that remain in the deidentified corpus and associated sensitive information to specific patients in the corpus from which the embeddings were created. We also found that the distance between the word vector representation of a patient’s name and a diagnostic billing code is informative and differs significantly from the distance between the name and a code not billed for that patient. Conclusions: Special care must be taken when sharing word embeddings created from clinical texts, as current approaches may compromise patient privacy. If PHI removal is used for anonymization before traditional word embeddings are trained, it is possible to attribute sensitive information to patients who have not been fully deidentified by the (necessarily imperfect) removal algorithms. A promising alternative (ie, anonymization by PHI replacement) may avoid these flaws. Our results are timely and critical, as an increasing number of researchers are pushing for publicly available health data.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- A comparison of word embeddings for the biomedical natural language processingJournal of Biomedical Informatics, 2018
- Comparing deep learning and concept extraction based methods for patient phenotyping from clinical narrativesPLOS ONE, 2018
- Deep Contextualized Word Representations2018
- De-identification of patient notes with recurrent neural networksJournal of the American Medical Informatics Association, 2016
- How to Generate a Good Word EmbeddingIEEE Intelligent Systems, 2016
- MIMIC-III, a freely accessible critical care databaseScientific Data, 2016
- Glove: Global Vectors for Word Representation2014
- Strategies for De-identification and Anonymization of Electronic Health Record Data for Use in Multicenter Research StudiesMedical Care, 2012
- Automated de-identification of free-text medical recordsBMC Medical Informatics and Decision Making, 2008
- A successful technique for removing names in pathology reports using an augmented search and replace method.2002