A clustering approach for detecting implausible observation values in electronic health records data
Open Access
- 23 July 2019
- journal article
- research article
- Published by Springer Nature in BMC Medical Informatics and Decision Making
- Vol. 19 (1) , 1-16
Abstract
Identifying implausible clinical observations (e.g., laboratory test and vital sign values) in Electronic Health Record (EHR) data using rule-based procedures is challenging. Anomaly/outlier detection methods can be applied as an alternative algorithmic approach to flagging such implausible values in EHRs. The primary objectives of this research were to develop and test an unsupervised clustering-based anomaly/outlier detection approach for detecting implausible observations in EHR data as an alternative algorithmic solution to the existing procedures. Our approach is built upon two underlying hypotheses that, (i) when there are large number of observations, implausible records should be sparse, and therefore (ii) if these data are clustered properly, clusters with sparse populations should represent implausible observations. To test these hypotheses, we applied an unsupervised clustering algorithm to EHR observation data on 50 laboratory tests from Partners HealthCare. We tested different specifications of the clustering approach and computed confusion matrix indices against a set of silver-standard plausibility thresholds. We compared the results from the proposed approach with conventional anomaly detection (CAD) approaches, including standard deviation and Mahalanobis distance. We found that the clustering approach produced results with exceptional specificity and high sensitivity. Compared with the conventional anomaly detection approaches, our proposed clustering approach resulted in significantly smaller number of false positive cases. Our contributions include (i) a clustering approach for identifying implausible EHR observations, (ii) evidence that implausible observations are sparse in EHR laboratory test results, (iii) a parallel implementation of the clustering approach on i2b2 star schema, and (3) a set of silver-standard plausibility thresholds for 50 laboratory tests that can be used in other studies for validation. The proposed algorithmic solution can augment human decisions to improve data quality. Therefore, a workflow is needed to complement the algorithm’s job and initiate necessary actions that need to be taken in order to improve the quality of data.Keywords
All Related Versions
Funding Information
- Patient-Centered Outcomes Research Institute (CDRN-1306-04608)
- National Human Genome Research Institute (R01-HG009174)
- U.S. National Library of Medicine (T15LM007092)
This publication has 21 references indexed in Scilit:
- Anomaly detection in medical treatment to discover unusual patient managementIIE Transactions on Healthcare Systems Engineering, 2013
- Workflow mining and outlier detection from clinical activity logsJournal of Biomedical Informatics, 2012
- Data clustering: 50 years beyond K-meansPattern Recognition Letters, 2010
- Anomaly detectionACM Computing Surveys, 2009
- A Survey of Outlier Detection MethodologiesArtificial Intelligence Review, 2004
- Finding the Number of Clusters in a DatasetJournal of the American Statistical Association, 2003
- Model-Based Clustering, Discriminant Analysis, and Density EstimationJournal of the American Statistical Association, 2002
- Outlier detection for high dimensional dataACM SIGMOD Record, 2001
- Distance-based outliers: algorithms and applicationsThe VLDB Journal, 2000
- The Mahalanobis distanceChemometrics and Intelligent Laboratory Systems, 2000