From micro to macro
Authors:
Open Access
- 24 August 2014
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 135-144
Abstract
Inferring phenotypic patterns from population-scale clinical data is a core computational task in the development of personalized medicine. One important source of data on which to conduct this type of research is patient Electronic Medical Records (EMR). However, the patient EMRs are typically sparse and noisy, which creates significant challenges if we use them directly to represent patient phenotypes. In this paper, we propose a data driven phenotyping framework called Pacifier (PAtient reCord densIFIER), where we interpret the longitudinal EMR data of each patient as a sparse matrix with a feature dimension and a time dimension, and derive more robust patient phenotypes by exploring the latent structure of those matrices. Specifically, we assume that each derived phenotype is composed of a subset of the medical features contained in original patient EMR, whose value evolves smoothly over time. We propose two formulations to achieve such goal. One is Individual Basis Approach (IBA), which assumes the phenotypes are different for every patient. The other is Shared Basis Approach (SBA), which assumes the patient population shares a common set of phenotypes. We develop an efficient optimization algorithm that is capable of resolving both problems efficiently. Finally we validate Pacifier on two real world EMR cohorts for the tasks of early prediction of Congestive Heart Failure (CHF) and End Stage Renal Disease (ESRD). Our results show that the predictive performance in both tasks can be improved significantly by the proposed algorithms (average AUC score improved from 0.689 to 0.816 on CHF, and from 0.756 to 0.838 on ESRD respectively, on diagnosis group granularity). We also illustrate some interesting phenotypes derived from our data.Keywords
Funding Information
- Division of Computing and Communication Foundations (CCF-1025177)
- National Institutes of Health (R01 LM010730)
- Division of Molecular and Cellular Biosciences (MCB-1026710)
- Division of Information and Intelligent Systems (IIS-0953662)
This publication has 25 references indexed in Scilit:
- Computational Phenotype Discovery Using Unsupervised Feature Learning over Noisy, Sparse, and Irregular Clinical DataPLOS ONE, 2013
- Supervised patient similarity measure of heterogeneous patient recordsACM SIGKDD Explorations Newsletter, 2012
- Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithmMathematical Programming Computation, 2012
- Prediction Modeling Using EHR DataMedical Care, 2010
- A Singular Value Thresholding Algorithm for Matrix CompletionSIAM Journal on Optimization, 2010
- Exact Matrix Completion via Convex OptimizationFoundations of Computational Mathematics, 2009
- Electronic Health Record-Based Cardiac Risk Assessment and Identification of Unmet Preventive NeedsMedical Care, 2009
- Validation of Prediction of Diabetes by the Archimedes Model and Comparison With Other Predicting ModelsDiabetes Care, 2008
- Utility of medical and drug history in fracture risk prediction among men and womenBone, 2002
- Arterial Calcifications, Arterial Stiffness, and Cardiovascular Risk in End-Stage Renal DiseaseHypertension, 2001