Medical record linkage in health information systems by approximate string matching and clustering
Open Access
- 11 October 2005
- journal article
- Published by Springer Nature in BMC Medical Informatics and Decision Making
- Vol. 5 (1) , 32
Abstract
Background: Multiplication of data sources within heterogeneous healthcare information systems always results in redundant information, split among multiple databases. Our objective is to detect exact and approximate duplicates within identity records, in order to attain a better quality of information and to permit cross-linkage among stand-alone and clustered databases. Furthermore, we need to assist human decision making, by computing a value reflecting identity proximity.Methods: The proposed method is in three steps. The first step is to standardise and to index elementary identity fields, using blocking variables, in order to speed up information analysis. The second is to match similar pair records, relying on a global similarity value taken from the Porter-Jaro-Winkler algorithm. And the third is to create clusters of coherent related records, using graph drawing, agglomerative clustering methods and partitioning methods.Results: The batch analysis of 300,000 "supposedly" distinct identities isolates 240,000 true unique records, 24,000 duplicates (clusters composed of 2 records) and 3,000 clusters whose size is greater than or equal to 3 records.Conclusion: Duplicate-free databases, used in conjunction with relevant indexes and similarity values, allow immediate (i.e.: real-time) proximity detection when inserting a new identity.Keywords
This publication has 16 references indexed in Scilit:
- A clustering algorithm based on graph connectivityInformation Processing Letters, 2000
- Clustering Gene Expression PatternsJournal of Computational Biology, 1999
- A Method for Calibrating False-Match Rates in Record LinkageJournal of the American Statistical Association, 1995
- Graph drawing by force‐directed placementSoftware: Practice and Experience, 1991
- Advances in Record-Linkage Methodology as Applied to Matching the 1985 Census of Tampa, FloridaJournal of the American Statistical Association, 1989
- An algorithm for drawing general undirected graphsInformation Processing Letters, 1989
- Identification of common molecular subsequencesJournal of Molecular Biology, 1981
- The theory and computation of evolutionary distances: Pattern recognitionJournal of Algorithms, 1980
- Speech discrimination by dynamic programmingCybernetics and Systems Analysis, 1972
- Record linkageCommunications of the ACM, 1962