Augmenting Data Quality through High-Precision Gender Categorization
Authors:
Open Access
- 7 May 2019
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Journal of Data and Information Quality
- Vol. 11 (2) , 1-18
Abstract
Mappings of first name to gender have been widely recognized as a critical tool for the completion, study, and validation of data records in a range of areas. In this study, we investigate how organizations with large databases of existing entities can create their own mappings between first names and gender and how these mappings can be improved and utilized. Therefore, we first explore a dataset with demographic information on more than 4 million people, which was provided by a car insurance company. Then, we study how naming conventions have changed over time and how they differ by nationality. Next, we build a probabilistic first-name-to-gender mapping and augment the mapping by adding nationality and decade of birth to improve the mapping's performance. We test our mapping in two-label and three-label settings and further validate our mapping by categorizing patent filings by gender of the inventor. We compare the results with previous studies’ outcomes and find that our mapping produces high-precision results. We validate that the additional information of nationality and year of birth improve the precision scores of name-to-gender mappings. Therefore, the proposed approach constitutes an efficient process for improving the data quality of organizations’ records, if the gender attribute is missing or unreliable.Keywords
This publication has 23 references indexed in Scilit:
- Semi-parametric optimization for missing data imputationApplied Intelligence, 2007
- An analysis of four missing data treatment methods for supervised learningApplied Artificial Intelligence, 2003
- Data quality assessmentCommunications of the ACM, 2002
- Gender Differences in Internet Use Patterns and Internet Application Preferences: A Two-Sample ComparisonCyberPsychology & Behavior, 2000
- Data quality and systems theoryCommunications of the ACM, 1998
- Examining data qualityCommunications of the ACM, 1998
- Anchoring data quality dimensions in ontological foundationsCommunications of the ACM, 1996
- A framework for analysis of data quality researchIEEE Transactions on Knowledge and Data Engineering, 1995
- A critical investigation of recall and precision as measures of retrieval system performanceACM Transactions on Information Systems, 1989
- The MRC Psycholinguistic DatabaseThe Quarterly Journal of Experimental Psychology Section A, 1981