Equal accuracy for Andrew and Abubakar—detecting and mitigating bias in name-ethnicity classification algorithms
Open Access
- 9 February 2023
- journal article
- research article
- Published by Springer Nature in AI & SOCIETY
- Vol. 39 (4) , 1605-1629
Abstract
Uncovering the world’s ethnic inequalities is hampered by a lack of ethnicity-annotated datasets. Name-ethnicity classifiers (NECs) can help, as they are able to infer people’s ethnicities from their names. However, since the latest generation of NECs rely on machine learning and artificial intelligence (AI), they may suffer from the same racist and sexist biases found in many AIs. Therefore, this paper offers an algorithmic fairness audit of three NECs. It finds that the UK-Census-trained EthnicityEstimator displays large accuracy biases with regards to ethnicity, but relatively less among gender and age groups. In contrast, the Twitter-trained NamePrism and the Wikipedia-trained Ethnicolr are more balanced among ethnicity, but less among gender and age. We relate these biases to global power structures manifested in naming conventions and NECs’ input distribution of names. To improve on the uncovered biases, we program a novel NEC, N2E, using fairness-aware AI techniques. We make N2E freely available at www.name-to-ethnicity.com.Keywords
This publication has 93 references indexed in Scilit:
- Use of name recognition software, census data and multiple imputation to predict missing data on ethnicity: application to cancer registry recordsBMC Medical Informatics and Decision Making, 2012
- Ethnicity and Population Structure in Personal Naming NetworksPLOS ONE, 2011
- Women’s Marital Naming Choices in a Nationally Representative SampleJournal of Family Issues, 2009
- From Eugenics to ScientometricsSocial Studies of Science, 2007
- Use of Geocoding and Surname Analysis to Estimate Race and EthnicityHealth Services Research, 2006
- Development and validation of a computerized South Asian Names and Group Recognition Algorithm (SANGRA) for use in British health-related studiesJournal of Public Health, 2001
- The Instability of Androgynous Names: The Symbolic Maintenance of Gender BoundariesAmerican Journal of Sociology, 2000
- Globalization or World society: How to conceive of modern society?International Review of Sociology, 1997
- the named and the nameless: gender and person in Chinese societyAmerican Ethnologist, 1986
- A Multi-Level Approach to the Study of Center-Periphery Systems and Socio-Economic ChangeJournal of Peace Research, 1977