FA*IR
Open Access
- 6 November 2017
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1569-1578
Abstract
In this work, we define and solve the Fair Top-k Ranking problem, in which we want to determine a subset of k candidates from a large pool of n >> k candidates, maximizing utility (i.e., select the "best" candidates) subject to group fairness criteria. Our ranked group fairness definition extends group fairness using the standard notion of protected groups and is based on ensuring that the proportion of protected candidates in every prefix of the top-k ranking remains statistically above or indistinguishable from a given minimum. Utility is operationalized in two ways: (i) every candidate included in the top-$k$ should be more qualified than every candidate not included; and (ii) for every pair of candidates in the top-k, the more qualified candidate should be ranked above. An efficient algorithm is presented for producing the Fair Top-k Ranking, and tested experimentally on existing datasets as well as new datasets released with this paper, showing that our approach yields small distortions with respect to rankings that maximize utility without considering fairness criteria. To the best of our knowledge, this is the first algorithm grounded in statistical tests that can mitigate biases in the representation of an under-represented group along a ranked list.Comment: Accepted at the 26th ACM International Conference on Information and Knowledge Management (CIKM'17). 10 pageKeywords
All Related Versions
Funding Information
- Eurecat
- German Research Foundation
- Catalonia Trade and Investment Agency
This publication has 19 references indexed in Scilit:
- Certifying and Removing Disparate Impact2015
- Generalization-based privacy preservation and discrimination prevention in data publishing and miningData Mining and Knowledge Discovery, 2014
- Fairness through awareness2012
- Handling Conditional Discrimination2011
- Three naive Bayes approaches for discrimination-free classificationData Mining and Knowledge Discovery, 2010
- Gendering Representation in Spain: Opportunities and Limits of Gender QuotasJournal of Women, Politics & Policy, 2010
- Discrimination-aware data mining2008
- Cumulated gain-based evaluation of IR techniquesACM Transactions on Information Systems, 2002
- The use of MMR, diversity-based reranking for reordering documents and producing summaries1998
- Bias in computer systemsACM Transactions on Information Systems, 1996