Recommender Systems and Discrimination
Open Access
- 4 August 2023
- book chapter
- Published by Springer Nature
- p. 13-29
Abstract
The following article deals with the topic of discrimination “by” a recommender system. Several reasons can create discriminating recommendations, especially the lack of diversity in training data, bias in training data or errors in the underlying modelling algorithm. The legal frame is still not sufficient to nudge developers or users to effectively avoid those discriminations, especially data protection law as enshrined in the EU General Data Protection Regulation (GDPR) is not feasible to fight discrimination. The same applies for the EU Unfair Competition Law, that at least contains first considerations to allow an autonomous decision of the subjects involved to know about possible forms of discrimination. Furthermore, with the Digital Service Act (DSA) and the AI Act (AIA) there are first steps into a direction that can inter alia tackle the problem. Most effectively seems a combination of regular monitoring and audit obligations and the development of an information model, supported by information by legal design, that allows an autonomous decision of all individuals using a recommender system.Keywords
This publication has 22 references indexed in Scilit:
- Die Drittwirkung der Grundrechte und -freiheiten gegenüber Privaten2018
- Discriminating Tastes: Uber's Customer Ratings as Vehicles for Workplace DiscriminationPolicy & Internet, 2017
- Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction InstrumentsBig Data, 2017
- The continuing problems with online consent under the EU's emerging data protection principlesComputer Law & Security Review, 2016
- Quality of evidence revealing subtle gender biases in science is in the eye of the beholderProceedings of the National Academy of Sciences, 2015
- Elite male faculty in the life sciences employ fewer womenProceedings of the National Academy of Sciences, 2014
- Why Unbiased Computational Processes Can Lead to Discriminative Decision Procedures2013
- Grundfreiheiten, Grundrechte-Charta und Privatrecht2013
- Science faculty’s subtle gender biases favor male studentsProceedings of the National Academy of Sciences, 2012
- Market Structure and Discrimination: The Case of Small BusinessesJournal of Money, Credit and Banking, 1998