Emerging trends: Unfair, biased, addictive, dangerous, deadly, and insanely profitable
Open Access
- 19 December 2022
- journal article
- research article
- Published by Cambridge University Press (CUP) in Natural Language Engineering
- Vol. 29 (2) , 483-508
Abstract
There has been considerable work recently in the natural language community and elsewhere on Responsible AI. Much of this work focuses on fairness and biases (henceforth Risks 1.0), following the 2016 best seller:Weapons of Math Destruction. Two books published in 2022, The Chaos MachineandLike, Comment, Subscribe, raise additional risks to public health/safety/security such as genocide, insurrection, polarized politics, vaccinations (henceforth, Risks 2.0). These books suggest that the use of machine learning to maximize engagement in social media has created a Frankenstein Monster that is exploiting human weaknesses with persuasive technology, the illusory truth effect, Pavlovian conditioning, and Skinner’s intermittent variable reinforcement. Just as we cannot expect tobacco companies to sell fewer cigarettes and prioritize public health ahead of profits, so too, it may be asking too much of companies (and countries) to stop trafficking in misinformation given that it is so effective and so insanely profitable (at least in the short term). Eventually, we believe the current chaos will end, like the lawlessness in Wild West, because chaos is bad for business. As computer scientists, this paper will summarize criticisms from other fields and focus on implications for computer science; we will not attempt to contribute to those other fields. There is quite a bit of work in computer science on these risks, especially on Risks 1.0 (bias and fairness), but more work is needed, especially on Risks 2.0 (addictive, dangerous, and deadly).Keywords
This publication has 89 references indexed in Scilit:
- Social Media and Suicide: A Public Health PerspectiveAmerican Journal of Public Health, 2012
- Online Social Networking and Addiction—A Review of the Psychological LiteratureInternational Journal of Environmental Research and Public Health, 2011
- The Wired Generation: Academic and Social Outcomes of Electronic Media Use Among University StudentsCyberpsychology, Behavior, and Social Networking, 2010
- ‘STORMFRONT IS LIKE A SECOND HOME TO ME’Information, Communication & Society, 2008
- Penalties for Success: Reactions to Women Who Succeed at Male Gender-Typed Tasks.Journal of Applied Psychology, 2004
- Birds of a Feather: Homophily in Social NetworksAnnual Review of Sociology, 2001
- Black Feminist ThoughtTeaching Philosophy, 1993
- Pavlovian conditioning: It's not what you think it is.American Psychologist, 1988
- Is it behaviorism?Behavioral and Brain Sciences, 1986
- Some contributions of an experimental analysis of behavior to psychology as a whole.American Psychologist, 1953