Representation Bias of Adolescents in AI: A Bilingual, Bicultural Study
Open Access
- 16 October 2024
- journal article
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society
- Vol. 7, 1621-1634
Abstract
Popular and news media often portray teenagers with sensationalism, as both a risk to society and at risk from society. As AI begins to absorb some of the epistemic functions of traditional media, we study how teenagers in two countries speaking two languages: 1) are depicted by AI, and 2) how they would prefer to be depicted. Specifically, we study the biases about teenagers learned by static word embeddings (SWEs) and generative language models (GLMs), comparing these with the perspectives of adolescents living in the U.S. and Nepal. We find English-language SWEs associate teenagers with societal problems, and more than 50% of the 1,000 words most associated with teenagers in the pretrained GloVe SWE reflect such problems. Given prompts about teenagers, 30% of outputs from GPT2-XL and 29% from LLaMA-2-7B GLMs discuss societal problems, most commonly violence, but also drug use, mental illness, and sexual taboo. Nepali models, while not free of such associations, are less dominated by social problems. Data from workshops with N=13 U.S. adolescents and N=18 Nepalese adolescents show that AI presentations are disconnected from teenage life, which revolves around activities like school and friendship. Participant ratings of how well 20 trait words describe teens are decorrelated from SWE associations, with Pearson's rho=.02, n.s. in English FastText and rho=.06, n.s. GloVe; and rho=.06, n.s. in Nepali FastText and rho=-.23, n.s. in GloVe. U.S. participants suggested AI could fairly present teens by highlighting diversity, while Nepalese participants centered positivity. Participants were optimistic that, if it learned from adolescents, rather than media sources, AI could help mitigate stereotypes. Our work offers an understanding of the ways SWEs and GLMs misrepresent a developmentally vulnerable group and provides a template for less sensationalized characterization.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- Machine cultureNature Human Behaviour, 2023
- Have color representations in books changed over the past 200 years? An empirical analysis based on the Google Books Ngram corpusColor Research & Application, 2023
- Early adolescents’ stereotypes about teens in Hong Kong and Chongqing: Reciprocal pathways with problem behavior.Developmental Psychology, 2020
- How Payment for Research Participation Can Be CoerciveThe American Journal of Bioethics, 2019
- Word embeddings quantify 100 years of gender and ethnic stereotypesProceedings of the National Academy of Sciences, 2018
- Around the world, adolescence is a time of heightened sensation seeking and immature self‐regulationDevelopmental Science, 2017
- Automatic speech recognition for under-resourced languages: A surveySpeech Communication, 2014
- Representations of youth in local media: Implications for library serviceLibrary & Information Science Research, 2011
- Teen driving as public drama: statistics, risk, and the social construction of youth as a public problemJournal of Youth Studies, 2008
- Silhouettes: A graphical aid to the interpretation and validation of cluster analysisJournal of Computational and Applied Mathematics, 1987