”Because AI is 100% right and safe”: User Attitudes and Sources of AI Authority in India
Authors:
Open Access
- 27 April 2022
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-18
Abstract
Most prior work on human-AI interaction is set in communities that indicate skepticism towards AI, but we know less about contexts where AI is viewed as aspirational. We investigated the perceptions around AI systems by drawing upon 32 interviews and 459 survey respondents in India. Not only do Indian users accept AI decisions (79.2% respondents indicate acceptance), we find a case of AI authority—AI has a legitimized power to influence human actions, without requiring adequate evidence about the capabilities of the system. AI authority manifested into four user attitudes of vulnerability: faith, forgiveness, self-blame, and gratitude, pointing to higher tolerance for system misfires, and introducing potential for irreversible individual and societal harm. We urgently call for calibrating AI authority, reconsidering success metrics and responsible AI approaches and present methodological suggestions for research and deployments in India.Keywords
This publication has 72 references indexed in Scilit:
- The machine to aspire to: The computer in rural south IndiaFirst Monday, 2012
- Extent and impact of response biases in cross-national survey researchInternational Journal of Research in Marketing, 2010
- The effects of transparency on trust in and acceptance of a content-based art recommenderUser Modeling and User-Adapted Interaction, 2008
- The measurement of values across cultures: A pairwise comparison approachJournal of Research in Personality, 2005
- What's wrong with cross-cultural comparisons of subjective Likert scales?: The reference-group effect.Journal of Personality and Social Psychology, 2002
- Changing the ParadigmThe American Review of Public Administration, 2000
- Distinguishing Power, Authority & Legitimacy: Taking Max Weber at His Word by Using Resources-Exchange AnalysisPolity, 1989
- Trust in close relationships.Journal of Personality and Social Psychology, 1985
- Conceptual and methodological considerations in the study of trust and suspicionJournal of Conflict Resolution, 1970
- Complete Counterbalancing of Immediate Sequential Effects in a Latin Square DesignJournal of the American Statistical Association, 1958