Mitigating allocative tradeoffs and harms in an environmental justice data tool
Open Access
- 16 February 2024
- journal article
- research article
- Published by Springer Nature in Nature Machine Intelligence
- Vol. 6 (2) , 187-194
Abstract
Neighbourhood-level screening algorithms are increasingly being deployed to inform policy decisions. However, their potential for harm remains unclear: algorithmic decision-making has broadly fallen under scrutiny for disproportionate harm to marginalized groups, yet opaque methodology and proprietary data limit the generalizability of algorithmic audits. Here we leverage publicly available data to fully reproduce and audit a large-scale algorithm known as CalEnviroScreen, designed to promote environmental justice and guide public funding by identifying disadvantaged neighbourhoods. We observe the model to be both highly sensitive to subjective model specifications and financially consequential, estimating the effect of its positive designations as a 104% (62–145%) increase in funding, equivalent to US$2.08 billion (US$1.56–2.41 billion) over four years. We further observe allocative tradeoffs and susceptibility to manipulation, raising ethical concerns. We recommend incorporating technical strategies to mitigate allocative harm and accountability mechanisms to prevent misuse.Keywords
Funding Information
- National Science Foundation (DGE 1656518)
This publication has 39 references indexed in Scilit:
- Association Between Birthplace and Current Asthma: The Role of Environment and AcculturationAmerican Journal of Public Health, 2014
- Emergency Department Services Use Among Immigrant and Non-immigrant Groups in the United StatesJournal of Immigrant and Minority Health, 2013
- Fair Air: Distributive Justice and Environmental EconomicsEnvironmental and Resource Economics, 2010
- Classifying and communicating uncertainties in model-based policy analysisInternational Journal of Technology, Policy and Management, 2010
- Regression discontinuity designs: A guide to practiceJournal of Econometrics, 2008
- Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal InferencePolitical Analysis, 2007
- Uncertainty and Sensitivity Analysis Techniques as Tools for the Quality Assessment of Composite IndicatorsJournal of the Royal Statistical Society Series A: Statistics in Society, 2005
- Defining Uncertainty: A Conceptual Basis for Uncertainty Management in Model-Based Decision SupportIntegrated Assessment, 2003
- Indoor air quality and healthAtmospheric Environment, 1999
- `` Direct Search'' Solution of Numerical and Statistical ProblemsJournal of the ACM, 1961