Measuring disparate impact in human and machine decisions
Open Access
- 20 July 2026
- journal article
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 123 (30)
Abstract
Empirical analyses have grown increasingly important in discrimination litigation with the greater availability of detailed data on individuals and decisions. A popular analytic strategy is to estimate disparities after adjusting for observed covariates, typically with a regression model, in hopes of ferreting out discriminatory intent. This approach, however, is ill-suited to auditing algorithms that are now commonly used to aid decisions, which typically do not include race or other legally protected factors as inputs. Motivated by legal understandings of disparate impact, we introduce an approach that aims to measure “unjustified” disparities in both human and machine decisions. Our method, which we call risk-adjusted regression, proceeds in three steps. In the first step, we combine all available information in a machine learning model to estimate the value, or inversely, the risk, of taking a certain action, such as approving a loan application or hiring a job candidate. Second, we measure disparities in decisions after adjusting for these risk estimates alone. Finally, in the third step, we assess the sensitivity of results to potential mismeasurement of risk. We demonstrate this approach on a detailed dataset of 2.2 million police stops of pedestrians in New York City, and show that traditional statistical tests of discrimination can substantially understate the magnitude of (risk-adjusted) racial disparities.Keywords
This publication has 45 references indexed in Scilit:
- A simple, statistically robust test of discriminationProceedings of the National Academy of Sciences, 2025
- Measuring and Mitigating Racial Disparities in Tax AuditsThe Quarterly Journal of Economics, 2024
- The disparate impacts of college admissions policies on Asian American applicantsScientific Reports, 2024
- A Causal Framework for Observational Studies of DiscriminationStatistics and Public Policy, 2022
- A large-scale analysis of racial disparities in police stops across the United StatesNature Human Behaviour, 2020
- Predictive Analytics for City Agencies: Lessons from Children's ServicesBig Data, 2017
- Observational Studies2002
- Racial Bias in Motor Vehicle Searches: Theory and EvidenceJournal of Political Economy, 2001
- Nobel Lecture: The Economic Way of Looking at BehaviorJournal of Political Economy, 1993
- The central role of the propensity score in observational studies for causal effectsBiometrika, 1983