Audits Under Resource, Data, and Access Constraints: Scaling Laws For Less Discriminatory Alternatives
Preprint
Abstract
AI audits play a critical role in AI accountability and safety. One branch of the law for which AI audits are particularly salient is anti-discrimination law. Several areas of anti-discrimination law implicate the "less discriminatory alternative" (LDA) requirement, in which a protocol (e.g., model) is defensible if no less discriminatory protocol that achieves comparable performance can be found with a reasonable amount of effort. Notably, the burden of proving an LDA exists typically falls on the claimant (the party alleging discrimination). This creates a significant hurdle in AI cases, as the claimant would seemingly need to train a less discriminatory yet high-performing model, a task requiring resources and expertise beyond most litigants. Moreover, developers often shield information about and access to their model and training data as trade secrets, making it difficult to reproduce a similar model from scratch. In this work, we present a procedure enabling claimants to determine if an LDA exists, even when they have limited compute, data, information, and model access. We focus on the setting in which fairness is given by demographic parity and performance by binary cross-entropy loss. As our main result, we provide a novel closed-form upper bound for the loss-fairness Pareto frontier (PF). We show how the claimant can use it to fit a PF in the "low-resource regime," then extrapolate the PF that applies to the (large) model being contested, all without training a single large model. The expression thus serves as a scaling law for loss-fairness PFs. To use this scaling law, the claimant would require a small subsample of the train/test data. Then, the claimant can fit the context-specific PF by training as few as 7 (small) models. We stress test our main result in simulations, finding that our scaling law holds even when the exact conditions of our theory do not.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Explaining neural scaling lawsProceedings of the National Academy of Sciences, 2024
- Sociotechnical Audits: Broadening the Algorithm Auditing Lens to Investigate Targeted AdvertisingProceedings of the ACM on Human-Computer Interaction, 2023
- Privacy-Preserving and Trustless Verifiable Fairness Audit of Machine Learning ModelsInternational Journal of Advanced Computer Science and Applications, 2023
- A minimax framework for quantifying risk-fairness trade-off in regressionThe Annals of Statistics, 2022
- Accuracy and fairness trade-offs in machine learning: a stochastic multi-objective approachComputational Management Science, 2022
- The algorithm audit: Scoring the algorithms that score usBig Data & Society, 2021
- Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction InstrumentsBig Data, 2017
- Certifying and Removing Disparate Impact2015
- Basic Inequalities2013
- Data preprocessing techniques for classification without discriminationKnowledge and Information Systems, 2011