A Comparative Simulation Study of the Fairness and Accuracy of Predictive Policing Systems in Baltimore City
Open Access
- 16 May 2026
- journal article
- research article
- Published by MDPI AG in Algorithms
- Vol. 19 (5) , 398
Abstract
There are ongoing discussions about predictive policing systems being unfair, for example, by exhibiting racial bias. Law enforcement in some cities, such as Los Angeles, California, and Baltimore, Maryland, have initiated the integration of these systems into their decision-making processes, and some of these systems were advertised as being unbiased. However, later studies discovered that these methods could also be unfair due to feedback loops and being trained on historically biased recorded data. Comparative studies on predictive policing systems are few and insufficiently comprehensive. Crucially, the relative fairness of predictive policing methods with regard to traditional hot spot-based policing has not been established. Moreover, the relationship between fairness and accuracy is complex and requires further study. Furthermore, the case of Baltimore City, Maryland, USA, has not yet been systematically analyzed despite its relevance as an early adopter of predictive policing technologies with a fraught history of social justice concerns around policing. An improved understanding of these questions could better inform policy decisions around predictive policing technologies both in Baltimore and beyond. Therefore, in this work we perform a comprehensive comparative simulation study on the fairness and accuracy of predictive policing technologies in Baltimore. Our results suggest that the situation around bias in predictive policing is more complex than previously assumed. While we find that predictive policing exhibits bias due to feedback loops, as previously reported, we also find traditional hot spot-based policing to have similar issues. Although predictive policing is found to be more fair and accurate than hot spot policing in the short term, it also amplifies bias more quickly, suggesting the potential for worse long-run behavior. In Baltimore, the bias in these systems tended toward over-policing White neighborhoods in some cases, unlike in previous studies. However, when the analysis was restricted to some specific crime types, this tendency differed. Overall, this work demonstrates a methodology for city-specific evaluation and compares behavioral tendencies of predictive policing systems, showing how such simulations can reveal inequities and long-term tendencies. We recommend that authorities and community stakeholders use simulation methodologies to assist in collaboratively navigating the complexities around fairness in predictive policing.Keywords
All Related Versions
Funding Information
- National Science Foundation (IS1927486)
- National Science Foundation (IIS2046381)
This publication has 33 references indexed in Scilit:
- Do hotspot policing interventions against optimal foragers cause crime displacement?International Journal of Law, Crime and Justice, 2024
- Spatio-temporal Crime Analysis and Forecasting on Twitter Data Using Machine Learning AlgorithmsSN Computer Science, 2023
- Algorithmic fairness through group parities? The case of COMPAS-SAPMOCAI & SOCIETY, 2022
- Hot spots policing of small geographic areas effects on crimeCampbell Systematic Reviews, 2019
- A spatio-temporal kernel density estimation framework for predictive crime hotspot mapping and evaluationApplied Geography, 2018
- Does Predictive Policing Lead to Biased Arrests? Results From a Randomized Controlled TrialStatistics and Public Policy, 2018
- Randomized Controlled Field Trials of Predictive PolicingJournal of the American Statistical Association, 2015
- Exploiting spatio-temporal patterns using partial-state reinforcement learning in a synthetically augmented environmentProgress in Artificial Intelligence, 2014
- Marked point process hotspot maps for homicide and gun crime prediction in ChicagoInternational Journal of Forecasting, 2014
- The Utility of Hotspot Mapping for Predicting Spatial Patterns of CrimeSecurity Journal, 2008