Towards User-Centred Design of AI-Assisted Decision-Making in Law Enforcement
Authors:
- Vesna NowackVNVesna Nowack
- Dalal AlrajehDADalal Alrajeh
- Carolina Gutierrez MuñozCMCarolina Gutierrez Muñoz
- Katie ThomasKTKatie Thomas
- William HobsonWHWilliam Hobson
- Catherine Hamilton-GiachritsisCHCatherine Hamilton-Giachritsis
- Patrick BenjaminPBPatrick Benjamin
- Tim GrantTGTim Grant
- Juliane A. KloessJKJuliane A. Kloess
- Jessica WoodhamsJWJessica Woodhams
Preprint
Abstract
Artificial Intelligence (AI) has become an important part of our everyday lives, yet user requirements for designing AI-assisted systems in law enforcement remain unclear. To address this gap, we conducted qualitative research on decision-making within a law enforcement agency. Our study aimed to identify limitations of existing practices, explore user requirements and understand the responsibilities that humans expect to undertake in these systems. Participants in our study highlighted the need for a system capable of processing and analysing large volumes of data efficiently to help in crime detection and prevention. Additionally, the system should satisfy requirements for scalability, accuracy, justification, trustworthiness and adaptability to be adopted in this domain. Participants also emphasised the importance of having end users review the input data that might be challenging for AI to interpret, and validate the generated output to ensure the system's accuracy. To keep up with the evolving nature of the law enforcement domain, end users need to help the system adapt to the changes in criminal behaviour and government guidance, and technical experts need to regularly oversee and monitor the system. Furthermore, user-friendly human interaction with the system is essential for its adoption and some of the participants confirmed they would be happy to be in the loop and provide necessary feedback that the system can learn from. Finally, we argue that it is very unlikely that the system will ever achieve full automation due to the dynamic and complex nature of the law enforcement domain.Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- A model for secondary traumatic stress following workplace exposure to traumatic material in analytical staffCommunications Psychology, 2024
- Toward Human-centered XAI in Practice: A surveyMachine Intelligence Research, 2024
- Human-in-the-loop machine learning: Reconceptualizing the role of the user in interactive approachesInternet of Things, 2024
- Associations between individual cognitive factors, mode of exposure and depression symptoms in practitioners working with aversive crime materialEuropean Journal of Psychotraumatology, 2023
- Artificial intelligence & crime prediction: A systematic literature reviewSocial Sciences & Humanities Open, 2022
- Impact of Traumatic Material on Professionals in Analytical and Secondary Investigative Roles Working in Criminal Justice Settings: a Qualitative ApproachJournal of Police and Criminal Psychology, 2022
- AI in Criminal Law: An Overview of AI Applications in Substantive and Procedural Criminal Law2022
- Approaching the human in the loop – legal perspectives on hybrid human/algorithmic decision-making in three contextsInformation & Communications Technology Law, 2021
- Conducting Semi‐Structured Interviews2015
- Measuring nominal scale agreement among many raters.Psychological Bulletin, 1971