Data-Dependent Goal Modeling for ML-Enabled Law Enforcement Systems
Authors:
- Dalal AlrajehDADalal Alrajeh
- Vesna NowackVNVesna Nowack
- Patrick BenjaminPBPatrick Benjamin
- Katie ThomasKTKatie Thomas
- William HobsonWHWilliam Hobson
- Carolina Gutierrez MuñozCMCarolina Gutierrez Muñoz
- Catherine Hamilton-GiachritsisCHCatherine Hamilton-Giachritsis
- Juliane A. KloessJKJuliane A. Kloess
- Jessica WoodhamsJWJessica Woodhams
- Daniel ButlerDBDaniel Butler
- Mark LawMLMark Law
- Ralph MortonRMRalph Morton
Preprint
Abstract
Investigating serious crimes is inherently complex and resource-constrained. Law enforcement agencies (LEAs) grapple with overwhelming volumes of offender and incident data, making effective suspect identification difficult. Although machine learning (ML)-enabled systems have been explored to support LEAs, several have failed in practice. This highlights the need to align system behavior with stakeholder goals early in development, motivating the use of Goal-Oriented Requirements Engineering (GORE). This paper reports our experience applying the GORE framework KAOS to designing an ML-enabled system for identifying suspects in online child sexual abuse. We describe how KAOS supported early requirements elaboration, including goal refinement, object modeling, agent assignment, and operationalization. A key finding is the central role of data elicitation: data requirements constrain refinement choices and candidate agents while influencing how goals are linked, operationalized, and satisfied. Conversely, goal elaboration and agent assignment shape data quality expectations and collection needs. Our experience highlights the iterative, bidirectional dependencies between goals, data, and ML performance. We contribute a reference model for integrating GORE with data-driven system development, and identify gaps in KAOS, particularly the need for explicit support for data elicitation and quality management. These insights inform future extensions of KAOS and, more broadly, the application of formal GORE methods to ML-enabled systems for high-stakes societal contexts.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- RM4ML: requirements model for machine learning-enabled software systemsRequirements Engineering, 2024
- Integrated multi-view modeling for reliable machine learning-intensive software engineeringSoftware Quality Journal, 2024
- Modeling and reasoning about uncertainty in goal models: a decision-theoretic approachSoftware and Systems Modeling, 2022
- Modeling machine learning requirements from three perspectives: a case report from the healthcare domainRequirements Engineering, 2021
- Conducting Semi‐Structured Interviews2015
- Interactive goal model analysis for early requirements engineeringRequirements Engineering, 2014
- Thematic Analysis2014
- Design Science Research in Information Systems2010
- Requirements Elicitation: A Survey of Techniques, Approaches, and Tools2006
- Non-Functional Requirements in Software Engineering2000