A neural network to identify requests, decisions, and arguments in court rulings on custody
Open Access
- 9 January 2024
- journal article
- research article
- Published by Springer Nature in Artificial Intelligence and Law
- Vol. 33 (1) , 101-135
Abstract
Court rulings are among the most important documents in all legal systems. This article describes a study in which natural language processing is used for the automatic characterization of Spanish judgments that deal with the physical custody (joint or individual) of minors. The model was trained to identify a set of elements: the type of custody requested by the plaintiff, the type of custody decided on by the court, and eight of the most commonly used arguments in this type of judgment. Two jurists independently annotated more than 3000 judgments, which were used to train a model based on transformers. The main difficulties encountered in this task were the complexity of the judicial language and the need to work with appellate court rulings that have a more complicated structure than decisions at first instance. For the complete court rulings, the F1 score of the inter-annotator agreement ranged from 0.60 to 0.86 and the Kappa index from 0.33 to 0.73. The F1 score of the agreement between the model and the annotators ranged from 0.66 to 0.93 and the Kappa index from 0.57 to 0.80. These results in which the model performance exceeds even the inter-annotator agreement show the high ability of transformers to identify abstract entities in legal texts.Keywords
Funding Information
- Gobierno de Aragón (LMP118_18, T17_20R, S12_20R)
- Ministerio de Ciencia, Innovación y Universidades (RTI2018-095843-B-I00)
This publication has 49 references indexed in Scilit:
- Recognizing cited facts and principles in legal judgementsArtificial Intelligence and Law, 2017
- Word2VecNatural Language Engineering, 2016
- An extensive experimental comparison of methods for multi-label learningPattern Recognition, 2012
- Understanding inverse document frequency: on theoretical arguments for IDFJournal of Documentation, 2004
- The Split-up project: induction, context and knowledge discovery in lawLaw, Probability and Risk, 2004
- Random ForestsMachine Learning, 2001
- Bidirectional recurrent neural networksIEEE Transactions on Signal Processing, 1997
- Long Short-Term MemoryNeural Computation, 1997
- THE BEST INTERESTS OF THE CHILDFamily Court Review, 1997
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960