LeCaRDv2: A Large-Scale Chinese Legal Case Retrieval Dataset
Top Cited Papers
Open Access
- 10 July 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 2251-2260
Abstract
As an important component of intelligent legal systems, legal case retrieval plays a critical role in ensuring judicial justice and fairness. However, the development of legal case retrieval technologies in the Chinese legal system is restricted by three problems in existing datasets: limited data size, narrow definitions of legal relevance, and naive candidate pooling strategies used in data sampling. To alleviate these issues, we introduce LeCaRDv2, a large-scale Legal Case Retrieval Dataset (version 2). It consists of 800 queries and 55,192 candidates extracted from 4.3 million criminal case documents. To the best of our knowledge, LeCaRDv2 is one of the largest Chinese legal case retrieval datasets, providing extensive coverage of criminal charges. Additionally, we enrich the existing relevance criteria by considering three key aspects: characterization, penalty, procedure. This comprehensive criteria enriches the dataset and may provides a more holistic perspective. Furthermore, we propose a two-level candidate set pooling strategy that effectively identify potential candidates for each query case. It's important to note that all cases in the dataset have been annotated by multiple legal experts specializing in criminal law. Their expertise ensures the accuracy and reliability of the annotations. We evaluate several state-of-the-art retrieval models at LeCaRDv2, demonstrating that there is still significant room for improvement in legal case retrieval. The details of LeCaRDv2 can be found at the anonymous website https://github.com/THUIR/LeCaRDv2.Keywords
All Related Versions
Funding Information
- Natural Science Foundation of China (62002194)
This publication has 24 references indexed in Scilit:
- I3 Retriever: Incorporating Implicit Interaction in Pre-trained Language Models for Passage Retrieval2023
- SAILER: Structure-aware Pre-trained Language Model for Legal Case Retrieval2023
- T2Ranking: A Large-scale Chinese Benchmark for Passage Ranking2023
- Legal case document similarity: You need both network and textInformation Processing & Management, 2022
- LeCaRD: A Legal Case Retrieval Dataset for Chinese Law System2021
- Lawformer: A pre-trained language model for Chinese legal long documentsAI Open, 2021
- The German Federal Courts Dataset 1950–2019: From Paper Archives to Linked Open DataJournal of Empirical Legal Studies, 2019
- Recognizing cited facts and principles in legal judgementsArtificial Intelligence and Law, 2017
- On the concept of relevance in legal information retrievalArtificial Intelligence and Law, 2017
- An information-theoretic perspective of tf–idf measuresInformation Processing & Management, 2003