Investigating User Behavior in Legal Case Retrieval
Authors:
Open Access
- 11 July 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 962-972
Abstract
Legal case retrieval is a specialized IR task aiming to retrieve supporting cases given a query case. While recent research efforts are committed to improving the automatic retrieval models' performances, little attention has been paid to the practical search interactions between users and systems in this task. Therefore, we focus on investigating user behavior in the scenario of legal case retrieval. Specifically, we conducted a laboratory user study that involved 45 participants majoring in law to collect users' rich interactions and relevance assessments. With the collected data, we first analyzed the characteristics of the search process in legal case retrieval practice. We observed significant differences between legal case retrieval and general web search in various search behavior. These differences highlight the necessity of in-depth investigating user behavior in legal case retrieval and re-thinking the application of related mechanisms developed based on the user models in Web search. Then we investigated factors that would influence search behavior from different perspectives, including task difficulty and domain expertise. Finally, we shed light on implicit feedback in legal case retrieval and designed a predictive model for relevance based on user behavior. Our work provides a better understanding of user interactions in the legal case retrieval process, which can benefit the design of the corresponding retrieval systems to support legal practitioners.Keywords
Funding Information
- Beijing Academy of Artificial Intelligence
- Natural Science Foundation of China (61732008,61532011,62002194)
- Tsinghua University Guoqiang Research Institute
- National Key Research and Development Program of China (2018YFC0831700)
This publication has 30 references indexed in Scilit:
- Towards better measurement of attention and satisfaction in mobile search2014
- Aggregated search interface preferences in multi-session search tasks2013
- Exploring and predicting search task difficulty2012
- A history of AI and Law in 50 papers: 25 years of the international conference on AI and LawArtificial Intelligence and Law, 2012
- Beyond dwell time2012
- Predicting users' domain knowledge from search behaviors2011
- Multiple significance tests: the Bonferroni correctionBMJ, 2011
- Improving legal information retrieval using an ontological frameworkArtificial Intelligence and Law, 2009
- Context-aware query suggestion by mining click-through and session data2008
- Investigating the information-seeking behaviour of academic lawyers: From Ellis’s model to designInformation Processing & Management, 2008