Information Extraction from Lengthy Legal Contracts: Leveraging Query-Based Summarization and GPT-3.5
Open Access
- 7 December 2023
- book chapter
- Published by IOS Press
- p. 177-186
Abstract
In the legal domain, extracting information from contracts poses significant challenges, primarily due to the scarcity of annotated data. In such situations, leveraging large language models (LLMs), such as the Generative Pretrained Transformer (GPT) models, offers a promising solution. However, the inherent token limitations of these models can be a bottleneck for processing lengthy legal contracts. This paper presents an unsupervised two-step approach to address these challenges. First, we propose a query-based summarization model that extracts sentences pertinent to predefined queries, concisely representing lengthy contracts. This summarization ensures that the core information remains intact while simultaneously addressing the token limitation issue. Subsequently, the generated summary is fed to GPT-3.5 for precise information extraction. Our approach effectively overcomes the challenges of token limitations and zero resources, enabling efficient and scalable information extraction from legal contracts. We compare our results with those obtained from supervised models that have been finetuned on domain-specific annotated data. Experimental results demonstrate the remarkable effectiveness of our approach, as it achieves state-of-the-art performance without the need for domain-specific training data.Keywords
This publication has 8 references indexed in Scilit:
- Information Extraction from Documents: Question Answering Vs Token Classification in Real-World Setups2023
- PharmKE: Knowledge Extraction Platform for Pharmaceutical Texts Using Transfer LearningComputers, 2023
- Named Entity Recognition and Knowledge Extraction from Pharmaceutical Texts using Transfer LearningProcedia Computer Science, 2022
- Capturing Global Structural Information in Long Document Question Answering with Compressive Graph Selector Network2022
- Recurrent Chunking Mechanisms for Long-Text Machine Reading Comprehension2020
- Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks2019
- Multi-passage BERT: A Globally Normalized BERT Model for Open-domain Question Answering2019
- SQuAD: 100,000+ Questions for Machine Comprehension of Text2016