Patrick Lewis
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Patrick Lewis has a total of 4 co-authors. Here are the top co-authors by number of shared publications:
- Angela Fan
Facebook AI Research
1 shared publication - Christopher Ré
Stanford University
1 shared publication - Jacob Kahn
Facebook AI Research Menlo Park & New York USA
1 shared publication - Simran Arora
Apple Stanford University
1 shared publication
Latest Publications
- Open Access
- 7 August 2023
- Published by MIT Press in Transactions of the Association for Computational Linguistics
- Vol. 11, 902-921
Reasoning over Public and Private Data in Retrieval-Based Systems
Users an organizations are generating ever-increasing amounts of private data from a wide range of sources. Incorporating private context is important to personalize open-domain tasks such as question-answering, fact-checking, and personal assistants. State-of-the-art systems for these tasks explicitly retrieve information that is relevant to an input question from a background corpus before producing an answer. While today’s retrieval systems assume relevant corpora are fully (e.g., publicly) accessible, users are often unable or unwilling to expose their private data to entities hosting public data. We define the Split Iterative Retrieval (SPIRAL) problem involving iterative retrieval over multiple privacy scopes. We introduce a foundational benchmark with which to study SPIRAL, as no existing benchmark includes data from a private distribution. Our dataset, ConcurrentQA, includes data from distinct public and private distributions and is the first textual QA benchmark requiring concurrent retrieval over multiple distributions. Finally, we show that existing retrieval approaches face significant performance degradations when applied to our proposed retrieval setting and investigate approaches with which these tradeoffs can be mitigated. We release the new benchmark and code to reproduce the results.1
- 7 August 2023
- Published by MIT Press in Transactions of the Association for Computational Linguistics
- Vol. 11, 902-921
Open AccessReasoning over Public and Private Data in Retrieval-Based Systems
Users an organizations are generating ever-increasing amounts of private data from a wide range of sources. Incorporating private context is important to personalize open-domain tasks such as question-answering, fact-checking, and personal assistants. State-of-the-art systems for these tasks explicitly retrieve information that is relevant to an input question from a background corpus before producing an answer. While today’s retrieval systems assume relevant corpora are fully (e.g., publicly) accessible, users are often unable or unwilling to expose their private data to entities hosting public data. We define the Split Iterative Retrieval (SPIRAL) problem involving iterative retrieval over multiple privacy scopes. We introduce a foundational benchmark with which to study SPIRAL, as no existing benchmark includes data from a private distribution. Our dataset, ConcurrentQA, includes data from distinct public and private distributions and is the first textual QA benchmark requiring concurrent retrieval over multiple distributions. Finally, we show that existing retrieval approaches face significant performance degradations when applied to our proposed retrieval setting and investigate approaches with which these tradeoffs can be mitigated. We release the new benchmark and code to reproduce the results.1