Yoelle Maarek
Yoelle Maarek has a total of 19 co-authors. Here are the top co-authors by number of shared publications:
- David Carmel
Technology Innovation Institute (TII), Haifa, Israel
3 shared publications - Simone Filice
Technology Innovation Institute (TII), Haifa, Israel
3 shared publications - Guy Horowitz
Technology Innovation Institute (TII), Haifa, Israel
2 shared publications - Oren Somekh
Technology Innovation Institute (TII), Haifa, Israel
2 shared publications - Ran Tavory
Technology Innovation Institute (TII), Haifa, Israel
2 shared publications - Alex Shtoff
Yahoo Research, Haifa, Israel
1 shared publication
Latest Publications
- Open Access
- 19 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 3109-3116
LiveRAG: A Diverse Q&A Dataset with Varying Difficulty Level for RAG Evaluation
- 19 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 3109-3116
Open AccessLiveRAG: A Diverse Q&A Dataset with Varying Difficulty Level for RAG Evaluation
- Open Access
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 4199-4201
The LiveRAG Challenge at SIGIR 2025
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 4199-4201
Open AccessThe LiveRAG Challenge at SIGIR 2025
- Open Access
- 10 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 2559-2563
Old IR Methods Meet RAG
Retrieval augmented generation (RAG) is an important approach to provide large language models (LLMs) with context pertaining to the text generation task: given a prompt, passages are retrieved from external corpora to ground the generation with more relevant and/or fresher data. Most previous studies used dense retrieval methods for applying RAG in question answering scenarios. However, recent work showed that traditional information retrieval methods (a.k.a. sparse methods) can do as well as or even better than dense retrieval ones. In particular, it was shown that Okapi BM25 outperforms dense retrieval methods, in terms of perplexity, for the fundamental text completion task in LLMs. We extend this study and show, using two popular LLMs, that a broad set of sparse retrieval methods achieve better results than all the dense retrieval methods we experimented with, for varying lengths of queries induced from the prompt. Furthermore, we found that Okapi BM25 is substantially outperformed by a term-proximity retrieval method (MRF), which is in turn outperformed by a pseudo-feedback-based bag-of-terms approach (relevance model). Additional exploration sheds some light on the effectiveness of lexical retrieval methods for RAG. Our findings call for further study of classical retrieval methods for RAG.
- 10 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 2559-2563
Open AccessOld IR Methods Meet RAG
Retrieval augmented generation (RAG) is an important approach to provide large language models (LLMs) with context pertaining to the text generation task: given a prompt, passages are retrieved from external corpora to ground the generation with more relevant and/or fresher data. Most previous studies used dense retrieval methods for applying RAG in question answering scenarios. However, recent work showed that traditional information retrieval methods (a.k.a. sparse methods) can do as well as or even better than dense retrieval ones. In particular, it was shown that Okapi BM25 outperforms dense retrieval methods, in terms of perplexity, for the fundamental text completion task in LLMs. We extend this study and show, using two popular LLMs, that a broad set of sparse retrieval methods achieve better results than all the dense retrieval methods we experimented with, for varying lengths of queries induced from the prompt. Furthermore, we found that Okapi BM25 is substantially outperformed by a term-proximity retrieval method (MRF), which is in turn outperformed by a pseudo-feedback-based bag-of-terms approach (relevance model). Additional exploration sheds some light on the effectiveness of lexical retrieval methods for RAG. Our findings call for further study of classical retrieval methods for RAG.
- Top Cited PapersOpen Access
- 10 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 719-729
The Power of Noise: Redefining Retrieval for RAG Systems
Retrieval-Augmented Generation (RAG) has recently emerged as a method to extend beyond the pre-trained knowledge of Large Language Models by augmenting the original prompt with relevant passages or documents retrieved by an Information Retrieval (IR) system. RAG has become increasingly important for Generative AI solutions, especially in enterprise settings or in any domain in which knowledge is constantly refreshed and cannot be memorized in the LLM. We argue here that the retrieval component of RAG systems, be it dense or sparse, deserves increased attention from the research community, and accordingly, we conduct the first comprehensive and systematic examination of the retrieval strategy of RAG systems. We focus, in particular, on the type of passages IR systems within a RAG solution should retrieve. Our analysis considers multiple factors, such as the relevance of the passages included in the prompt context, their position, and their number. One counter-intuitive finding of this work is that the retriever's highest-scoring documents that are not directly relevant to the query (e.g., do not contain the answer) negatively impact the effectiveness of the LLM. Even more surprising, we discovered that adding random documents in the prompt improves the LLM accuracy by up to 35%. These results highlight the need to investigate the appropriate strategies when integrating retrieval with LLMs, thereby laying the groundwork for future research in this area.
- 10 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 719-729
Top Cited PapersOpen AccessThe Power of Noise: Redefining Retrieval for RAG Systems
Retrieval-Augmented Generation (RAG) has recently emerged as a method to extend beyond the pre-trained knowledge of Large Language Models by augmenting the original prompt with relevant passages or documents retrieved by an Information Retrieval (IR) system. RAG has become increasingly important for Generative AI solutions, especially in enterprise settings or in any domain in which knowledge is constantly refreshed and cannot be memorized in the LLM. We argue here that the retrieval component of RAG systems, be it dense or sparse, deserves increased attention from the research community, and accordingly, we conduct the first comprehensive and systematic examination of the retrieval strategy of RAG systems. We focus, in particular, on the type of passages IR systems within a RAG solution should retrieve. Our analysis considers multiple factors, such as the relevance of the passages included in the prompt context, their position, and their number. One counter-intuitive finding of this work is that the retriever's highest-scoring documents that are not directly relevant to the query (e.g., do not contain the answer) negatively impact the effectiveness of the LLM. Even more surprising, we discovered that adding random documents in the prompt improves the LLM accuracy by up to 35%. These results highlight the need to investigate the appropriate strategies when integrating retrieval with LLMs, thereby laying the groundwork for future research in this area.
- Open Access
- 14 September 2023
- Published by Association for Computing Machinery (ACM)
- p. 826-832
Extended Conversion: Capturing Successful Interactions in Voice Shopping
- 14 September 2023
- Published by Association for Computing Machinery (ACM)
- p. 826-832
Open AccessExtended Conversion: Capturing Successful Interactions in Voice Shopping
- Open Access
- 8 February 2016
- Published by Association for Computing Machinery (ACM)
Session details: Leveraging Users
- 8 February 2016
- Published by Association for Computing Machinery (ACM)
Open AccessSession details: Leveraging Users