Ronak Pradeep
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Ronak Pradeep has a total of 63 co-authors. Here are the top co-authors by number of shared publications:
- Jimmy Lin
University of Waterloo, Waterloo, Canada
21 shared publications - Nandan Thakur
University of Waterloo, Waterloo, ON, Canada
5 shared publications - Shivani Upadhyay
University of Waterloo, Waterloo, Canada
5 shared publications - Daniel Campos
Snowflake, San Mateo, USA
4 shared publications Jimmy Lin
University of Waterloo
4 shared publications- Nick Craswell
Microsoft, Bellevue, USA
4 shared publications
Latest Publications
- Open Access
- 24 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 403-413
Search Arena Meets Nuggets: Towards Explanations and Diagnostics in the Evaluation of LLM Responses
- 24 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 403-413
Open AccessSearch Arena Meets Nuggets: Towards Explanations and Diagnostics in the Evaluation of LLM Responses
- Open Access
- 19 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 4205-4210
Automating Generation of Long-Form Queries
- 19 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 4205-4210
Open AccessAutomating Generation of Long-Form Queries
- Open Access
- 19 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 3159-3166
Auto-Judge: A Cross-Task Benchmark for Comparing LLM Judges for Citation-Grounded RAG Systems
- 19 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 3159-3166
Open AccessAuto-Judge: A Cross-Task Benchmark for Comparing LLM Judges for Citation-Grounded RAG Systems
- Open Access
- 21 February 2026
- Published by Association for Computing Machinery (ACM)
- p. 1349-1350
Assembling Your Personal AI Council in Yupp to Provide Multiple Perspectives
Yupp is a consumer product that provides users with responses from multiple AI models in side-by-side comparisons, allowing them to seek diverse perspectives from many models at once. Through various incentive mechanisms, we encourage users to provide feedback on the response they prefer, which is then aggregated into a leaderboard that ranks models along many dimensions. While much progress in AI has been driven by benchmark datasets, gathering ''vibes'' from diverse populations for real-world use cases is also highly valuable. Looking further ahead, we envision a future where AIs collaborate and compete in multi-party dialogues. To this end, we discuss attempts to translate innovations from the research lab into an engaging consumer product.
- 21 February 2026
- Published by Association for Computing Machinery (ACM)
- p. 1349-1350
Open AccessAssembling Your Personal AI Council in Yupp to Provide Multiple Perspectives
Yupp is a consumer product that provides users with responses from multiple AI models in side-by-side comparisons, allowing them to seek diverse perspectives from many models at once. Through various incentive mechanisms, we encourage users to provide feedback on the response they prefer, which is then aggregated into a leaderboard that ranks models along many dimensions. While much progress in AI has been driven by benchmark datasets, gathering ''vibes'' from diverse populations for real-world use cases is also highly valuable. Looking further ahead, we envision a future where AIs collaborate and compete in multi-party dialogues. To this end, we discuss attempts to translate innovations from the research lab into an engaging consumer product.
- Top Cited PapersOpen Access
- 18 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 358-368
A Large-Scale Study of Relevance Assessments with Large Language Models Using UMBRELA
- 18 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 358-368
Top Cited PapersOpen AccessA Large-Scale Study of Relevance Assessments with Large Language Models Using UMBRELA
- Open Access
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 180-190
The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 180-190
Open AccessThe Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models
- Open Access
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 2759-2763
Assessing Support for the TREC 2024 RAG Track: A Large-Scale Comparative Study of LLM and Human Evaluations
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 2759-2763
Open AccessAssessing Support for the TREC 2024 RAG Track: A Large-Scale Comparative Study of LLM and Human Evaluations
- Open Access
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 3681-3690
RankLLM: A Python Package for Reranking with LLMs
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 3681-3690
Open AccessRankLLM: A Python Package for Reranking with LLMs
- Open Access
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 3223-3233
Gosling Grows Up: Retrieval with Learned Dense and Sparse Representations Using Anserini
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 3223-3233
Open AccessGosling Grows Up: Retrieval with Learned Dense and Sparse Representations Using Anserini
- Open Access
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 3165-3172
Accelerating Listwise Reranking: Reproducing and Enhancing FIRST
- 13 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 3165-3172
Open AccessAccelerating Listwise Reranking: Reproducing and Enhancing FIRST