Unifying Bias and Unfairness in Information Retrieval: New Challenges in the LLM Era
Open Access
- 10 March 2025
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 998-1001
Abstract
With the rapid advancements of large language models (LLMs), information retrieval (IR) systems, such as search engines and recommender systems, have undergone a paradigm shift due to their integration. However, integrating LLMs into the IR pipelines has also introduced new challenges, particularly in the form of biases and unfairness that may disrupt the information ecosystem. This tutorial will offer a comprehensive overview of emerging and pressing bias and unfairness issues associated with integrating LLMs into IR systems. Specifically, this tutorial first unifies bias and unfairness issues as problems of distribution mismatch and further categorizes the mitigation strategies under the umbrella of distribution alignment. Then, we summarize several types of bias and unfairness issues emerging from three critical stages of LLM integration into IR systems: data collection, model development, and result evaluation. We will systematically review and analyze their definitions, characteristics, and corresponding mitigation strategies in recent literature. Finally, we will highlight some open problems and future research directions. We hope this tutorial can raise the awareness of researchers and stakeholders in the IR field and beyond regarding bias and unfairness issues in this LLM era.Keywords
Funding Information
- Youth Innovation Promotion Association CAS (2023111)
- National Natural Science Foundation of China (62377044, 62276248)
- National Key R&D Program of China (2023YFA1008704)
This publication has 26 references indexed in Scilit:
- Large Language Models are Zero-Shot Rankers for Recommender Systems2024
- Dually Enhanced Delayed Feedback Modeling for Streaming Conversion Rate Prediction2023
- Quotation Recommendation for Multi-party Online Conversations Based on Semantic and Topic FusionACM Transactions on Information Systems, 2023
- P-MMF: Provider Max-min Fairness Re-ranking in Recommender System2023
- Information Retrieval meets Large Language Models: A strategic report from Chinese IR communityAI Open, 2023
- Counteracting User Attention Bias in Music Streaming Recommendation via Reward Modification2022
- Tutorial on Fairness of Machine Learning in Recommender Systems2021
- Beyond Probability Ranking Principle: Modeling the Dependencies among Documents2021
- Deep Learning for Matching in Search and Recommendation2018
- Beyond bag-of-words2012