Explainability of Text Processing and Retrieval Methods: A Survey
Open Access
- 26 March 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
Abstract
Deep Learning and Machine Learning based models have become extremely popular in text processing and information retrieval, owing to their remarkable effectiveness. However, the complex non-linear structures underlying these models make them largely inscrutable. A significant body of research has focused on increasing the transparency of these models. This article provides a broad overview of research on the explainability and interpretability of information retrieval methods, focusing primarily on both neural models for document ranking, and retrieval-augmented generation systems. A significant part of this research is inspired by, and strongly related to, similar work done in the area of natural language processing (NLP). For completeness, therefore, we also briefly review (in the Appendices) some recent studies from the NLP community on explaining word embeddings, sequence modeling, attention modules, transformers, and BERT. The concluding section suggests some possible directions for future research on this topic.Keywords
All Related Versions
This publication has 37 references indexed in Scilit:
- Explainable Natural Language Processing2021
- Imparting interpretability to word embeddings while preserving semantic structureNatural Language Engineering, 2020
- The Mythos of Model InterpretabilityQueue, 2018
- Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information RetrievalIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2016
- Visualizing and Understanding Convolutional Networks2014
- Diagnostic Evaluation of Information Retrieval ModelsACM Transactions on Information Systems, 2011
- A similarity measure for indefinite rankingsACM Transactions on Information Systems, 2010
- LETOR: A benchmark collection for research on learning to rank for information retrievalInformation Retrieval Journal, 2010
- The Importance of Length Normalization for XML RetrievalInformation Retrieval Journal, 2005
- Estimating regression models with unknown break‐pointsStatistics in Medicine, 2003