A Python Interface to PISA!
Authors:
Open Access
- 6 July 2022
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 3339-3344
Abstract
PISA (Performant Indexes and Search for Academia) provides very efficient implementations of various retrieval algorithms over sparse inverted indices. The highly-optimized C++ implementation, however, has previously only been accessible via command line tools. From indexing to retrieval, 5--6 commands need to be executed in sequence, making the process relatively involved. Further complications when using PISA include a lengthy build process and minimal interoperability with other tools. In this work, we demonstrate a new tool that provides a native Python wrapper around PISA. The wrapper features a simplified interface that adheres to the PyTerrier API, making it easy to use (e.g., via Pandas DataFrames), apply to a multitude of datasets (e.g., those from the ir_datasets package) and combine with other methods (e.g., neural re-ranking and dense retrieval methods).Keywords
Funding Information
- EPSRC (EP/R018634/1)
This publication has 9 references indexed in Scilit:
- PyTerrier: Declarative Experimentation in Python from BM25 to Dense Retrieval2021
- IR From Bag-of-words to BERT and Beyond through Practical Experiments2021
- Simplified Data Wrangling with ir_datasets2021
- Declarative Experimentation in Information Retrieval using PyTerrier2020
- Pytrec_eval2018
- Anserini2017
- Faster BlockMax WAND with Variable-sized Blocks2017
- Upper-bound approximations for dynamic pruningACM Transactions on Information Systems, 2011
- Faster top-k document retrieval using block-max indexes2011