Multilingual Reference Need Assessment System for Wikipedia
Open Access
- 12 April 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 8191-8199
Abstract
Wikipedia is a critical source of information for millions of users across the Web. It serves as a key resource for large language models, search engines, question-answering systems, and other Web-based applications. In Wikipedia, content needs to be verifiable, meaning that readers can check that claims are backed by references to reliable sources. This depends on manual verification by editors, an effective but labor-intensive process, especially given the high volume of daily edits. To address this challenge, we introduce a multilingual machine learning system to assist editors in identifying claims requiring citations. Our approach is tested in 10 language editions of Wikipedia, outperforming existing benchmarks for reference need assessment. We not only consider machine learning evaluation metrics but also system requirements, allowing us to explore the trade-offs between model accuracy and computational efficiency under real-world infrastructure constraints. We deploy our system in production and release data and code to support further research.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Providing Citations to Support Fact-Checking: Contextualizing Detection of Sentences Needing Citation on Small WikipediasNatural Language Processing Journal, 2024
- Language-Agnostic Modeling of Wikipedia Articles for Content Quality Assessment across LanguagesProceedings of the International AAAI Conference on Web and Social Media, 2024
- A Comparative Study of Reference Reliability in Multiple Language Editions of Wikipedia2023
- Longitudinal Assessment of Reference Quality on Wikipedia2023
- Wikinformetrics: Construction and description of an open Wikipedia knowledge graph data set for informetric purposesQuantitative Science Studies, 2022
- Unsupervised Cross-lingual Representation Learning at Scale2020
- Fine-grained Sentiment Classification using BERT2019
- Citation Needed: A Taxonomy and Algorithmic Assessment of Wikipedia's Verifiability2019
- Model Cards for Model Reporting2019
- An Introduction to the Bootstrap1994