MegaWika 2: A More Comprehensive Multilingual Collection of Articles and their Sources
Preprint
Abstract
We introduce MegaWika 2, a large, multilingual dataset of Wikipedia articles with their citations and scraped web sources; articles are represented in a rich data structure, and scraped source texts are stored inline with precise character offsets of their citations in the article text. MegaWika 2 is a major upgrade from the original MegaWika, spanning six times as many articles and twice as many fully scraped citations. Both MegaWika and MegaWika 2 support report generation research ; whereas MegaWika also focused on supporting question answering and retrieval applications, MegaWika 2 is designed to support fact checking and analyses across time and language.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- AmbiFC: Fact-Checking Ambiguous Claims with EvidenceTransactions of the Association for Computational Linguistics, 2024
- Improving Wikipedia verifiability with AINature Machine Intelligence, 2023
- MIRACL: A Multilingual Retrieval Dataset Covering 18 Diverse LanguagesTransactions of the Association for Computational Linguistics, 2023
- MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question AnsweringTransactions of the Association for Computational Linguistics, 2021
- WikiCheck2021
- Multilingual Entity Linking System for Wikipedia with a Machine-in-the-Loop Approach2021
- WhatTheWikiFact2021
- PAQ: 65 Million Probably-Asked Questions and What You Can Do With ThemTransactions of the Association for Computational Linguistics, 2021
- Why the World Reads Wikipedia2019
- Methods for exploring and mining tables on Wikipedia2013