PadChest-GR: A Bilingual Chest X-ray Dataset for Grounded Radiology Report Generation

Authors:
  • DCDaniel C. Castro
    Daniel C. Castro
  • ABAurelia Bustos
    Aurelia Bustos
  • SBShruthi Bannur
    Shruthi Bannur
  • SHStephanie L. Hyland
    Stephanie L. Hyland
  • KBKenza Bouzid
    Kenza Bouzid
  • MWMaria Teodora Wetscherek
    Maria Teodora Wetscherek
  • MSMaria Dolores Sánchez-Valverde
    Maria Dolores Sánchez-Valverde
  • LJLara Jaques-Pérez
    Lara Jaques-Pérez
  • LPLourdes Pérez-Rodríguez
    Lourdes Pérez-Rodríguez
  • KTKenji Takeda
    Kenji Takeda
  • JSJosé María Salinas
    José María Salinas
  • JAJavier Alvarez-Valle
    Javier Alvarez-Valle

Abstract
Radiology report generation (RRG) aims to create free-text radiology reports from clinical imaging. Grounded radiology report generation (GRRG) extends RRG by including the localisation of individual findings on the image. Currently, there are no manually annotated chest X-ray (CXR) datasets to train GRRG models. In this work, we present a dataset called PadChest-GR (Grounded-Reporting) derived from PadChest aimed at training GRRG models for CXR images. We curate a public bi-lingual dataset of 4,555 CXR studies with grounded reports (3,099 abnormal and 1,456 normal), each containing complete lists of sentences describing individual present (positive) and absent (negative) findings in English and Spanish. In total, PadChest-GR contains 7,037 positive and 3,422 negative finding sentences. Every positive finding sentence is associated with up to two independent sets of bounding boxes labelled by different readers and has categorical labels for finding type, locations, and progression. To the best of our knowledge, PadChest-GR is the first manually curated dataset designed to train GRRG models for understanding and interpreting radiological images and generated text. By including detailed localization and comprehensive annotations of all clinically relevant findings, it provides a valuable resource for developing and evaluating GRRG models from CXR images. PadChest-GR can be downloaded under request from https://bimcv.cipf.es/bimcv-projects/padchest-gr/