Data auditing and quality assurance in a federated learning consortium: getting the best of both worlds from cross-institutional and in-house data quality inspection
Open Access
- 10 November 2026
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Applied Mathematics and Statistics
- Vol. 12, 1981705
Abstract
Introduction: Rare and heterogeneous disease research increasingly relies on privacy-enhancing technologies such as federated learning (FL) to enable cross-institutional collaboration across fragmented datasets. However, data quality assurance in FL can be limited, because individual-level data are not directly accessible to researchers. While schema-dependent inspection offers a partial solution, it requires standardised schemas or resource-intensive frameworks, hindering scalability and collaboration. To address these challenges, we implemented two complementary dashboards and evaluated their interplay. Methodology: We adapted a recognised data quality control framework for re-use of electronic health record (EHR) data using breast cancer records from Centre Léon Bérard into two dashboards: (1) an in-house dashboard for intra-clinic quality assessment, and (2) a federated dashboard for inter-clinic quality assessment. To evaluate detection capabilities, artificial inconsistencies were introduced into distributed datasets mirroring the in-house source. Results: The in-house dashboard provided granularity and reliability, pinpointing individual-level inconsistencies, while the federated dashboard enabled cross-institutional pattern detection–trade-offs inherent to their designs. The federated system revealed ecosystem-wide trends inaccessible to single-institution tools, whereas the in-house dashboard provided local validation and thoroughness. Discussion: Our findings confirm a complementary relationship: FL dashboards provide scalable, collaborative oversight but may require additional quality checks, while in-house tools ensure thoroughness at the cost of scalability. A combined model seemingly offers the optimal balance, accommodating both institution-specific needs and collaborative research requirements in evolving, multi-institutional ecosystems.Keywords
This publication has 11 references indexed in Scilit:
- Knowledge Representation of a Multicenter Adolescent and Young Adult Cancer Infrastructure: Development of the STRONG AYA Knowledge GraphJCO Clinical Cancer Informatics, 2026
- Development of a core outcome set for adolescents and young adults with cancerThe Lancet Oncology, 2025
- Frameworks, Dimensions, Definitions of Aspects, and Assessment Methods for the Appraisal of Quality of Health Data for Secondary Use: Comprehensive Overview of ReviewsJMIR Medical Informatics, 2024
- Making head and neck cancer clinical data Findable-Accessible-Interoperable-Reusable to support multi-institutional collaboration and federated learningBJR|Artificial Intelligence, 2024
- Federated learning: an introduction [report]2023
- OSIRIS: A Minimum Data Set for Data Sharing and Interoperability in OncologyJCO Clinical Cancer Informatics, 2021
- Increasing trust in real-world evidence through evaluation of observational data qualityJournal of the American Medical Informatics Association, 2021
- Multisite Evaluation of a Data Quality Tool for Patient-Level Clinical DatasetseGEMs (Generating Evidence & Methods to improve patient outcomes), 2016
- A Harmonized Data Quality Assessment Terminology and Framework for the Secondary Use of Electronic Health Record DataeGEMs (Generating Evidence & Methods to improve patient outcomes), 2016
- The FAIR Guiding Principles for scientific data management and stewardshipScientific Data, 2016