Citizen Science Gamers Enable Automated Flow Cytometry Gating Through Machine Learning
Open Access
- 29 October 2026
- journal article
- Published by Wiley in Cytometry Part A
Abstract
Machine learning can greatly accelerate biomedical research but is fundamentally constrained by the scarcity of high‐quality labeled data. We introduce a scalable data‐generation framework based on citizen science and apply it to automated flow cytometry gating, a foundational but subjective step in immunology that limits reproducibility. Using the massively multiplayer online game EVE Online, 839,199 de‐identified player accounts analyzed 52,000 plots, from which stringent quality control produced 31,703 consensus annotations for model training. Leveraging these data, we developed flowMagic, a machine learning framework for automated gating. Evaluated on 92,203 bivariate plots with standardized reference gates spanning 79 immune populations, the template model outperformed the generalized model, achieving 90% and 65% agreement for large and low‐abundance populations, respectively, compared with 78% and 42% for the generalized model. These results show that expert‐provided templates currently provide the highest agreement, while the citizen‐science‐trained generalized model enables gating without gate‐specific templates but remains limited by the absence of expert‐curated examples for complex, low‐abundance or context‐dependent gates. Both model types reproduced biologically meaningful patterns, including neutrophil dynamics in COVID‐19 patients and immune development in newborns. Together, these results establish citizen‐science annotation as a scalable strategy for generating training data that complements, rather than replaces, expert input in automated flow cytometry gating.Keywords
Funding Information
- Natural Sciences and Engineering Research Council of Canada
This publication has 39 references indexed in Scilit:
- Recommendations for using artificial intelligence in clinical flow cytometryCytometry Part B: Clinical Cytometry, 2024
- flowSim: Near duplicate detection for flow cytometry dataCytometry Part A, 2023
- A literature study and public survey on mass cytometry dataset release and reuseCytometry Part A, 2021
- Current trends in flow cytometry automated data analysis softwareCytometry Part A, 2021
- Hematologist‐Level Classification of Mature B‐Cell Neoplasm Using Deep Learning on Multiparameter Flow Cytometry DataCytometry Part A, 2020
- An Introduction to Machine LearningClinical Pharmacology & Therapeutics, 2020
- Comparison of clustering methods for high‐dimensional single‐cell flow and mass cytometry dataCytometry Part A, 2016
- A benchmark for evaluation of algorithms for identification of cellular correlates of clinical outcomesCytometry Part A, 2015
- FlowSOM: Using self‐organizing maps for visualization and interpretation of cytometry dataCytometry Part A, 2015
- FlowRepository: A resource of annotated flow cytometry datasets associated with peer‐reviewed publicationsCytometry Part A, 2012