Integrating the BIDS Neuroimaging Data Format and Workflow Optimization for Large-Scale Medical Image Analysis
Authors:
- Shunxing BaoSBShunxing Bao
- Brian D. BoydBBBrian D. Boyd
- Praitayini KanakarajPKPraitayini Kanakaraj
- Karthik RamadassKRKarthik Ramadass
- Francisco A. C. MeyerFMFrancisco A. C. Meyer
- Yuqian LiuYLYuqian Liu
- William E. DuettWDWilliam E. Duett
- Yuankai HuoYHYuankai Huo
- Ilwoo LyuILIlwoo Lyu
- David H. ZaldDZDavid H. Zald
- Seth A. SmithSSSeth A. Smith
- Baxter P. RogersBRBaxter P. Rogers
- 3 August 2022
- journal article
- research article
- Published by Springer Nature in Journal of Digital Imaging
- Vol. 35 (6) , 1576-1589
Abstract
A robust medical image computing infrastructure must host massive multimodal archives, perform extensive analysis pipelines, and execute scalable job management. An emerging data format standard, the Brain Imaging Data Structure (BIDS), introduces complexities for interfacing with XNAT archives. Moreover, workflow integration is combinatorically problematic when matching large amount of processing to large datasets. Historically, workflow engines have been focused on refining workflows themselves instead of actual job generation. However, such an approach is incompatible with data centric architecture that hosts heterogeneous medical image computing. Distributed automation for XNAT toolkit (DAX) provides large-scale image storage and analysis pipelines with an optimized job management tool. Herein, we describe developments for DAX that allows for integration of XNAT and BIDS standards. We also improve DAX’s efficiencies of diverse containerized workflows in a high-performance computing (HPC) environment. Briefly, we integrate YAML configuration processor scripts to abstract workflow data inputs, data outputs, commands, and job attributes. Finally, we propose an online database–driven mechanism for DAX to efficiently identify the most recent updated sessions, thereby improving job building efficiency on large projects. We refer the proposed overall DAX development in this work as DAX-1 (DAX version 1). To validate the effectiveness of the new features, we verified (1) the efficiency of converting XNAT data to BIDS format and the correctness of the conversion using a collection of BIDS standard containerized neuroimaging workflows, (2) how YAML-based processor simplified configuration setup via a sequence of application pipelines, and (3) the productivity of DAX-1 on generating actual HPC processing jobs compared with earlier DAX baseline method. The empirical results show that (1) DAX-1 converting XNAT data to BIDS has similar speed as accessing XNAT data only; (2) YAML can integrate to the DAX-1 with shallow learning curve for users, and (3) DAX-1 reduced the job/assessor generation latency by finding recent modified sessions. Herein, we present approaches for efficiently integrating XNAT and modern image formats with a scalable workflow engine for the large-scale dataset access and processing.Keywords
Funding Information
- National Center for Advancing Translational Sciences (Grant 2 UL1 TR000445-06)
- National Science Foundation (CAREER 1452485)
- National Institutes of Health (R01EB017230)
- National Institute of Biomedical Imaging and Bioengineering (Grant T32-EB021937)
- National Center for Research Resources (Grant UL1 RR024975-01)
- NIH S10 Shared Instrumentation (Grant 1S10OD020154-01)
This publication has 46 references indexed in Scilit:
- FreeSurferNeuroImage, 2012
- Co-activation patterns distinguish cortical modules, their connectivity and functional differentiationNeuroImage, 2011
- COINS: An Innovative Informatics and Neuroimaging Tool Suite Built for Large Heterogeneous DatasetsFrontiers in Neuroinformatics, 2011
- Nipype: A Flexible, Lightweight and Extensible Neuroimaging Data Processing Framework in PythonFrontiers in Neuroinformatics, 2011
- The Java Image Science Toolkit (JIST) for Rapid Prototyping and Publishing of Neuroimaging SoftwareNeuroinformatics, 2010
- Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics supportJournal of Biomedical Informatics, 2009
- Flexible and Efficient Workflow Deployment of Data-Intensive Applications On Grids With MOTEURThe International Journal of High Performance Computing Applications, 2008
- Meta-analysis of Go/No-go tasks demonstrating that fMRI activation associated with response inhibition is task-dependentNeuropsychologia, 2008
- FMRI Visualization of Brain Activity during a Monetary Incentive Delay TaskNeuroImage, 2000
- A resource management architecture for metacomputing systems1998