MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-aware CT-Projections from a Single X-ray
Authors:
Top Cited Papers
- 11 July 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Annual International Conference of the IEEE Engineering in Medicine and Biology Society
- Vol. 2022, 3843-3848
Abstract
Computed tomography (CT) is an effective med-ical imaging modality, widely used in the field of clinical medicine for the diagnosis of various pathologies. Advances in Multidetector CT imaging technology have enabled additional functionalities, including generation of thin slice multi planar cross-sectional body imaging and 3D reconstructions. However, this involves patients being exposed to a considerable dose of ionising radiation. Excessive ionising radiation can lead to deterministic and harmful effects on the body. This paper proposes a Deep Learning model that learns to reconstruct CT projections from a few or even a single-view X-ray. This is based on a novel architecture that builds from neural radiance fields, which learns a continuous representation of CT scans by disentangling the shape and volumetric depth of surface and internal anatomical structures from 2D images. Our model is trained on chest and knee datasets, and we demonstrate qual-itative and quantitative high-fidelity renderings and compare our approach to other recent radiance field-based methods. Our code and link to our datasets are available at https://qithub.com/abrilcf/mednerf Clinical relevance- Our model is able to infer the anatomical 3D structure from a few or a single-view X-ray showing future potential for reduced ionising radiation exposure during the imaging process.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Learning to Reconstruct Computed Tomography Images Directly From Sinogram Data Under A Variety of Data Acquisition ConditionsIEEE Transactions on Medical Imaging, 2019
- The Perception-Distortion Tradeoff2018
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018
- Image Reconstruction is a New Frontier of Machine LearningIEEE Transactions on Medical Imaging, 2018
- A Combined Experimental and Computational Approach to Subject-Specific Analysis of Knee Joint LaxityJournal of Biomechanical Engineering, 2016
- Validation of predicted patellofemoral mechanics in a finite element model of the healthy and cruciate-deficient kneeJournal of Biomechanics, 2016
- Estimating CT Image From MRI Data Using Structured Random Forest and Auto-Context ModelIEEE Transactions on Medical Imaging, 2015
- The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information RepositoryJournal of Digital Imaging, 2013
- Extraction of Airways From CT (EXACT'09)IEEE Transactions on Medical Imaging, 2012
- Patient setup for PET/CT acquisition in radiotherapy planningRadiotherapy and Oncology, 2010