CuNeRF: Cube-Based Neural Radiance Field for Zero-Shot Medical Image Arbitrary-Scale Super Resolution
Authors:
- 1 October 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 21128-21138
Abstract
Medical image arbitrary-scale super-resolution (MIASSR) has recently gained widespread attention, aiming to supersample medical volumes at arbitrary scales via a single model. However, existing MIASSR methods face two major limitations: (i) reliance on high-resolution (HR) volumes and (ii) limited generalization ability, which restricts their applications in various scenarios. To overcome these limitations, we propose Cube-based Neural Radiance Field (CuNeRF), a zero-shot MIASSR framework that is able to yield medical images at arbitrary scales and free viewpoints in a continuous domain. Unlike existing MISR methods that only fit the mapping between low-resolution (LR) and HR volumes, CuNeRF focuses on building a continuous volumetric representation from each LR volume without the knowledge of the corresponding HR one. This is achieved by the proposed differentiable modules: cube-based sampling, isotropic volume rendering, and cube-based hierarchical rendering. Through extensive experiments on magnetic resource imaging (MRI) and computed tomography (CT) modalities, we demonstrate that CuNeRF can synthesize high-quality SR medical images, which outperforms state-of-the-art MISR methods, achieving better visual verisimilitude and fewer objectionable artifacts. Compared to existing MISR methods, our CuNeRF is more applicable in practice.Keywords
All Related Versions
This publication has 37 references indexed in Scilit:
- RPLHR-CT Dataset and Transformer Baseline for Volumetric Super-Resolution from CT Scans2022
- UASSR: Unsupervised Arbitrary Scale Super-Resolution Reconstruction of Single Anisotropic 3D Images via Disentangled Representation Learning2022
- A Review of the Deep Learning Methods for Medical Images Super Resolution ProblemsIRBM, 2021
- NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis2020
- Efficient and Accurate MRI Super-Resolution Using a Generative Adversarial Network and 3D Multi-level Densely Connected Network2018
- Zero-Shot Super-Resolution Using Deep Internal Learning2018
- Learning a Deep Convolutional Network for Image Super-Resolution2014
- Health effects of ionising radiation from diagnostic CTThe Lancet, 2006
- Tricubic interpolation in three dimensionsInternational Journal for Numerical Methods in Engineering, 2005
- Optical models for direct volume renderingIEEE Transactions on Visualization and Computer Graphics, 1995