CuNeRF: Cube-Based Neural Radiance Field for Zero-Shot Medical Image Arbitrary-Scale Super Resolution
Preprint
Abstract
Medical image arbitrary-scale super-resolution (MIASSR) has recently gained widespread attention, aiming to super sample medical volumes at arbitrary scales via a single model. However, existing MIASSR methods face two major limitations: (i) reliance on high-resolution (HR) volumes and (ii) limited generalization ability, which restricts their application in various scenarios. To overcome these limitations, we propose Cube-based Neural Radiance Field (CuNeRF), a zero-shot MIASSR framework that can yield medical images at arbitrary scales and viewpoints in a continuous domain. Unlike existing MIASSR methods that fit the mapping between low-resolution (LR) and HR volumes, CuNeRF focuses on building a coordinate-intensity continuous representation from LR volumes without the need for HR references. This is achieved by the proposed differentiable modules: including cube-based sampling, isotropic volume rendering, and cube-based hierarchical rendering. Through extensive experiments on magnetic resource imaging (MRI) and computed tomography (CT) modalities, we demonstrate that CuNeRF outperforms state-of-the-art MIASSR methods. CuNeRF yields better visual verisimilitude and reduces aliasing artifacts at various upsampling factors. Moreover, our CuNeRF does not need any LR-HR training pairs, which is more flexible and easier to be used than others. Our code is released at https://github.com/NarcissusEx/CuNeRF.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Implicit Neural Representation in Medical Imaging: A Comparative Survey2023
- SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesis2023
- An Arbitrary Scale Super-Resolution Approach for 3D MR Images via Implicit Neural RepresentationIEEE Journal of Biomedical and Health Informatics, 2022
- MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-aware CT-Projections from a Single X-rayAnnual International Conference of the IEEE Engineering in Medicine and Biology Society, 2022
- Channel Splitting Network for Single MR Image Super-ResolutionIEEE Transactions on Image Processing, 2019
- Deep MR Brain Image Super-Resolution Using Spatio-Structural PriorsIEEE Transactions on Image Processing, 2019
- Robust Super-Resolution Volume Reconstruction From Slice Acquisitions: Application to Fetal Brain MRIIEEE Transactions on Medical Imaging, 2010
- Tricubic interpolation in three dimensionsInternational Journal for Numerical Methods in Engineering, 2005
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Optical models for direct volume renderingIEEE Transactions on Visualization and Computer Graphics, 1995