PA-NeRF, a neural radiance field model for 3D photoacoustic tomography reconstruction from limited Bscan data
Authors:
- 14 February 2024
- journal article
- research article
- Published by Optica Publishing Group in Biomedical Optics Express
- Vol. 15 (3) , 1651-1667
Abstract
We introduce a novel deep-learning-based photoacoustic tomography method called Photoacoustic Tomography Neural Radiance Field (PA-NeRF) for reconstructing 3D volumetric PAT images from limited 2D Bscan data. In conventional 3D volumetric imaging, a 3D reconstruction requires transducer element data obtained from all directions. Our model employs a NeRF-based PAT 3D reconstruction method, which learns the relationship between transducer element positions and the corresponding 3D imaging. Compared with convolution-based deep-learning models, such as Unet and TransUnet, PA-NeRF does not learn the interpolation process but rather gains insight from 3D photoacoustic imaging principles. Additionally, we introduce a forward loss that improves the reconstruction quality. Both simulation and phantom studies validate the performance of PA-NeRF. Further, we apply the PA-NeRF model to clinical examples to demonstrate its feasibility. To the best of our knowledge, PA-NeRF is the first method in photoacoustic tomography to successfully reconstruct a 3D volume from sparse Bscan data.Keywords
Funding Information
- National Cancer Institute (RO1CA237664, R01CA228047)
This publication has 42 references indexed in Scilit:
- Quantitative spectroscopic photoacoustic imaging: a reviewJournal of Biomedical Optics, 2012
- Photoacoustic tomography: fundamentals, advances and prospectsContrast Media & Molecular Imaging, 2011
- k-Wave: MATLAB toolbox for the simulation and reconstruction of photoacoustic wave fieldsJournal of Biomedical Optics, 2010
- Prospects of photoacoustic tomographyMedical Physics, 2008
- Pathogenesis of Ovarian CancerInternational Journal of Gynecological Pathology, 2008
- Photoacoustic tomography with a limited-aperture planar sensor and a reverberant cavityInverse Problems, 2007
- Functional photoacoustic microscopy for high-resolution and noninvasive in vivo imagingNature Biotechnology, 2006
- Three-dimensional imaging of skin melanoma in vivo by dual-wavelength photoacoustic microscopyJournal of Biomedical Optics, 2006
- Universal back-projection algorithm for photoacoustic computed tomographyPhysical Review E, 2005
- A Morphology Index Based on Sonographic Findings in Ovarian CancerGynecologic Oncology, 1993