Reconstructing Undersampled Photoacoustic Microscopy Images Using Deep Learning
Top Cited Papers
- 16 October 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 40 (2) , 562-570
Abstract
One primary technical challenge in photoacoustic microscopy (PAM) is the necessary compromise between spatial resolution and imaging speed. In this study, we propose a novel application of deep learning principles to reconstruct undersampled PAM images and transcend the trade-off between spatial resolution and imaging speed. We compared various convolutional neural network (CNN) architectures, and selected a Fully Dense U-net (FD U-net) model that produced the best results. To mimic various undersampling conditions in practice, we artificially downsampled fully-sampled PAM images of mouse brain vasculature at different ratios. This allowed us to not only definitively establish the ground truth, but also train and test our deep learning model at various imaging conditions. Our results and numerical analysis have collectively demonstrated the robust performance of our model to reconstruct PAM images with as few as 2% of the original pixels, which can effectively shorten the imaging time without substantially sacrificing the image quality.Keywords
Funding Information
- National Institutes of Health (R01 EB028143, R01 NS111039, R01 NS115581, R21 EB027304, R43 CA243822, R43 CA239830, R44 HL138185)
- Duke MEDx Basic Science Grant
- Duke Center for Genomic and Computational Biology Faculty Research Grant
- Duke Institute of Brain Science Incubator Award
- American Heart Association Collaborative Sciences (18CSA34080277)
This publication has 44 references indexed in Scilit:
- Photoacoustic microscopyLaser & Photonics Reviews, 2013
- Reconstructing absorption and scattering distributions in quantitative photoacoustic tomographyInverse Problems, 2012
- Biomedical photoacoustic imagingInterface Focus, 2011
- Photoacoustic tomography in absorbing acoustic media using time reversalInverse Problems, 2010
- Multiscale photoacoustic microscopy and computed tomographyNature Photonics, 2009
- Uniqueness of reconstruction and an inversion procedure for thermoacoustic and photoacoustic tomography with variable sound speedInverse Problems, 2007
- Noninvasive Imaging of Angiogenesis With a 99mTc-Labeled Peptide Targeted at αvβ3 Integrin After Murine Hindlimb IschemiaYearbook of Vascular Surgery, 2007
- Functional photoacoustic microscopy for high-resolution and noninvasive in vivo imagingNature Biotechnology, 2006
- Noninvasive Imaging of Angiogenesis With a 99m Tc-Labeled Peptide Targeted at α v β 3 Integrin After Murine Hindlimb IschemiaCirculation, 2005
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004