Bayesian Estimation of Intrinsic Tissue Oxygenation and Perfusion From RGB Images
Open Access
- 20 February 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 36 (7) , 1491-1501
Abstract
Multispectral imaging (MSI) can potentially assist the intra-operative assessment of tissue structure, function and viability, by providing information about oxygenation. In this paper, we present a novel technique for recovering intrinsic MSI measurements from endoscopic RGB images without custom hardware adaptations. The advantage of this approach is that it requires no modification to existing surgical and diagnostic endoscopic imaging systems. Our method uses a radiometric color calibration of the endoscopic camera's sensor in conjunction with a Bayesian framework to recover a per-pixel measurement of the total blood volume (THb) and oxygen saturation (SO 2 ) in the observed tissue. The sensor's pixel measurements are modeled as weighted sums over a mixture of Poisson distributions and we optimize the variables SO 2 and THb to maximize the likelihood of the observations. To validate our technique, we use synthetic images generated from Monte Carlo physics simulation of light transport through soft tissue containing sub-surface blood vessels. We also validate our method on in vivo data by comparing it to a MSI dataset acquired with a hardware system that sequentially images multiple spectral bands without overlap. Our results are promising and show that we are able to provide surgeons with additional relevant information by processing endoscopic images with our modeling and inference framework.Keywords
Funding Information
- Imperial College Junior Research Fellowship
- EPSRC (EP/N013220/1, EP/N022750/1)
- ERC (242991)
- EPSRC (EP/N013220/1, EP/N022750/1)
- EU-FP7 Project CASCADE (FP7-ICT-2913-601021)
- EU-Horizon2020 project EndoVESPA (H2020-ICT-2015-688592)
This publication has 30 references indexed in Scilit:
- Intraoperative measurement of bowel oxygen saturation using a multispectral imaging laparoscopeBiomedical Optics Express, 2015
- Optical properties of human colon tissues in the 350 – 2500 nm spectral rangeQuantum Electronics, 2014
- Multispectral image alignment using a three channel endoscope in vivo during minimally invasive surgeryBiomedical Optics Express, 2012
- Mesh-based Monte Carlo method using fast ray-tracing in Plücker coordinatesBiomedical Optics Express, 2010
- Active Multispectral Illumination and Image Fusion for Retinal MicrosurgeryLecture Notes in Computer Science, 2010
- Ultra-fast multispectral optical imaging of cortical oxygenation, blood flow, and intracellular calcium dynamicsOptics Express, 2009
- Quantifying mucosal blood volume fraction from multispectral images of the colon2007
- Regional Variations in Myocardial Tissue Oxygenation Mapped by Near-Infrared Spectroscopic ImagingJournal of Molecular and Cellular Cardiology, 2002
- Spectral characterization of electronic cameras1998
- MCML—Monte Carlo modeling of light transport in multi-layered tissuesComputer Methods and Programs in Biomedicine, 1995