Hyperspectral image segmentation: a preliminary study on the Oral and Dental Spectral Image Database (ODSI-DB)
Open Access
- 23 January 2023
- journal article
- research article
- Published by Taylor & Francis in Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization
- Vol. 11 (4) , 1290-1298
Abstract
Visual discrimination of clinical tissue types remains challenging, with traditional RGB imaging providing limited contrast for such tasks. Hyperspectral imaging (HSI) is a promising technology providing rich spectral information that can extend far beyond three-channel RGB imaging. Moreover, recently developed snapshot HSI cameras enable real-time imaging with significant potential for clinical applications. Despite this, the investigation into the relative performance of HSI over RGB imaging for semantic segmentation purposes has been limited, particularly in the context of medical imaging. Here we compare the performance of state-of-the-art deep learning image segmentation methods when trained on hyperspectral images, RGB images, hyperspectral pixels (minus spatial context), and RGB pixels (disregarding spatial context). To achieve this, we employ the recently released Oral and Dental Spectral Image Database (ODSI-DB), which consists of 215 manually segmented dental reflectance spectral images with 35 different classes across 30 human subjects. The recent development of snapshot HSI cameras has made real-time clinical HSI a distinct possibility, though successful application requires a comprehensive understanding of the additional information HSI offers. Our work highlights the relative importance of spectral resolution, spectral range, and spatial information to both guide the development of HSI cameras and inform future clinical HSI applications.Keywords
All Related Versions
Funding Information
- Horizon 2020 Framework Programme (101016985)
- Innovate UK (75124)
- EPSRC (NS/A000027/1)
- Royal Academy of Engineering (RCSRF1819\7\34)
- Wellcome Trust (WT101957)
This publication has 31 references indexed in Scilit:
- Hyperspectral Imaging Provides Early Prediction of Random Axial Flap Necrosis in a Preclinical ModelPlastic and Reconstructive Surgery, 2017
- Hyperspectral interventional imaging for enhanced tissue visualization and discrimination combining band selection methodsInternational Journal of Computer Assisted Radiology and Surgery, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Renal Oxygenation Measurement During Partial Nephrectomy Using Hyperspectral Imaging May Predict Acute Postoperative Renal FunctionJournal of Endourology, 2013
- Minimal Arterial In-flow Protects Renal Oxygenation and Function During Porcine Partial Nephrectomy: Confirmation by Hyperspectral ImagingUrology, 2011
- Digital dental photography. Part 2: purposes and usesBritish Dental Journal, 2009
- Digital dental photography. Part 1: an overviewBritish Dental Journal, 2009
- Intraoperative bile duct visualization using near-infrared hyperspectral video imagingThe American Journal of Surgery, 2008
- Characterization of a Near-Infrared Laparoscopic Hyperspectral Imaging System for Minimally Invasive SurgeryAnalytical Chemistry, 2007
- The C.I.E. colorimetric standards and their useTransactions of the Optical Society, 1931