Visual Enhancement and Semantic Segmentation of Murine Tissue Scans with Pulsed THz Spectroscopy
- 1 February 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2023, 80-87
Abstract
Semantic Artificial Intelligence has certain qualities that are advantageous for deep learning-based medical imaging tasks. Medical images can be augmented by injecting semantic context into the underlying classification mechanism, increasing the information density of the scan and ultimately can provide more trust in the result. This work considers an application of semantic AI to segment tissue types from excised breast tumors imaged with pulsed terahertz (THz)–an emerging imaging technology. Prior work has demonstrated traditional data driven methodology for deep learning on THz has two key weaknesses: namely 1) low image resolution compared to other state-of-the-art imaging techniques and 2) a lack of expertly-labeled images due to domain transformation and tissue changes during histopathology. This work seeks to address these limitations through two semantic AI mechanisms. Specifically, we introduce a two stage pipeline using an unsupervised image-to-image translation network and a supervised segmentation network. The combination of these contributions enables enhanced near-real-time visualization of excised tissue through THz scans and a supervised segmentation and classification training strategy using only synthetic THz scans generated by our bi-directional image-to-image translation network.Keywords
Funding Information
- University of Arkansas
This publication has 20 references indexed in Scilit:
- Multimodal Unsupervised Image-to-Image Translation2018
- Assessment of Terahertz Imaging for Excised Breast Cancer Tumors with Image MorphingJournal of Infrared, Millimeter, and Terahertz Waves, 2018
- Pulsed terahertz imaging of breast cancer in freshly excised murine tumorsJournal of Biomedical Optics, 2018
- Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network2017
- Deep Residual Learning for Image Recognition2016
- Accurate Image Super-Resolution Using Very Deep Convolutional Networks2016
- Fully convolutional networks for semantic segmentation2015
- Making a “Completely Blind” Image Quality AnalyzerIEEE Signal Processing Letters, 2012
- Blind/Referenceless Image Spatial Quality Evaluator2011
- Removing camera shake from a single photographACM Transactions on Graphics, 2006