Taylor L. Bobrow
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Taylor L. Bobrow has a total of 38 co-authors. Here are the top co-authors by number of shared publications:
- Nicholas J. Durr
Johns Hopkins University
8 shared publications - Faisal Mahmood
Department of Pathology, Harvard Medical School, Boston, USA
2 shared publications - Mayank Golhar
Johns Hopkins University
2 shared publications Miguel Inserni
Department of Biomedical Engineering, Johns Hopkins University (JHU), Baltimore, MD 21218, USA
2 shared publications- Andrew S. Tsai
Department of Biomedical Engineering, Johns Hopkins University, 3400 N Charles Street, Baltimore, MD 21218
1 shared publication - Anil K. Palepu
Department of Biomedical Engineering, Johns Hopkins University, 3400 N Charles Street, Baltimore, MD 21218
1 shared publication
Latest Publications
- Open Access
- 1 January 2025
- Published by SPIE-Intl Soc Optical Eng in Journal of Biomedical Optics
- Vol. 30 (S1) , S13710-19
Speckle-illumination spatial frequency domain imaging with a stereo laparoscope for profile-corrected optical property mapping
Laparoscopy is a minimally invasive surgical technique that has become the standard of care for many procedures, such as prostatectomies and appendectomies.1 Compared with traditional open surgery, laparoscopy results in faster recovery times, reduced scarring, and lower medical costs.2 However, laparoscopy presents challenges in visualization due to limited field of view (FOV) and poor contrast, which can make it difficult to accurately identify critical anatomical structures, assess tissue perfusion, and determine cancerous tissue margins.3 These limitations can lead to subjective decision-making reliant on the surgeon’s experience,4 leading to wide variability in clinical outcomes.5 This has spurred the development of optical technologies for surgical guidance, including fluorescence contrast6,7 and endogenous contrast.8 – 10 However, fluorescence imaging using an exogenous dye requires pre- or peri-operative administration of an optical contrast agent, which increases intraoperative workflow complexity. In addition, many of these techniques are qualitative, leading to user subjectivity, which limits their practical clinical value and generalization to downstream tasks employing artificial intelligence. Recent research studies have demonstrated that tissue optical properties can be used to identify tissue types with high sensitivity and specificity,10,11 underscoring the potential impact of laparoscopic techniques enabling quantitative mapping of optical properties.
- 1 January 2025
- Published by SPIE-Intl Soc Optical Eng in Journal of Biomedical Optics
- Vol. 30 (S1) , S13710-19
Open AccessSpeckle-illumination spatial frequency domain imaging with a stereo laparoscope for profile-corrected optical property mapping
Laparoscopy is a minimally invasive surgical technique that has become the standard of care for many procedures, such as prostatectomies and appendectomies.1 Compared with traditional open surgery, laparoscopy results in faster recovery times, reduced scarring, and lower medical costs.2 However, laparoscopy presents challenges in visualization due to limited field of view (FOV) and poor contrast, which can make it difficult to accurately identify critical anatomical structures, assess tissue perfusion, and determine cancerous tissue margins.3 These limitations can lead to subjective decision-making reliant on the surgeon’s experience,4 leading to wide variability in clinical outcomes.5 This has spurred the development of optical technologies for surgical guidance, including fluorescence contrast6,7 and endogenous contrast.8 – 10 However, fluorescence imaging using an exogenous dye requires pre- or peri-operative administration of an optical contrast agent, which increases intraoperative workflow complexity. In addition, many of these techniques are qualitative, leading to user subjectivity, which limits their practical clinical value and generalization to downstream tasks employing artificial intelligence. Recent research studies have demonstrated that tissue optical properties can be used to identify tissue types with high sensitivity and specificity,10,11 underscoring the potential impact of laparoscopic techniques enabling quantitative mapping of optical properties.
- 7 May 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 29 (6) , 3864-3873
GAN Inversion for Data Augmentation to Improve Colonoscopy Lesion Classification
A major challenge in applying deep learning to medical imaging is the paucity of annotated data. This study explores the use of synthetic images for data augmentation to address the challenge of limited annotated data in colonoscopy lesion classification. We demonstrate that synthetic colonoscopy images generated by Generative Adversarial Network (GAN) inversion can be used as training data to improve polyp classification performance by deep learning models. We invert pairs of images with the same label to a semantically rich and disentangled latent space and manipulate latent representations to produce new synthetic images. These synthetic images maintain the same label as the input pairs. We perform image modality translation (style transfer) between white light and narrow-band imaging (NBI). We also generate realistic synthetic lesion images by interpolating between original training images to increase the variety of lesion shapes in the training dataset. Our experiments show that GAN inversion can produce multiple colonoscopy data augmentations that improve the downstream polyp classification performance by 2.7% in F1-score and 4.9% in sensitivity over other methods, including state-of-the-art data augmentation. Testing on unseen out-of-domain data also showcased an improvement of 2.9% in F1-score and 2.7% in sensitivity. This approach outperforms other colonoscopy data augmentation techniques and does not require re-training multiple generative models. It also effectively uses information from diverse public datasets, even those not specifically designed for the targeted downstream task, resulting in strong domain generalizability. Project code and model: https://github.com/DurrLab/GAN-Inversion .
- 7 May 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 29 (6) , 3864-3873
GAN Inversion for Data Augmentation to Improve Colonoscopy Lesion Classification
A major challenge in applying deep learning to medical imaging is the paucity of annotated data. This study explores the use of synthetic images for data augmentation to address the challenge of limited annotated data in colonoscopy lesion classification. We demonstrate that synthetic colonoscopy images generated by Generative Adversarial Network (GAN) inversion can be used as training data to improve polyp classification performance by deep learning models. We invert pairs of images with the same label to a semantically rich and disentangled latent space and manipulate latent representations to produce new synthetic images. These synthetic images maintain the same label as the input pairs. We perform image modality translation (style transfer) between white light and narrow-band imaging (NBI). We also generate realistic synthetic lesion images by interpolating between original training images to increase the variety of lesion shapes in the training dataset. Our experiments show that GAN inversion can produce multiple colonoscopy data augmentations that improve the downstream polyp classification performance by 2.7% in F1-score and 4.9% in sensitivity over other methods, including state-of-the-art data augmentation. Testing on unseen out-of-domain data also showcased an improvement of 2.9% in F1-score and 2.7% in sensitivity. This approach outperforms other colonoscopy data augmentation techniques and does not require re-training multiple generative models. It also effectively uses information from diverse public datasets, even those not specifically designed for the targeted downstream task, resulting in strong domain generalizability. Project code and model: https://github.com/DurrLab/GAN-Inversion .
- Top Cited Papers
- 7 September 2023
- Published by Elsevier in Medical Image Analysis
- Vol. 90, 102956
Colonoscopy 3D video dataset with paired depth from 2D-3D registration
- 7 September 2023
- Published by Elsevier in Medical Image Analysis
- Vol. 90, 102956
Top Cited PapersColonoscopy 3D video dataset with paired depth from 2D-3D registration
- Top Cited Papers
- 1 July 2021
- Published by Elsevier in Medical Image Analysis
- Vol. 71, 102058
EndoSLAM dataset and an unsupervised monocular visual odometry and depth estimation approach for endoscopic videos
- 1 July 2021
- Published by Elsevier in Medical Image Analysis
- Vol. 71, 102058
Top Cited PapersEndoSLAM dataset and an unsupervised monocular visual odometry and depth estimation approach for endoscopic videos
- 18 December 2020
- Published by ASME International in Journal of Medical Devices
- Vol. 15 (2)
Establishing a Quantitative Endpoint for Transarterial Embolization From Real-Time Pressure Measurements
Transarterial embolization (TAE) is a standard-of-care treatment for tumors in which embolic particles are locally injected via a catheter to occlude blood flow and induce ischemia in the target tissue. Physicians currently rely on subjective visual cues from fluoroscopy in order to determine the procedural endpoint relative to the injection site. This contributes to highly variable treatment outcomes, including the accumulation of embolic particles in healthy tissue, called off-target embolization. To address this concern, we describe a novel, multilumen catheter that 1) measures real-time pressure upstream of the tumor site during TAE injection; and 2) associates that measurement with the volume of embolic particles injected. Using an in vitro silicon vascular model, we characterize the relationship between blood flow, intravascular pressure, and injection pressure. Furthermore, we identify a predictive pressure curve based on the volume of embolic particles injected. This approach has the potential to standardize and optimize TAE, reducing the likelihood of incomplete or off-target embolization, and improving patient outcomes.
- 18 December 2020
- Published by ASME International in Journal of Medical Devices
- Vol. 15 (2)
Establishing a Quantitative Endpoint for Transarterial Embolization From Real-Time Pressure Measurements
Transarterial embolization (TAE) is a standard-of-care treatment for tumors in which embolic particles are locally injected via a catheter to occlude blood flow and induce ischemia in the target tissue. Physicians currently rely on subjective visual cues from fluoroscopy in order to determine the procedural endpoint relative to the injection site. This contributes to highly variable treatment outcomes, including the accumulation of embolic particles in healthy tissue, called off-target embolization. To address this concern, we describe a novel, multilumen catheter that 1) measures real-time pressure upstream of the tumor site during TAE injection; and 2) associates that measurement with the volume of embolic particles injected. Using an in vitro silicon vascular model, we characterize the relationship between blood flow, intravascular pressure, and injection pressure. Furthermore, we identify a predictive pressure curve based on the volume of embolic particles injected. This approach has the potential to standardize and optimize TAE, reducing the likelihood of incomplete or off-target embolization, and improving patient outcomes.
- 17 May 2019
- Published by Optica Publishing Group in Biomedical Optics Express
- Vol. 10 (6) , 2869-2882
DeepLSR: a deep learning approach for laser speckle reduction
Speckle artifacts degrade image quality in virtually all modalities that utilize coherent energy, including optical coherence tomography, reflectance confocal microscopy, ultrasound, and widefield imaging with laser illumination. We present an adversarial deep learning framework for laser speckle reduction, called DeepLSR (https://durr.jhu.edu/DeepLSR), that transforms images from a source domain of coherent illumination to a target domain of speckle-free, incoherent illumination. We apply this method to widefield images of objects and tissues illuminated with a multi-wavelength laser, using light emitting diode-illuminated images as ground truth. In images of gastrointestinal tissues, DeepLSR reduces laser speckle noise by 6.4 dB, compared to a 2.9 dB reduction from optimized non-local means processing, a 3.0 dB reduction from BM3D, and a 3.7 dB reduction from an optical speckle reducer utilizing an oscillating diffuser. Further, DeepLSR can be combined with optical speckle reduction to reduce speckle noise by 9.4 dB. This dramatic reduction in speckle noise may enable the use of coherent light sources in applications that require small illumination sources and high-quality imaging, including medical endoscopy.
- 17 May 2019
- Published by Optica Publishing Group in Biomedical Optics Express
- Vol. 10 (6) , 2869-2882
DeepLSR: a deep learning approach for laser speckle reduction
Speckle artifacts degrade image quality in virtually all modalities that utilize coherent energy, including optical coherence tomography, reflectance confocal microscopy, ultrasound, and widefield imaging with laser illumination. We present an adversarial deep learning framework for laser speckle reduction, called DeepLSR (https://durr.jhu.edu/DeepLSR), that transforms images from a source domain of coherent illumination to a target domain of speckle-free, incoherent illumination. We apply this method to widefield images of objects and tissues illuminated with a multi-wavelength laser, using light emitting diode-illuminated images as ground truth. In images of gastrointestinal tissues, DeepLSR reduces laser speckle noise by 6.4 dB, compared to a 2.9 dB reduction from optimized non-local means processing, a 3.0 dB reduction from BM3D, and a 3.7 dB reduction from an optical speckle reducer utilizing an oscillating diffuser. Further, DeepLSR can be combined with optical speckle reduction to reduce speckle noise by 9.4 dB. This dramatic reduction in speckle noise may enable the use of coherent light sources in applications that require small illumination sources and high-quality imaging, including medical endoscopy.
- 4 March 2019
- Published by SPIE-Intl Soc Optical Eng
- Vol. 10889, 42
Speckle reduction in laser illuminated endoscopy using adversarial deep learning
Endoscope size is a major design constraint that must be managed with the clinical demand for high-quality illumination and imaging. Existing commercial endoscopes most often use an arc lamp to produce bright, incoherent white light, requiring large-area fiber bundles to deliver sufficient illumination power to the sample. Moreover, the power instability of these light sources creates challenges for computer vision applications. We demonstrate an alternative illumination technique using red-green-blue laser light and a data-driven approach to combat the speckle noise that is a byproduct of coherent illumination. We frame the speckle artifact problem as an image-to-image translation task solved using conditional Generative Adversarial Networks (cGANs). To train the network, we acquire images illuminated with a coherent laser diode, with a laser diode source made partially- coherent using a laser speckle reducer, and with an incoherent LED light source as the target domain. We train networks using laser-illuminated endoscopic images of ex-vivo, porcine gastrointestinal tissues, augmented by images of laser-illuminated household and laboratory objects. The network is then benchmarked against state of-the-art optical and image processing speckle reduction methods, achieving an increased peak signal-to-noise ratio (PSNR) of 4.1 db, compared to 0.7 dB using optical speckle reduction, 0.6 dB using median filtering, and 0.5 dB using non-local means. This approach not only allows for endoscopes with smaller, more efficient light sources with extremely short triggering times, but it also enables imaging modalities that require both coherent and incoherent sources, such as combined widefield and speckle ow contrast imaging in a single image frame.
- 4 March 2019
- Published by SPIE-Intl Soc Optical Eng
- Vol. 10889, 42
Speckle reduction in laser illuminated endoscopy using adversarial deep learning
Endoscope size is a major design constraint that must be managed with the clinical demand for high-quality illumination and imaging. Existing commercial endoscopes most often use an arc lamp to produce bright, incoherent white light, requiring large-area fiber bundles to deliver sufficient illumination power to the sample. Moreover, the power instability of these light sources creates challenges for computer vision applications. We demonstrate an alternative illumination technique using red-green-blue laser light and a data-driven approach to combat the speckle noise that is a byproduct of coherent illumination. We frame the speckle artifact problem as an image-to-image translation task solved using conditional Generative Adversarial Networks (cGANs). To train the network, we acquire images illuminated with a coherent laser diode, with a laser diode source made partially- coherent using a laser speckle reducer, and with an incoherent LED light source as the target domain. We train networks using laser-illuminated endoscopic images of ex-vivo, porcine gastrointestinal tissues, augmented by images of laser-illuminated household and laboratory objects. The network is then benchmarked against state of-the-art optical and image processing speckle reduction methods, achieving an increased peak signal-to-noise ratio (PSNR) of 4.1 db, compared to 0.7 dB using optical speckle reduction, 0.6 dB using median filtering, and 0.5 dB using non-local means. This approach not only allows for endoscopes with smaller, more efficient light sources with extremely short triggering times, but it also enables imaging modalities that require both coherent and incoherent sources, such as combined widefield and speckle ow contrast imaging in a single image frame.
- 27 February 2019
- Published by SPIE-Intl Soc Optical Eng in Proceedings of SPIE
- Vol. 10871, 34
An adaptive-coherence light source for hyperspectral, topographic, and flow-contrast imaging
Colorectal cancer accounts for an estimated 8% of cancer deaths in the United States with a five-year survival rate of 55-75%. The early detection and removal of precancerous lesions is critical for reducing mortality, but subtle neoplastic growths, such as non-polypoid lesions, often go undetected during routine colonoscopy. Current approaches to flat or depressed lesion detection are ineffective due to the poor contrast of subtle features in white light endoscopy. Towards improving colorectal lesion contrast, we present an endoscopic light source with custom laser channels for multimodal color, topographic, and speckle contrast flow imaging. Three red-green-blue laser units, paired with laser speckle reducers, are coupled into endoscopic fiber optic light guides in a benchtop endoscope. Tissue phantom topography is reconstructed using alternating illumination of the laser units and a photometric stereo endoscopy algorithm. The contrast of flow regions is enhanced in an optical flow phantom using laser speckle contrast imaging. Further, the system retains the ability to offer white light and narrow band illumination modes with improved power efficiency, a reduced size, and longer lifetimes compared to conventional endoscopic arc lamp sources. This novel endoscopic light source design shows promise for increasing the detection of subtle lesions in routine colonoscopy screening.
- 27 February 2019
- Published by SPIE-Intl Soc Optical Eng in Proceedings of SPIE
- Vol. 10871, 34
An adaptive-coherence light source for hyperspectral, topographic, and flow-contrast imaging
Colorectal cancer accounts for an estimated 8% of cancer deaths in the United States with a five-year survival rate of 55-75%. The early detection and removal of precancerous lesions is critical for reducing mortality, but subtle neoplastic growths, such as non-polypoid lesions, often go undetected during routine colonoscopy. Current approaches to flat or depressed lesion detection are ineffective due to the poor contrast of subtle features in white light endoscopy. Towards improving colorectal lesion contrast, we present an endoscopic light source with custom laser channels for multimodal color, topographic, and speckle contrast flow imaging. Three red-green-blue laser units, paired with laser speckle reducers, are coupled into endoscopic fiber optic light guides in a benchtop endoscope. Tissue phantom topography is reconstructed using alternating illumination of the laser units and a photometric stereo endoscopy algorithm. The contrast of flow regions is enhanced in an optical flow phantom using laser speckle contrast imaging. Further, the system retains the ability to offer white light and narrow band illumination modes with improved power efficiency, a reduced size, and longer lifetimes compared to conventional endoscopic arc lamp sources. This novel endoscopic light source design shows promise for increasing the detection of subtle lesions in routine colonoscopy screening.
- Open Access
- 19 January 2018
- Published by SAGE Publications in I-Perception
- Vol. 9 (1)
Transient Signals and Inattentional Blindness in a Multi-object Tracking Task
Inattentional blindness is a failure to notice an unexpected event when attention is directed elsewhere. The current study examined participants’ awareness of an unexpected object that maintained luminance contrast, switched the luminance once, or repetitively flashed. One hundred twenty participants performed a dynamic tracking task on a computer monitor for which they were instructed to count the number of movement deflections of an attended set of objects while ignoring other objects. On the critical trial, an unexpected cross that did not change its luminance (control condition), switched its luminance once (switch condition), or repetitively flashed (flash condition) traveled across the stimulus display. Participants noticed the unexpected cross more frequently when the luminance feature matched their attention set than when it did not match. Unexpectedly, however, a proportion of the participants who noticed the cross in the switch and flash conditions were statistically comparable. The results suggest that an unexpected object with even a single luminance change can break inattentional blindness in a multi-object tracking task.
- 19 January 2018
- Published by SAGE Publications in I-Perception
- Vol. 9 (1)
Open AccessTransient Signals and Inattentional Blindness in a Multi-object Tracking Task
Inattentional blindness is a failure to notice an unexpected event when attention is directed elsewhere. The current study examined participants’ awareness of an unexpected object that maintained luminance contrast, switched the luminance once, or repetitively flashed. One hundred twenty participants performed a dynamic tracking task on a computer monitor for which they were instructed to count the number of movement deflections of an attended set of objects while ignoring other objects. On the critical trial, an unexpected cross that did not change its luminance (control condition), switched its luminance once (switch condition), or repetitively flashed (flash condition) traveled across the stimulus display. Participants noticed the unexpected cross more frequently when the luminance feature matched their attention set than when it did not match. Unexpectedly, however, a proportion of the participants who noticed the cross in the switch and flash conditions were statistically comparable. The results suggest that an unexpected object with even a single luminance change can break inattentional blindness in a multi-object tracking task.