Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


William Evan Higgins has a total of 64 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Automated detection of central chest lymph nodes for guided bronchoscopy

    by Yuxuan He, William E. Higgins

    Physicians now commonly use guided bronchoscopy systems to help diagnose lung cancer in early stage patients. To use such a system, the physician draws on a patient’s high-resolution chest computed tomography (CT) scan to preplan a bronchoscopic procedure for a peripheral nodule observed on the CT. Later, in the operating room, the physician uses the guidance system, driven by the procedure plan, to navigate the bronchoscope to the nodule and perform the desired tissue biopsy. Central-chest lymph node staging, however, is also required to ascertain a patient’s disease stage. Unfortunately, current practice tends to rely on manually identifying only 2 or 3 enlarged lymph nodes (short axis ≥ 10 mm) on a thick-slice CT scan (slice spacing ≥ 3 mm). Yet, to have a truly accurate and effective assessment of disease stage, the staging procedure should satisfy two criteria: 1) consider a more comprehensive set of nodes distributed across the chest; 2) include nodes smaller than what had heretofore been considered in clinical practice. Because manual identification of lymph nodes is known to be challenging, researchers have suggested automatic deep learning methods for CT-based lymph extraction. Unfortunately, these methods have only focused on defining enlarged lymph nodes observed in thick-slice CT scans, as typically done by radiologists. We present a three-stage framework that detects lymph nodes across a broader size range; i.e., short axis ≥ 5 mm; and draws on high-resolution chest CT scans used for guided bronchoscopy (slice spacing < 1 mm). The framework includes: 1) pre-processing, to reduce redundant information; 2) model inference, using a trained Swin-UNETR Transformer model; and 3) post-prediction filtering, to eliminate false positives. On a 41-patient training and validation dataset containing 847 nodes having short axis ≥ 5 mm, our model showed an average sensitivity of 76.5% for lymph node detection. In a separate comparison test involving a set of 3D high-resolution chest CT scans, our framework gave detection rates of 80%, 91%, and 71% for all nodes, enlarged nodes and smaller nodes, respectively, versus 52%, 73%, and 38% for a state-of-the-art deep learning method. Furthermore, the proposed framework achieved 85.4% detection rate on a widely used public dataset with 388 enlarged mediastinal lymph nodes from 30 CT scans.

  • Automatic lesion detection in high-definition white-light bronchoscopic video

    by Austin C. Kao, Qi Chang, William E. Higgins, Danish Ahmad, Yu Htwe, Jennifer Toth, Rebecca Bascom

    The formation of bronchial lesions along the airway walls (mucosa) is known to be a potential indicator of early lung cancer. White-Light Bronchoscopy (WLB) has long been the standard minimally invasive modality for identifying bronchial lesions. To do this, the physician performs a procedure known as bronchoscopy, examining the major airways to interactively locate suspect lesion sites. Unfortunately, past clinical studies have established that such an exam demands a time-consuming, careful inspection of the lengthy incoming WLB video stream. Because suspect lesions are typically distinguished from normal background regions by subtle differences, many lesions are easily missed in the video stream, resulting in lesion detection rates as low as 29% in past clinical studies. The recent introduction of High-Definition (HD) WLB offers the potential for more detailed airway wall imaging, thereby offering a potentially more informative data source for identifying lesions. Nevertheless, the physician still must rely on interactive inspection to identify lesions. We consider deep learning approaches for automating the process of analyzing WLB video. In particular, we develop an HD WLB ground truth dataset and apply this dataset to a series of deep learning models to the problem of automatic bronchial lesion detection and segmentation. In our study, the best model achieved 97% detection accuracy and a Dice score of 0.54 for lesion segmentation.


  • Open Access

    Two-phase radial endobronchial ultrasound bronchoscopy registration

    by Wennan Zhao, Trevor Kuhlengel, Qi Chang, Vahid Daneshpajooh, Yuxuan He, Austin Kao, Rebecca Bascom, Danish Ahmad, Yu Maw Htwe, Jennifer Toth, et al.

    PurposeLung cancer remains the leading cause of cancer death. This has brought about a critical need for managing peripheral regions of interest (ROIs) in the lungs, be it for cancer diagnosis, staging, or treatment. The state-of-the-art approach for assessing peripheral ROIs involves bronchoscopy. To perform the procedure, the physician first navigates the bronchoscope to a preplanned airway, aided by an assisted bronchoscopy system. They then confirm an ROI’s specific location and perform the requisite clinical task. Many ROIs, however, are extraluminal and invisible to the bronchoscope’s field of view. For such ROIs, current practice dictates using a supplemental imaging method, such as fluoroscopy, cone-beam computed tomography (CT), or radial endobronchial ultrasound (R-EBUS), to gather additional ROI location information. Unfortunately, fluoroscopy and cone-beam CT require substantial radiation and lengthen procedure time. As an alternative, R-EBUS is a safer real-time option involving no radiation. Regrettably, existing assisted bronchoscopy systems offer no guidance for R-EBUS confirmation, forcing the physician to resort to an unguided guess-and-check approach for R-EBUS probe placement—an approach that can produce R-EBUS placement errors exceeding 30 deg, an error that can result in missing many ROIs. Thus, because of physician skill variations, biopsy success rates using R-EBUS for ROI confirmation have varied greatly from 31% to 80%. This situation obliges the physician to turn to a radiation-based modality to gather sufficient information for ROI confirmation. We propose a two-phase registration method that provides guidance for R-EBUS probe placement.ApproachAfter the physician navigates the bronchoscope to the airway near a target ROI, the two-phase registration method begins by registering a virtual bronchoscope to the real bronchoscope. A virtual 3D R-EBUS probe model is then registered to the real R-EBUS probe shape depicted in the bronchoscopic video using an iterative region-based alignment method drawing on a level-set-based optimization. This synchronizes the guidance system to the target ROI site. The physician can now perform the R-EBUS scan to confirm the ROI.ResultsWe validated the method’s efficacy for localizing extraluminal ROIs with a series of three studies. First, for a controlled phantom study, we observed that the mean accumulated position and direction errors (accounting for both registration phases) were 1.94 mm and 3.74 deg (equivalent to 1.30 mm position error for a 20 mm biopsy needle), respectively. Next, for a live animal study, these errors were 2.81 mm and 4.79 deg (2.41 mm biopsy needle error), respectively. For 100% of the ROIs considered in these two studies, the method enabled visualization of an ROI via R-EBUS in under 3 min per ROI. Finally, initial operating-room tests on lung cancer patients indicated the method’s efficacy, functionality, efficiency, and safety under standard clinical conditions.ConclusionsThe method offers a quick, low-cost, radiation-free approach for examining peripheral extraluminal ROIs using R-EBUS. Although our studies focused on R-EBUS as the supplemental working channel instrument, the proposed method has general applicability to any clinical bronchoscopic task requiring a working channel instrument. Thus, the method has the potential to improve the efficiency and efficacy of bronchoscopic procedures for lung cancer patients.


  • Open Access

    ESFPNet: Efficient Stage-Wise Feature Pyramid on Mix Transformer for Deep Learning-Based Cancer Analysis in Endoscopic Video

    by Qi Chang, Danish Ahmad, Jennifer Toth, Rebecca Bascom, William E. Higgins

    For patients at risk of developing either lung cancer or colorectal cancer, the identification of suspect lesions in endoscopic video is an important procedure. The physician performs an endoscopic exam by navigating an endoscope through the organ of interest, be it the lungs or intestinal tract, and performs a visual inspection of the endoscopic video stream to identify lesions. Unfortunately, this entails a tedious, error-prone search over a lengthy video sequence. We propose a deep learning architecture that enables the real-time detection and segmentation of lesion regions from endoscopic video, with our experiments focused on autofluorescence bronchoscopy (AFB) for the lungs and colonoscopy for the intestinal tract. Our architecture, dubbed ESFPNet, draws on a pretrained Mix Transformer (MiT) encoder and a decoder structure that incorporates a new Efficient Stage-Wise Feature Pyramid (ESFP) to promote accurate lesion segmentation. In comparison to existing deep learning models, the ESFPNet model gave superior lesion segmentation performance for an AFB dataset. It also produced superior segmentation results for three widely used public colonoscopy databases and nearly the best results for two other public colonoscopy databases. In addition, the lightweight ESFPNet architecture requires fewer model parameters and less computation than other competing models, enabling the real-time analysis of input video frames. Overall, these studies point to the combined superior analysis performance and architectural efficiency of the ESFPNet for endoscopic video analysis. Lastly, additional experiments with the public colonoscopy databases demonstrate the learning ability and generalizability of ESFPNet, implying that the model could be effective for region segmentation in other domains.


  • Automatic lesion detection for narrow-band imaging bronchoscopy

    by Vahid Daneshpajooh, Danish Ahmad, Jennifer Toth, Rebecca Bascom, William E. Higgins

    PurposeEarly detection of cancer is crucial for lung cancer patients, as it determines disease prognosis. Lung cancer typically starts as bronchial lesions along the airway walls. Recent research has indicated that narrow-band imaging (NBI) bronchoscopy enables more effective bronchial lesion detection than other bronchoscopic modalities. Unfortunately, NBI video can be hard to interpret because physicians currently are forced to perform a time-consuming subjective visual search to detect bronchial lesions in a long airway-exam video. As a result, NBI bronchoscopy is not regularly used in practice. To alleviate this problem, we propose an automatic two-stage real-time method for bronchial lesion detection in NBI video and perform a first-of-its-kind pilot study of the method using NBI airway exam video collected at our institution.ApproachGiven a patient’s NBI video, the first method stage entails a deep-learning-based object detection network coupled with a multiframe abnormality measure to locate candidate lesions on each video frame. The second method stage then draws upon a Siamese network and a Kalman filter to track candidate lesions over multiple frames to arrive at final lesion decisions.ResultsTests drawing on 23 patient NBI airway exam videos indicate that the method can process an incoming video stream at a real-time frame rate, thereby making the method viable for real-time inspection during a live bronchoscopic airway exam. Furthermore, our studies showed a 93% sensitivity and 86% specificity for lesion detection; this compares favorably to a sensitivity and specificity of 80% and 84% achieved over a series of recent pooled clinical studies using the current time-consuming subjective clinical approach.ConclusionThe method shows potential for robust lesion detection in NBI video at a real-time frame rate. Therefore, it could help enable more common use of NBI bronchoscopy for bronchial lesion detection.


  • Open Access

    Autofluorescence Bronchoscopy Video Analysis for Lesion Frame Detection

    by Qi Chang, Rebecca Bascom, Jennifer Toth, Danish Ahmad, William E. Higgins

    Because of the significance of bronchial lesions as indicators of early lung cancer and squamous cell carcinoma, a critical need exists for early detection of bronchial lesions. Autofluorescence bronchoscopy (AFB) is a primary modality used for bronchial lesion detection, as it shows high sensitivity to suspicious lesions. The physician, however, must interactively browse a long video stream to locate lesions, making the search exceedingly tedious and error prone. Unfortunately, limited research has explored the use of automated AFB video analysis for efficient lesion detection. We propose a robust automatic AFB analysis approach that distinguishes informative and uninformative AFB video frames in a video. In addition, for the informative frames, we determine the frames containing potential lesions and delineate candidate lesion regions. Our approach draws upon a combination of computer-based image analysis, machine learning, and deep learning. Thus, the analysis of an AFB video stream becomes more tractable. Tests with patient AFB video indicate that $\ge$97\% of frames were correctly labeled as informative or uninformative. In addition, $\ge$97\% of lesion frames were correctly identified, with false positive and false negative rates $\le$3\%.

  • Open Access

    Bronchoscopic video synchronization for interactive multimodal inspection of bronchial lesions

    by Qi Chang, Patrick D. Byrnes, Danish Ahmad, Jennifer Toth, Rebecca Bascom, William E. Higgins

    With lung cancer being the most fatal cancer worldwide, it is important to detect the disease early. A potentially effective way of detecting early cancer lesions developing along the airway walls (epithelium) is bronchoscopy. To this end, developments in bronchoscopy offer three promising noninvasive modalities for imaging bronchial lesions: white-light bronchoscopy (WLB), autofluorescence bronchoscopy (AFB), and narrow-band imaging (NBI). While these modalities give complementary views of the airway epithelium, the physician must manually inspect each video stream produced by a given modality to locate the suspect cancer lesions. Unfortunately, no effort has been made to rectify this situation by providing efficient quantitative and visual tools for analyzing these video streams. This makes the lesion search process extremely time-consuming and error-prone, thereby making it impractical to utilize these rich data sources effectively. We propose a framework for synchronizing multiple bronchoscopic videos to enable an interactive multimodal analysis of bronchial lesions. Our methods first register the video streams to a reference 3D chest computed-tomography (CT) scan to produce multimodal linkages to the airway tree. Our methods then temporally correlate the videos to one another to enable synchronous visualization of the resulting multimodal data set. Pictorial and quantitative results illustrate the potential of the methods.

  • Open Access

    ESFPNet: efficient deep learning architecture for real-time lesion segmentation in autofluorescence bronchoscopic video

    by Qi Chang, Danish Ahmad, Jennifer Toth, Rebecca Bascom, William E. Higgins

    Lung cancer tends to be detected at an advanced stage, resulting in a high patient mortality rate. Thus, much recent research has focused on early disease detection Bronchoscopy is the procedure of choice for an effective noninvasive way of detecting early manifestations (bronchial lesions) of lung cancer. In particular, autofluorescence bronchoscopy (AFB) discriminates the autofluorescence properties of normal (green) and diseased tissue (reddish brown) with different colors. Because recent studies show AFB's high sensitivity in searching lesions, it has become a potentially pivotal method in bronchoscopic airway exams. Unfortunately, manual inspection of AFB video is extremely tedious and error prone, while limited effort has been expended toward potentially more robust automatic AFB lesion analysis. We propose a real-time (processing throughput of 27 frames/sec) deep-learning architecture dubbed ESFPNet for accurate segmentation and robust detection of bronchial lesions in AFB video streams. The architecture features an encoder structure that exploits pretrained Mix Transformer (MiT) encoders and an efficient stage-wise feature pyramid (ESFP) decoder structure. Segmentation results from the AFB airway-exam videos of 20 lung cancer patients indicate that our approach gives a mean Dice index = 0.756 and an average Intersection of Union = 0.624, results that are superior to those generated by other recent architectures. Thus, ESFPNet gives the physician a potential tool for confident real-time lesion segmentation and detection during a live bronchoscopic airway exam. Moreover, our model shows promising potential applicability to other domains, as evidenced by its state-of-the-art (SOTA) performance on the CVC-ClinicDB, ETIS-LaribPolypDB datasets, and superior performance on the Kvasir, CVC-ColonDB datasets.

  • Efficient procedure planning for comprehensive lymph node staging bronchoscopy

    by Trevor K. Kuhlengel, Rebecca Bascom, William E. Higgins

    Purpose: For a patient at risk of having lung cancer, accurate disease staging is vital as it dictates disease prognosis and treatment. Accurate staging requires a comprehensive sampling of lymph nodes within the chest via bronchoscopy. Unfortunately, physicians are generally unable to plan and perform sufficiently comprehensive procedures to ensure accurate disease staging. We propose a method for planning comprehensive lymph node staging procedures.Approach: Drawing on a patient’s chest CT scan, the method derives a multi-destination tour for efficient navigation to a set of lymph nodes. We formulate the planning task as a traveling salesman problem. To solve the problem, we apply the concept of ant colony optimization (ACO) to derive an efficient airway tour connecting the target nodes. The method has three main steps: (1) CT preprocessing, to define important chest anatomy; (2) graph and staging zone construction, to set up the necessary data structures and clinical constraints; and (3) tour computation, to derive the staging plan. The plan conforms to the world standard International Association for the Study of Lung Cancer (IASLC) lymph node map and recommended clinical staging guidelines.Results: Tests with a patient database indicate that the method derives optimal or near-optimal tours in under a few seconds, regardless of the number of target lymph nodes (mean tour length = 1.4% longer than the optimum). A brute force optimal search, on the other hand, generally cannot reach a solution in under 10 min. for patients exhibiting >16 nodes, and other methods provide poor solutions. We also demonstrate the method’s utility in an image-guided bronchoscopy system.Conclusions: The method provides an efficient computational approach for planning a comprehensive lymph node staging bronchoscopy. In addition, the method shows promise for driving an image-guided bronchoscopy system or robotics-assisted bronchoscopy system tailored to lymph node staging.


  • Endobronchial Ultrasound Image Simulation for Image-Guided Bronchoscopy

    by Wennan Zhao, Danish Ahmad, Jennifer Toth, Rebecca Bascom, William E. Higgins

    Background/Objective: Accurate disease diagnosis and staging are essential for patients suspected of having lung cancer. The state-of-the-art minimally invasive tools used by physicians to perform these operations are bronchoscopy, for navigating the lung airways, and endobronchial ultrasound (EBUS), for localizing suspect extraluminal cancer lesions. While new image-guided systems enable accurate bronchoscope navigation close to a lesion, no means exists for guiding the final EBUS localization of an extraluminal lesion. We propose an EBUS simulation method to assist with EBUS localization. Methods: The method draws on a patient's chest computed-tomography (CT) scan to model the ultrasound signal propagation through the tissue media. The method, which is suitable for simulating EBUS images for both radial-probe and convex-probe EBUS devices, entails three steps: 1) image preprocessing, which generates a 2D CT equivalent of the EBUS scan plane; 2) EBUS scan-line computation, which models ultrasound transmission to map the CT plane into a preliminary simulated EBUS image; and 3) image post-processing, which increases realism by introducing simulated EBUS imaging effects and artifacts. Results: Results show that the method produces simulated EBUS images that strongly resemble images generated live by a real device and compares favorably to an existing ultrasound simulation method. It also produces images at a rate greater than real time (i.e., $>$ 53 frames/sec). We also demonstrate a successful integration of the method into an image-guided EBUS bronchoscopy system. Conclusion/Significance: The method is effective and practical for procedure planning/preview and follow-on live guidance of EBUS bronchoscopy.