Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Jian Du has a total of 17 co-authors. Here are the top co-authors by number of shared publications:

  • Zhoufeng Zhang

    Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China

    7 shared publications
  • Bingliang Hu

    Key Laboratory of Spectral Imaging Technology, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China

    5 shared publications
  • Chenglong Tao

    Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China

    3 shared publications
  • Jiayue Yan

    Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China

    3 shared publications
  • Junjie Wang

    Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China

    3 shared publications
  • Chenglong Tao

    Key Laboratory of Spectral Imaging Technology CAS, Xi'an Institute of Optics and Precision Mechanics of Chinese Academy of Sciences, Xi'an, 710119, Shaanxi, China; Key Laboratory of Biomedical Spectroscopy of Xi'an, Xi'an, 710119, Shaanxi, China

    2 shared publications

Latest Publications

  • Open Access

    Application of Enhanced Weighted Least Squares with Dark Background Image Fusion for Inhomogeneity Noise Removal in Brain Tumor Hyperspectral Images

    by Jiayue Yan, Chenglong Tao, Yuan Wang, Jian Du, Meijie Qi, Zhoufeng Zhang, Bingliang Hu

    The inhomogeneity of spectral pixel response is an unavoidable phenomenon in hyperspectral imaging, which is mainly manifested by the existence of inhomogeneity banding noise in the acquired hyperspectral data. It must be carried out to get rid of this type of striped noise since it is frequently uneven and densely distributed, which negatively impacts data processing and application. By analyzing the source of the instrument noise, this work first created a novel non-uniform noise removal method for a spatial dimensional push sweep hyperspectral imaging system. Clean and clear medical hyperspectral brain tumor tissue images were generated by combining scene-based and reference-based non-uniformity correction denoising algorithms, providing a strong basis for further diagnosis and classification. The precise procedure entails gathering the reference dark background image for rectification and the actual medical hyperspectral brain tumor image. The original hyperspectral brain tumor image is then smoothed using a weighted least squares algorithm model embedded with bilateral filtering (BLF-WLS), followed by a calculation and separation of the instrument fixed-mode fringe noise component from the acquired reference dark background image. The purpose of eliminating non-uniform fringe noise is achieved. In comparison to other common image denoising methods, the evaluation is based on the subjective effect and unreferenced image denoising evaluation indices. The approach discussed in this paper, according to the experiments, produces the best results in terms of the subjective effect and unreferenced image denoising evaluation indices (MICV and MNR). The image processed by this method has almost no residual non-uniform noise, the image is clear, and the best visual effect is achieved. It can be concluded that different denoising methods designed for different noises have better denoising effects on hyperspectral images. The non-uniformity denoising method designed in this paper based on a spatial dimension push-sweep hyperspectral imaging system can be widely used.


  • Open Access

    Classification of Benign–Malignant Thyroid Nodules Based on Hyperspectral Technology

    by Junjie Wang, Jian Du, Chenglong Tao, Meijie Qi, Jiayue Yan, Bingliang Hu, Zhoufeng Zhang

    In recent years, the incidence of thyroid cancer has rapidly increased. To address the issue of the inefficient diagnosis of thyroid cancer during surgery, we propose a rapid method for the diagnosis of benign and malignant thyroid nodules based on hyperspectral technology. Firstly, using our self-developed thyroid nodule hyperspectral acquisition system, data for a large number of diverse thyroid nodule samples were obtained, providing a foundation for subsequent diagnosis. Secondly, to better meet clinical practical needs, we address the current situation of medical hyperspectral image classification research being mainly focused on pixel-based region segmentation, by proposing a method for nodule classification as benign or malignant based on thyroid nodule hyperspectral data blocks. Using 3D CNN and VGG16 networks as a basis, we designed a neural network algorithm (V3Dnet) for classification based on three-dimensional hyperspectral data blocks. In the case of a dataset with a block size of 50 × 50 × 196, the classification accuracy for benign and malignant samples reaches 84.63%. We also investigated the impact of data block size on the classification performance and constructed a classification model that includes thyroid nodule sample acquisition, hyperspectral data preprocessing, and an algorithm for thyroid nodule classification as benign and malignant based on hyperspectral data blocks. The proposed model for thyroid nodule classification is expected to be applied in thyroid surgery, thereby improving surgical accuracy and providing strong support for scientific research in related fields.


  • Open Access

    Design of Optical System for Ultra-Large Range Line-Sweep Spectral Confocal Displacement Sensor

    by Weiguang Yang, Jian Du, Meijie Qi, Jiayue Yan, Mohan Cheng, Zhoufeng Zhang

    The spectrum confocal displacement sensor is an innovative type of photoelectric sensor. The non-contact advantages of this method include the capacity to obtain highly accurate measurements without inflicting any harm as well as the ability to determine the object’s surface contour recovery by reconstructing the measurement data. Consequently, it has been widely used in the field of three-dimensional topographic measuring. The spectral confocal displacement sensor consists of a light source, a dispersive objective, and an imaging spectrometer. The scanning mode can be categorized into point scanning and line scanning. Point scanning is inherently present when the scanning efficiency is low, resulting in a slower measurement speed. Further improvements are necessary in the research on the line-scanning type. It is crucial to expand the measurement range of existing studies to overcome the limitations encountered during the detection process. The objective of this study is to overcome the constraints of the existing line-swept spectral confocal displacement sensor’s limited measuring range and lack of theoretical foundation for the entire system. This is accomplished by suggesting an appropriate approach for creating the optical design of the dispersive objective lens in the line-swept spectral confocal displacement sensor. Additionally, prism-grating beam splitting is employed to simulate and analyze the imaging spectrometer’s back end. The combination of a prism and a grating eliminates the spectral line bending that occurs in the imaging spectrometer. The results indicate that a complete optical pathway for the line-scanning spectral confocal displacement sensor has been built, achieving an axial resolution of 0.8 μm, a scanning line length of 24 mm, and a dispersion range of 3.9 mm. This sensor significantly expands the range of measurements and fills a previously unaddressed gap in the field of analyzing the current stage of line-scanning spectral confocal displacement sensors. This is a groundbreaking achievement for both the sensor itself and the field it operates in. The line-scanning spectral confocal displacement sensor’s design addresses a previously unmet need in systematic analysis by successfully obtaining a wide measuring range. This provides systematic theoretical backing for the advancement of the sensor, which has potential applications in the industrial detection of various ranges and complicated objects.


  • Open Access

    Rapid Determination of Positive–Negative Bacterial Infection Based on Micro-Hyperspectral Technology

    by Jian Du, Chenglong Tao, Meijie Qi, Bingliang Hu, Zhoufeng Zhang

    To meet the demand for rapid bacterial detection in clinical practice, this study proposed a joint determination model based on spectral database matching combined with a deep learning model for the determination of positive–negative bacterial infection in directly smeared urine samples. Based on a dataset of 8124 urine samples, a standard hyperspectral database of common bacteria and impurities was established. This database, combined with an automated single-target extraction, was used to perform spectral matching for single bacterial targets in directly smeared data. To address the multi-scale features and the need for the rapid analysis of directly smeared data, a multi-scale buffered convolutional neural network, MBNet, was introduced, which included three convolutional combination units and four buffer units to extract the spectral features of directly smeared data from different dimensions. The focus was on studying the differences in spectral features between positive and negative bacterial infection, as well as the temporal correlation between positive–negative determination and short-term cultivation. The experimental results demonstrate that the joint determination model achieved an accuracy of 97.29%, a Positive Predictive Value (PPV) of 97.17%, and a Negative Predictive Value (NPV) of 97.60% in the directly smeared urine dataset. This result outperformed the single MBNet model, indicating the effectiveness of the multi-scale buffered architecture for global and large-scale features of directly smeared data, as well as the high sensitivity of spectral database matching for single bacterial targets. The rapid determination solution of the whole process, which combines directly smeared sample preparation, joint determination model, and software analysis integration, can provide a preliminary report of bacterial infection within 10 min, and it is expected to become a powerful supplement to the existing technologies of rapid bacterial detection.


  • Open Access

    Joint Diagnostic Method of Tumor Tissue Based on Hyperspectral Spectral-Spatial Transfer Features

    by Jian Du, Chenglong Tao, Shuang Xue, Zhoufeng Zhang

    In order to improve the clinical application of hyperspectral technology in the pathological diagnosis of tumor tissue, a joint diagnostic method based on spectral-spatial transfer features was established by simulating the actual clinical diagnosis process and combining micro-hyperspectral imaging with large-scale pathological data. In view of the limited sample volume of medical hyperspectral data, a multi-data transfer model pre-trained on conventional pathology datasets was applied to the classification task of micro-hyperspectral images, to explore the differences in spectral-spatial transfer features in the wavelength of 410–900 nm between tumor tissues and normal tissues. The experimental results show that the spectral-spatial transfer convolutional neural network (SST-CNN) achieved a classification accuracy of 95.46% for the gastric cancer dataset and 95.89% for the thyroid cancer dataset, thus outperforming models trained on single conventional digital pathology and single hyperspectral data. The joint diagnostic method established based on SST-CNN can complete the interpretation of a section of data in 3 min, thus providing a new technical solution for the rapid diagnosis of pathology. This study also explored problems involving the correlation between tumor tissues and typical spectral-spatial features, as well as the efficient transformation of conventional pathological and transfer spectral-spatial features, which solidified the theoretical research on hyperspectral pathological diagnosis.


  • Open Access

    Rapid Identification of Infectious Pathogens at the Single-Cell Level via Combining Hyperspectral Microscopic Images and Deep Learning

    by Chenglong Tao, Jian Du, Junjie Wang, Bingliang Hu, Zhoufeng Zhang

    Identifying infectious pathogens quickly and accurately is significant for patients and doctors. Identifying single bacterial strains is significant in eliminating culture and speeding up diagnosis. We present an advanced optical method for the rapid detection of infectious (including common and uncommon) pathogens by combining hyperspectral microscopic imaging and deep learning. To acquire more information regarding the pathogens, we developed a hyperspectral microscopic imaging system with a wide wavelength range and fine spectral resolution. Furthermore, an end-to-end deep learning network based on feature fusion, called BI-Net, was designed to extract the species-dependent features encoded in cell-level hyperspectral images as the fingerprints for species differentiation. After being trained based on a large-scale dataset that we built to identify common pathogens, BI-Net was used to classify uncommon pathogens via transfer learning. An extensive analysis demonstrated that BI-Net was able to learn species-dependent characteristics, with the classification accuracy and Kappa coefficients being 92% and 0.92, respectively, for both common and uncommon species. Our method outperformed state-of-the-art methods by a large margin and its excellent performance demonstrates its excellent potential in clinical practice.


  • Open Access

    A Deep-Learning Based System for Rapid Genus Identification of Pathogens under Hyperspectral Microscopic Images

    by Chenglong Tao, Jian Du, Yingxin Tang, Junjie Wang, Ke Dong, Ming Yang, Bingliang Hu, Zhoufeng Zhang

    Infectious diseases have always been a major threat to the survival of humanity. Additionally, they bring an enormous economic burden to society. The conventional methods for bacteria identification are expensive, time-consuming and laborious. Therefore, it is of great importance to automatically rapidly identify pathogenic bacteria in a short time. Here, we constructed an AI-assisted system for automating rapid bacteria genus identification, combining the hyperspectral microscopic technology and a deep-learning-based algorithm Buffer Net. After being trained and validated in the self-built dataset, which consists of 11 genera with over 130,000 hyperspectral images, the accuracy of the algorithm could achieve 94.9%, which outperformed 1D-CNN, 2D-CNN and 3D-ResNet. The AI-assisted system we developed has great potential in assisting clinicians in identifying pathogenic bacteria at the single-cell level with high accuracy in a cheap, rapid and automatic way. Since the AI-assisted system can identify the pathogenic genus rapidly (about 30 s per hyperspectral microscopic image) at the single-cell level, it can shorten the time or even eliminate the demand for cultivating. Additionally, the system is user-friendly for novices.