Jingjing Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Jingjing Li has a total of 40 co-authors. Here are the top co-authors by number of shared publications:
- Wei Ji
Nanjing University, Suzhou, China
9 shared publications - Huchuan Lu
Dalian University of Technology, Dalian, China
6 shared publications - Miao Zhang
Dalian University of Technology, Dalian, Liaoning, China
6 shared publications - Yongri Piao
Dalian University of Technology, Dalian, Liaoning, China
6 shared publications - Li Cheng
Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, Canada
5 shared publications - Kai Peng
Dalian University of Technology, Dalian, Liaoning, China
3 shared publications
Latest Publications
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 6425-6434
Hear to See: Discerning Stateful Listening for Audio-Visual Instance Segmentation
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 6425-6434
Open AccessHear to See: Discerning Stateful Listening for Audio-Visual Instance Segmentation
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 8096-8105
SAMOT: State-Aware Step Modulation and Optimal Transport Matching for Audio-Visual Instance Segmentation
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 8096-8105
Open AccessSAMOT: State-Aware Step Modulation and Optimal Transport Matching for Audio-Visual Instance Segmentation
- 1 October 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 45 (10) , 5059-5071
Taking a Deep Look at Multi-Rater Agreement for Calibrated Medical Image Segmentation
In medical image analysis, it is common to collect multiple annotations from different clinical experts or raters to mitigate potential diagnostic inaccuracies. However, in computer vision research, it has been conventional to adopt ground-truth labels generated either by majority voting or by selecting a single rater's annotation. Such practices overlook the rich information embedded in the original multi-rater annotations, particularly the patterns of agreement and disagreement among experts. In this paper, we propose to explicitly model multi-rater (dis-)agreement, referred to as MRNet+, which offers several key innovations. First, an Expertise-aware Inferring Module (EIM) is developed to incorporate the expertise level of each rater as prior knowledge, thereby forming discriminative semantic features. Second, our method efficiently infers interobserver variability through a disentangled erasing-based Multi-rater Knowledge Modeling (MKM) module. Third, the cues pertaining to multi-rater (dis-)agreement are further leveraged through a Multi-rater Perception Module (MPM) to enhance segmentation performance. To the best of our knowledge, this is the first method to generate calibrated predictions that account for varying expertise levels in medical image segmentation. Moreover, MRNet+ is computationally efficient, achieving real-time performance with a speed of 89 FPS on 256×256 images. We validate our framework across ten medical segmentation tasks spanning diverse imaging modalities. In all cases, MRNet+ consistently outperforms state-of-the-art specialized methods, highlighting its effectiveness and broad applicability to real-world medical image segmentation scenarios. Source code is available at https://github.com/jiwei0921/MRNet_plus.
- 1 October 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 45 (10) , 5059-5071
Taking a Deep Look at Multi-Rater Agreement for Calibrated Medical Image Segmentation
In medical image analysis, it is common to collect multiple annotations from different clinical experts or raters to mitigate potential diagnostic inaccuracies. However, in computer vision research, it has been conventional to adopt ground-truth labels generated either by majority voting or by selecting a single rater's annotation. Such practices overlook the rich information embedded in the original multi-rater annotations, particularly the patterns of agreement and disagreement among experts. In this paper, we propose to explicitly model multi-rater (dis-)agreement, referred to as MRNet+, which offers several key innovations. First, an Expertise-aware Inferring Module (EIM) is developed to incorporate the expertise level of each rater as prior knowledge, thereby forming discriminative semantic features. Second, our method efficiently infers interobserver variability through a disentangled erasing-based Multi-rater Knowledge Modeling (MKM) module. Third, the cues pertaining to multi-rater (dis-)agreement are further leveraged through a Multi-rater Perception Module (MPM) to enhance segmentation performance. To the best of our knowledge, this is the first method to generate calibrated predictions that account for varying expertise levels in medical image segmentation. Moreover, MRNet+ is computationally efficient, achieving real-time performance with a speed of 89 FPS on 256×256 images. We validate our framework across ten medical segmentation tasks spanning diverse imaging modalities. In all cases, MRNet+ consistently outperforms state-of-the-art specialized methods, highlighting its effectiveness and broad applicability to real-world medical image segmentation scenarios. Source code is available at https://github.com/jiwei0921/MRNet_plus.
- 10 June 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. PP (15209210) , 1-13
Selective Noise Suppression and Discriminative Mutual Interaction for Robust Audio-Visual Segmentation
The ability to capture and segment sounding objects in dynamic visual scenes is crucial for the development of Audio-Visual Segmentation (AVS) tasks. While significant progress has been made in this area, the interaction between audio and visual modalities still requires further exploration. In this work, we aim to answer the following questions: How can a model effectively suppress audio noise while enhancing relevant audio information? How can we achieve discriminative interaction between the audio and visual modalities? To this end, we propose SDAVS, equipped with the Selective Noise-Resilient Processor (SNRP) module and the Discriminative Audio-Visual Mutual Fusion (DAMF) strategy. The proposed SNRP mitigates audio noise interference by selectively emphasizing relevant auditory cues, while DAMF ensures more consistent audio-visual representations. Experimental results demonstrate that our proposed method achieves state-of-the-art performance on benchmark AVS datasets, especially in multi-source and complex scenes.
- 10 June 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. PP (15209210) , 1-13
Selective Noise Suppression and Discriminative Mutual Interaction for Robust Audio-Visual Segmentation
The ability to capture and segment sounding objects in dynamic visual scenes is crucial for the development of Audio-Visual Segmentation (AVS) tasks. While significant progress has been made in this area, the interaction between audio and visual modalities still requires further exploration. In this work, we aim to answer the following questions: How can a model effectively suppress audio noise while enhancing relevant audio information? How can we achieve discriminative interaction between the audio and visual modalities? To this end, we propose SDAVS, equipped with the Selective Noise-Resilient Processor (SNRP) module and the Discriminative Audio-Visual Mutual Fusion (DAMF) strategy. The proposed SNRP mitigates audio noise interference by selectively emphasizing relevant auditory cues, while DAMF ensures more consistent audio-visual representations. Experimental results demonstrate that our proposed method achieves state-of-the-art performance on benchmark AVS datasets, especially in multi-source and complex scenes.
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 35, 11364-11376
Frequency-Domain Decomposition and Recomposition for Robust Audio–Visual Segmentation
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 35, 11364-11376
Frequency-Domain Decomposition and Recomposition for Robust Audio–Visual Segmentation
- Open AccessSpikeVideoFormer: An Efficient Spike-Driven Video Transformer with Hamming Attention and $\mathcal{O}(T)$ ComplexitySpiking Neural Networks (SNNs) have shown competitive performance to Artificial Neural Networks (ANNs) in various vision tasks, while offering superior energy efficiency. However, existing SNN-based Transformers primarily focus on single-image tasks, emphasizing spatial features while not effectively leveraging SNNs' efficiency in video-based vision tasks. In this paper, we introduce SpikeVideoFormer, an efficient spike-driven video Transformer, featuring linear temporal complexity $\mathcal{O}(T)$. Specifically, we design a spike-driven Hamming attention (SDHA) which provides a theoretically guided adaptation from traditional real-valued attention to spike-driven attention. Building on SDHA, we further analyze various spike-driven space-time attention designs and identify an optimal scheme that delivers appealing performance for video tasks, while maintaining only linear temporal complexity. The generalization ability and efficiency of our model are demonstrated across diverse downstream video tasks, including classification, human pose tracking, and semantic segmentation. Empirical results show our method achieves state-of-the-art (SOTA) performance compared to existing SNN approaches, with over 15\% improvement on the latter two tasks. Additionally, it matches the performance of recent ANN-based methods while offering significant efficiency gains, achieving $\times 16$, $\times 10$ and $\times 5$ improvements on the three tasks. https://github.com/JimmyZou/SpikeVideoFormerOpen AccessSpikeVideoFormer: An Efficient Spike-Driven Video Transformer with Hamming Attention and $\mathcal{O}(T)$ ComplexitySpiking Neural Networks (SNNs) have shown competitive performance to Artificial Neural Networks (ANNs) in various vision tasks, while offering superior energy efficiency. However, existing SNN-based Transformers primarily focus on single-image tasks, emphasizing spatial features while not effectively leveraging SNNs' efficiency in video-based vision tasks. In this paper, we introduce SpikeVideoFormer, an efficient spike-driven video Transformer, featuring linear temporal complexity $\mathcal{O}(T)$. Specifically, we design a spike-driven Hamming attention (SDHA) which provides a theoretically guided adaptation from traditional real-valued attention to spike-driven attention. Building on SDHA, we further analyze various spike-driven space-time attention designs and identify an optimal scheme that delivers appealing performance for video tasks, while maintaining only linear temporal complexity. The generalization ability and efficiency of our model are demonstrated across diverse downstream video tasks, including classification, human pose tracking, and semantic segmentation. Empirical results show our method achieves state-of-the-art (SOTA) performance compared to existing SNN approaches, with over 15\% improvement on the latter two tasks. Additionally, it matches the performance of recent ANN-based methods while offering significant efficiency gains, achieving $\times 16$, $\times 10$ and $\times 5$ improvements on the three tasks. https://github.com/JimmyZou/SpikeVideoFormer
- Open Access
- 11 September 2024
- Published by Springer Nature in Machine Intelligence Research
- Vol. 21 (6) , 1215
Correction to: Segment Anything Is Not Always Perfect: An Investigation of SAM on Different Real-world Applications
- 11 September 2024
- Published by Springer Nature in Machine Intelligence Research
- Vol. 21 (6) , 1215
Open AccessCorrection to: Segment Anything Is Not Always Perfect: An Investigation of SAM on Different Real-world Applications
- Top Cited PapersOpen Access
- 12 April 2024
- Published by Springer Nature in Machine Intelligence Research
- Vol. 21 (4) , 617-630
Segment Anything Is Not Always Perfect: An Investigation of SAM on Different Real-world Applications
Recently, Meta AI Research approaches a general, promptable segment anything model (SAM) pre-trained on an unprecedentedly large segmentation dataset (SA-1B). Without a doubt, the emergence of SAM will yield significant benefits for a wide array of practical image segmentation applications. In this study, we conduct a series of intriguing investigations into the performance of SAM across various applications, particularly in the fields of natural images, agriculture, manufacturing, remote sensing and healthcare. We analyze and discuss the benefits and limitations of SAM, while also presenting an outlook on its future development in segmentation tasks. By doing so, we aim to give a comprehensive understanding of SAM’s practical applications. This work is expected to provide insights that facilitate future research activities toward generic segmentation. Source code is publicly available at https://github.com/LiuTingWed/SAM-Not-Perfect .
- 12 April 2024
- Published by Springer Nature in Machine Intelligence Research
- Vol. 21 (4) , 617-630
Top Cited PapersOpen AccessSegment Anything Is Not Always Perfect: An Investigation of SAM on Different Real-world Applications
Recently, Meta AI Research approaches a general, promptable segment anything model (SAM) pre-trained on an unprecedentedly large segmentation dataset (SA-1B). Without a doubt, the emergence of SAM will yield significant benefits for a wide array of practical image segmentation applications. In this study, we conduct a series of intriguing investigations into the performance of SAM across various applications, particularly in the fields of natural images, agriculture, manufacturing, remote sensing and healthcare. We analyze and discuss the benefits and limitations of SAM, while also presenting an outlook on its future development in segmentation tasks. By doing so, we aim to give a comprehensive understanding of SAM’s practical applications. This work is expected to provide insights that facilitate future research activities toward generic segmentation. Source code is publicly available at https://github.com/LiuTingWed/SAM-Not-Perfect .
- Open Access
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 3307-3316
SemanticRT: A Large-Scale Dataset and Method for Robust Semantic Segmentation in Multispectral Images
Growing interests in multispectral semantic segmentation (MSS) have been witnessed in recent years, thanks to the unique advantages of combining RGB and thermal infrared images to tackle challenging scenarios with adverse conditions. However, unlike traditional RGB-only semantic segmentation, the lack of a large-scale MSS dataset has become a hindrance to the progress of this field. To address this issue, we introduce a SemanticRT dataset - the largest MSS dataset to date, comprising 11,371 high-quality, pixel-level annotated RGB-thermal image pairs. It is 7 times larger than the existing MFNet dataset, and covers a wide variety of challenging scenarios in adverse lighting conditions such as low-light and pitch black. Further, a novel Explicit Complement Modeling (ECM) framework is developed to extract modality-specific information, which is propagated through a robust cross-modal feature encoding and fusion process. Extensive experiments demonstrate the advantages of our approach and dataset over the existing counterparts. Our new dataset may also facilitate further development and evaluation of existing and new MSS algorithms.
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 3307-3316
Open AccessSemanticRT: A Large-Scale Dataset and Method for Robust Semantic Segmentation in Multispectral Images
Growing interests in multispectral semantic segmentation (MSS) have been witnessed in recent years, thanks to the unique advantages of combining RGB and thermal infrared images to tackle challenging scenarios with adverse conditions. However, unlike traditional RGB-only semantic segmentation, the lack of a large-scale MSS dataset has become a hindrance to the progress of this field. To address this issue, we introduce a SemanticRT dataset - the largest MSS dataset to date, comprising 11,371 high-quality, pixel-level annotated RGB-thermal image pairs. It is 7 times larger than the existing MFNet dataset, and covers a wide variety of challenging scenarios in adverse lighting conditions such as low-light and pitch black. Further, a novel Explicit Complement Modeling (ECM) framework is developed to extract modality-specific information, which is propagated through a robust cross-modal feature encoding and fusion process. Extensive experiments demonstrate the advantages of our approach and dataset over the existing counterparts. Our new dataset may also facilitate further development and evaluation of existing and new MSS algorithms.
- Open Access
Segment Anything Is Not Always Perfect: An Investigation of SAM on Different Real-world Applications
Recently, Meta AI Research approaches a general, promptable Segment Anything Model (SAM) pre-trained on an unprecedentedly large segmentation dataset (SA-1B). Without a doubt, the emergence of SAM will yield significant benefits for a wide array of practical image segmentation applications. In this study, we conduct a series of intriguing investigations into the performance of SAM across various applications, particularly in the fields of natural images, agriculture, manufacturing, remote sensing, and healthcare. We analyze and discuss the benefits and limitations of SAM, while also presenting an outlook on its future development in segmentation tasks. By doing so, we aim to give a comprehensive understanding of SAM's practical applications. This work is expected to provide insights that facilitate future research activities toward generic segmentation. Source code is publicly available.
Open AccessSegment Anything Is Not Always Perfect: An Investigation of SAM on Different Real-world Applications
Recently, Meta AI Research approaches a general, promptable Segment Anything Model (SAM) pre-trained on an unprecedentedly large segmentation dataset (SA-1B). Without a doubt, the emergence of SAM will yield significant benefits for a wide array of practical image segmentation applications. In this study, we conduct a series of intriguing investigations into the performance of SAM across various applications, particularly in the fields of natural images, agriculture, manufacturing, remote sensing, and healthcare. We analyze and discuss the benefits and limitations of SAM, while also presenting an outlook on its future development in segmentation tasks. By doing so, we aim to give a comprehensive understanding of SAM's practical applications. This work is expected to provide insights that facilitate future research activities toward generic segmentation. Source code is publicly available.