TGS-LGP: Text-Guided Medical Image Segmentation Via Local-Global Perception
- 15 December 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 993-998
Abstract
In this paper, we propose TGS-LGP, a framework for text-guided medical image segmentation that synergistically combines cross-modal understanding with local-global features perception. Our method employs a local-global text encoder that simultaneously processes clinical language inputs through two complementary pathways: one leverages contrastive language-image pretraining to capture global semantic context, and another employes domain-specific linguistic analysis to extract fine-grained lesion characteristics. These multiscale textual representations are progressively fused with refined visual features through an attention-based decoder that dynamically fuse cross-modal features. This architectural design enables context-aware integration of diagnostic text guidance with radiological image patterns. Additionally, we introduce vision refiner, a novel component that effectively integrates global features of medical images with minimal computational cost, compensating for the information loss caused by the local modeling bias of CNNs in medical imaging. This enhancement strengthens visual representation, thereby facilitating more effective fusion with textual features. Experimental results on two widely used benchmarks demonstrate that our method achieves the best accuracy compared to state-of-the-art methods.Keywords
This publication has 26 references indexed in Scilit:
- LGA: A Language Guide Adapter for Advancing the SAM Model’s Capabilities in Medical Image Segmentation2024
- PolyFormer: Referring Image Segmentation as Sequential Polygon Generation2023
- Universal Instance Perception as Object Discovery and Retrieval2023
- TGANet: Text-Guided Attention for Improved Polyp Segmentation2022
- CRIS: CLIP-Driven Referring Image Segmentation2022
- LAVT: Language-Aware Vision Transformer for Referring Image Segmentation2022
- A ConvNet for the 2020s2022
- Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysisnpj Digital Medicine, 2021
- nnU-Net: a self-configuring method for deep learning-based biomedical image segmentationNature Methods, 2020
- Referring Image Segmentation via Recurrent Refinement Networks2018