Abstract
In this paper, we propose TGS-LGP, a framework for text-guided medical image segmentation that synergistically combines cross-modal understanding with local-global features perception. Our method employs a local-global text encoder that simultaneously processes clinical language inputs through two complementary pathways: one leverages contrastive language-image pretraining to capture global semantic context, and another employes domain-specific linguistic analysis to extract fine-grained lesion characteristics. These multiscale textual representations are progressively fused with refined visual features through an attention-based decoder that dynamically fuse cross-modal features. This architectural design enables context-aware integration of diagnostic text guidance with radiological image patterns. Additionally, we introduce vision refiner, a novel component that effectively integrates global features of medical images with minimal computational cost, compensating for the information loss caused by the local modeling bias of CNNs in medical imaging. This enhancement strengthens visual representation, thereby facilitating more effective fusion with textual features. Experimental results on two widely used benchmarks demonstrate that our method achieves the best accuracy compared to state-of-the-art methods.