Generative Retrieval for Unsupervised Text-Based Person Search
- 1 November 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 48 (11) , 14375-14391
Abstract
Text-based person search (TBPS) aims to retrieve images of a target person from a large image gallery based on a given natural language description. Most existing methods rely on supervised learning with manually annotated image-text pairs. In this paper, we explore unsupervised TBPS, with only unlabeled images. We propose GTR$^+$+, a two-stage generation-then-retrieval framework. In the generation stage, we introduce a tiered description generation framework designed to produce fine-grained and stylistically diverse textual descriptions through a three-tier sequential process. The base tier leverages an automated question-and-answer mechanism to generate basic visual attribute descriptions; the intermediate tier enhances fine-grained detail using an inter-sample contrastive mechanism; the advanced tier further enriches textual diversity via a stylized expansion mechanism. In the retrieval stage, to mitigate the impact of noisy pseudo texts, we develop an adaptive confidence-weighted retrieval learning framework. We model image-text pairs as clean or noisy using a Gaussian Mixture Model, calibrated by real-time image-text similarity and static text generation probability from the prior stage, yielding adaptive sample weights during training. Beyond that, we also contribute LargeFine-Person, a large-scale TBPS dataset with high-quality, fine-grained, and diverse textual annotations, enabling a practical and generalizable TBPS pre-training benchmark under unsupervised setting. Experiments on multiple TBPS benchmarks demonstrate the effectiveness and generalization of both GTR$^+$+ and LargeFine-Person.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62476188)
This publication has 86 references indexed in Scilit:
- Personalizing Multimodal Large Language Models for Image Captioning: An Experimental Analysis2025
- Synthesize then align: Modality alignment augmentation for zero-shot image captioning with synthetic dataKnowledge-Based Systems, 2025
- An ensemble model with attention based mechanism for image captioningComputers and Electrical Engineering, 2025
- ShareGPT4V: Improving Large Multi-modal Models with Better Captions2024
- PLOT: Text-Based Person Search with Part Slot Attention for Corresponding Part Discovery2024
- Unleashing Text-to-Image Diffusion Prior for Zero-Shot Image Captioning2024
- An Adaptive Correlation Filtering Method for Text-Based Person SearchInternational Journal of Computer Vision, 2024
- A Simple and Robust Correlation Filtering Method for Text-Based Person Search2022
- TIPCB: A simple but effective part-based convolutional baseline for text-based person searchNeurocomputing, 2022
- ViTAA: Visual-Textual Attributes Alignment in Person Search by Natural Language2020