ID-like Prompt Learning for Few-Shot Out-of-Distribution Detection
Authors:
- 16 June 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 17480-17489
Abstract
Out-of-distribution (OOD) detection methods often exploit auxiliary outliers to train model identifying OOD samples, especially discovering challenging outliers from auxiliary outliers dataset to improve OOD detection. However, they may still face limitations in effectively distinguishing between the most challenging OOD samples that are much like in-distribution (ID) data, i.e., ID-like samples. To this end, we propose a novel OOD detection framework that discovers ID-like outliers using CLIP [32]from the vicinity space of the ID samples, thus helping to identify these most challenging OOD samples. Then a prompt learning framework is proposed that utilizes the identified ID-like outliers to further leverage the capabilities of CLIP for OOD detection. Benefiting from the powerful CLIP, we only need a small number of ID samples to learn the prompts of the model without exposing other auxiliary outlier datasets. By focusing on the most challenging ID-like OOD samples and elegantly exploiting the capabilities of CLIP, our method achieves superior few-shot learning performance on various real-world image datasets (e.g., in 4-shot OOD detection on the ImageNet-1k dataset, our method reduces the average FPR95 by 12.16% and improves the average AUROC by 2.76%, compared to state-of-the-art methods). Code is available at https://github.com/ycfate/ID-likeKeywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62376193,62106171,62172371,U21B2037,61976151)
This publication has 16 references indexed in Scilit:
- Learning to Prompt for Vision-Language ModelsInternational Journal of Computer Vision, 2022
- Conditional Prompt Learning for Vision-Language Models2022
- Prompt Distribution Learning2022
- ATOM: Robustifying Out-of-Distribution Detection Using Outlier Mining2021
- MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space2021
- Generalized ODIN: Detecting Out-of-Distribution Image Without Learning From Out-of-Distribution Data2020
- Why ReLU Networks Yield High-Confidence Predictions Far Away From the Training Data and How to Mitigate the Problem2019
- Describing Textures in the Wild2014
- SUN database: Large-scale scene recognition from abbey to zoo2010
- ImageNet: A large-scale hierarchical image database2009