MMT: Cross Domain Few-Shot Learning via Meta-Memory Transfer
- 18 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 45 (12) , 15018-15035
Abstract
Few-shot learning aims to recognize novel categories solely relying on a few labeled samples, with existing few-shot methods primarily focusing on the categories sampled from the same distribution. Nevertheless, this assumption cannot always be ensured, and the actual domain shift problem significantly reduces the performance of few-shot learning. To remedy this problem, we investigate an interesting and challenging cross-domain few-shot learning task, where the training and testing tasks employ different domains. Specifically, we propose a Meta-Memory scheme to bridge the domain gap between source and target domains, leveraging style-memory and content-memory components. The former stores intra-domain style information from source domain instances and provides a richer feature distribution. The latter stores semantic information through exploration of knowledge of different categories. Under the contrastive learning strategy, our model effectively alleviates the cross-domain problem in few-shot learning. Extensive experiments demonstrate that our proposed method achieves state-of-the-art performance on cross-domain few-shot semantic segmentation tasks on the COCO-20 $^{i}$ , PASCAL-5 $^{i}$ , FSS-1000, and SUIM datasets and positively affects few-shot classification tasks on Meta-Dataset.
Keywords
Funding Information
- National Natural Science Foundation of China (62176009)
- Major Project for New Generation of AI (2018AAA0100400)
- National Natural Science Foundation of China (61836014, U21B2042, 62072457, 62006231)
- Ant Group and InnoHK program
This publication has 69 references indexed in Scilit:
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Deep Residual Learning for Image Recognition2016
- Human-level concept learning through probabilistic program inductionScience, 2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Describing Textures in the Wild2014
- Detection of traffic signs in real-world images: The German traffic sign detection benchmark2013
- Semantic contours from inverse detectors2011
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Automated Flower Classification over a Large Number of Classes2008
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998