Abstract
Foundation vision models show remarkable performance across various tasks but often require domain-specific adaptation to achieve optimal results. However, fine-tuning these models is challenging due to the high cost of obtaining labeled data, particularly in specialized domains like medical imaging. Semi-supervised learning (SSL) addresses this challenge by leveraging limited labeled data to generate pseudo-labels for unlabeled data. Existing SSL methods rely on confidence-based thresholding, which biases training towards high-confidence samples while neglecting uncertain ones, leading to suboptimal generalization.To overcome this limitation, we propose \algo, an SSL booster that enhances representation learning by incorporating Masked Autoencoder (MAE)-based reconstruction loss and Supplementary MixUp (SMU). Unlike traditional MAE-based pretraining followed by fine-tuning, our method jointly optimizes reconstruction and classification, learning from all data and ensuring feature alignment with the target task (i.e., classification). To avoid overfitting issues of MixUp in SSLs, we propose SMU that balances original and MixUp-augmented data. This approach also addressed the challenge of determining the optimal transition point for augmentation.Our approach achieves state-of-the-art performance on multiple SSL benchmarks, including 97.5\% accuracy on Euro-SAT with 2 labeled samples per class and 74.6\% accuracy on R2PPE recognition with 20 labeled samples per class. These results show that \algo effectively improves SSL by leveraging all available unlabeled data, reducing reliance on confidence thresholds, and enhancing generalization through joint optimization of MAE and classification objectives.