Multispectral Domain Invariant Image for Retrieval-based Place Recognition
- 1 May 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 9271-9277
Abstract
Multispectral recognition has attracted increasing attention from the research community due to its potential competence for many applications from day to night. However, due to the domain shift between RGB and thermal image, it has still many challenges to apply and to use RGB domain-based tasks. To reduce the domain gap, we propose multispectral domain invariant framework, which leverages the unpaired image translation method to generate a semantic and strongly discriminative invariant image by enforcing novel constraints in the objective function. We demonstrate the efficacy of the proposed method on mainly multispectral place recognition task and achieve significant improvement compared to previous works. Furthermore, we test on multispectral semantic segmentation and unsupervised domain adaptations to prove the scalability and generality of the proposed method. We will open our source code and dataset.Keywords
This publication has 20 references indexed in Scilit:
- MFNet: Towards real-time semantic segmentation for autonomous vehicles with multi-spectral scenes2017
- Image-to-Image Translation with Conditional Adversarial Networks2017
- Person Recognition System Based on a Combination of Body Images from Visible Light and Thermal CamerasSensors, 2017
- Thermal Image Enhancement using Convolutional Neural Network2016
- Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation2016
- Multispectral pedestrian detection: Benchmark dataset and baseline2015
- 24/7 place recognition by view synthesis2015
- Multispectral Stereo OdometryIEEE Transactions on Intelligent Transportation Systems, 2014
- Vision meets robotics: The KITTI datasetThe International Journal of Robotics Research, 2013
- Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories2006