Same Features, Different Day: Weakly Supervised Feature Learning for Seasonal Invariance
Authors:
- 1 June 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 6458-6467
Abstract
"Like night and day" is a commonly used expression to imply that two things are completely different. Unfortunately, this tends to be the case for current visual feature representations of the same scene across varying seasons or times of day. The aim of this paper is to provide a dense feature representation that can be used to perform localization, sparse matching or image retrieval, regardless of the current seasonal or temporal appearance. Recently, there have been several proposed methodologies for deep learning dense feature representations. These methods make use of ground truth pixel-wise correspondences between pairs of images and focus on the spatial properties of the features. As such, they don't address temporal or seasonal variation. Furthermore, obtaining the required pixel-wise correspondence data to train in cross-seasonal environments is highly complex in most scenarios. We propose Deja-Vu, a weakly supervised approach to learning season invariant features that does not require pixel-wise ground truth data. The proposed system only requires coarse labels indicating if two images correspond to the same location or not. From these labels, the network is trained to produce "similar" dense feature maps for corresponding locations despite environmental changes. Code will be made available at: https://github.com/jspenmar/DejaVu_FeaturesKeywords
All Related Versions
This publication has 40 references indexed in Scilit:
- PCANet: A Simple Deep Learning Baseline for Image Classification?IEEE Transactions on Image Processing, 2015
- ORB-SLAM: A Versatile and Accurate Monocular SLAM SystemIEEE Transactions on Robotics, 2015
- Superpixel-based appearance change prediction for long-term navigation across seasonsRobotics and Autonomous Systems, 2015
- Worldwide Pose Estimation Using 3D Point Clouds2012
- KinectFusion2011
- SIFT, SURF & seasons: Appearance-based long-term localization in outdoor environmentsRobotics and Autonomous Systems, 2010
- Local Invariant Feature Detectors: A SurveyFoundations and Trends in Computer Graphics and Vision, 2008
- A visual bag of words method for interactive qualitative localization and mapping2007
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Random sample consensusCommunications of the ACM, 1981