Shadow compensation for outdoor perception
- 1 May 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10504729,p. 4835-4842
Abstract
Outdoor robotic systems rely on perception modules that must be robust to variations in environmental conditions. In particular, vision-based perception systems are affected by illumination variations caused by occlusions. We propose an approach to calculate the lighting distribution of outdoor scenes. The new approach enables us to compensate for shadows and therefore obtain images which are invariant to the sun position and scene geometry, while also retaining the dimensionality of the original data. The method combines images with geometric information provided by range sensors to infer shadows. We select a pair of points on a shadow boundary from a single material and estimate a terrestrial sunlight-skylight ratio. Individual scaling factors are then calculated for all points based on their orientation and incident illumination sources. The result is a coloured point cloud that is independent of illumination variation due to occlusions and geometry. To demonstrate the effectiveness and generalisation of the approach, we present evaluations using two datasets with different cameras. The first uses a hyperspectral sensor that allows us to analyse the results for a large number of wavelengths, while the second dataset uses a standard RGB camera. The approach is shown to consistently provide good illumination compensation in both scenarios.Keywords
This publication has 13 references indexed in Scilit:
- Lighting invariant urban street classification2014
- Shady dealings: Robust, long-term visual localisation using illumination invariance2014
- Improved atmospheric compensation of hyperspectral imagery using LIDAR2013
- Shadow removal for aerial imagery by information theoretic intrinsic image analysis2012
- Introduction to Information Retrieval2008
- On the removal of shadows from imagesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- Relighting Acquired Models of Outdoor Scenes2005
- Solar position algorithm for solar radiation applicationsSolar Energy, 2004
- The Earth Mover's Distance as a Metric for Image RetrievalInternational Journal of Computer Vision, 2000
- Inverse global illumination1999