LLVIP: A Visible-infrared Paired Dataset for Low-light Vision
Preprint
Abstract
It is very challenging for various visual tasks such as image fusion, pedestrian detection and image-to-image translation in low light conditions due to the loss of effective target areas. In this case, infrared and visible images can be used together to provide both rich detail information and effective target areas. In this paper, we present LLVIP, a visible-infrared paired dataset for low-light vision. This dataset contains 30976 images, or 15488 pairs, most of which were taken at very dark scenes, and all of the images are strictly aligned in time and space. Pedestrians in the dataset are labeled. We compare the dataset with other visible-infrared datasets and evaluate the performance of some popular visual algorithms including image fusion, pedestrian detection and image-to-image translation on the dataset. The experimental results demonstrate the complementary effect of fusion on image information, and find the deficiency of existing algorithms of the three visual tasks in very low-light conditions. We believe the LLVIP dataset will contribute to the community of computer vision by promoting image fusion, pedestrian detection and image-to-image translation in very low-light applications. The dataset is being released in https://bupt-ai-cz.github.io/LLVIP. Raw data is also provided for further research such as image registration.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Sparse GANs for Thermal Infrared Image Generation From Optical ImageIEEE Access, 2020
- IFCNN: A general image fusion framework based on convolutional neural networkInformation Fusion, 2020
- FusionGAN: A generative adversarial network for infrared and visible image fusionInformation Fusion, 2019
- DenseFuse: A Fusion Approach to Infrared and Visible ImagesIEEE Transactions on Image Processing, 2018
- Infrared and visible image fusion via gradient transfer and total variation minimizationInformation Fusion, 2016
- Pedestrian Detection at Day/Night Time with Visible and FIR Cameras: A ComparisonSensors, 2016
- A new image fusion performance metric based on visual information fidelityInformation Fusion, 2013
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Information measure for performance of image fusionElectronics Letters, 2002