Multimodal Multispectral Imaging System for Small UAVs
Open Access
- 17 January 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 5 (2) , 1039-1046
Abstract
Multispectral imaging is an attractive sensing modality for small unmanned aerial vehicles (UAVs) in numerous applications. The most compact spectral camera architecture is based on spectral filters in the focal plane. Vehicle movement can be used to scan the scene using multiple bandpass filters arranged perpendicular to the flight direction. With known camera trajectory and scene structure, it is possible to assemble a spectral image in software. In this paper, we demonstrate the feasibility of a novel concept for low-cost wide area multispectral imaging with integrated spectral consistency testing. Six bandpass filters are arranged in a periodically repeating pattern. Since different bands are recorded at different times and in different viewing directions, there is a risk of obtaining spectral artifacts in the image. We exploit the repeated sampling of bands to enable spectral consistency testing, which leads to significantly improved spectral integrity. In addition, an unfiltered region permits conventional 2D video imaging that can be used for image-based navigation and 3D reconstruction. The proposed multimodal imaging system was tested on a UAV in a realistic experiment. The results demonstrate that spectral reconstruction and consistency testing can be performed by image processing alone, based on visual simultaneous localization and mapping (VSLAM).Keywords
Funding Information
- Norges Forskningsråd
This publication has 27 references indexed in Scilit:
- ORB-SLAM: A Versatile and Accurate Monocular SLAM SystemIEEE Transactions on Robotics, 2015
- Probabilistic Semi-Dense Mapping from Highly Accurate Feature-Based Monocular SLAM2015
- Multi- and hyperspectral UAV imaging system for forest and agriculture applications2012
- DTAM: Dense tracking and mapping in real-time2011
- Parallel Tracking and Mapping for Small AR Workspaces2007
- Real-Time Plane-Sweeping Stereo with Multiple Sweeping Directions2007
- Image Alignment and Stitching: A TutorialFoundations and Trends in Computer Graphics and Vision, 2007
- Lucas-Kanade 20 Years On: A Unifying FrameworkInternational Journal of Computer Vision, 2004
- Bundle Adjustment — A Modern Synthesis2000
- A space-sweep approach to true multi-image matching1996