Fusion or Confusion? Assessing the Impact of Visible‐Thermal Image Fusion for Automated Wildlife Detection
Open Access
- 25 June 2026
- journal article
- Published by Wiley in Remote Sensing in Ecology and Conservation
Abstract
Efficient wildlife monitoring methods are necessary for biodiversity conservation and management. The combination of remote sensing, aerial imagery, and deep learning offers promising opportunities to renew or improve existing survey methods. The complementary use of visible (VIS) and thermal infrared (TIR) imagery can add information compared to a single‐source image and improve results in an automated detection context. However, the alignment and fusion process can be challenging, especially since visible and thermal images usually have different fields of view (FOV) and spatial resolutions. This research presents a case study on the great blue heron ( Ardea herodias ) to evaluate the performances of synchronous aerial VIS and TIR imagery to automatically detect individuals and nests using a YOLO11n model. Two VIS–TIR fusion methods were tested and compared: an early fusion approach and a late fusion approach to determine if the addition of the TIR image gives any added value compared to a VIS‐only model. VIS and TIR images were automatically aligned using a deep learning model. A principal component analysis fusion method was applied to VIS–TIR image pairs to form the early fusion dataset. A classification and regression tree was used to process the late fusion dataset based on the detection from the VIS‐only and TIR‐only trained models. Across all classes, both late and early fusion improved the F1 score compared to the VIS‐only model. For the main class, occupied nest, the late fusion improved the F1 score from 90.2 (VIS‐only) to 93.0%. This model was also able to identify false positives from both sources with 90% recall. Although fusion methods seem to give better results, this approach comes with a limiting TIR FOV and alignment constraints that eliminate data. Using an aircraft‐mounted very high‐resolution visible sensor (wide FOV) could be an interesting compromise for operationalizing surveys.Keywords
All Related Versions
Funding Information
- Natural Sciences and Engineering Research Council of Canada (CCARD‐2022‐00270)
This publication has 38 references indexed in Scilit:
- Efficient wildlife monitoring: Deep learning-based detection and counting of green turtles in coastal areasEcological Informatics, 2025
- Fire identification based on improved multi feature fusion of YCbCr and regional growthExpert Systems with Applications, 2023
- Comparison of multimodal RGB-thermal fusion techniques for exterior wall multi-defect detectionJournal of Infrastructure Intelligence and Resilience, 2023
- Dual visible‐thermal camera approach facilitates drone surveys of colonial marshbirdsRemote Sensing in Ecology and Conservation, 2020
- Wild animal survey using UAS imagery and deep learning: modified Faster R-CNN for kiang detection in Tibetan PlateauISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Evaluating the Use of Drones Equipped with Thermal Sensors as an Effective Method for Estimating WildlifeWildlife Society Bulletin, 2020
- Ratcheting up Rigor in Wildlife Management Decision MakingWildlife Society Bulletin, 2020
- Visible and thermal infrared remote sensing for the detection of white‐tailed deer using an unmanned aerial systemWildlife Society Bulletin, 2016
- A false color image fusion method based on multi-resolution color transfer in normalization YCC spaceOptik, 2014
- A systematic analysis of performance measures for classification tasksInformation Processing & Management, 2009