Image Fusion and Target Detection Based on Dual ResNet for Power Sensing Equipment
Open Access
Abstract
Target detection helps to identify, locate, and monitor key components and potential issues in power sensing networks. The fusion of infrared and visible light images can effectively integrate the target the indication characteristics of infrared images and the rich scene detail information of visible light images, thereby enhancing the ability for target detection in power equipment in complex environments. In order to improve the registration accuracy and feature extraction stability of traditional registration algorithms for infrared and visible light images, an image registration method based on an improved SIFT algorithm is proposed. The image is preprocessed to a certain extent, using edge detection algorithms and corner detection algorithms to extract relatively stable feature points, and the feature vectors with excessive gradient values in the normalized visible light image are truncated and normalized again to eliminate the influence of nonlinear lighting. To address the issue of insufficient deep information extraction during image fusion using a single deep learning network, a dual ResNet network is designed to extract deep level feature information from infrared and visible light images, improving the similarity of the fused images. The image fusion technology based on the dual ResNet network was applied to the target detection of sensing insulators in the power sensing network, improving the average accuracy of target detection. The experimental results show that the improved registration algorithm has increased the registration accuracy of each group of images by more than 1%, the structural similarity of image fusion in the dual ResNet network has been improved by about 0.2% compared to in the single ResNet network, and the mean Average Precision (mAP) of the fusion image obtained via the dual ResNet network has been improved by 3% and 6% compared to the infrared and visible light images, respectively.Keywords
Funding Information
- National Natural Science Foundation of China (61901211, 62101244, BY20230583)
- Jiangsu Province Industry-University-Research Program (61901211, 62101244, BY20230583)
This publication has 30 references indexed in Scilit:
- Infrared and visible image fusion based on VPDE model and VGG networkApplied Intelligence, 2023
- Infrared and visible image fusion based on NSST and phase consistency adaptive DUAL channel PCNNInfrared Physics & Technology, 2023
- Fusion of visible and infrared images using GE-WA model and VGG-19 networkScientific Reports, 2023
- Improving Performance of Breast Lesion Classification Using a ResNet50 Model Optimized with a Novel Attention MechanismTomography, 2022
- Infrared and visible image fusion based on saliency and fast guided filteringInfrared Physics & Technology, 2022
- An infrared and visible image fusion method based on VGG-19 networkOptik, 2021
- A Lightweight Two-stream Fusion Deep Neural Network Based on ResNet Model for Sports Motion Image RecognitionSensing and Imaging, 2021
- Automatic prediction of COVID− 19 from chest images using modified ResNet50Multimedia Tools and Applications, 2021
- Infrared and visible image fusion using multi-scale edge-preserving decomposition and multiple saliency featuresOptik, 2021
- An improved multimodal medical image fusion algorithm based on fuzzy transformJournal of Visual Communication and Image Representation, 2018