Small Scale Multi-Object Segmentation in Mid-Infrared Image Using the Image Timing Features–Gaussian Mixture Model and Convolutional-UNet
Open Access
Abstract
The application of intelligent video monitoring for natural resource protection and management has become increasingly common in recent years. To enhance safety monitoring during the grazing prohibition and rest period of grassland, this paper proposes a multi-object segmentation algorithm based on mid-infrared images for all-weather surveillance. The approach integrates the Image Timing Features–Gaussian Mixture Model (ITF-GMM) and Convolutional-UNet (Con-UNet) to improve the accuracy of target detection. First, a robust background modelling, i.e., the ITF-GMM, is proposed. Unlike the basic Gaussian Mixture Model (GMM), the proposed model dynamically adjusts the learning rate according to the content difference between adjacent frames and optimizes the number of Gaussian distributions through time series histogram analysis of pixels. Second, a segmentation framework based on Con-UNet is developed to improve the feature extraction ability of UNet. In this model, the maximum pooling layer is replaced with a convolutional layer, addressing the challenge of limited training data and improving the network’s ability to preserve spatial features. Finally, an integrated computation strategy is designed to combine the outputs of ITF-GMM and Con-UNet at the pixel level, and morphological operations are performed to refine the segmentation results and suppress noises, ensuring clearer object boundaries. The experimental results show the effectiveness of proposed approach, achieving a precision of 96.92%, an accuracy of 99.87%, an intersection over union (IOU) of 94.81%, and a recall of 97.75%. Furthermore, the proposed algorithm meets real-time processing requirements, confirming its capability to enhance small-target detection in complex outdoor environments and supporting the automation of grassland monitoring and enforcement.Keywords
Funding Information
- Foundation of National Key Laboratory of Human Factors Engineering (HFNKL2023WW11, 62373042, 2023A1515010275, FRF-BD-19-002A)
- National Natural Science Foundation of China (HFNKL2023WW11, 62373042, 2023A1515010275, FRF-BD-19-002A)
- Guangdong Basic and Applied Basic Research Foundation (HFNKL2023WW11, 62373042, 2023A1515010275, FRF-BD-19-002A)
- Fundamental Research Fund for the China Central Universities of USTB (HFNKL2023WW11, 62373042, 2023A1515010275, FRF-BD-19-002A)
This publication has 34 references indexed in Scilit:
- Foreground segmentation network using transposed convolutional neural networks and up sampling for multiscale feature encodingNeural Networks, 2023
- Computer vision system for superpixel classification and segmentation of sheepEcological Informatics, 2022
- Detecting sheep in UAV imagesComputers and Electronics in Agriculture, 2021
- Role of monitoring in environmental regulation: An empirical analysis of grazing restrictions in pastoral ChinaEnvironmental Science & Policy, 2020
- Foreground segmentation using convolutional neural networks for multiscale feature encodingPattern Recognition Letters, 2018
- Improved background subtraction method for detecting moving objects based on GMMIEEJ Transactions on Electrical and Electronic Engineering, 2018
- BMOG: boosted Gaussian Mixture Model with controlled complexity for background subtractionPattern Analysis and Applications, 2018
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- LabelMe: A Database and Web-Based Tool for Image AnnotationInternational Journal of Computer Vision, 2007
- Real-time foreground–background segmentation using codebook modelReal-Time Imaging, 2005