Swin-Panda: Behavior Recognition for Giant Pandas Based on Local Fine-Grained and Spatiotemporal Displacement Features

Authors:
Open Access
Publisher website
Google Scholar
Abstract
The giant panda, a rare and iconic species endemic to China, has attracted significant attention from both domestic and international researchers due to its crucial ecological role, unique cultural value, and distinct evolutionary history. While substantial progress has been made in the field of individual identification, behavior recognition remains underdeveloped, facing challenges such as the lack of dynamic temporal features and insufficient extraction of behavioral characteristics. To address these challenges, we propose the Swin-Panda model, which leverages transfer learning based on the Video Swin Transformer architecture within the mmaction2 framework. In addition, we introduce two novel modules: the Comprehensive Perception Auxiliary Module and the Spatiotemporal Shift Attention Module. These modules facilitate the extraction of local and spatiotemporal information, allowing the model to more effectively capture the behavioral and movement patterns of giant pandas. Experimental results on the PACV-8 dataset demonstrate that our model achieves an accuracy of 88.02%, outperforming several benchmark models. This approach significantly enhances behavior recognition accuracy, thereby contributing to the advancement of panda welfare and species conservation efforts.
Funding Information
  • Returned Overseas Chinese Program of Ministry of Human Resources and Social Security, Sichuan Science and Technology Program (2023NSFSC1926, 2022NSFSC0020, 2023NSFSC1080, 2023NSFSC0210, 2023YFS0202, 2022-YF09-00019-SN, 2021CPB-B06)
  • Natural Science Foundation of Sichuan Province (2023NSFSC1926, 2022NSFSC0020, 2023NSFSC1080, 2023NSFSC0210, 2023YFS0202, 2022-YF09-00019-SN, 2021CPB-B06)
  • Chengdu Science and Technology Program (2023NSFSC1926, 2022NSFSC0020, 2023NSFSC1080, 2023NSFSC0210, 2023YFS0202, 2022-YF09-00019-SN, 2021CPB-B06)
  • Chengdu Research Base of Giant Panda Breeding (2023NSFSC1926, 2022NSFSC0020, 2023NSFSC1080, 2023NSFSC0210, 2023YFS0202, 2022-YF09-00019-SN, 2021CPB-B06)
  • wildlife Conservation Department of the National Forestry and Grassland Administration of P.R. China (2023NSFSC1926, 2022NSFSC0020, 2023NSFSC1080, 2023NSFSC0210, 2023YFS0202, 2022-YF09-00019-SN, 2021CPB-B06)

This publication has 34 references indexed in Scilit: