Object Detector Based on Center Keypoints for Behavior Recognition in Classroom Scenes
- 31 March 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Social Systems
- Vol. 12 (6) , 4744-4756
Abstract
Student pose information can reflect learning status, which is significant in teaching management and evaluation. However, the traditional manual behavior recognition and analysis process is complex and slow, so counting massive classroom data is a difficult task. Therefore, using computer vision technology to accurately recognize student behavior is of great significance to teaching management and evaluation. Besides, the performance of existing behavior recognition methods is limited by problems such as dense objects and occlusion in classroom scenes. To address these issues, we propose an anchor-free object detector based on center keypoints for behavior recognition in classroom scenes. Specifically, we design a multiscale convolution neural networks (CNNs) module to alleviate the scale variation of objects through multiscale receptive fields. The head network is based on the anchor-free detection head architecture and integrates the keypoint heatmaps to accurately extract the center keypoint position through the center pooling module (CPM). the CPM can suppress irrelevant background information and effectively alleviate the missed detection of dense objects. Regressing the distances from the center keypoint of the positive region to the four sides can suppress low-quality bounding boxes so that the detector can accurately locate the object. Furthermore, during the inference stage, the heatmap scores of keypoints and center keypoints are linearly combined as novel confidence to mitigate inaccurate measurement of predicted bounding boxes. The extensive experimental performance comparison on the classroom behavior (CB) and SCB-dataset3 benchmark datasets demonstrate that the proposed behavior recognition method can accurately detect objects in classroom scenes. Compared with other current state-of-the-art methods, the proposed behavior recognition method based on anchor-free object detector is able to achieve good performance.Keywords
Funding Information
- Key Research and Development Program of Shaanxi province, China (2023-YBGY-205)
- Natural Science Basic Research Program of Shaanxi, China (2024JC-ZDXM-40)
- Key Research and Development Program of Shaanxi, China (2024GXYBXM-039)
- Innovation Capability Support Program of Shaanxi, China (2023-CX-TD-08)
This publication has 42 references indexed in Scilit:
- Multi-object behaviour recognition based on object detection cascaded image classification in classroom scenesApplied Intelligence, 2024
- Multi-object behavior recognition based on object detection for dense crowdsExpert Systems with Applications, 2024
- Zero-watermark scheme for medical image protection based on style feature and ResNetBiomedical Signal Processing and Control, 2023
- ObjectBox: From Centers to Boxes for Anchor-Free Object Detection2022
- True wide convolutional neural network for image denoisingInformation Sciences, 2022
- PersonLab: Person Pose Estimation and Instance Segmentation with a Bottom-Up, Part-Based, Geometric Embedding Model2018
- CornerNet: Detecting Objects as Paired Keypoints2018
- Simple Baselines for Human Pose Estimation and Tracking2018
- DeeperCut: A Deeper, Stronger, and Faster Multi-person Pose Estimation Model2016
- Microsoft COCO: Common Objects in Context2014