Individual Behavior Recognition in Laboratory Rats: a Comparative Analysis of Computer Vision Methods
Open Access
- 31 March 2026
- journal article
- Published by Samara National Research University in Journal of Biomedical Photonics & Engineering
- Vol. 12 (1) , 010306
Abstract
Computer-vision methods have been applied to automated behavior recognition in laboratory rodents. Namely, we explored the possibility of classifying certain behavior classes from still images; compared keypoint-based methods with approaches based on visual embeddings; studied the feasibility of transferring models between rats and mice; and evaluated the relevance of the number and the accuracy of the detected keypoints. We collected a dataset of a freely moving Wistar rat to train six pose-based classifiers with Long Short-Term Memory (LSTM) using six sets of keypoints produced by two detectors and four Convolutional Neural Network (CNN) classifiers using images and optical flow frames. The results demonstrated the highest mean average precision (mAP) of 65.7% for the CNN-based methods and 34.3% for the LSTM classifiers, the feasibility of recognizing visually distinct classes (rearing and body grooming) from still images, and the applicability of a keypoint detector trained on mice. The results of this study can be applied to the design of a computer vision system for automating long-term monitoring of laboratory rodent behaviorKeywords
This publication has 24 references indexed in Scilit:
- Simple Behavioral Analysis (SimBA) as a platform for explainable machine learning in behavioral neuroscienceNature Neuroscience, 2024
- B-SOiD, an open-source unsupervised algorithm for identification and fast prediction of behaviorsNature Communications, 2021
- A YOLO based software for automated detection and analysis of rodent behaviour in the open field arenaComputers in Biology and Medicine, 2021
- Deep learning improves automated rodent behavior recognition within a specific experimental setupJournal of Neuroscience Methods, 2020
- Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset2017
- Deep Residual Learning for Image Recognition2016
- Convolutional Two-Stream Network Fusion for Video Action Recognition2016
- Automated Recognition of Social Behavior in Rats: The Role of Feature Quality2015
- JAABA: interactive machine learning for automatic annotation of animal behaviorNature Methods, 2013
- Two-Frame Motion Estimation Based on Polynomial Expansion2003