A-SOiD, an active learning platform for expert-guided, data efficient discovery of behavior
Preprint
Abstract
To identify and extract naturalistic behavior, two schools of methods have become popular: supervised and unsupervised. Each approach carries its own strengths and weaknesses, which the user must weigh in on their decision. Here, a new active learning platform, A-SOiD, blends these strengths and, in doing so, overcomes several of their inherent drawbacks. A-SOiD iteratively learns user-defined groups and can considerably reduce the necessary training data while attaining expansive classification through directed unsupervised classification. In socially-interacting mice, A-SOiD outperformed other methods and required 85% less training data than was available. Additionally, it isolated two additional ethologically-distinct mouse interactions via unsupervised classification. Similar performance and efficiency were observed using non-human primate 3D pose data. In both cases, the transparency in A-SOiD's cluster definitions revealed the defining features of the supervised classification through a game-theoretic approach. Lastly, we show the potential of A-SOiD to segment a large and rich variety of human social and single-person behaviors with 3D position keypoints. To facilitate use, A-SOiD comes as an intuitive, open-source interface for efficient segmentation of user-defined behaviors and discovered subactions.Keywords
All Related Versions
- Published version: Nature Methods, 21 (4), 703.
This publication has 39 references indexed in Scilit:
- BORIS: a free, versatile open‐source event‐logging software for video/audio coding and live observationsMethods in Ecology and Evolution, 2016
- Learning from imbalanced data: open challenges and future directionsProgress in Artificial Intelligence, 2016
- ODOC-ELM: Optimal decision outputs compensation-based extreme learning machine for classifying imbalanced dataKnowledge-Based Systems, 2016
- Mapping Sub-Second Structure in Mouse BehaviorNeuron, 2015
- Automated measurement of mouse social behaviors using depth sensing, video tracking, and machine learningProceedings of the National Academy of Sciences, 2015
- Neighbourhood sampling in bagging for imbalanced dataNeurocomputing, 2015
- SMOTE–IPF: Addressing the noisy and borderline examples problem in imbalanced classification by a re-sampling method with filteringInformation Sciences, 2015
- Automatic Visual Tracking and Social Behaviour Analysis with Multiple MicePLOS ONE, 2013
- JAABA: interactive machine learning for automatic annotation of animal behaviorNature Methods, 2013
- Computerized video analysis of social interactions in miceNature Methods, 2012