Reliability, agreement and variability of a markerless computer vision algorithm for equine gait analysis under field conditions
Open Access
- 4 November 2025
- journal article
- Published by Wiley in Equine Veterinary Journal
- Vol. 58 (5) , 1467-1481
Abstract
Background: Computer vision‐based algorithms offer accessible alternatives for equine gait analysis but require thorough assessment under diverse conditions. Objectives: To evaluate a proprietary vision‐based algorithm's reliability in measuring vertical displacement signals (VDS) at the eye, withers and croup, alongside groundline estimation, for horses trotting on straight lines and circles under field conditions. Study Design: Cross‐sectional comparative study evaluating agreement, variability and reliability of a markerless computer vision algorithm. Methods: We obtained 67 handheld iPhone recordings from 37 horses. A vision‐based algorithm and independent manual annotation produced 2D anatomical keypoints on all frames of the recordings, which were processed to estimate a groundline and compute VDS and stride‐based maxima (Maxdiff) and minima (Mindiff) vertical differences. Mean signed error (MSE), mean absolute error (MAE) and Bland–Altman plots were used to compare detected and annotated data. Results: The frame level vertical keypoint accuracy was 4.5 mm (eye), 5.5 mm (croup) and 11.8 mm (withers), and the manual annotation error was averaged at 2.7 mm. At the stride level ( n = 1556), the overall mean absolute errors (MAEs) for both Maxdiff and Mindiff were 4.3 mm. The eye keypoint exhibited the lowest errors (2.9 mm Maxdiff, 3.0 mm Mindiff), while the withers error was 5.5 mm for both Maxdiff and Mindiff, and the croup showed 4.3 mm (Maxdiff) and 4.4 mm (Mindiff). Trial‐level ( n = 67) analysis, with below optimal number of strides per trial in this study, revealed lower overall absolute differences (Eye: 2.3 mm, Withers: 3.7 mm, Croup: 2.7 mm), indicating consistent performance across multiple strides. Subjective lameness scoring aligned with objective measures with some variation. Main Limitations: Groundline estimation accuracy was stress‐tested on treadmill data in another study. Further clinical comparison with established gait analysis systems is recommended. Conclusions: The algorithm robustly measured vertical displacements under varied conditions.Keywords
This publication has 30 references indexed in Scilit:
- Use of superpixels for improvement of inter-rater and intra-rater reliability during annotation of medical imagesMedical Image Analysis, 2024
- Reliable and clinically applicable gait event classification using upper body motion in walking and trotting horsesJournal of Biomechanics, 2021
- Quantitative lameness assessment in the horse based on upper body movement symmetry: The effect of different filtering techniques on the quantification of motion symmetryBiomedical Signal Processing and Control, 2020
- Fast animal pose estimation using deep neural networksNature Methods, 2018
- DeepLabCut: markerless pose estimation of user-defined body parts with deep learningNature Neuroscience, 2018
- On the brink of daily clinical application of objective gait analysis: What evidence do we have so far from studies using an induced lameness model?The Veterinary Journal, 2018
- Understanding hind limb lameness signs in horses using simple rigid body mechanicsJournal of Biomechanics, 2015
- Evidence-Based Lameness Detection and QuantificationVeterinary Clinics of North America: Equine Practice, 2007
- The intra- and inter-assessor reliability of measurement of functional outcome by lameness scoring in horsesThe Veterinary Journal, 2006
- STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENTThe Lancet, 1986