A Pose-Based Feature Fusion and Classification Framework for the Early Prediction of Cerebral Palsy in Infants
Open Access
- 23 December 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Vol. 30 (15344320) , 8-19
Abstract
The early diagnosis of cerebral palsy is an area which has recently seen significant multi-disciplinary research. Diagnostic tools such as the General Movements Assessment (GMA), have produced some very promising results. However, the prospect of automating these processes may improve accessibility of the assessment and also enhance the understanding of movement development of infants. Previous works have established the viability of using pose-based features extracted from RGB video sequences to undertake classification of infant body movements based upon the GMA. In this paper, we propose a series of new and improved features, and a feature fusion pipeline for this classification task. We also introduce the RVI-38 dataset, a series of videos captured as part of routine clinical care. By utilising this challenging dataset we establish the robustness of several motion features for classification, subsequently informing the design of our proposed feature fusion framework based upon the GMA. We evaluate our proposed framework’s classification performance using both the RVI-38 dataset and the publicly available MINI-RGBD dataset. We also implement several other methods from the literature for direct comparison using these two independent datasets. Our experimental results and feature analysis show that our proposed pose-based method performs well across both datasets. The proposed features afford us the opportunity to include finer detail than previous methods, and further model GMA specific body movements. These new features also allow us to take advantage of additional body-part specific information as a means of improving the overall classification performance, whilst retaining GMA relevant, interpretable, and shareable features.Keywords
Funding Information
- Royal Society (IES\R2\181024, IES\R1\191147)
This publication has 51 references indexed in Scilit:
- Temporal trends in cerebral palsy by impairment severity and birth gestationDevelopmental Medicine & Child Neurology, 2016
- Movement Recognition Technology as a Method of Assessing Spontaneous General Movements in High Risk InfantsFrontiers in Neurology, 2015
- Learning Actionlet Ensemble for 3D Human Action RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- A systematic review of tests to predict cerebral palsy in young childrenDevelopmental Medicine & Child Neurology, 2013
- An update on the prevalence of cerebral palsy: a systematic review and meta‐analysisDevelopmental Medicine & Child Neurology, 2013
- Advances in Video-Based Human Activity Analysis2010
- Using computer-based video analysis in the study of fidgety movementsEarly Human Development, 2009
- The qualitative assessment of general movements in preterm, term and young infants — review of the methodologyEarly Human Development, 1997
- Comparison of the predicted and observed secondary structure of T4 phage lysozymeBiochimica et Biophysica Acta (BBA) - Protein Structure, 1975
- A New Method of Interpolation and Smooth Curve Fitting Based on Local ProceduresJournal of the ACM, 1970