Learning and Tracking the 3D Body Shape of Freely Moving Infants from RGB-D sequences
Open Access
- 6 June 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 42 (10) , 2540-2551
Abstract
Statistical models of the human body surface are generally learned from thousands of high-quality 3D scans in predefined poses to cover the wide variety of human body shapes and articulations. Acquisition of such data requires expensive equipment, calibration procedures, and is limited to cooperative subjects who can understand and follow instructions, such as adults. We present a method for learning a statistical 3D Skinned Multi-Infant Linear body model (SMIL) from incomplete, low-quality RGB-D sequences of freely moving infants. Quantitative experiments show that SMIL faithfully represents the RGB-D data and properly factorizes the shape and pose of the infants. To demonstrate the applicability of SMIL, we fit the model to RGB-D sequences of freely moving infants and show, with a case study, that our method captures enough motion detail for General Movements Assessment (GMA), a method used in clinical practice for early detection of neurodevelopmental disorders in infants. SMIL provides a new tool for analyzing infant shape and movement and is a step towards an automated system for GMA.Keywords
All Related Versions
This publication has 47 references indexed in Scilit:
- Quantifying Progression of Multiple Sclerosis via Classification of Depth Videos2014
- Validity of the Microsoft Kinect for assessment of postural controlGait & Posture, 2012
- Real-Time Human Pose Tracking from Range Data2012
- Coregistration: Simultaneous Alignment and Modeling of Articulated 3D Shape2012
- Performance Capture of Interacting Characters with Handheld Kinects2012
- A Statistical Model of Human Pose and Body ShapeComputer Graphics Forum, 2009
- SCAPEACM Transactions on Graphics, 2005
- The space of human body shapesACM Transactions on Graphics, 2003
- Qualitative changes of spontaneous movements in fetus and preterm infant are a marker of neurological dysfunctionEarly Human Development, 1990
- Random sample consensusCommunications of the ACM, 1981