Two-Step Deep Learning for Estimating Human Sleep Pose Occluded by Bed Covers
Authors:
- 1 July 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2019, 3115-3118
Abstract
In this study, a novel sleep pose identification method has been proposed for classifying 12 different sleep postures using a two-step deep learning process. For this purpose, transfer learning as an initial stage retrains a well-known CNN network (VGG-19) to categorise the data into four main pose classes, namely: supine, left, right, and prone. According to the decision made by VGG-19, subsets of the image data are next passed to one of four dedicated sub-class CNNs. As a result, the pose estimation label is further refined from one of four sleep pose labels to one of 12 sleep pose labels. 10 participants contributed for recording infrared (IR) images of 12 pre-defined sleep positions. Participants were covered by a blanket to occlude the original pose and present a more realistic sleep situation. Finally, we have compared our results with (1) the traditional CNN learning from scratch and (2) retrained VGG-19 network in one stage. The average accuracy increased from 74.5% & 78.1% to 85.6% compared with (1) & (2) respectively.Keywords
This publication has 14 references indexed in Scilit:
- Sleep position classification from a depth camera using Bed Aligned Maps2016
- Improving time–frequency domain sleep EEG classification via singular spectrum analysisJournal of Neuroscience Methods, 2016
- Sleep Monitoring System Using Kinect SensorInternational Journal of Distributed Sensor Networks, 2015
- Classification of awake, REM, and NREM from EEG via singular spectrum analysis2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2015
- Tensor Based Singular Spectrum Analysis for Automatic Scoring of Sleep EEGIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014
- ARTIFICIAL NEURAL NETWORKS BASED SLEEP MOTION RECOGNITION USING NIGHT VISION CAMERASBiomedical Engineering: Applications, Basis and Communications, 2004
- An overview of statistical learning theoryIEEE Transactions on Neural Networks, 1999
- Time of day effects in, and the relationship between, sleep quality and movementJournal of Sleep Research, 1998
- Sleep Apnea and Body Position during SleepSLEEP, 1988
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960