Multimodal Ambulatory Sleep Detection Using LSTM Recurrent Neural Networks
- 29 August 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 23 (4) , 1607-1617
Abstract
Unobtrusive and accurate ambulatory methods are needed to monitor long-term sleep patterns for improving health. Previously developed ambulatory sleep detection methods rely either in whole or in part on self-reported diary data as ground truth, which is a problem, since people often do not fill them out accurately. This paper presents an algorithm that uses multimodal data from smart-phones and wearable technologies to detect sleep/wake state and sleep onset/offset using a type of recurrent neural network with long-short-term memory (LSTM) cells for synthesizing temporal information. We collected 5580 days of multimodal data from 186 participants and compared the new method for sleep/wake classification and sleep onset/offset detection to, first, nontemporal machine learning methods and, second, a state-of-the-art actigraphy software. The new LSTM method achieved a sleep/wake classification accuracy of 96.5%, and sleep onset/offset detection F1 scores of 0.86 and 0.84, respectively, with mean absolute errors of 5.0 and 5.5 min, respectively, when compared with sleep/wake state and sleep onset/offset assessed using actigraphy and sleep diaries. The LSTM results were statistically superior to those from non-temporal machine learning algorithms and the actigraphy software. We show good generalization of the new algorithm by comparing participant-dependent and participant-independent models, and we show how to make the model nearly realtime with slightly reduced performance.Keywords
Funding Information
- National Institutes of Health (R01GM105018)
- Samsung Electronics
- NEC
- MIT Media Lab Consortium
This publication has 47 references indexed in Scilit:
- An Investigation into the Strength of the Association and Agreement Levels between Subjective and Objective Sleep Duration in AdolescentsPLOS ONE, 2013
- Uncovering Different Masking Factors on Wrist Skin Temperature Rhythm in Free-Living SubjectsPLOS ONE, 2013
- The Consensus Sleep Diary: Standardizing Prospective Sleep Self-MonitoringSLEEP, 2012
- Social fMRI: Investigating and shaping social mechanisms in the real worldPervasive and Mobile Computing, 2011
- The role and validity of actigraphy in sleep medicine: An updateSleep Medicine Reviews, 2011
- Sleep Habits and Susceptibility to the Common ColdArchives of internal medicine (1960), 2009
- Sleep Deprivation and Vigilant AttentionAnnals of the New York Academy of Sciences, 2008
- Objectively Measured Sleep Characteristics among Early-Middle-Aged AdultsAmerican Journal of Epidemiology, 2006
- Effects of 24-hour sleep deprivation on rate of decrement in a 10-minute auditory reaction time task.Journal of Experimental Psychology, 1972
- PHENOMENOLOGICAL STUDY OF PARADOXICAL PHASE AND REVERSE PARADOXICAL PHASE OF SLEEPThe Japanese Journal of Physiology, 1964