A Hybrid DCNN-SVM Model for Classifying Neonatal Sleep and Wake States Based on Facial Expressions in Video
- 15 April 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 25 (5) , 1441-1449
Abstract
Sleep is a natural phenomenon controlled by the central nervous system. The sleep-wake pattern, which functions as an essential indicator of neurophysiological organization in the neonatal period, has profound meaning in the prediction of cognitive diseases and brain maturity. In recent years, unobtrusive sleep monitoring and automatic sleep staging have been intensively studied for adults, but much less for neonates. This work aims to investigate a novel video-based unobtrusive method for neonatal sleep-wake classification by analyzing the behavioral changes in the neonatal facial region. A hybrid model is proposed to monitor the sleep-wake patterns of human neonates. The model combines two algorithms: deep convolutional neural network (DCNN) and support vector machine (SVM), where DCNN works as a trainable feature extractor and SVM as a classifier. Data was collected from nineteen Chinese neonates at the Children's Hospital of Fudan University, Shanghai, China. The classification results are compared with the gold standard of video-electroencephalography scored by pediatric neurologists. Validations indicate that the proposed hybrid DCNN-SVM model achieved reliable performances in classifying neonatal sleep and wake states in RGB video frames (with the face region detected), with an accuracy of 93.8 ± 2.2% and an F1-score 0.93 ± 0.3.Keywords
Funding Information
- Science and Technology Commission of Shanghai Municipality (2017SHZDZX01)
- National Key R&D Program of China (2017YFE0112000)
This publication has 54 references indexed in Scilit:
- A Review of near Infrared Spectroscopy for Term and Preterm NewbornsJournal of Near Infrared Spectroscopy, 2012
- Algorithms for sleep–wake identification using actigraphy: a comparative study and new resultsJournal of Sleep Research, 2009
- A trainable feature extractor for handwritten digit recognitionPattern Recognition, 2007
- Neurophysiologic Assessment of Neonatal Sleep Organization: Preliminary Results of a Randomized, Controlled Trial of Skin Contact With Preterm InfantsPediatrics, 2006
- Activity-based sleep–wake identification in infantsPhysiological Measurement, 2004
- Sleep-wake states and their regulatory mechanisms throughout early human developmentThe Journal of Pediatrics, 2003
- Long Short-Term MemoryNeural Computation, 1997
- Support-vector networksMachine Learning, 1995
- Measurement of facial skin temperatureJournal of Dentistry, 1990
- Ontogenetic Development of the Human Sleep-Dream CycleScience, 1966