Pain Detection from Facial Videos Using Two-Stage Deep Learning
Authors:
- 1 November 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
A new method to objectively measure pain using computer vision and machine learning technologies is presented. Our method seeks to capture facial expressions of pain to detect pain, especially when a patients cannot communicate pain verbally. This approach relies on using Facial muscle-based Action Units (AUs), defined by the Facial Action Coding System (FACS), that are associated with pain. It is impractical to use human FACS coding experts in clinical settings to perform this task as it is too labor-intensive and recent research has sought computer-based solutions to the problem. An effective automated system for performing the task is proposed here in which we develop an end-to-end deep learning-based Automated Facial Expression Recognition (AFER) that jointly detects the complete set of pain-related AUs. The facial video clip is processed frame by frame to estimate a vector of AU likelihood values for each frame using a deep convolutional neural network. The AU vectors are concatenated to form a table of AU values for a given video clip. Our results show significantly improved performance compared with those obtained with other known methods.Keywords
This publication has 35 references indexed in Scilit:
- Towards the automatic detection of spontaneous agreement and disagreement based on nonverbal behaviour: A survey of related cues, databases, and toolsImage and Vision Computing, 2013
- Painful monitoring: Automatic pain monitoring using the UNBC-McMaster shoulder pain expression archive databaseImage and Vision Computing, 2012
- Facial expression and pain in the critically ill non-communicative patient: State of science reviewIntensive and Critical Care Nursing, 2010
- The painful face – Pain expression recognition using active appearance modelsImage and Vision Computing, 2009
- An Interdisciplinary Expert Consensus Statement on Assessment of Pain in Older PersonsThe Clinical Journal of Pain, 2007
- Genuine, suppressed and faked facial behavior during exacerbation of chronic low back painPain, 1991
- Pain expression in patients with shoulder pathology: validity, properties and relationship to sickness impactPain, 1989
- Facial expressions of pain and emotions in chronic TMD patientsPain, 1988
- Facial expression accompanying painSocial Science & Medicine, 1984
- Development of an observation method for assessing pain behavior in chronic low back pain patientsBehavior Therapy, 1982