Pain Action Unit Detection in Critically Ill Patients
Authors:
- 9 September 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2021, 645-651
Abstract
Existing pain assessment methods in the intensive care unit rely on patient self-report or visual observation by nurses. Patient self-report is subjective and can suffer from poor recall. In the case of non-verbal patients, behavioral pain assessment methods provide limited granularity, are subjective, and put additional burden on already overworked staff. Previous studies have shown the feasibility of autonomous pain expression assessment by detecting Facial Action Units (AUs). However, previous approaches for detecting facial pain AUs are historically limited to controlled environments. In this study, for the first time, we collected and annotated a pain-related AU dataset, Pain-ICU, containing 55,085 images from critically ill adult patients. We evaluated the performance of OpenFace, an open-source facial behavior analysis tool, and the trained AU R-CNN model on our Pain-ICU dataset. Variables such as assisted breathing devices, environmental lighting, and patient orientation with respect to the camera make AU detection harder than with controlled settings. Although OpenFace has shown state-of-the-art results in general purpose AU detection tasks, it could not accurately detect AUs in our Pain-ICU dataset (F1-score 0.42). To address this problem, we trained the AU R-CNN model on our Pain-ICU dataset, resulting in a satisfactory average F1-score 0.77. In this study, we show the feasibility of detecting facial pain AUs in uncontrolled ICU settings.Keywords
Funding Information
- National Science Foundation
- National Institute of Biomedical Imaging and Bioengineering
- National Institute of Neurological Disorders and Stroke
This publication has 18 references indexed in Scilit:
- Fifty years on the Visual Analogue Scale (VAS) for pain-intensity is still good for acute pain. But multidimensional assessment is needed for chronic painScandinavian Journal of Pain, 2016
- FaceNet: A unified embedding for face recognition and clustering2015
- BP4D-Spontaneous: a high-resolution spontaneous 3D dynamic facial expression databaseImage and Vision Computing, 2014
- Decreasing severe pain and serious adverse events while moving intensive care unit patients: a prospective interventional study (the NURSE-DO project)Critical Care, 2013
- Three new datasets supporting use of the Numerical Rating Scale (NRS-11) for children’s self-reports of pain intensityPain, 2009
- The structure, reliability and validity of pain expression: Evidence from patients with shoulder painPain, 2008
- Understanding posttraumatic stress disorder-related symptoms after critical care: The early illness amnesia hypothesis*Critical Care Medicine, 2008
- Assessing Pain Control in Nonverbal Critically Ill AdultsDimensions of Critical Care Nursing, 2003
- Reliability of the Visual Analog Scale for Measurement of Acute PainAcademic Emergency Medicine, 2001
- Relative importance of face, body, and speech in judgments of personality and affect.Journal of Personality and Social Psychology, 1980