Development of a binary classifier model from extended facial codes toward video-based pain recognition in cancer patients
Authors:
- 5 September 2023
- journal article
- research article
- Published by Walter de Gruyter GmbH in Scandinavian Journal of Pain
- Vol. 23 (4) , 638-645
Abstract
Objectives: The Automatic Pain Assessment (APA) relies on the exploitation of objective methods to evaluate the severity of pain and other pain-related characteristics. Facial expressions are the most investigated pain behavior features for APA. We constructed a binary classifier model for discriminating between the absence and presence of pain through video analysis. Methods: A brief interview lasting approximately two-minute was conducted with cancer patients, and video recordings were taken during the session. The Delaware Pain Database and UNBC-McMaster Shoulder Pain dataset were used for training. A set of 17 Action Units (AUs) was adopted. For each image, the OpenFace toolkit was used to extract the considered AUs. The collected data were grouped and split into train and test sets: 80 % of the data was used as a training set and the remaining 20 % as the validation set. For continuous estimation, the entire patient video with frame prediction values of 0 (no pain) or 1 (pain), was imported into an annotator (ELAN 6.4). The developed Neural Network classifier consists of two dense layers. The first layer contains 17 nodes associated with the facial AUs extracted by OpenFace for each image. The output layer is a classification label of “pain” (1) or “no pain” (0). Results: The classifier obtained an accuracy of ∼94 % after about 400 training epochs. The Area Under the ROC curve (AUROC) value was approximately 0.98. Conclusions: This study demonstrated that the use of a binary classifier model developed from selected AUs can be an effective tool for evaluating cancer pain. The implementation of an APA classifier can be useful for detecting potential pain fluctuations. In the context of APA research, further investigations are necessary to refine the process and particularly to combine this data with multi-parameter analyses such as speech analysis, text analysis, and data obtained from physiological parameters.Keywords
This publication has 40 references indexed in Scilit:
- OpenFace: An open source facial behavior analysis toolkit2016
- Enhanced image classification with a fast-learning shallow convolutional neural network2015
- Ontogeny and phylogeny of facial expression of painPain, 2015
- Pain communication through body posture: The development and validation of a stimulus setPain, 2014
- Comparative Responsiveness of Verbal and Numerical Rating Scales to Measure Pain Intensity in Patients With Chronic PainThe Journal of Pain, 2013
- The Role of Pain Catastrophizing in Experimental Pain PerceptionPain Practice, 2013
- Painful monitoring: Automatic pain monitoring using the UNBC-McMaster shoulder pain expression archive databaseImage and Vision Computing, 2012
- Automatically Detecting Pain in Video Through Facial Action UnitsIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2010
- The structure, reliability and validity of pain expression: Evidence from patients with shoulder painPain, 2008
- Faces of pain2007