Recurrent Convolutional Neural Network Regression for Continuous Pain Intensity Estimation in Video
Authors:
- Jing ZhouJZJing Zhou
- Xiaopeng HongXHXiaopeng Hong
- Fei SuFSFei Su
- Guoying ZhaoGZGuoying Zhao
- 1 June 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1535-1543
Abstract
Automatic pain intensity estimation possesses a significant position in healthcare and medical field. Traditional static methods prefer to extract features from frames separately in a video, which would result in unstable changes and peaks among adjacent frames. To overcome this problem, we propose a real-time regression framework based on the recurrent convolutional neural network for automatic frame-level pain intensity estimation. Given vector sequences of AAM-warped facial images, we used a slidingwindow strategy to obtain fixed-length input samples for the recurrent network. We then carefully design the architecture of the recurrent network to output continuousvalued pain intensity. The proposed end-to-end pain intensity regression framework can predict the pain intensity of each frame by considering a sufficiently large historical frames while limiting the scale of the parameters within the model. Our method achieves promising results regarding both accuracy and running speed on the published UNBCMcMaster Shoulder Pain Expression Archive Database.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- Pain monitoring: A dynamic and context-sensitive systemPattern Recognition, 2012
- Painful monitoring: Automatic pain monitoring using the UNBC-McMaster shoulder pain expression archive databaseImage and Vision Computing, 2012
- Continuous Pain Intensity Estimation from Facial Expressions2012
- The painful face – Pain expression recognition using active appearance modelsImage and Vision Computing, 2009
- The structure, reliability and validity of pain expression: Evidence from patients with shoulder painPain, 2008
- Active appearance modelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- The consistency of facial expressions of pain: a comparison across modalitiesPain, 1992
- Finding structure in timeCognitive Science, 1990
- Backpropagation through time: what it does and how to do itProceedings of the IEEE, 1990
- A massively parallel architecture for a self-organizing neural pattern recognition machineComputer Vision, Graphics, and Image Processing, 1987