Full-convolution Siamese network algorithm under deep learning used in tracking of facial video image in newborns
- 1 April 2022
- journal article
- research article
- Published by Springer Nature in The Journal of Supercomputing
- Vol. 78 (12) , 14343-14361
Abstract
This study was carried out with the aim of exploring the full-convolution Siamese network (SiamFC) in the application of neonatal facial video image tracking, achieving accurate recognition of neonatal pain and helping doctors evaluate neonatal emotions in an automatic manner. The current technology shows low accuracy on facial image recognition of newborns, so the SiamFC algorithm under the deep learning was optimized in this study. Besides, a newborn facial video image tracking model (FVIT model) was constructed based on the SiamFC algorithm in combination with the attention mechanism with face tracking algorithm, and the facial features of newborns were tracked and recognized. In addition, a newborn face database was constructed based on the adult face database to evaluate performance of the FVIT model. It was found that the accuracy of the improved algorithm is 0.889, higher by 0.036 in contrast to other models; the area under the curve (AUC) of success rate reaches 0.748, higher by 0.075 compared with other algorithms. What’s more, the improved algorithm shows good performance in tracking the facial occlusion, facial expression changes, and scale conversion of newborns. Therefore, the improved algorithm shows higher accuracy and success rate and has good effect in capturing and tracking the facial images of newborns, thereby providing an experimental basis for facial recognition and pain assessment of newborns in the later stage.Keywords
This publication has 39 references indexed in Scilit:
- A Deep Learning Approach for Credit Scoring of Peer-to-Peer Lending Using Attention Mechanism LSTMIEEE Access, 2018
- Convolutional neural networks based on multi-scale additive merging layers for visual smoke recognitionMachine Vision and Applications, 2018
- Automatic Metallic Surface Defect Detection and Recognition with Convolutional Neural NetworksApplied Sciences, 2018
- On the Estimation and Control of Nonlinear Systems With Parametric Uncertainties and Noisy OutputsIEEE Access, 2018
- Robust real-time visual object tracking via multi-scale fully convolutional Siamese networksMultimedia Tools and Applications, 2018
- Handwritten Devanagari Character Recognition Using Layer-Wise Training of Deep Convolutional Neural Networks and Adaptive Gradient MethodsJournal of Imaging, 2018
- CNNSFR: A Convolutional Neural Network System for Face Detection and RecognitionInternational Journal of Advanced Computer Science and Applications, 2018
- A Comprehensive Performance Evaluation of Deformable Face Tracking “In-the-Wild”International Journal of Computer Vision, 2017
- A smart and effective method for digital video compression2016
- A Hybrid Image steganography method based on genetic algorithm2016