System for customers' routing based on their emotional state and age in public services systems
Open Access
- 1 October 2023
- journal article
- research article
- Published by ITMO University in Scientific and Technical Journal of Information Technologies, Mechanics and Optics
- Vol. 23 (5) , 1009
Abstract
In this paper, we have developed a system for assigning customers to the routes based on their emotional state and age in Public Service Systems (PSSs). The Squeeze-and-Excitation (SE) method was used to develop the models, it improves the efficiency of the Deep Convolutional Neural Networks (DCNN) architecture by increasing the information flow between layers and enhancing important features. The method is based on compressing and exciting information at each convolution stage, which allows obtaining a vector of channel importance scores and using it to reweight the channels of the feature map. The study showed that this method allowed improving the quality of classification and reducing the model training time. The model of emotional target routing was developed based on the Newton interpolation polynomial to route customers based on their emotional state and age. The interpolation function in this model calculates the waiting time for customers according to their emotional state. Three models of binary classification of emotions and ages were developed, namely, two models for recognizing the emotional state of the customer, and one model for recognizing their age. The first and third models utilize DCNN from scratch using the new SE approach based on the attention mechanism. The second model uses the Support Vector Machine (SVM) method. The evaluate method was used to test the model after training, which allows evaluating the quality of the model on new data that was not used during training. This is done to check how accurately the model can predict the values of the target variable on new data. The evaluate method utilizes quality evaluation metrics such as accuracy, recall, and F1-score to assess the performance of the model. According to the experimental data obtained, the first and the second developed models achieved the validation accuracy of 72 % and 66 %, respectively, on the FER-2013 and Adience datasets. Their sizes were 0.69 MB and 369 MB, respectively. At the same time, the age recognition model achieved the accuracy of 88 % with the size of 1.68 MB. The mathematical model of emotional target routing (TERSS) was developed to minimize conflicts in public service systems. The developed system can automatically route customers based on their emotional state (presence of anger) and age to the appropriate operator. Thus, customers over 60 years old or with the anger level of 60–80 % are directed to a senior operator who knows how to communicate with elderly or emotionally excited customers, while customers with the anger level of 80–100 % are directed to a psychologist. This research can be applied in PSSs to detect the features of customers’ age and anger. Moreover, it can be applied in various areas where there is a contact with a large number of people, such as banks, supermarkets, airports access control systems, police stations, subways, and call centers.Keywords
This publication has 26 references indexed in Scilit:
- RETRACTED ARTICLE: Age and gender classification using Seg-Net based architecture and machine learningMultimedia Tools and Applications, 2022
- Multi-task CNN for multi-cue affects recognition using upper-body gestures and facial expressionsInternational Journal of Information Technology, 2021
- Automatic stress analysis from facial videos based on deep facial action units recognitionPattern Analysis and Applications, 2021
- Fast gradient descent algorithm for image classification with neural networksSignal, Image and Video Processing, 2020
- Classification from Complex Training Sets2019
- Analysis of PCA and LDA Features for Facial Expression Recognition Using SVM and HMM Classifiers2019
- War outside, ceasefire inside: An analysis of the performance appraisal system of a public hospital in a zone of conflictEvaluation and Program Planning, 2012
- Exploiting graphical processing units for data‐parallel scientific applicationsConcurrency and Computation: Practice and Experience, 2009
- Facial expressions of emotion influence interpersonal trait inferencesJournal of Nonverbal Behavior, 1996
- Newton interpolation at Leja pointsBIT Numerical Mathematics, 1990