Michele Tritto

Background: Human-Machine Interaction (HMI) has been an important field of research in recent years, since machines will continue to be embedded in many human actvities in several contexts, such as industry and healthcare. Monitoring in an ecological mannerthe cognitive workload (CW) of users, who interact with machines, is crucial to assess their level of engagement in activities and the required effort, with the goal of preventing stressful circumstances. This study provides a comprehensive analysis of the assessment of CW using wearable sensors in HMI. Methods: this narrative review explores several techniques and procedures for collecting physiological data through wearable sensors with the possibility to integrate these multiple physiological signals, providing a multimodal monitoring of the individuals’CW. Finally, it focuses on the impact of artificial intelligence methods in the physiological signals data analysis to provide models of the CW to be exploited in HMI. Results: the review provided a comprehensive evaluation of the wearables, physiological signals, and methods of data analysis for CW evaluation in HMI. Conclusion: the literature highlighted the feasibility of employing wearable sensors to collect physiological signals for an ecological CW monitoring in HMI scenarios. However, challenges remain in standardizing these measures across different populations and contexts.

This study examines the ability of infrared thermography (IRT) to distinguish vasculopathy patients (VP) from healthy controls (HC) during post-occlusive reactive hyperemia (PORH). Three VP and three HC participated in the study. The experimental procedure included a 3-min baseline, a 5-min occlusion at 50 mmHg above the systolic pressure, and a 3-min reperfusion. During PORH, HC had a larger temperature fluctuation of the fingertips from the baseline (1.22 ± 0.97 °C) compared to VP (0.53 ± 0.57 °C). Accordingly, color Doppler ultrasound assessed differences in the arterial resistivity index between the two groups. These findings, albeit preliminary, could facilitate IRT employment during POHR.

Social robots represent a valid opportunity to manage the diagnosis, treatment, care, and support of older people with dementia. The aim of this study is to validate the Mini-Mental State Examination (MMSE) test administered by the Pepper robot equipped with systems to detect psychophysical and emotional states in older patients. Our main result is that the Pepper robot is capable of administering the MMSE and that cognitive status is not a determinant in the effective use of a social robot. People with mild cognitive impairment appreciate the robot, as it interacts with them. Acceptability does not relate strictly to the user experience, but the willingness to interact with the robot is an important variable for engagement. We demonstrate the feasibility of a novel approach that, in the future, could lead to more natural human–machine interaction when delivering cognitive tests with the aid of a social robot and a Computational Psychophysiology Module (CPM).

Cerebral palsy (CP) is a non-progressive neurologic pathology representing a leading cause of spasticity and concerning gait impairments in children. Robotic-assisted gait training (RAGT) is widely employed to treat this pathology to improve children’s gait pattern. Importantly, the effectiveness of the therapy is strictly related to the engagement of the patient in the rehabilitation process, which depends on his/her psychophysiological state. The aim of the study is to evaluate the psychophysiological condition of children with CP during RAGT through infrared thermography (IRT), which was acquired during three sessions in one month. A repeated measure ANOVA was performed (i.e., mean value, standard deviation, and sample entropy) extracted from the temperature time course collected over the nose and corrugator, which are known to be indicative of the psychophysiological state of the individual. Concerning the corrugator, significant differences were found for the sample entropy (F (1.477, 5.907) = 6.888; p = 0.033) and for the mean value (F (1.425, 5.7) = 5.88; p = 0.047). Regarding the nose tip, the sample entropy showed significant differences (F (1.134, 4.536) = 11.5; p = 0.041). The findings from this study suggests that this approach can be used to evaluate in a contactless manner the psychophysiological condition of the children with CP during RAGT, allowing to monitor their engagement to the therapy, increasing the benefits of the treatment.

Cerebral palsy (CP) is a non-progressive neurologic condition that causes gait limitations, spasticity, and impaired balance and coordination. Robotic-assisted gait training (RAGT) has become a common rehabilitation tool employed to improve the gait pattern of people with neurological impairments. However, few studies have demonstrated the effectiveness of RAGT in children with CP and its neurological effects through portable neuroimaging techniques, such as functional near-infrared spectroscopy (fNIRS). The aim of the study is to evaluate the neurophysiological processes elicited by RAGT in children with CP through fNIRS, which was acquired during three sessions in one month. The repeated measure ANOVA was applied to the β-values delivered by the General Linear Model (GLM) analysis used for fNIRS data analysis, showing significant differences in the activation of both prefrontal cortex (F (1.652, 6.606) = 7.638; p = 0.022), and sensorimotor cortex (F (1.294, 5.175) = 11.92; p = 0.014) during the different RAGT sessions. In addition, a cross-validated Machine Learning (ML) framework was implemented to estimate the gross motor function measure (GMFM-88) from the GLM β-values, obtaining an estimation with a correlation coefficient r = 0.78. This approach can be used to tailor clinical treatment to each child, improving the effectiveness of rehabilitation for children with CP.

Mental workload (MW) represents the amount of brain resources required to perform concurrent tasks. The evaluation of MW is of paramount importance for Advanced Driver-Assistance Systems, given its correlation with traffic accidents risk. In the present research, two cognitive tests (Digit Span Test—DST and Ray Auditory Verbal Learning Test—RAVLT) were administered to participants while driving in a simulated environment. The tests were chosen to investigate the drivers’ response to predefined levels of cognitive load to categorize the classes of MW. Infrared (IR) thermal imaging concurrently with heart rate variability (HRV) were used to obtain features related to the psychophysiology of the subjects, in order to feed machine learning (ML) classifiers. Six categories of models have been compared basing on unimodal IR/unimodal HRV/multimodal IR + HRV features. The best classifier performances were reached by the multimodal IR + HRV features-based classifiers (DST: accuracy = 73.1%, sensitivity = 0.71, specificity = 0.69; RAVLT: accuracy = 75.0%, average sensitivity = 0.75, average specificity = 0.87). The unimodal IR features based classifiers revealed high performances as well (DST: accuracy = 73.1%, sensitivity = 0.73, specificity = 0.73; RAVLT: accuracy = 71.1%, average sensitivity = 0.71, average specificity = 0.85). These results demonstrated the possibility to assess drivers’ MW levels with high accuracy, also using a completely non-contact and non-invasive technique alone, representing a key advancement with respect to the state of the art in traffic accident prevention.