JEJohn Elson

John Elson

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


John Elson has a total of 17 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Effects of temperature and lighting on drivers’ neural responses: Evidence from EEG and fNIRS during simulated driving

    by Chao Wang, Yao Xiao, Xiaojun Cheng, Yingzi Lin, Erin Solovey, John Elson, Shichao Liu

    Environmental conditions inside vehicle cabins may influence thermal comfort and drivers’ cognitive state and performance. While the hue–heat hypothesis suggests that lighting color can alter perceived temperature, it remains unclear whether such cross-modal effects persist during cognitively demanding driving. This study investigated the combined effects of cabin temperature and ambient lighting color on drivers’ neural responses during simulated driving. Seventy-two participants were assigned to one of three cabin-temperature conditions (18 °C, 23 °C, and 28 °C), and each participant completed four driving sessions under red, blue, warm white, and cool white lighting, while EEG and fNIRS measurements were recorded simultaneously. Temperature significantly influenced neural activity across multiple frequency bands and cortical regions. Across the entire driving session, whole-brain relative δ-band PSD increased from 0.623 at 18 °C to 0.657 at 28 °C (p = 0.0007), whereas relative β-band PSD decreased from 0.083 to 0.064 (p < 0.001). Significant temperature effects were also observed in prefrontal hemodynamic responses, including HbR in the combined PFC and LPFC (p ≤ 0.003). In contrast, lighting color showed no significant effects on neural activity, and no interaction between temperature and lighting was detected. These findings suggest that thermal conditions play a stronger role than lighting color in shaping drivers’ cognitive state during short-term driving. The results further indicate that no neurophysiological evidence of a temperature–lighting interaction consistent with the hue–heat hypothesis was detected under the tested conditions.

  • Multimodal Non-Contact Based Modeling of Enervation

    by Salem Sharak, Kais Riani, Mohamed Abouelenien, Mihai Burzo, Rada Mihalcea, John Elson, Clay Maranville

    The advancement of autonomous vehicle technology has heightened interest in modeling occupant states and behaviors. This paper models occupant circadian state using four modalities: physiological, thermal, linguistic, and acoustic modalities. Moreover, it advances research by developing a fully non-contact pipeline to derive physiological signals from thermal imagery. Linguistic and acoustic features derived from speech are incorporated with the extracted physiological and thermal features to enhance circadian rhythm models and detect enervation states. The proposed approach leverages a multimodal dataset of 36 subjects captured across multiple channels. Comparative analysis between non-contact and contactbased channels reveals that physiological signals from thermal imagery, combined with linguistic and acoustic data, achieve accuracy comparable to or exceeding those of contact-based methods. This non-contact approach achieves accurate identification of energized versus enervated states, reaching 78.6% accuracy. These findings offer a novel framework for integrating unobtrusive sensing technologies in future automotive designs, facilitating next-generation occupant monitoring.

  • Open Access

    Towards Autonomous Physiological Signal Extraction From Thermal Videos Using Deep Learning

    by Kapotaksha Das, Mohamed Abouelenien, Mihai G. Burzo, John Elson, Kwaku Prakah-Asante, Clay Maranville

    Using the thermal modality in order to extract physiological signals as a noncontact means of remote monitoring is gaining traction in applications, such as healthcare monitoring. However, existing methods rely heavily on traditional tracking and mostly unsupervised signal processing methods, which could be affected significantly by noise and subjects’ movements. Using a novel deep learning architecture based on convolutional long short-term memory networks on a diverse dataset of 36 subjects, we present a personalized approach to extract multimodal signals, including the heart rate, respiration rate, and body temperature from thermal videos. We perform multimodal signal extraction for subjects in states of both active speaking and silence, requiring no parameter tuning in an end-to-end deep learning approach with automatic feature extraction. We experiment with different data sampling methods for training our deep learning models, as well as different network designs. Our results indicate the effectiveness and improved efficiency of the proposed models reaching more than 90% accuracy based on the availability of proper training data for each subject.


  • Non-Contact Based Modeling of Enervation

    by Kais Riani, Salem Sharak, Mohamed Abouelenien, Mihai Burzo, Rada Mihalcea, John Elson, Clay Maranville, Kwaku Prakah-Asante, Waqas Manzoor

    Significant research is currently carried out with a focus on autonomous vehicles; research is starting to focus on areas such as the modeling of occupant states and behavioral elements. This paper contributes to this line of research by developing a pipeline that extracts physiological signals from thermal imagery and modeling occupant enervation using a fully non-contact based approach. These signals are obtained via a multimodal dataset of 36 subjects across multiple channels, including the thermal and physiological modalities. Moreover, we provide a comparative analysis of non-contact and contact based channels to model the enervation state of individuals. Our analysis indicates that non-contact physiological signals extracted from thermal imagery can reach and exceed the performance of contact-based physiological signals. In addition, modeling of enervation is possible using said non-contact physiological signals and thermal features, with an accuracy of up to 70% in identifying energized and enervated occupant states. Our findings provide a novel approach for future research and opens the possibility for integration of unrestrictive sensors in future automobiles.