John Elson
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
John Elson has a total of 17 co-authors. Here are the top co-authors by number of shared publications:
- Clay Maranville
Ford Motor Company, USA
3 shared publications - Mihai Burzo
University of Michigan
3 shared publications - Mohamed Abouelenien
University of Michigan, Dearborn, USA
3 shared publications Chao Wang
2 shared publications- Kais Riani
University of Michigan, USA
2 shared publications - Kwaku Prakah-Asante
Ford Motor Company, United States
2 shared publications
Latest Publications
- Open Access
- 24 September 2026
- Published by Elsevier in SSRN Electronic Journal
Effects of temperature and lighting on drivers’ neural responses: Evidence from EEG and fNIRS during simulated driving
Environmental conditions inside vehicle cabins may influence thermal comfort and drivers’ cognitive state and performance. While the hue–heat hypothesis suggests that lighting color can alter perceived temperature, it remains unclear whether such cross-modal effects persist during cognitively demanding driving. This study investigated the combined effects of cabin temperature and ambient lighting color on drivers’ neural responses during simulated driving. Seventy-two participants were assigned to one of three cabin-temperature conditions (18 °C, 23 °C, and 28 °C), and each participant completed four driving sessions under red, blue, warm white, and cool white lighting, while EEG and fNIRS measurements were recorded simultaneously. Temperature significantly influenced neural activity across multiple frequency bands and cortical regions. Across the entire driving session, whole-brain relative δ-band PSD increased from 0.623 at 18 °C to 0.657 at 28 °C (p = 0.0007), whereas relative β-band PSD decreased from 0.083 to 0.064 (p < 0.001). Significant temperature effects were also observed in prefrontal hemodynamic responses, including HbR in the combined PFC and LPFC (p ≤ 0.003). In contrast, lighting color showed no significant effects on neural activity, and no interaction between temperature and lighting was detected. These findings suggest that thermal conditions play a stronger role than lighting color in shaping drivers’ cognitive state during short-term driving. The results further indicate that no neurophysiological evidence of a temperature–lighting interaction consistent with the hue–heat hypothesis was detected under the tested conditions.
- 24 September 2026
- Published by Elsevier in SSRN Electronic Journal
Open AccessEffects of temperature and lighting on drivers’ neural responses: Evidence from EEG and fNIRS during simulated driving
Environmental conditions inside vehicle cabins may influence thermal comfort and drivers’ cognitive state and performance. While the hue–heat hypothesis suggests that lighting color can alter perceived temperature, it remains unclear whether such cross-modal effects persist during cognitively demanding driving. This study investigated the combined effects of cabin temperature and ambient lighting color on drivers’ neural responses during simulated driving. Seventy-two participants were assigned to one of three cabin-temperature conditions (18 °C, 23 °C, and 28 °C), and each participant completed four driving sessions under red, blue, warm white, and cool white lighting, while EEG and fNIRS measurements were recorded simultaneously. Temperature significantly influenced neural activity across multiple frequency bands and cortical regions. Across the entire driving session, whole-brain relative δ-band PSD increased from 0.623 at 18 °C to 0.657 at 28 °C (p = 0.0007), whereas relative β-band PSD decreased from 0.083 to 0.064 (p < 0.001). Significant temperature effects were also observed in prefrontal hemodynamic responses, including HbR in the combined PFC and LPFC (p ≤ 0.003). In contrast, lighting color showed no significant effects on neural activity, and no interaction between temperature and lighting was detected. These findings suggest that thermal conditions play a stronger role than lighting color in shaping drivers’ cognitive state during short-term driving. The results further indicate that no neurophysiological evidence of a temperature–lighting interaction consistent with the hue–heat hypothesis was detected under the tested conditions.
- 11 February 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE MultiMedia
- Vol. PP (1070986X) , 1-12
Multimodal Non-Contact Based Modeling of Enervation
The advancement of autonomous vehicle technology has heightened interest in modeling occupant states and behaviors. This paper models occupant circadian state using four modalities: physiological, thermal, linguistic, and acoustic modalities. Moreover, it advances research by developing a fully non-contact pipeline to derive physiological signals from thermal imagery. Linguistic and acoustic features derived from speech are incorporated with the extracted physiological and thermal features to enhance circadian rhythm models and detect enervation states. The proposed approach leverages a multimodal dataset of 36 subjects captured across multiple channels. Comparative analysis between non-contact and contactbased channels reveals that physiological signals from thermal imagery, combined with linguistic and acoustic data, achieve accuracy comparable to or exceeding those of contact-based methods. This non-contact approach achieves accurate identification of energized versus enervated states, reaching 78.6% accuracy. These findings offer a novel framework for integrating unobtrusive sensing technologies in future automotive designs, facilitating next-generation occupant monitoring.
- 11 February 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE MultiMedia
- Vol. PP (1070986X) , 1-12
Multimodal Non-Contact Based Modeling of Enervation
The advancement of autonomous vehicle technology has heightened interest in modeling occupant states and behaviors. This paper models occupant circadian state using four modalities: physiological, thermal, linguistic, and acoustic modalities. Moreover, it advances research by developing a fully non-contact pipeline to derive physiological signals from thermal imagery. Linguistic and acoustic features derived from speech are incorporated with the extracted physiological and thermal features to enhance circadian rhythm models and detect enervation states. The proposed approach leverages a multimodal dataset of 36 subjects captured across multiple channels. Comparative analysis between non-contact and contactbased channels reveals that physiological signals from thermal imagery, combined with linguistic and acoustic data, achieve accuracy comparable to or exceeding those of contact-based methods. This non-contact approach achieves accurate identification of energized versus enervated states, reaching 78.6% accuracy. These findings offer a novel framework for integrating unobtrusive sensing technologies in future automotive designs, facilitating next-generation occupant monitoring.
- Open Access
- 3 March 2025
- Published by Elsevier in Building and Environment
- Vol. 275
The influence of temperature and interior ambient lighting color on nighttime driving performance
- 3 March 2025
- Published by Elsevier in Building and Environment
- Vol. 275
Open AccessThe influence of temperature and interior ambient lighting color on nighttime driving performance
- Open Access
- 9 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 584-593
Towards Autonomous Physiological Signal Extraction From Thermal Videos Using Deep Learning
Using the thermal modality in order to extract physiological signals as a noncontact means of remote monitoring is gaining traction in applications, such as healthcare monitoring. However, existing methods rely heavily on traditional tracking and mostly unsupervised signal processing methods, which could be affected significantly by noise and subjects’ movements. Using a novel deep learning architecture based on convolutional long short-term memory networks on a diverse dataset of 36 subjects, we present a personalized approach to extract multimodal signals, including the heart rate, respiration rate, and body temperature from thermal videos. We perform multimodal signal extraction for subjects in states of both active speaking and silence, requiring no parameter tuning in an end-to-end deep learning approach with automatic feature extraction. We experiment with different data sampling methods for training our deep learning models, as well as different network designs. Our results indicate the effectiveness and improved efficiency of the proposed models reaching more than 90% accuracy based on the availability of proper training data for each subject.
- 9 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 584-593
Open AccessTowards Autonomous Physiological Signal Extraction From Thermal Videos Using Deep Learning
Using the thermal modality in order to extract physiological signals as a noncontact means of remote monitoring is gaining traction in applications, such as healthcare monitoring. However, existing methods rely heavily on traditional tracking and mostly unsupervised signal processing methods, which could be affected significantly by noise and subjects’ movements. Using a novel deep learning architecture based on convolutional long short-term memory networks on a diverse dataset of 36 subjects, we present a personalized approach to extract multimodal signals, including the heart rate, respiration rate, and body temperature from thermal videos. We perform multimodal signal extraction for subjects in states of both active speaking and silence, requiring no parameter tuning in an end-to-end deep learning approach with automatic feature extraction. We experiment with different data sampling methods for training our deep learning models, as well as different network designs. Our results indicate the effectiveness and improved efficiency of the proposed models reaching more than 90% accuracy based on the availability of proper training data for each subject.
- 5 January 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Non-Contact Based Modeling of Enervation
Significant research is currently carried out with a focus on autonomous vehicles; research is starting to focus on areas such as the modeling of occupant states and behavioral elements. This paper contributes to this line of research by developing a pipeline that extracts physiological signals from thermal imagery and modeling occupant enervation using a fully non-contact based approach. These signals are obtained via a multimodal dataset of 36 subjects across multiple channels, including the thermal and physiological modalities. Moreover, we provide a comparative analysis of non-contact and contact based channels to model the enervation state of individuals. Our analysis indicates that non-contact physiological signals extracted from thermal imagery can reach and exceed the performance of contact-based physiological signals. In addition, modeling of enervation is possible using said non-contact physiological signals and thermal features, with an accuracy of up to 70% in identifying energized and enervated occupant states. Our findings provide a novel approach for future research and opens the possibility for integration of unrestrictive sensors in future automobiles.
- 5 January 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Non-Contact Based Modeling of Enervation
Significant research is currently carried out with a focus on autonomous vehicles; research is starting to focus on areas such as the modeling of occupant states and behavioral elements. This paper contributes to this line of research by developing a pipeline that extracts physiological signals from thermal imagery and modeling occupant enervation using a fully non-contact based approach. These signals are obtained via a multimodal dataset of 36 subjects across multiple channels, including the thermal and physiological modalities. Moreover, we provide a comparative analysis of non-contact and contact based channels to model the enervation state of individuals. Our analysis indicates that non-contact physiological signals extracted from thermal imagery can reach and exceed the performance of contact-based physiological signals. In addition, modeling of enervation is possible using said non-contact physiological signals and thermal features, with an accuracy of up to 70% in identifying energized and enervated occupant states. Our findings provide a novel approach for future research and opens the possibility for integration of unrestrictive sensors in future automobiles.