Multimodal Approach to Identify Attention Level of Students using Jetson Nano
Authors:
- 1 December 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 148, 624-629
Abstract
Students must be attentive in the classroom to improve on their learning. Further, it is important for the faculty to know whether the students pay complete attention in the classroom. If not, faculty can slow down and modify their mode of delivery by making the classes more interesting to gain students attention. The aim of this work is to monitor the student’s attention in the classroom based on their physical state which is the result of their bio chemical and electrical signals in the brain. The approaches like Electro dermal activity (EDA), Electroencephalography (EEG), Electrocardiogram (ECG) are measured by using physiological signals but is hard to extract and analyze. Head bands extracting EEG signals may also distract a student’s attention in classes. The proposed work aims to make use of Deep Convolution Neural Network (DCNN) with Histogram of Gradient (HoG) for face detection and facenet algorithm for face recognition. To evaluate the attentiveness of the students, A Convolution Neural Network model is proposed. The trained model is tested by deploying in Jetson Nano. To identify the attentiveness of the student, the physical state of the face is considered, such as head movement, and the state of eyes and mouth, whether it is opened or closed. Furthermore, the open eye region is analysed if it is partially opened or fully opened. By using CNN to train the model instead of Machine learning algorithms, the accuracy of the system is found to increase.Keywords
This publication has 11 references indexed in Scilit:
- Emotions recognition as innovative tool for improving students’ performance and learning approachesProcedia Computer Science, 2020
- Emotion Recognition and Detection Methods: A Comprehensive SurveyJournal of Artificial Intelligence and Systems, 2020
- Increased emotional engagement in game-based learning – A machine learning approach on facial emotion detection dataComputers & Education, 2019
- Deep learning analysis of mobile physiological, environmental and location sensor data for emotion detectionInformation Fusion, 2019
- Real-time Algorithms for Facial Emotion Recognition: A Comparison of Different Approaches2018
- Facial Expression Emotion Detection for Real-Time Embedded SystemsTechnologies, 2018
- An Emotion Recognition Model Based on Facial Recognition in Virtual Learning EnvironmentProcedia Computer Science, 2018
- Student Emotion Recognition System (SERS) for e-learning Improvement Based on Learner Concentration MetricProcedia Computer Science, 2016
- 3D face model dataset: Automatic detection of facial expressions and emotions for educational environmentsBritish Journal of Educational Technology, 2015
- Robust facial expression classification using shape and appearance features2015