Using Convolutional Neural Networks for Smart Classroom Observation
Authors:
- 1 February 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 608-612
Abstract
Classroom observation is one the primary tools for providing teachers feedback on their classroom practices. However, classroom observation is expensive and may suffer from bias. A partial automation of this process should go a long way towards improving the quantity and quality of feedback provided to a teacher that may eventually lead to better education. This paper presents the design and implementation of a Convolution Neural Network (CNN) that used class observation audio data to classify classroom activities into those based on the Stallings Classroom Snapshot. Data consisting of 859 audio episodes taken from a variety of semi-rural schools was used to train a CNN to classify the audio episode into one of six Stalling categories; Classwork, Classroom Management, Lecture/Demonstration, Practice & Drill, Discussion/Question and Answer, and Reading Aloud. The resulting model yielded a best accuracy of 89.97%. The model performed better than previous model built using KNN and Random Forest. The 20 MB model implementation of the CNN on an iPhone SE using CoreML yielded an average response time of 0.8 seconds/inference (sd = 0.01).Keywords
This publication has 8 references indexed in Scilit:
- Using Machine Learning to Automate Classroom Observation for Low-Resource Environments2018
- Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound ClassificationIEEE Signal Processing Letters, 2017
- A Dataset and Taxonomy for Urban Sound Research2014
- The Individualized Classroom Assessment Scoring System (inCLASS): Preliminary reliability and validity of a system for observing preschoolers’ competence in classroom interactionsEarly Childhood Research Quarterly, 2010
- The ISI Classroom Observation System: Examining the Literacy Instruction Provided to Individual StudentsEducational Researcher, 2009
- SMOTE: Synthetic Minority Over-sampling TechniqueJournal of Artificial Intelligence Research, 2002
- Capturing classroom context: The observation system as lens for assessmentJournal of Personnel Evaluation in Education, 1989
- Monitoring achievement in schoolNSPI Journal, 1977