Automatic Grading of 3D Computer Animation Laboratory Assignments
Open Access
- 18 July 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Learning Technologies
- Vol. 7 (3) , 280-290
Abstract
Assessment is a delicate task in the overall teaching process because it may require significant time and may be prone to subjectivity. Subjectivity is especially true for disciplines in which perceptual factors play a key role in the evaluation. In previous decades, computer-based assessment techniques were developed to address the above-mentioned challenges and to automatically grade students' work in a variety of educational fields. In this paper, the application of automatic assessment strategies in the unexplored domain of computer graphics is discussed. In particular, a tool that is designed to evaluate student assignments for a 3D computer animation course taught at Politecnico di Torino University is presented. During laboratory examination sessions, students are requested to individually operate on the open-source Blender suite and to recreate a 3D animation similar to a reference one. Student's output is assessed against a set of similarity indicators, which are specifically designed to capture the technical and perceptual factors that would be blended in a traditional teacher's evaluation. A comparison of the results that are achieved by the computer-based tool with grades assigned by visual inspection confirms the effectiveness of the designed approach and displays a high-quality concurrence between automatic and manual evaluations.Keywords
This publication has 36 references indexed in Scilit:
- Automatically assessing graph‐based diagramsLearning, Media and Technology, 2008
- Emulating human perception of motion similarityComputer Animation and Virtual Worlds, 2008
- Perception of Human MotionAnnual Review of Psychology, 2007
- A data-driven approach to quantifying natural human motionACM Transactions on Graphics, 2005
- Efficient video similarity measurement with video signatureIEEE Transactions on Circuits and Systems for Video Technology, 2003
- ACES: an interactive software platform for self-instruction and self-evaluation in automatic control systemsIEEE Transactions on Education, 2003
- An automatic evaluation system for technical education at the University levelIEEE Transactions on Education, 2002
- Query by image and video content: the QBIC systemComputer, 1995
- Principles of traditional animation applied to 3D computer animationACM SIGGRAPH Computer Graphics, 1987
- Automatic graders for programming classesCommunications of the ACM, 1960