Automated Indicators to Assess the Creativity of Solutions to Programming Exercises
Authors:
- Sven ManskeSMSven Manske
- H. Ulrich HoppeHHH. Ulrich Hoppe
- 1 July 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21613761,p. 497-501
Abstract
Computer programs are a specific type of knowledge artefacts that result from a creative process under strong formal restrictions. From an educational perspective, it has been argued that programming supports intellectual development and knowledge building. In this paper, we give a short overview of a system created to automatically detect the creativity of solutions to programming exercises that address general mathematical and algorithmic skills. A first step to make these artefacts susceptible to automatic analysis was the definition a descriptive feature set that captures both structural and procedural aspects of each solution. Secondly, machine learning techniques have been used to form higher-level metrics simulating expert judgments on a given set of solutions. It turned out that expert judgments of program creativity differ considerably and systematically. This also led to a classification of the experts.Keywords
This publication has 16 references indexed in Scilit:
- How creative is your writing? A linguistic creativity measure from computer science and cognitive psychology perspectives2009
- Reliability in Content Analysis.Human Communication Research, 2004
- Construction of a Systemic Quality Model for Evaluating a Software ProductSoftware Quality Journal, 2003
- Improvements to the SMO algorithm for SVM regressionIEEE Transactions on Neural Networks, 2000
- Creativity and artificial intelligenceArtificial Intelligence, 1998
- Using Model Trees for ClassificationMachine Learning, 1998
- Measurement of creativity of IS products1992
- Optimization of magnetization transfer measurements: Statistical analysis by stochastic simulation. Application to creatine kinase kineticsMagnetic Resonance in Medicine, 1990
- Model Selection and Akaike's Information Criterion (AIC): The General Theory and its Analytical ExtensionsPsychometrika, 1987
- The person, the product, and the response: conceptual problems in the assessment of creativity1Journal of Personality, 1965