On the design and validation of a rubric for the evaluation of performance in a musical contest
Authors:
- Marcos Álvarez-DíazMÁMarcos Álvarez-Díaz
- Luis Magín Muñiz-BascónLMLuis Magín Muñiz-Bascón
- Antonio Soria-AlemanyASAntonio Soria-Alemany
- Rubén Fernández-AlonsoRFRubén Fernández-Alonso
- 26 June 2020
- journal article
- research article
- Published by SAGE Publications in International Journal of Music Education
- Vol. 39 (1) , 66-79
Abstract
Evaluation of music performance in competitive contexts often produces discrepancies between the expert judges. These discrepancies can be reduced by using appropriate rubrics that minimise the differences between judges. The objective of this study was the design and validation of an analytical evaluation rubric, which would allow the most objective evaluation possible of a musical solo performance in a regulated official competition. A panel of three experts created an analytical rubric made up of five review criteria and three scoring levels, together with their respective indicators. To validate the rubric, two independent panels of judges used it to score a sample of recordings. An examination was made of the dimensionality, sources of error, inter-rater reliability and internal consistency of the scores coming from the experts. The essential unidimensionality of the rubric was confirmed. No differential effects between raters were found, nor were significant differences seen in each rater’s internal consistency. The use of a rubric as tool for evaluating music performance in a competitive context has positive effects, improving reliability and objectivity of the results, both in terms of intra-rater consistency and agreement between raters.Keywords
Funding Information
- Fundación Universidad de Oviedo
This publication has 43 references indexed in Scilit:
- When the Eye Listens: A Meta-analysis of How Audio-visual Presentation Enhances the Appreciation of Music PerformanceMusic Perception: An Interdisciplinary Journal, 2012
- Evaluating Evaluation: Musical Performance Assessment as a Research ToolMusic Perception: An Interdisciplinary Journal, 2003
- Development and Validation of a String Performance Rating ScaleJournal of Research in Music Education, 2002
- Relationships among Faculty, Peer, and Self-Evaluations of Applied PerformancesJournal of Research in Music Education, 1997
- Criteria-Specific Rating Scales in the Evaluation of High School Instrumental PerformanceJournal of Research in Music Education, 1997
- Audiation-Based Improvisation Techniques and Elementary Instrumental Students' Music AchievementJournal of Research in Music Education, 1993
- Assessing Musical Performance MusicallyEducational Studies, 1991
- Relationship of Selected Factors in Trumpet Performance Adjudication ReliabilityJournal of Research in Music Education, 1977
- A Facet-Factorial Approach to Rating High School Choral Music PerformanceJournal of Research in Music Education, 1977
- Judge-Group Differences in the Rating of Secondary School Trumpet PerformancesJournal of Research in Music Education, 1975