Algorithm Visualization and the Elusive Modality Effect
Open Access
- 16 August 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- Vol. 35, 368-378
Abstract
The modality effect in multimedia learning suggests that pictures are best accompanied by audio explanations rather than text, but this finding has not been replicated in computing education. We investigate which instructional modality works best as an accompaniment for algorithm visualizations. In a randomized controlled trial, learners were split into three conditions who viewed an instructional video on Dijkstra’s algorithm, with diagrams accompanied by audio, text, or both. We find neither a modality effect in favor of the audio condition nor a verbal redundancy effect in favor of using only a single modality rather than both. Taken together with earlier research, our findings suggest that the modality effect is difficult to apply reliably and computing educators should not rush to integrate audio into visualizations in expectation of the effect. We discuss theoretical viewpoints that future research should attend to; these include alternative part-explanations of the modality effect and attention-based models of working memory, among others.Keywords
This publication has 47 references indexed in Scilit:
- Algorithm VisualizationACM Transactions on Computing Education, 2010
- Evidence for Modality-Independent Order Coding in Working MemoryQuarterly Journal of Experimental Psychology, 2009
- Observations on student misconceptions—A case study of the Build – Heap AlgorithmComputer Science Education, 2006
- Algorithm simulation with automatic assessmentACM SIGCSE Bulletin, 2000
- Managing split-attention and redundancy in multimedia instructionApplied Cognitive Psychology, 1999
- Integrating textual and pictorial information via pop-up windows: An experimental studyBehaviour & Information Technology, 1998
- Intonation and auditory grouping in immediate serial recallApplied Cognitive Psychology, 1995
- Working MemoryScience, 1992
- Dual coding theory and educationEducational Psychology Review, 1991
- A note on two problems in connexion with graphsNumerische Mathematik, 1959