Multimodal reading and second language learning
- 1 February 2022
- journal article
- research article
- Published by John Benjamins Publishing Company in ITL - International Journal of Applied Linguistics
- Vol. 173 (1) , 2-17
Abstract
Most of the texts that second language learners engage with include both text (written and/or spoken) and images. The use of images accompanying texts is believed to support reading comprehension and facilitate learning. Despite their widespread use, very little is known about how the presentation of multiple input sources affects the attentional demands and the underlying cognitive processes involved. This paper provides a review of research on multimodal reading, with a focus on attentional processing. It first introduces the relevant theoretical frameworks and empirical evidence provided in support of the use of pictures in reading. It then reviews studies that have looked at the processing of text and pictures in first and second language contexts. Based on this review, main gaps in research and future research directions are identified. The discussion provided in this paper aims at advancing research on multimodal reading in a second language. Achieving a better understanding of the underlying cognitive processes in multimodal reading is crucial to inform pedagogical practices and to develop theoretical accounts of second language multimodal reading.Keywords
This publication has 55 references indexed in Scilit:
- AN EYE FOR WORDSStudies in Second Language Acquisition, 2013
- Graded readersELT Journal, 2012
- Writing in Multimodal TextsWritten Communication, 2008
- Areas of research that influence L2 reading instruction2006
- What Children Are Looking at During Shared Storybook ReadingPsychological Science, 2005
- Pre‐schoolers, print and storybooks: an observational study using eye movement analysisJournal of Research in Reading, 2005
- The effect of visual imagery training on the reading and listening comprehension of low listening comprehenders in Year 2Journal of Research in Reading, 1999
- Multimedia-Supported Metaphors for Meaning Making in MathematicsCognition and Instruction, 1999
- Dual coding theory and educationEducational Psychology Review, 1991
- Pictures and Second Language Comprehension: Do They Help?Foreign Language Annals, 1979