Dual Coding or Cognitive Load? Exploring the Effect of Multimodal Input on English as a Foreign Language Learners’ Vocabulary Learning
Authors:
Open Access
- 11 March 2022
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Psychology
- Vol. 13, 834706
Abstract
In the era of eLearning 4.0, many researchers have suggested that multimodal input helps to enhance second language (L2) vocabulary learning. However, previous studies on the effects of multimodal teaching have failed to yield definitive conclusions. Furthermore, only few studies on the multimodal input of vocabulary learning have aimed at junior high school students and have focused on explicit vocabulary instruction in class. To explore the effects of multimodal input on English as a foreign language (EFL) learners’ vocabulary learning and summarize effective methods, this study adopts a mixed-method approach. Based on dual coding theory and cognitive load theory, the teaching materials in this study were designed using the resources provided by the multimodal corpus iWeb and other websites. A total of 60 junior high school students who learned EFL and had a similar English proficiency level were divided into an experimental group (EG) and a control group (CG). Target words were selected through questionnaire I. During the experiment, the CG learned from monomodal materials while the EG received multimodal input, and an immediate post-test was delivered to the two groups. Questionnaire II was distributed in the EG, and five students of the EG were randomly selected for an interview. One week later, a delayed post-test was conducted on the EG and CG. The results showed that the EG performed better in the post-test but did worse than the CG in the delayed post-test. The results of the questionnaire and the interview suggest that students held both positive and negative attitudes toward the multimodal input approach in vocabulary learning. The study concludes with some implications for choosing a multimodal input approach in vocabulary learning, along with a number of suggestions on how to optimize its positive influence and minimize its negative effects.Keywords
This publication has 39 references indexed in Scilit:
- The Effects of Hypertext Gloss on Comprehension and Vocabulary Retention under Incidental and Intentional Learning ConditionsEnglish Language Teaching, 2012
- The effectiveness of multimedia programmes in children's vocabulary learningBritish Journal of Educational Technology, 2008
- Perceived Processing Strategies of Students Watching Captioned VideoForeign Language Annals, 2005
- Second Language Vocabulary Acquisition: A Lexical Input Processing ApproachForeign Language Annals, 2004
- Cognitive load in reading a foreign language text with multimedia aids and the influence of verbal and spatial abilitiesComputers in Human Behavior, 2003
- Computers and L2 Reading: Student Performance, Student Attitudes1Foreign Language Annals, 1997
- Facilitating reading comprehension with multimediaSystem, 1996
- Effects of Multimedia Annotations on Vocabulary AcquisitionThe Modern Language Journal, 1996
- For whom is a picture worth a thousand words? Extensions of a dual-coding theory of multimedia learning.Journal of Educational Psychology, 1994
- We Acquire Vocabulary and Spelling by Reading: Additional Evidence for the Input HypothesisThe Modern Language Journal, 1989