Evaluation of Language Feedback Methods for Student Videos of American Sign Language
Open Access
- 4 April 2017
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Accessible Computing
- Vol. 10 (1) , 1-30
Abstract
This research investigates how to best present video-based feedback information to students learning American Sign Language (ASL); these results are relevant not only for the design of a software tool for providing automatic feedback to students but also in the context of how ASL instructors could convey feedback on students’ submitted work. It is known that deaf children benefit from early exposure to language, and higher levels of written language literacy have been measured in deaf adults who were raised in homes using ASL. In addition, prior work has established that new parents of deaf children benefit from technologies to support learning ASL. As part of a long-term project to design a tool to automatically analyze a video of a students’ signing and provide immediate feedback about fluent and non-fluent aspects of their movements, we conducted a study to compare multiple methods of conveying feedback to ASL students, using videos of their signing. Through two user studies, with a Wizard-of-Oz design, we compared multiple types of feedback in regard to users’ subjective judgments of system quality and the degree students’ signing improved (as judged by an ASL instructor who analyzed recordings of students’ signing before and after they viewed each type of feedback). The initial study revealed that displaying videos to students of their signing, augmented with feedback messages about their errors or correct ASL usage, yielded higher subjective scores and greater signing improvement. Students gave higher subjective scores to a version in which time-synchronized pop-up messages appeared overlaid on the student's video to indicate errors or correct ASL usage. In a subsequent study, we found that providing images of correct ASL face and hand movements when providing feedback yielded even higher subjective evaluation scores from ASL students using the system.Keywords
Funding Information
- National Science Foundation (1400802, 1400810 and 1462280)
This publication has 16 references indexed in Scilit:
- Collecting and evaluating the CUNY ASL corpus for research on American Sign Language animationComputer Speech & Language, 2014
- Sign Language Recognition2011
- How Many People Use ASL in the United States? Why Estimates Need UpdatingSign Language Studies, 2006
- When learners surpass their models: The acquisition of American Sign Language from inconsistent inputCognitive Psychology, 2004
- Chasing the Mythical Ten Percent: Parental Hearing Status of Deaf and Hard of Hearing Students in the United StatesSign Language Studies, 2004
- Beginning L2 production errors in ASL lexical phonology2004
- How Do Profoundly Deaf Children Learn to Read?Learning Disabilities Research & Practice, 2001
- The Use of ASL to Support the Development of English and LiteracyJournal of Deaf Studies and Deaf Education, 2000
- A Study of the Relationship Between American Sign Language and English LiteracyJournal of Deaf Studies and Deaf Education, 1997
- The long-lasting advantage of learning sign language in childhood: Another look at the critical period for language acquisitionJournal of Memory and Language, 1991