Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective
Authors:
- Danielle BraggDBDanielle Bragg
- Oscar KollerOKOscar Koller
- Larwan BerkeLBLarwan Berke
- Patrick BoudrealtPBPatrick Boudrealt
- Annelies BraffortABAnnelies Braffort
- Naomi CaselliNCNaomi Caselli
- Matt HuenerfauthMHMatt Huenerfauth
- Hernisa KacorriHKHernisa Kacorri
- Tessa VerhoefTVTessa Verhoef
- Christian VoglerCVChristian Vogler
- Meredith Ringel MorrisMMMeredith Ringel Morris
Preprint
Abstract
Developing successful sign language recognition, generation, and translation systems requires expertise in a wide range of fields, including computer vision, computer graphics, natural language processing, human-computer interaction, linguistics, and Deaf culture. Despite the need for deep interdisciplinary knowledge, existing research occurs in separate disciplinary silos, and tackles separate portions of the sign language processing pipeline. This leads to three key questions: 1) What does an interdisciplinary view of the current landscape reveal? 2) What are the biggest challenges facing the field? and 3) What are the calls to action for people working in the field? To help answer these questions, we brought together a diverse group of experts for a two-day workshop. This paper presents the results of that interdisciplinary workshop, providing key background that is often overlooked by computer scientists, a review of the state-of-the-art, a set of pressing challenges, and a call to action for the research community.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Deep Sign: Enabling Robust Statistical Continuous Sign Language Recognition via Hybrid CNN-HMMsInternational Journal of Computer Vision, 2018
- Sign Language Recognition Using Sub-units2017
- KAZOO: a sign language generation platform based on production rulesUniversal Access in the Information Society, 2015
- Transcription and Notation Methods2015
- American Sign Language word recognition with a sensory glove using artificial neural networksEngineering Applications of Artificial Intelligence, 2011
- Cybersign and new proximities: Impacts of new communication technologies on space and languageJournal of Pragmatics, 2008
- Educational resources and implementation of a Greek sign language synthesis architectureComputers & Education, 2007
- Trilled movement: Phonetic realization and formal representationLingua, 1996
- Image processing system for interpreting motion in American Sign LanguageJournal of Biomedical Engineering, 1992
- Recognition of sign language motion imagesPattern Recognition, 1988