Co-Creation for Sign Language Processing and Translation Technology
Open Access
- 4 April 2025
- journal article
- research article
- Published by MDPI AG in Information
- Vol. 16 (4) , 290
Abstract
Sign language machine translation (SLMT)—the task of automatically translating between sign and spoken languages or between sign languages—is a complex task within the field of NLP. Its multi-modal and non-linear nature require the joint efforts of sign language (SL) linguists, technical experts, and SL users. Effective user involvement is a challenge that can be addressed through co-creation. Co-creation has been formally defined in many fields, e.g., business, marketing, educational, and others; however, in NLP and in particular in SLMT, there is no formal, widely accepted definition. Starting from the inception and evolution of co-creation across various fields over time, we develop a relationship typology to address the collaboration between deaf, hard of hearing, and hearing researchers and the co-creation with SL users. We compare this new typology to the guiding principles of participatory design for NLP. We then assess 111 articles from the perspective of involvement of SL users and highlight the lack of involvement of the sign language community or users in decision-making processes required for effective co-creation. Finally, we derive formal guidelines for co-creation for SLMT which take the dynamic nature of co-creation throughout the life cycle of a research project into account.Keywords
All Related Versions
Funding Information
- Starter Grant according to the Administrative Agreement signed by the Minister of OC&W, the Netherlands Association of Universities of Applied Sciences, and the Association of Universities of the Netherlands
This publication has 34 references indexed in Scilit:
- Challenging the “norm”: a critical look at deaf-hearing comparison studies in researchJournal of Deaf Studies and Deaf Education, 2024
- Correction to: Machine translation from signed to spoken languages: state of the art and challengesUniversal Access in the Information Society, 2024
- A survey on Sign Language machine translationExpert Systems with Applications, 2022
- A Systematic Review of Co-Creation and Co-Production: Embarking on the social innovation journeyPublic Management Review, 2014
- Methodology for developing an advanced communications system for the Deaf in a new domainKnowledge-Based Systems, 2014
- Manual labour: tackling machine translation for sign languagesMachine Translation, 2013
- Deep Natural Language Processing for Italian Sign Language Translation2013
- Automatic Translation System to Spanish Sign Language with a Virtual Interpreter2009
- Co-creation experiences: The next practice in value creationJournal of Interactive Marketing, 2004
- Pattern Recognition and Synthesis for a Sign Language Translation SystemJournal of Visual Languages & Computing, 1996