Real-Time Augmented Reality Visual-Captions for Deaf and Hard-of-Hearing Children in Classrooms
Author:
- 1 March 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 641-642
Abstract
Deaf and hard-of-hearing (DHH) children experience difficulties in mainstream classrooms since they cannot access audio information effectively. Although tools like captions are developed specifically to assist DHH individuals, primary school children have trouble to read or understand the text. To address this challenge, this paper develops an AR-based visual-captions, which will transfer the speech to text and images in real-time and display the information around the teacher in classrooms. The AR visual-captions aims to help DHH children better receive information and enhance their classroom experience. We describe the concept, design and implementation of our prototype, and discuss future research directions.Keywords
This publication has 8 references indexed in Scilit:
- RealityTalk: Real-Time Speech-Driven Augmented Presentation for AR Live Storytelling2022
- Avatar Interpreter: Improving Classroom Experiences for Deaf and Hard-of-Hearing People Based on Augmented Reality2022
- Smart Captions: A Novel Solution for Closed Captioning in Theatre Settings with AR Glasses2021
- Towards Accessible Conversations in a Mobile Context for People who are Deaf and Hard of Hearing2018
- Exploring Augmented Reality Approaches to Real-Time Captioning2018
- SpeechBubbles2018
- Designing “Najeeb”: Technology-Enhanced Learning For Children With Impaired Hearing Using Arabic Sign-Language ArSL Applications2017
- Classroom Interpreting and Visual Information Processing in Mainstream Education for Deaf Students: Live or Memorex ® ?American Educational Research Journal, 2005