Smart Captions: A Novel Solution for Closed Captioning in Theatre Settings with AR Glasses
Authors:
- 11 December 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
There is a significant population of people who suffer from hearing impairments and rely on open captioning to know the dialogues among the actors during an on-stage show in theatres. However, existing open captioning solutions always project the captions on a large screen in the theatre which can be viewed by both the people with hearing problems and other people with functional hearing capabilities. This will impact the aesthetic experience for those people with functional hearing capabilities. Leveraging on the power of Augmented Reality (AR), we developed Smart Captions, a network-based novel solution for closed captioning in theatre settings. The solution allows the theatre staff to easily and flexibly configure and to control the captions for a target show in a theatre and the caption content will be transmitted through network and displayed on the AR smart glasses worn by the audience with hearing impairments. In this way, only the audience with hearing impairments will be able to view the captions while the audience with functional hearing capabilities will not be impacted. Our Smart Captions solution is successfully implemented on distributed system architecture thus allowing multiple audience to view the on-stage show at the same time. The solution has been successfully tested and deployed at the industry partner of the research work.Keywords
This publication has 7 references indexed in Scilit:
- HoloSound: Combining Speech and Sound Identification for Deaf or Hard of Hearing Users on a Head-mounted Display2020
- Collaborative SLAM and AR-guided navigation for floor layout inspectionThe Visual Computer, 2020
- Position-based augmented reality platform for aiding construction and inspection of offshore plantsThe Visual Computer, 2020
- Towards a Switchable AR/VR Near-eye Display with Accommodation-Vergence and Eyeglass Prescription SupportIEEE Transactions on Visualization and Computer Graphics, 2019
- Exploring Augmented Reality Approaches to Real-Time Captioning2018
- Single Frequency-Based Device-to-Device-Enhanced Video Delivery for Evolved Multimedia Broadcast and Multicast ServicesIEEE Transactions on Broadcasting, 2015
- Augmented reality supporting user-centric building information managementThe Visual Computer, 2013