Smart Captions: A Novel Solution for Closed Captioning in Theatre Settings with AR Glasses

Authors:

Abstract
There is a significant population of people who suffer from hearing impairments and rely on open captioning to know the dialogues among the actors during an on-stage show in theatres. However, existing open captioning solutions always project the captions on a large screen in the theatre which can be viewed by both the people with hearing problems and other people with functional hearing capabilities. This will impact the aesthetic experience for those people with functional hearing capabilities. Leveraging on the power of Augmented Reality (AR), we developed Smart Captions, a network-based novel solution for closed captioning in theatre settings. The solution allows the theatre staff to easily and flexibly configure and to control the captions for a target show in a theatre and the caption content will be transmitted through network and displayed on the AR smart glasses worn by the audience with hearing impairments. In this way, only the audience with hearing impairments will be able to view the captions while the audience with functional hearing capabilities will not be impacted. Our Smart Captions solution is successfully implemented on distributed system architecture thus allowing multiple audience to view the on-stage show at the same time. The solution has been successfully tested and deployed at the industry partner of the research work.

This publication has 7 references indexed in Scilit: