Real-Time Screen-Camera Communication Behind Any Scene
Authors:
Open Access
- 18 May 2015
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 197-211
Abstract
We present HiLight, a new form of real-time screen-camera communication without showing any coded images (e.g., barcodes) for off-the-shelf smart devices. HiLight encodes data into pixel translucency change atop any screen content, so that camera-equipped devices can fetch the data by turning their cameras to the screen. HiLight leverages the alpha channel, a well-known concept in computer graphics, to encode bits into the pixel translucency change. By removing the need to directly modify pixel RGB values, HiLight overcomes the key bottleneck of existing designs and enables real-time unobtrusive communication while supporting any screen content. We build a HiLight prototype using off-the-shelf smart devices and demonstrate its efficacy and robustness in practical settings. By offering an unobtrusive, flexible, and lightweight communication channel between screens and cameras, HiLight opens up opportunities for new HCI and context-aware applications, e.g., smart glasses communicating with screens to realize augmented reality.Keywords
Funding Information
- National Science Foundation (CNS-1421528)
- Dartmouth College (Dartmouth Burke Research Initiation Award)
This publication has 30 references indexed in Scilit:
- SENSeTREAM2014
- FOCUS2013
- A multi-directional backlight for a wide-angle, glasses-free three-dimensional displayNature, 2013
- "Yours is better!"2012
- Effects of flicker characteristics from solid-state lighting on detection, acceptability and comfortLighting Research & Technology, 2011
- Evaluation of global image thresholding for change detectionPattern Recognition Letters, 2003
- A robust scene-change detection method for video segmentationIEEE Transactions on Circuits and Systems for Video Technology, 2001
- Toward specification-driven change detectionIEEE Transactions on Geoscience and Remote Sensing, 2000
- Automatic partitioning of full-motion videoMultimedia Systems, 1993
- Compositing digital imagesACM SIGGRAPH Computer Graphics, 1984