An Expanded Perspective on Physical-Virtual Interaction in Window-Based Interfaces
- 29 September 2026
- conference paper
- Published by Sociedade Brasileira de Computação
- p. 159-162
Abstract
We present a browser-based solution that combines facial tracking using a webcam and off-axis perspective projection (asymmetric frustum) to align the rendering of a virtual environment through a physical window with the observer's eyes position and orientation. Utilizing MediaPipe facial landmark detection and a Three.js/A-Frame-based pipeline, the system calculates an asymmetric projection matrix in real time, providing a perceptually convincing parallax. Preliminary results demonstrate stable perspective correction, accompanied by an additional computational cost of 18.4% in memory and 46.8% in CPU usage, indicating a viable, hardware-independent approach for depth and motion parallax effects in Web VR interfaces.This publication has 4 references indexed in Scilit: