Roomify: Spatially-Grounded Style Transformation for Immersive Virtual Environments
Open Access
- 13 April 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-24
Abstract
We present Roomify, a spatially-grounded transformation system that generates themed virtual environments anchored to users’ physical rooms while maintaining spatial structure and functional semantics. Current VR approaches face a fundamental trade-off: full immersion sacrifices spatial awareness, while passthrough solutions break presence. Roomify addresses this through spatially-grounded transformation—treating physical spaces as “spatial containers” that preserve key functional and geometric properties of furniture while enabling radical stylistic changes. Our pipeline combines in-situ 3D scene understanding, AI-driven spatial reasoning, and style-aware generation to create personalized virtual environments grounded in physical reality. We introduce a cross-reality authoring tool enabling fine-grained user control through MR editing and VR preview workflows. Two user studies validate our approach: one with 18 VR users demonstrates a 63% improvement in presence over passthrough and 26% over fully virtual baselines while maintaining spatial awareness; another with 8 design professionals confirms the system’s creative expressiveness (scene quality: 5.95/7; creativity support: 6.08/7) and professional workflow value across diverse environments.Keywords
All Related Versions
This publication has 69 references indexed in Scilit:
- Scene semantics affects allocentric spatial coding for action in naturalistic (virtual) environmentsScientific Reports, 2024
- Synchronous mixed reality (SMR): A personalized virtual‐real fusion framework with high immersion and effective interactionJournal of the Society for Information Display, 2023
- Magic3D: High-Resolution Text-to-3D Content Creation2023
- Influences of virtual reality on design creativity and design thinkingThinking Skills and Creativity, 2022
- StyleMesh: Style Transfer for Indoor 3D Scene Reconstructions2022
- StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning2022
- HoloDesigner: A mixed reality tool for on-site designAutomation in Construction, 2021
- SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequences2021
- Scene grammar shapes the way we interact with objects, strengthens memories, and speeds searchScientific Reports, 2017
- ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes2017