Abstract
Scene synthesis has gained significant attention recently, and interactive scene synthesis focuses on yielding scenes according to user preferences. Existing literature either generates floor plans or scenes according to the floor plans. The system proposed in this paper generates scenes over floor plans in real-time. Given an initial scene, the only interaction a user needs is changing the room shapes. Our framework splits/merges rooms and adds/rearranges/removes objects for each transient moment during interactions. A systematic pipeline achieves our framework by compressing objects' arrangements over modified room shapes in a transient moment, thus enabling real-time performances. We also propose elastic boxes that indicate how objects should be arranged according to their continuously changed contexts, such as room shapes and other objects. Through a few interactions, a floor plan filled with object layouts is generated concerning user preferences on floor plans and object layouts according to floor plans. Experiments show that our framework is efficient at user interactions and plausible for synthesizing 3D scenes.
Funding Information
  • Tsinghua-Tencent Joint Laboratory for Internet Innovation Technology
  • Postdoctoral Fellowship Program of CPSF (GZB20230353)
  • Tsinghua University Student Research Training (2421T0278, 2421T0277, 2411T0372, 2411T0371)
  • National Natural Science Foundation of China (62132012, 62361146854)
  • National Key Research and Development Program of China (2023YFF0905104)
  • Shuimu Tsinghua Scholar Program (2023SM061)
  • Young Elite Scientists Sponsorship Program by BAST (BYESS2024242)
  • China Postdoctoral Science Foundation (2024M751696)

This publication has 20 references indexed in Scilit: