Shao-Kui Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Shao-Kui Zhang has a total of 38 co-authors. Here are the top co-authors by number of shared publications:
- Song-Hai Zhang
Tsinghua University, Beijing, China
13 shared publications - Jia-Hong Liu
Department of Computer Science and Technology, Tsinghua University, Beijing, China
5 shared publications - Yong-Liang Yang
University of Bath
4 shared publications - Hanxi Zhu
Tsinghua University, Beijing, China
3 shared publications - Hongbo Fu
Hong Kong University of Science and Technology, Hong Kong, Hong Kong
3 shared publications - Hou Tam
Department of Computer Science and Technology, Tsinghua University, Beijing, China
3 shared publications
Latest Publications
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 16209-16218
InteriorGPT: Autoregressive Interior Scene Generation via Next-Scale Prediction
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 16209-16218
Open AccessInteriorGPT: Autoregressive Interior Scene Generation via Next-Scale Prediction
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 6340-6349
ScapePhotographer: Efficient View Selection for High-Quality Photography in Unlabeled 3D Landscape Scenes
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 6340-6349
Open AccessScapePhotographer: Efficient View Selection for High-Quality Photography in Unlabeled 3D Landscape Scenes
- 19 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (2) , 2326-2339
SceneCluster: Interactive Scene Synthesis by Clustering Groups of Furniture Objects
Scene synthesis is crucial to computer graphics. However, the current interactive scene synthesis methods usually cost the user too much time and interactions to edit objects. This paper presents a new interactive scene synthesis method that alleviates the designer from interacting with the 3D scene and its objects. Designers only need to select an object group in an independent panel through coarse clustering and fine clustering. Then, the furniture objects will be automatically added to the scene. This paper proposes a two-level clustering that applies the Affinity Propagation Algorithm (APA) to groups of furniture objects such that the object groups can even be clustered without linear representations, latent encoding, etc. To fully apply the APA, we also propose quantitatively measuring how different the two layouts are, i.e., how quantitatively the arrangements of two object groups differ. Experiments first show that our method is more user-friendly and interactively efficient than other interactive synthesis methods. By comparing our method with recent automatic scene synthesis methods, we demonstrate that our methods still have competitive plausibility. We also verify that our method does not harm the diversity and generalization of 3D scenes.
- 19 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (2) , 2326-2339
SceneCluster: Interactive Scene Synthesis by Clustering Groups of Furniture Objects
Scene synthesis is crucial to computer graphics. However, the current interactive scene synthesis methods usually cost the user too much time and interactions to edit objects. This paper presents a new interactive scene synthesis method that alleviates the designer from interacting with the 3D scene and its objects. Designers only need to select an object group in an independent panel through coarse clustering and fine clustering. Then, the furniture objects will be automatically added to the scene. This paper proposes a two-level clustering that applies the Affinity Propagation Algorithm (APA) to groups of furniture objects such that the object groups can even be clustered without linear representations, latent encoding, etc. To fully apply the APA, we also propose quantitatively measuring how different the two layouts are, i.e., how quantitatively the arrangements of two object groups differ. Experiments first show that our method is more user-friendly and interactively efficient than other interactive synthesis methods. By comparing our method with recent automatic scene synthesis methods, we demonstrate that our methods still have competitive plausibility. We also verify that our method does not harm the diversity and generalization of 3D scenes.
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 9385-9394
Synthesizing 3D Scenes via Diffusion Model that Incorporates Indoor Scene Characteristics
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 9385-9394
Open AccessSynthesizing 3D Scenes via Diffusion Model that Incorporates Indoor Scene Characteristics
- 30 October 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (9) , 6008-6021
SceneExplorer: An Interactive System for Expanding, Scheduling, and Organizing Transformable Layouts
Nowadays, 3D scenes are not merely static arrangements of objects. With the development of transformable modules, furniture objects can be translated, rotated, and even reshaped to achieve scenes with different functions (e.g., from a bedroom to a living room). Transformable domestic space, therefore, studies how a layout can change its function by reshaping and rearranging transformable modules, resulting in various transformable layouts. In practice, a rearrangement is dynamically conducted by reshaping/translating/rotating furniture objects with proper schedules, which can consume more time for designers than static scene design. Due to changes in objects’ functions, potential transformable layouts may also be extensive, making it hard to explore desired layouts. We present a system for exploring transformable layouts. Given a single input scene consisting of transformable modules, our system first attempts to derive more layouts by reshaping and rearranging the modules. The derived scenes are organized into a graph-like hierarchy according to their functions, where edges represent functional evolutions (e.g., a living room can be reshaped to a bedroom), and nodes represent layouts that are dynamically transformable through translating/rotating/reshaping modules. The resulting hierarchy lets scene designers interactively explore possible scene variants and preview the animated rearrangement process. Experiments show that our system is efficient for generating transformable layouts, sensible for organizing functional hierarchies, and inspiring for providing ideas during interactions.
- 30 October 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (9) , 6008-6021
SceneExplorer: An Interactive System for Expanding, Scheduling, and Organizing Transformable Layouts
Nowadays, 3D scenes are not merely static arrangements of objects. With the development of transformable modules, furniture objects can be translated, rotated, and even reshaped to achieve scenes with different functions (e.g., from a bedroom to a living room). Transformable domestic space, therefore, studies how a layout can change its function by reshaping and rearranging transformable modules, resulting in various transformable layouts. In practice, a rearrangement is dynamically conducted by reshaping/translating/rotating furniture objects with proper schedules, which can consume more time for designers than static scene design. Due to changes in objects’ functions, potential transformable layouts may also be extensive, making it hard to explore desired layouts. We present a system for exploring transformable layouts. Given a single input scene consisting of transformable modules, our system first attempts to derive more layouts by reshaping and rearranging the modules. The derived scenes are organized into a graph-like hierarchy according to their functions, where edges represent functional evolutions (e.g., a living room can be reshaped to a bedroom), and nodes represent layouts that are dynamically transformable through translating/rotating/reshaping modules. The resulting hierarchy lets scene designers interactively explore possible scene variants and preview the animated rearrangement process. Experiments show that our system is efficient for generating transformable layouts, sensible for organizing functional hierarchies, and inspiring for providing ideas during interactions.
- Open Access
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 6232-6240
SceneExpander: Real-Time Scene Synthesis for Interactive Floor Plan Editing
Scene synthesis has gained significant attention recently, and interactive scene synthesis focuses on yielding scenes according to user preferences. Existing literature either generates floor plans or scenes according to the floor plans. The system proposed in this paper generates scenes over floor plans in real-time. Given an initial scene, the only interaction a user needs is changing the room shapes. Our framework splits/merges rooms and adds/rearranges/removes objects for each transient moment during interactions. A systematic pipeline achieves our framework by compressing objects' arrangements over modified room shapes in a transient moment, thus enabling real-time performances. We also propose elastic boxes that indicate how objects should be arranged according to their continuously changed contexts, such as room shapes and other objects. Through a few interactions, a floor plan filled with object layouts is generated concerning user preferences on floor plans and object layouts according to floor plans. Experiments show that our framework is efficient at user interactions and plausible for synthesizing 3D scenes.
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 6232-6240
Open AccessSceneExpander: Real-Time Scene Synthesis for Interactive Floor Plan Editing
Scene synthesis has gained significant attention recently, and interactive scene synthesis focuses on yielding scenes according to user preferences. Existing literature either generates floor plans or scenes according to the floor plans. The system proposed in this paper generates scenes over floor plans in real-time. Given an initial scene, the only interaction a user needs is changing the room shapes. Our framework splits/merges rooms and adds/rearranges/removes objects for each transient moment during interactions. A systematic pipeline achieves our framework by compressing objects' arrangements over modified room shapes in a transient moment, thus enabling real-time performances. We also propose elastic boxes that indicate how objects should be arranged according to their continuously changed contexts, such as room shapes and other objects. Through a few interactions, a floor plan filled with object layouts is generated concerning user preferences on floor plans and object layouts according to floor plans. Experiments show that our framework is efficient at user interactions and plausible for synthesizing 3D scenes.
- Open Access
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 7843-7851
ScenePhotographer: Object-Oriented Photography for Residential Scenes
Humans understand digital 3D scenes by observing them from reasonably placed virtual cameras. Selecting camera views is fundamental for 3D scene applications but is typically manual. Existing literature on selecting views is based on regular or polygonal room shapes without focusing on the objects in the scene, resulting in poorly composed views concerning objects. This paper introduces ScenePhotographer, an object-oriented framework for automatic view selection in residential scenes. Potential object-oriented views are yielded by a learning-based method, which clusters objects into groups according to objects' functional and spatial relationships. We propose four criteria to evaluate the views and recommend the best batch, including room information, visibility, composition balance, and line dynamics. Each criterion measures the view according to its corresponding photography rule. Experiments on various room types and layouts demonstrate that our method can generate views focusing on coherent objects while preserving aesthetics, leading to more visually pleasing results.
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 7843-7851
Open AccessScenePhotographer: Object-Oriented Photography for Residential Scenes
Humans understand digital 3D scenes by observing them from reasonably placed virtual cameras. Selecting camera views is fundamental for 3D scene applications but is typically manual. Existing literature on selecting views is based on regular or polygonal room shapes without focusing on the objects in the scene, resulting in poorly composed views concerning objects. This paper introduces ScenePhotographer, an object-oriented framework for automatic view selection in residential scenes. Potential object-oriented views are yielded by a learning-based method, which clusters objects into groups according to objects' functional and spatial relationships. We propose four criteria to evaluate the views and recommend the best batch, including room information, visibility, composition balance, and line dynamics. Each criterion measures the view according to its corresponding photography rule. Experiments on various room types and layouts demonstrate that our method can generate views focusing on coherent objects while preserving aesthetics, leading to more visually pleasing results.
- Open Access
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 6394-6403
Controllable Procedural Generation of Landscapes
Landscapes, recognized for their indispensable role in large-scale scenes, are experiencing growing demand. However, the manual modeling of such content is labor-intensive and lacks efficiency. Procedural Content Generation (PCG) techniques enable the rapid generation of diverse landscape elements. Nevertheless, ordinary users may encounter difficulties controlling these methods for desired results. In this paper, we introduce a controllable framework for procedurally generating landscapes. We integrate state-of-the-art Large Language Models (LLMs) to enhance user accessibility and control. By converting plain text inputs into parameters through LLMs, our framework allows ordinary users to generate a batch of plausible landscapes tailored to their specifications. A parameter-controlled PCG procedure is designed to leverage optimization techniques and employ rule-based refinements. It achieves harmonious layering in terrains, zoning, and roads while enabling aesthetic arrangement of vegetation and artificial elements. Extensive experiments demonstrate our framework's effectiveness in generating landscapes comparable to those crafted by experienced architects. Our framework has the potential to enhance the productivity of landscape designers significantly.
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 6394-6403
Open AccessControllable Procedural Generation of Landscapes
Landscapes, recognized for their indispensable role in large-scale scenes, are experiencing growing demand. However, the manual modeling of such content is labor-intensive and lacks efficiency. Procedural Content Generation (PCG) techniques enable the rapid generation of diverse landscape elements. Nevertheless, ordinary users may encounter difficulties controlling these methods for desired results. In this paper, we introduce a controllable framework for procedurally generating landscapes. We integrate state-of-the-art Large Language Models (LLMs) to enhance user accessibility and control. By converting plain text inputs into parameters through LLMs, our framework allows ordinary users to generate a batch of plausible landscapes tailored to their specifications. A parameter-controlled PCG procedure is designed to leverage optimization techniques and employ rule-based refinements. It achieves harmonious layering in terrains, zoning, and roads while enabling aesthetic arrangement of vegetation and artificial elements. Extensive experiments demonstrate our framework's effectiveness in generating landscapes comparable to those crafted by experienced architects. Our framework has the potential to enhance the productivity of landscape designers significantly.
- Open Access
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1137-1147
Automatic Generation of Commercial Scenes
Commercial scenes such as markets and shops are everyday scenes for both virtual scenes and real-world interior designs. However, existing literature on interior scene synthesis mainly focuses on formulating and optimizing residential scenes such as bedrooms, living rooms, etc. Existing literature typically presents a set of relations among objects. It recognizes each furniture object as the smallest unit while optimizing a residential room. However, object relations become less critical in commercial scenes since shelves are often placed next to each other so pre-calculated relations of objects are less needed. Instead, interior designers resort to evaluating how groups of objects perform in commercial scenes, i.e., the smallest unit to be evaluated is a group of objects. This paper presents a system automatically synthesizes market-like commercial scenes in virtual environments. Following the rules of commercial layout design, we parameterize groups of objects as "patterns" contributing to a scene. Each pattern directly yields a human-centric routine locally, provides potential connectivity with other routines, and derives the arrangements of objects concerning itself according to the assigned parameters. In order to optimize a scene, the patterns are iteratively multiplexed to insert new routines or modify existing ones under a set of constraints derived from commercial layout designs. Through extensive experiments, we demonstrate the ability of our framework to generate plausible and practical commercial scenes.
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1137-1147
Open AccessAutomatic Generation of Commercial Scenes
Commercial scenes such as markets and shops are everyday scenes for both virtual scenes and real-world interior designs. However, existing literature on interior scene synthesis mainly focuses on formulating and optimizing residential scenes such as bedrooms, living rooms, etc. Existing literature typically presents a set of relations among objects. It recognizes each furniture object as the smallest unit while optimizing a residential room. However, object relations become less critical in commercial scenes since shelves are often placed next to each other so pre-calculated relations of objects are less needed. Instead, interior designers resort to evaluating how groups of objects perform in commercial scenes, i.e., the smallest unit to be evaluated is a group of objects. This paper presents a system automatically synthesizes market-like commercial scenes in virtual environments. Following the rules of commercial layout design, we parameterize groups of objects as "patterns" contributing to a scene. Each pattern directly yields a human-centric routine locally, provides potential connectivity with other routines, and derives the arrangements of objects concerning itself according to the assigned parameters. In order to optimize a scene, the patterns are iteratively multiplexed to insert new routines or modify existing ones under a set of constraints derived from commercial layout designs. Through extensive experiments, we demonstrate the ability of our framework to generate plausible and practical commercial scenes.
- 21 April 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 30 (8) , 4558-4569
SceneDirector: Interactive Scene Synthesis by Simultaneously Editing Multiple Objects in Real-Time
Intelligent tools for creating synthetic scenes have been developed significantly in recent years. Existing techniques on interactive scene synthesis only incorporate a single object at every interaction, i.e., crafting a scene through a sequence of single-object insertions with user preferences. These techniques suggest objects by considering existent objects in the scene instead of fully picturing the eventual result, which is inherently problematic since the sets of objects to be inserted are seldom fixed during interactive processes. In this article, we introduce SceneDirector, a novel interactive scene synthesis tool to help users quickly picture various potential synthesis results by simultaneously editing groups of objects. Specifically, groups of objects are rearranged in real-time with respect to a position of an object specified by a mouse cursor or gesture, i.e., a movement of a single object would trigger the rearrangement of the existing object group, the insertions of potentially appropriate objects, and the removal of redundant objects. To achieve this, we first propose an idea of coherent group set which expresses various concepts of layout strategies. Subsequently, we present layout attributes, where users can adjust how objects are arranged by tuning the weights of the attributes. Thus, our method gives users intuitive control of both how to arrange groups of objects and where to place them. Through extensive experiments and two applications, we demonstrate the potentiality of our framework and how it enables concurrently effective and efficient interactions of editing groups of objects.
- 21 April 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 30 (8) , 4558-4569
SceneDirector: Interactive Scene Synthesis by Simultaneously Editing Multiple Objects in Real-Time
Intelligent tools for creating synthetic scenes have been developed significantly in recent years. Existing techniques on interactive scene synthesis only incorporate a single object at every interaction, i.e., crafting a scene through a sequence of single-object insertions with user preferences. These techniques suggest objects by considering existent objects in the scene instead of fully picturing the eventual result, which is inherently problematic since the sets of objects to be inserted are seldom fixed during interactive processes. In this article, we introduce SceneDirector, a novel interactive scene synthesis tool to help users quickly picture various potential synthesis results by simultaneously editing groups of objects. Specifically, groups of objects are rearranged in real-time with respect to a position of an object specified by a mouse cursor or gesture, i.e., a movement of a single object would trigger the rearrangement of the existing object group, the insertions of potentially appropriate objects, and the removal of redundant objects. To achieve this, we first propose an idea of coherent group set which expresses various concepts of layout strategies. Subsequently, we present layout attributes, where users can adjust how objects are arranged by tuning the weights of the attributes. Thus, our method gives users intuitive control of both how to arrange groups of objects and where to place them. Through extensive experiments and two applications, we demonstrate the potentiality of our framework and how it enables concurrently effective and efficient interactions of editing groups of objects.