Human-aware Design Generation: Adding 3D Humans into Graphic Designs
Open Access
- 9 November 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 3113-3122
Abstract
Graphic designs nowadays predominantly contain human images, where people are posed and framed in a delicate way to guide viewers' visual exploration and evoke desired feelings. Despite recent progress in automatic graphic design generation, there has been no work on investigating the role of the human representations in design creation. In this paper, we seek to emphasize the importance of visual human representations in graphic design generation, by studying a novel task, dubbed as design-conditioned 3D human adding. To solve this task, we propose a model that adds 3D human representations into an existing partial design, by predicting their 3D poses, their 2D composition in the image containing them, as well as the spatial arrangement of the image in the input design, to generate a complete design.Our experiments show that our model outperforms baselines by predicting the 3D human poses, 2D framing and human image layout that better harmonize with the other existing design elements, and generating higher-quality holistic designs. Our work is the first to explore connections between 3D human generation and 2D graphic design generation, which would inspire future research in leveraging 3D information to build more powerful generative models for graphic designs in the 2D domain.Keywords
This publication has 20 references indexed in Scilit:
- PosterLlama: Bridging Design Ability of Language Model to Content-Aware Layout Generation2024
- Scaling Up Dynamic Human-Scene Interaction Modeling2024
- Visual Layout Composer: Image-Vector Dual Diffusion Model for Design Layout Generation2024
- NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesis2024
- ChatPose: Chatting about 3D Human Pose2024
- TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representation2024
- One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformer2023
- Towards Flexible Multi-modal Document Models2023
- BLT: Bidirectional Layout Transformer for Controllable Layout Generation2022
- Expressive Body Capture: 3D Hands, Face, and Body From a Single Image2019