CXChufeng Xiao

Chufeng Xiao

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Chufeng Xiao has a total of 27 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    PhotoMaster: Learning Holistic Capture-Time Decisions for Guided Photography Reshooting

    by Zian Qian, Cheuk Him Chau, Siyue Xie, Chufeng Xiao, Qifeng Chen, Rui Liu, Chenyang Lei

    Capturing compelling photographs requires sequential capture-time decisions. However, existing guidance methods operate at the image level rather than modeling the decision process that diagnoses photographic dimensions (e.g., camera position, lighting) and resolves them into executable reshooting actions, offering limited actionable support for novices. We present PhotoMaster, a decision-driven multimodal framework for capture-time photography guidance. To model the decision-making process, we propose the Photography Decision Taxonomy (PDT) that defines photographic dimensions for diagnosing novice-captured photos and maps them to executable actions. To make this intuitive, PhotoMaster pairs these executable actions with a rendered visual target that previews the expected outcome. To learn this decision space, we introduce a two-fold data engine: Forward Decision Transfer distills professional photographers' decisions from masterworks to casual shots, while Decision Inversion applies inverse capture decisions via camera-controllable world models, collectively yielding over 230K PDT-annotated triplets. Evaluations demonstrate PhotoMaster's capability to produce expert-aligned diagnoses and highly preferred visual references, while a real-world user study confirms that novices achieve significantly better captures using our framework.

  • Top Cited Papers

    MoGraphGPT : Creating Interactive Scenes Using Modular LLM and Graphical Control

    by Hui Ye, Chufeng Xiao, Jiaye Leng, Pengfei Xu, Hongbo Fu

    Creating interactive scenes often involves complex programming tasks. Although large language models (LLMs) like ChatGPT can generate code from natural language, their output is often error-prone, particularly when scripting interactions among multiple elements. The linear conversational structure limits the editing of individual elements, and the lack of graphical and precise control complicates visual integration. To address these issues, we integrate a context-aware modularization technique that processes textual descriptions for individual elements through separate LLM modules, with a central module managing interactions among elements. It defines a top-down structure to manage interactions, ensuring clear update logic and facilitating efficient collaboration while allowing for independent updates for each element. We design a graphical user interface, MoGraphGPT, which combines modular LLMs with enhanced graphical control to generate codes for 2D interactive scenes. It enables direct integration of graphical information and offers quick, precise control through automatically generated sliders. A comparative study with Cursor Composer shows MoGraphGPT significantly improves easiness, controllability, and performance in creating 2D interactive scenes with multiple visual elements in a coding-free manner. An ablation study validates the effectiveness of modularization, and an open-ended study demonstrates the usability and expressiveness of MoGraphGPT.


  • Open Access

    CustomSketching: Sketch Concept Extraction for Sketch‐based Image Synthesis and Editing

    by Chufeng Xiao, Hongbo Fu

    Personalization techniques for large text‐to‐image (T2I) models allow users to incorporate new concepts from reference images. However, existing methods primarily rely on textual descriptions, leading to limited control over customized images and failing to support fine‐grained and local editing (e.g., shape, pose, and details). In this paper, we identify sketches as an intuitive and versatile representation that can facilitate such control, e.g., contour lines capturing shape information and flow lines representing texture. This motivates us to explore a novel task of sketch concept extraction: given one or more sketch‐image pairs, we aim to extract a special sketch concept that bridges the correspondence between the images and sketches, thus enabling sketch‐based image synthesis and editing at a fine‐grained level. To accomplish this, we introduce CustomSketching, a two‐stage framework for extracting novel sketch concepts via few‐shot learning. Considering that an object can often be depicted by a contour for general shapes and additional strokes for internal details, we introduce a dual‐sketch representation to reduce the inherent ambiguity in sketch depiction. We employ a shape loss and a regularization loss to balance fidelity and editability during optimization. Through extensive experiments, a user study, and several applications, we show our method is effective and superior to the adapted baselines.


  • Open Access

    CustomSketching: Sketch Concept Extraction for Sketch-based Image Synthesis and Editing

    by Chufeng Xiao, Hongbo Fu

    Personalization techniques for large text-to-image (T2I) models allow users to incorporate new concepts from reference images. However, existing methods primarily rely on textual descriptions, leading to limited control over customized images and failing to support fine-grained and local editing (e.g., shape, pose, and details). In this paper, we identify sketches as an intuitive and versatile representation that can facilitate such control, e.g., contour lines capturing shape information and flow lines representing texture. This motivates us to explore a novel task of sketch concept extraction: given one or more sketch-image pairs, we aim to extract a special sketch concept that bridges the correspondence between the images and sketches, thus enabling sketch-based image synthesis and editing at a fine-grained level. To accomplish this, we introduce CustomSketching, a two-stage framework for extracting novel sketch concepts. Considering that an object can often be depicted by a contour for general shapes and additional strokes for internal details, we introduce a dual-sketch representation to reduce the inherent ambiguity in sketch depiction. We employ a shape loss and a regularization loss to balance fidelity and editability during optimization. Through extensive experiments, a user study, and several applications, we show our method is effective and superior to the adapted baselines.

  • Sketch2Stress: Sketching With Structural Stress Awareness

    by Deng Yu, Chufeng Xiao, Manfred Lau, Hongbo Fu

    In the process of product design and digital fabrication, the structural analysis of a designed prototype is a fundamental and essential step. However, such a step is usually invisible or inaccessible to designers at the early sketching phase. This limits the user's ability to consider a shape's physical properties and structural soundness. To bridge this gap, we introduce a novel approach Sketch2Stress that allows users to perform structural analysis of desired objects at the sketching stage. This method takes as input a 2D freehand sketch and one or multiple locations of user-assigned external forces. With the specially-designed two-branch generative-adversarial framework, it automatically predicts a normal map and a corresponding structural stress map distributed over the user-sketched underlying object. In this way, our method empowers designers to easily examine the stress sustained everywhere and identify potential problematic regions of their sketched object. Furthermore, combined with the predicted normal map, users are able to conduct a region- wise structural analysis efficiently by aggregating the stress effects of multiple forces in the same direction. Finally, we demonstrate the effectiveness and practicality of our system with extensive experiments and user studies.


  • Open Access

    ProObjAR: Prototyping Spatially-aware Interactions of Smart Objects with AR-HMD

    by Hui Ye, Jiaye Leng, Chufeng Xiao, Lili Wang, Hongbo Fu

    The rapid advances in technologies have brought new interaction paradigms of smart objects (e.g., digital devices) beyond digital device screens. By utilizing spatial properties, configurations, and movements of smart objects, designing spatial interaction, which is one of the emerging interaction paradigms, efficiently promotes engagement with digital content and physical facility. However, as an important phase of design, prototyping such interactions still remains challenging, since there is no ad-hoc approach for this emerging paradigm. Designers usually rely on methods that require fixed hardware setup and advanced coding skills to script and validate early-stage concepts. These requirements restrict the design process to a limited group of users in indoor scenes. To facilitate the prototyping to general usages, we aim to figure out the design difficulties and underlying needs of current design processes for spatially-aware object interactions by empirical studies. Besides, we explore the design space of the spatial interaction for smart objects and discuss the design space in an input-output spatial interaction model. Based on these findings, we present ProObjAR, an all-in-one novel prototyping system with an Augmented Reality Head Mounted Display (AR-HMD). Our system allows designers to easily obtain the spatial data of smart objects being prototyped, specify spatially-aware interactive behaviors from an input-output event triggering workflow, and test the prototyping results in situ. From the user study, we find that ProObjAR simplifies the design procedure and increases design efficiency to a large extent and thus advancing the development of spatially-aware applications in smart ecosystems.


  • Blind Image Denoising via Dynamic Dual Learning

    by Yong Du, Guoqiang Han, Yinjie Tan, Chufeng Xiao, Shengfeng He

    Existing discriminative learning methods for image denoising use either a single residual learning or a nonresidual learning design. However, we observe that these two schemes perform differently with the same noise level, and yet, there have been no explorations regarding whether residual or nonresidual designs are better suited for denoising. Additionally, many discriminative denoisers are designed to learn a model that corresponds to a fixed noise level, which means that multiple models are required to recover corrupted images with noise at different levels. In this paper, we propose a dynamic dual learning network for blind image denoising, namely, DualBDNet. Instead of modeling a sole task prediction network, the proposed DualBDNet investigates the inherent relations between the residual estimation and the nonresidual estimation. In particular, DualBDNet produces task-dependent feature maps, and each part of the features is devoted to one specific task (residual/nonresidual mapping). To address different noise levels with a single network or even cases where the statistics of noise are unknown, we further introduce an embedded subnetwork into DualBDNet. One output of the subnetwork is the learning of a dynamic compositional attention to highlight the more significant task-dependent feature maps, adaptively coinciding with the extent of corruption. The other output is the learning of a weight used for fusion of the results to ensure an end-to-end manner. Extensive experiments demonstrate that the proposed DualBDNet outperforms the state-of-the-art methods on both synthetic and real noisy images without estimating the noise levels as input.


  • Example‐Based Colourization Via Dense Encoding Pyramids

    by Chufeng Xiao, Chu Han, Zhuming Zhang, Jing Qin, Tien‐Tsin Wong, Guoqiang Han, Shengfeng He

    We propose a novel deep example‐based image colourization method called dense encoding pyramid network. In our study, we define the colourization as a multinomial classification problem. Given a greyscale image and a reference image, the proposed network leverages large‐scale data and then predicts colours by analysing the colour distribution of the reference image. We design the network as a pyramid structure in order to exploit the inherent multi‐scale, pyramidal hierarchy of colour representations. Between two adjacent levels, we propose a hierarchical decoder–encoder filter to pass the colour distributions from the lower level to higher level in order to take both semantic information and fine details into account during the colourization process. Within the network, a novel parallel residual dense block is proposed to effectively extract the local–global context of the colour representations by widening the network. Several experiments, as well as a user study, are conducted to evaluate the performance of our network against state‐of‐the‐art colourization methods. Experimental results show that our network is able to generate colourful, semantically correct and visually pleasant colour images. In addition, unlike fully automatic colourization that produces fixed colour images, the reference image of our network is flexible; both natural images and simple colour palettes can be used to guide the colourization.


  • Top Cited Papers

    Path Planning for Autonomous Underwater Vehicles: An Ant Colony Algorithm Incorporating Alarm Pheromone

    by Yi-Ning Ma, Yue-Jiao Gong, Chu-Feng Xiao, Ying Gao, Jun Zhang

    Path planning is a critical issue to ensure the safety and reliability of the autonomous navigation system of the Autonomous Underwater Vehicles (AUVs). Due to the nonlinearity and constraint issues, existing algorithms perform unsatisfactorily or even cannot find a feasible solution when facing large-scale problem spaces. This paper improves the path planning of AUVs in terms of both the path planning model and the optimization algorithm. The proposed model is comprehensive, which aggregates the length, energy consumption, and collision risk into the objective function and incorporates the steering window constraint. Based on the model, we develop a nature-inspired ant colony optimization algorithm to search the optimal path. Our algorithm is named alarm pheromone assisted ant colony system (AP-ACS), since it incorporates the alarm pheromone in addition to the traditional guiding pheromone. The alarm pheromone alerts the ants to infeasible areas, which saves invalid search efforts and thus improves the search efficiency. Meanwhile, three heuristic measures are specifically designed to provide additional knowledge to the ants for path planning. In the experiments, different from the previous works that are tested on synthetic instances only, we implement an interface to retrieve the practical underwater environment data. AP-ACS and the compared algorithms are thus tested on several practical environments of different scales. The experimental results show that AP-ACS can effectively handle the constraints and outperforms the other algorithms in terms of both accuracy, efficiency, and reliability.