Fiber-level Woven Fabric Capture from a Single Microscopic Image
Open Access
- 29 June 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 45 (5) , 1-18
Abstract
Accurately rendering the appearance of fabrics is challenging, due to their complex 3D microstructures and specialized optical properties. If we model the geometry and optics of fabrics down to the fiber level, we can achieve unprecedented rendering realism, but this raises the difficulty of authoring the fiber-level assets. Existing approaches can obtain fiber-level geometry with special devices (e.g., CT) or hand-designed procedural pipelines. In this paper, we propose a method to capture fiber-level geometry and appearance of woven fabrics using a single low-cost microscope image. This may seem like an impossible task: a single image from a low-cost microscope looks very different from the final rendering we would like to achieve, and the information contained in it may seem minimal. We propose a novel fiber parameter estimation pipeline in a coarse-to-fine manner, establishing a subset of parameters step by step. At the core of our pipeline are differentiable procedural geometric and appearance models for woven fabrics at the fiber level, enabling both geometry and appearance to be optimized simultaneously. We first use a simple neural network to predict initial parameters, then we optimize the parameters of procedural fiber geometry and an approximated shading model via differentiable rasterization to match the microscope photo more accurately. Finally, we refine the fiber appearance parameters via differentiable path tracing, converging to accurate fiber optical parameters, which are suitable for physically-based light simulations to produce high-quality rendered results. We believe that our method is the first to utilize differentiable rendering at the microscopic level, supporting physically-based scattering from explicit fiber assemblies. Our fabric parameter estimation achieves high-quality re-rendering of measured woven fabric samples in both distant and close-up views. We also propose a patch-space fiber geometry procedural generation method and a two-scale path tracing framework for efficient rendering of fabric scenes.Keywords
Funding Information
- National Natural Science Foundation of China (62572230)
This publication has 55 references indexed in Scilit:
- Neural inverse procedural modeling of knitting yarns from imagesComputers & Graphics, 2023
- A Practical and Hierarchical Yarn‐based Shading Model for ClothComputer Graphics Forum, 2023
- SVBRDF Recovery from a Single Image with Highlights Using a Pre‐trained Generative Adversarial NetworkComputer Graphics Forum, 2022
- A Bayesian Inference Framework for Procedural Material Parameter EstimationComputer Graphics Forum, 2020
- Guided Fine‐Tuning for Large‐Scale Material TransferComputer Graphics Forum, 2020
- Recent advances in fabric appearance reproductionComputers & Graphics, 2019
- Automatic extraction and synthesis of regular repeatable patternsComputers & Graphics, 2019
- Single Image Surface Appearance Modeling with Self‐augmented CNNs and Inexact SupervisionComputer Graphics Forum, 2018
- Image-Based Reverse Engineering and Visual Prototyping of Woven ClothIEEE Transactions on Visualization and Computer Graphics, 2014
- Dual scattering approximation for fast multiple scattering in hairACM Transactions on Graphics, 2008