Pascal Fua
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Pascal Fua has a total of 566 co-authors. Here are the top co-authors by number of shared publications:
Vincent Lepetit
Institute for Computer Graphics and Vision, Graz University of Technology, Graz, Austria
50 shared publications- Mathieu Salzmann
CVLab, EPFL, Lausanne, Switzerland
43 shared publications V. Lepetit
14 shared publications- Slobodan Ilic
Technical University of Munich
13 shared publications - Francesc Moreno-Noguer
Institut de Robòtica i Informàtica Industrial CSIC-UPC
12 shared publications - Raphael Sznitman
University of Bern
12 shared publications
Latest Publications
- 2 October 2026
- Published by Springer Nature
- p. 620-638
Generalizable Neural Reconstruction of High-Fidelity Surfaces via Sparse Volumetric Representations
- 2 October 2026
- Published by Springer Nature
- p. 620-638
Generalizable Neural Reconstruction of High-Fidelity Surfaces via Sparse Volumetric Representations
- 25 September 2026
- Published by Springer Nature
- p. 660-670
VecHeart: Holistic Four-Chamber Cardiac Anatomy Modeling via Hybrid VecSets
- 25 September 2026
- Published by Springer Nature
- p. 660-670
VecHeart: Holistic Four-Chamber Cardiac Anatomy Modeling via Hybrid VecSets
- Open Access
- 6 May 2026
- Published by IOP Publishing in Machine Learning: Science and Technology
- Vol. 7 (3) , 035024
Limited-angle tomography reconstruction via projector guided 3D diffusion
Limited-angle electron tomography aims to reconstruct 3D shapes from 2D projections of Transmission Electron Microscopy (TEM) within a restricted range and number of tilting angles, but it suffers from the missing-edge problem that causes severe reconstruction artefacts. Deep learning approaches have shown promising results in alleviating these artefacts, yet they typically require large high-quality training datasets with known 3D ground truth which are difficult to obtain in electron microscopy. To address these challenges, we propose TEMDiff , a novel 3D diffusion-based iterative reconstruction framework. Our method is trained on readily available volumetric FIB-SEM data using a simulator that maps them to TEM tilt series, enabling the model to learn realistic structural priors without requiring clean TEM ground truth. By operating directly on 3D volumes, TEMDiff implicitly enforces consistency across slices without the need for additional regularisation. On simulated electron tomography datasets with limited angular coverage, TEMDiff outperforms state-of-the-art methods in reconstruction quality. We further demonstrate that a trained TEMDiff model generalises well to real-world TEM tilts obtained under different conditions and can recover accurate structures from tilt ranges as narrow as 8 degrees, with 2-degree increments, without any retraining or fine-tuning.
- 6 May 2026
- Published by IOP Publishing in Machine Learning: Science and Technology
- Vol. 7 (3) , 035024
Open AccessLimited-angle tomography reconstruction via projector guided 3D diffusion
Limited-angle electron tomography aims to reconstruct 3D shapes from 2D projections of Transmission Electron Microscopy (TEM) within a restricted range and number of tilting angles, but it suffers from the missing-edge problem that causes severe reconstruction artefacts. Deep learning approaches have shown promising results in alleviating these artefacts, yet they typically require large high-quality training datasets with known 3D ground truth which are difficult to obtain in electron microscopy. To address these challenges, we propose TEMDiff , a novel 3D diffusion-based iterative reconstruction framework. Our method is trained on readily available volumetric FIB-SEM data using a simulator that maps them to TEM tilt series, enabling the model to learn realistic structural priors without requiring clean TEM ground truth. By operating directly on 3D volumes, TEMDiff implicitly enforces consistency across slices without the need for additional regularisation. On simulated electron tomography datasets with limited angular coverage, TEMDiff outperforms state-of-the-art methods in reconstruction quality. We further demonstrate that a trained TEMDiff model generalises well to real-world TEM tilts obtained under different conditions and can recover accurate structures from tilt ranges as narrow as 8 degrees, with 2-degree increments, without any retraining or fine-tuning.
- 4 May 2026
- Published by Elsevier in Computers & Fluids
- Vol. 315
Empirical uncertainty quantification in deep learning: Applications to fluid dynamics
- 4 May 2026
- Published by Elsevier in Computers & Fluids
- Vol. 315
Empirical uncertainty quantification in deep learning: Applications to fluid dynamics
- Open Access
Dflow-SUR: Enhancing Generative Aerodynamic Inverse Design using Differentiation Throughout Flow Matching
Generative inverse design requires incorporating physical constraints to ensure that generated designs are both reliable and accurate. However, we observe that current state-of-the-art energy-based methods suffer from an asynchronous phenomenon, where the optimization of the physical loss is constrained by the flow matching inference process. To overcome this limitation, we introduce Dflow-SUR, a differentiation strategy that separates the optimization of the physical loss from the flow matching inference. Compared to the most advanced energy-based baseline, Dflow-SUR achieves a reduction in physical loss by four orders of magnitude, while also cutting wall-clock time by 74% on the airfoil case. Additionally, it increases the mean lift-to-drag ratio by 11.8% over traditional Latin-hypercube sampling in wing design. Beyond improvements in accuracy and efficiency, Dflow-SUR offers three additional practical advantages: (i) enhanced control over guidance, (ii) lower surrogate uncertainty, and (iii) greater robustness to hyper-parameter tuning. Together, these results demonstrate that Dflow-SUR is a highly promising framework, providing both scalability and high fidelity for generative aerodynamic design.
Open AccessDflow-SUR: Enhancing Generative Aerodynamic Inverse Design using Differentiation Throughout Flow Matching
Generative inverse design requires incorporating physical constraints to ensure that generated designs are both reliable and accurate. However, we observe that current state-of-the-art energy-based methods suffer from an asynchronous phenomenon, where the optimization of the physical loss is constrained by the flow matching inference process. To overcome this limitation, we introduce Dflow-SUR, a differentiation strategy that separates the optimization of the physical loss from the flow matching inference. Compared to the most advanced energy-based baseline, Dflow-SUR achieves a reduction in physical loss by four orders of magnitude, while also cutting wall-clock time by 74% on the airfoil case. Additionally, it increases the mean lift-to-drag ratio by 11.8% over traditional Latin-hypercube sampling in wing design. Beyond improvements in accuracy and efficiency, Dflow-SUR offers three additional practical advantages: (i) enhanced control over guidance, (ii) lower surrogate uncertainty, and (iii) greater robustness to hyper-parameter tuning. Together, these results demonstrate that Dflow-SUR is a highly promising framework, providing both scalability and high fidelity for generative aerodynamic design.
- 20 September 2025
- Published by Springer Nature
- p. 161-172
DiffAtlas: GenAI-Fying Atlas Segmentation via Image-Mask Diffusion
- 20 September 2025
- Published by Springer Nature
- p. 161-172
DiffAtlas: GenAI-Fying Atlas Segmentation via Image-Mask Diffusion
- 20 September 2025
- Published by Springer Nature
- p. 387-396
Pairwise-Constrained Implicit Functions for 3D Human Heart Modeling
- 20 September 2025
- Published by Springer Nature
- p. 387-396
Pairwise-Constrained Implicit Functions for 3D Human Heart Modeling
- Open Access
- 27 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates
- 27 July 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Open AccessSingle View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates
- Open Access
High-Fidelity and Generalizable Neural Surface Reconstruction with Sparse Feature Volumes
Generalizable neural surface reconstruction has become a compelling technique to reconstruct from few images without per-scene optimization, where dense 3D feature volume has proven effective as a global representation of scenes. However, the dense representation does not scale well to increasing voxel resolutions, severely limiting the reconstruction quality. We thus present a sparse representation method, that maximizes memory efficiency and enables significantly higher resolution reconstructions on standard hardware. We implement this through a two-stage approach: First training a network to predict voxel occupancies from posed images and associated depth maps, then computing features and performing volume rendering only in voxels with sufficiently high occupancy estimates. To support this sparse representation, we developed custom algorithms for efficient sampling, feature aggregation, and querying from sparse volumes-overcoming the dense-volume assumptions inherent in existing works. Experiments on public datasets demonstrate that our approach reduces storage requirements by more than 50 times without performance degradation, enabling reconstructions at $512^3$ resolution compared to the typical $128^3$ on similar hardware, and achieving superior reconstruction accuracy over current state-of-the-art methods.Open AccessHigh-Fidelity and Generalizable Neural Surface Reconstruction with Sparse Feature Volumes
Generalizable neural surface reconstruction has become a compelling technique to reconstruct from few images without per-scene optimization, where dense 3D feature volume has proven effective as a global representation of scenes. However, the dense representation does not scale well to increasing voxel resolutions, severely limiting the reconstruction quality. We thus present a sparse representation method, that maximizes memory efficiency and enables significantly higher resolution reconstructions on standard hardware. We implement this through a two-stage approach: First training a network to predict voxel occupancies from posed images and associated depth maps, then computing features and performing volume rendering only in voxels with sufficiently high occupancy estimates. To support this sparse representation, we developed custom algorithms for efficient sampling, feature aggregation, and querying from sparse volumes-overcoming the dense-volume assumptions inherent in existing works. Experiments on public datasets demonstrate that our approach reduces storage requirements by more than 50 times without performance degradation, enabling reconstructions at $512^3$ resolution compared to the typical $128^3$ on similar hardware, and achieving superior reconstruction accuracy over current state-of-the-art methods. - Open Access
A View-consistent Sampling Method for Regularized Training of Neural Radiance Fields
Neural Radiance Fields (NeRF) has emerged as a compelling framework for scene representation and 3D recovery. To improve its performance on real-world data, depth regularizations have proven to be the most effective ones. However, depth estimation models not only require expensive 3D supervision in training, but also suffer from generalization issues. As a result, the depth estimations can be erroneous in practice, especially for outdoor unbounded scenes. In this paper, we propose to employ view-consistent distributions instead of fixed depth value estimations to regularize NeRF training. Specifically, the distribution is computed by utilizing both low-level color features and high-level distilled features from foundation models at the projected 2D pixel-locations from per-ray sampled 3D points. By sampling from the view-consistency distributions, an implicit regularization is imposed on the training of NeRF. We also utilize a depth-pushing loss that works in conjunction with the sampling technique to jointly provide effective regularizations for eliminating the failure modes. Extensive experiments conducted on various scenes from public datasets demonstrate that our proposed method can generate significantly better novel view synthesis results than state-of-the-art NeRF variants as well as different depth regularization methods.
Open AccessA View-consistent Sampling Method for Regularized Training of Neural Radiance Fields
Neural Radiance Fields (NeRF) has emerged as a compelling framework for scene representation and 3D recovery. To improve its performance on real-world data, depth regularizations have proven to be the most effective ones. However, depth estimation models not only require expensive 3D supervision in training, but also suffer from generalization issues. As a result, the depth estimations can be erroneous in practice, especially for outdoor unbounded scenes. In this paper, we propose to employ view-consistent distributions instead of fixed depth value estimations to regularize NeRF training. Specifically, the distribution is computed by utilizing both low-level color features and high-level distilled features from foundation models at the projected 2D pixel-locations from per-ray sampled 3D points. By sampling from the view-consistency distributions, an implicit regularization is imposed on the training of NeRF. We also utilize a depth-pushing loss that works in conjunction with the sampling technique to jointly provide effective regularizations for eliminating the failure modes. Extensive experiments conducted on various scenes from public datasets demonstrate that our proposed method can generate significantly better novel view synthesis results than state-of-the-art NeRF variants as well as different depth regularization methods.