DFDenis Fortun

Denis Fortun

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Denis Fortun has a total of 55 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Aggregation framework and patch-based representation for optical flow

    by Denis Fortun

    Schéma d'agrégation et représentations par patchs pour le flot optique: Nous nous intéressons dans cette thèse au problème de l'estimation dense du mouvement dans des séquences d'images, également désigné sous le terme de flot optique. Les approches usuelles exploitent une paramétrisation locale ou une régularisation globale du champ de déplacement. Nous explorons plusieurs façons de combiner ces deux stratégies, pour surmonter leurs limitations respectives. Nous nous plaçons dans un premier temps dans un cadre variationnel global, et considérons un filtrage local du terme de données. Nous proposons un filtrage spatialement adaptatif, optimisé conjointement au mouvement, pour empêcher le sur-lissage induit par le filtrage spatialement constant. Dans une seconde partie, nous proposons un cadre générique d'agrégation pour l'estimation du flot optique. Sous sa forme générale, il consiste en une estimation locale de candidats de mouvements, suivie de leur combinaison à l'étape d'agrégation avec un modèle global. Ce schéma permet une estimation efficace des grands déplacements et des discontinuités de mouvement. Nous développons également une méthode générique de gestion des occultations. Notre méthode est validée par une analyse expérimentale conséquente sur des bases de données de référence en vision par ordinateur. Nous démontrons la supériorité de notre méthode par rapport à l'état de l'art sur les séquences présentant de grands déplacements. La dernière partie de la thèse est consacrée à l'adaptation des approches précédentes à des problématiques d'imagerie biologique. Les changements locaux importants d'intensité observés en imagerie de fluorescence sont estimés et compensé par une adaptation de notre schéma d'agrégation. Nous proposons également une méthode variationnelle avec filtrage local dédiée au cas de mouvements diffusifs de particules.

  • An inducible multiciliated cell line resolves proteome dynamics and identifies CDK7 as a conserved regulator

    by Camille Boutin, Olivier Rosnet, Marine Touret, Stéphane Audebert, Luc Camoin, Salomé Dussert, Nicolas Brouilly, Virginie Thomé, Jean Plumail, Denis Fortun, et al.

    Multiciliated cells (MCCs) are essential for generating directional fluid flow across specialized epithelia in various vertebrate organs. MCC differentiation involves a tightly regulated program characterized by massive centriole amplification. Although transcriptional control of MCC development is well characterized, insights into proteome dynamics have been limited due to the lack of suitable models. Here, we report the generation of a stable inducible MCC line, derived from Xenopus A6 kidney epithelial cells. Upon induction of the master regulator multicilin (MCI), most A6-MCI cells synchronously differentiate into mature MCCs in 48 h. Using this resource, custom antibodies, and super-resolution imaging, we characterized Xenopus deuterosomes, the platforms that allow massive centriole synthesis in vertebrate MCCs. We performed detailed proteomic profiling throughout differentiation, uncovered previously uncharacterized regulators and highlighted a critical role for CDK7 in Xenopus and human MCC differentiation. Our work provides a valuable resource for mechanistic studies of MCC biology and opens avenues to identify novel therapeutic targets for motile ciliopathies.


  • Multiview Point Cloud Registration via Optimization in an Autoencoder Latent Space

    by Luc Vedrenne, Sylvain Faisan, Denis Fortun

    Point cloud rigid registration is a fundamental problem in 3D computer vision. In the multiview case, we aim to find a set of 6D poses to align a set of objects. Methods based on pairwise registration rely on a subsequent synchronization algorithm, which makes them poorly scalable with the number of views. Generative approaches overcome this limitation, but are based on Gaussian Mixture Models and use an Expectation-Maximization algorithm. Hence, they are not well suited to handle large transformations. Moreover, most existing methods cannot handle high levels of degradations. In this paper, we introduce POLAR (POint cloud LAtent Registration), a multiview registration method able to efficiently deal with a large number of views, while being robust to a high level of degradations and large initial angles. To achieve this, we transpose the registration problem into the latent space of a pretrained autoencoder, design a loss taking degradations into account, and develop an efficient multistart optimization strategy. Our proposed method significantly outperforms state-of-the-art approaches on synthetic and real data. POLAR is available at github.com/pypolar/polar or as a standalone package which can be installed with pip install polaregistration.


  • Multiview Point Cloud Registration with Anisotropic and Spatially Varying Localization Noise

    by Denis Fortun, Etienne Baudrier, Fabian Zwettler, Markus Sauer, Sylvain Faisan

    In this paper, we address the problem of registering multiple point clouds corrupted with high anisotropic localization noise. Our approach follows the widely used framework of Gaussian mixture model (GMM) reconstruction with an expectation-maximization (EM) algorithm. Existing methods are based on an implicit assumption of spatially invariant isotropic Gaussian noise. However, this assumption is violated in practice in applications such as single molecule localization microscopy (SMLM). To address this issue, we propose to introduce an explicit localization noise model that decouples shape modeling with the GMM from noise handling. We use this model for multiview point cloud registration by designing an EM algorithm that considers noise-free data as a latent variable, with closed-form solutions at each EM step. The first advantage of our approach is to handle spatially varying and anisotropic Gaussian noise. The second advantage is to leverage the explicit noise model to impose prior knowledge about the noise that may be available from physical sensors. We show on various simulated data that our noise handling strategy improves significantly the robustness to high levels of anisotropic noise. We also demonstrate the performance of our method on real SMLM data.


  • Fast and Robust Single Particle Reconstruction in 3D Fluorescence Microscopy

    by Thibaut Eloy, Étienne Baudrier, Marine Laporte, Virginie Hamel, Paul Guichard, Denis Fortun

    Single particle reconstruction has recently emerged in 3D fluorescence microscopy as a powerful technique to improve the axial resolution and the degree of fluorescent labeling. It is based on the reconstruction of an average volume of a biological particle from the acquisition of multiple views with unknown poses. Current methods are limited either by template bias, restriction to 2D data, high computational cost or lack of robustness to low fluorescent labeling. In this work, we propose a single particle reconstruction method dedicated to convolutional models in 3D fluorescence microscopy that overcomes these issues. We address the joint reconstruction and estimation of the poses of the particles, which translates into a challenging non-convex optimization problem. Our approach is based on a multilevel reformulation of this problem, and the development of efficient optimization techniques at each level. We demonstrate on synthetic data that our method outperforms the standard approaches in terms of resolution and reconstruction error, while achieving a low computational cost. We also perform successful reconstruction on real datasets of centrioles to show the potential of our method in concrete applications.


  • Open Access

    A unified framework for focal intensity change detection and deformable image registration. Application to the monitoring of multiple sclerosis lesions in longitudinal 3D brain MRI

    by Eléonore Dufresne, Denis Fortun, Stéphane Kremer, Vincent Noblet

    Registration is a crucial step in the design of automatic change detection methods dedicated to longitudinal brain MRI. Even small registration inaccuracies can significantly deteriorate the detection performance by introducing numerous spurious detections. Rigid or affine registration are usually considered to align baseline and follow-up scans, as a pre-processing step before applying a change detection method. In the context of multiple sclerosis, using deformable registration can be required to capture the complex deformations due to brain atrophy. However, non-rigid registration can alter the shape of appearing and evolving lesions while minimizing the dissimilarity between the two images. To overcome this issue, we consider registration and change detection as intertwined problems that should be solved jointly. To this end, we formulate these two separate tasks as a single optimization problem involving a unique energy that models their coupling. We focus on intensity-based change detection and registration, but the approach is versatile and could be extended to other modeling choices. We show experimentally on synthetic and real data that the proposed joint approach overcomes the limitations of the sequential scheme.


  • Open Access

    Homogeneous multifocal excitation for high-throughput super-resolution imaging

    by Dora Mahecic, Davide Gambarotto, Kyle M. Douglass, Denis Fortun, Niccoló Banterle, Maeva Le Guennec, Khalid Ibrahim, Pierre Gönczy, Virginie Hamel, Paul Guichard, et al.

    Super-resolution microscopies, which allow features below the diffraction limit to be resolved, have become an established tool in biological research. However, imaging throughput remains a major bottleneck in using them for quantitative biology, which requires large datasets to overcome the noise of the imaging itself and to capture the variability inherent to biological processes. Here, we develop a multi-focal flat illumination for field independent imaging (mfFIFI) module, and integrate it into an instant structured illumination microscope (iSIM). Our instrument extends the field of view (FOV) to >100×100 µm 2 without compromising image quality, and maintains high-speed (100 Hz), multi-color, volumetric imaging at double the diffraction-limited resolution. We further extend the effective FOV by stitching multiple adjacent images together to perform fast live-cell super-resolution imaging of dozens of cells. Finally, we combine our flat-fielded iSIM setup with ultrastructure expansion microscopy (U-ExM) to collect 3D images of hundreds of centrioles in human cells, as well as of thousands of purified Chlamydomonas reinhardtii centrioles per hour at an effective resolution of ∼35 nm. We apply classification and particle averaging to these large datasets, allowing us to map the 3D organization of post-translational modifications of centriolar microtubules, revealing differences in their coverage and positioning.

  • Open Access

    Fast Piecewise-Affine Motion Estimation Without Segmentation

    by Denis Fortun, Martin Storath, Dennis Rickert, Andreas Weinmann, Michael Unser

    Current algorithmic approaches for piecewise affine motion estimation are based on alternating motion segmentation and estimation. We propose a new method to estimate piecewise affine motion fields directly without intermediate segmentation. To this end, we reformulate the problem by imposing piecewise constancy of the parameter field, and derive a specific proximal splitting optimization scheme. A key component of our framework is an efficient one-dimensional piecewise-affine estimator for vector-valued signals. The first advantage of our approach over segmentation-based methods is its absence of initialization. The second advantage is its lower computational cost which is independent of the complexity of the motion field. In addition to these features, we demonstrate competitive accuracy with other piecewise-parametric methods on standard evaluation benchmarks. Our new regularization scheme also outperforms the more standard use of total variation and total generalized variation.


  • Open Access

    Reconstruction From Multiple Particles for 3D Isotropic Resolution in Fluorescence Microscopy

    by Denis Fortun, Paul Guichard, Virginie Hamel, Carlos Oscar S. Sorzano, Niccolo Banterle, Pierre Gonczy, Michael Unser

    The imaging of proteins within macromolecular complexes has been limited by the low axial resolution of optical microscopes. To overcome this problem, we propose a novel computational reconstruction method that yields isotropic resolution in fluorescence imaging. The guiding principle is to reconstruct a single volume from observations of multiple rotated particles. Our new operational framework detects particles, estimates their orientation, and reconstructs the final volume. The main challenge comes from the absence of initial template and a priori knowledge about the orientations. We formulate the estimation as a blind inverse problem, and propose a blockcoordinate stochastic approach to solve the associated nonconvex optimization problem. The reconstruction is performed jointly in multiple channels. We demonstrate that our method is able to reconstruct volumes with 3D isotropic resolution on simulated data. We also perform isotropic reconstructions from real experimental data of doubly labelled purified human centrioles. Our approach revealed the precise localization of the centriolar protein Cep63 around the centriole microtubule barrel. Overall, our method offers new perspectives for applications in biology that require the isotropic mapping of proteins within macromolecular assemblies.


  • Open Access

    Imaging neural activity in the ventral nerve cord of behaving adult Drosophila

    by Chin-Lin Chen, Laura Hermans, Meera C. Viswanathan, Denis Fortun, Michael Unser, Anthony Cammarato, Michael H. Dickinson, Pavan Ramdya

    To understand neural circuits that control limbs, one must measure their activity during behavior. Until now this goal has been challenging, because the portion of the nervous system that contains limb premotor and motor circuits is largely inaccessible to large-scale recording techniques in intact, moving animals – a constraint that is true for both vertebrate and invertebrate models. Here, we introduce a method for 2-photon functional imaging from the ventral nerve cord of behaving adult Drosophila melanogaster . We use this method to reveal patterns of activity across nerve cord populations during grooming and walking and to uncover the functional encoding of moonwalker ascending neurons (MANs), moonwalker descending neurons (MDNs), and a novel class of locomotion-associated descending neurons. This new approach enables the direct investigation of circuits associated with complex limb movements.