JMJean Martinet

Jean Martinet

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Jean Martinet has a total of 48 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Spectral Vs Topological Attention in Event-Based Vision

    by Thi-Thuy-Duong Pham, Quy-The Tran, Romaric Mazna, Jean Martinet

  • Open Access

    AIAC: A novel Master’s Programme in Artificial Intelligence with Affective Computing

    by Kinga Bettina Faragó, László Gulyás, Rasmus Kyyhkynen, Tapio Pahikkala, Jean Martinet, Jean Piroddi, Françoise Baude, Andrea Biancini, Vilma Djala, Salvatore Moccia, et al.

  • HFGaussian: Learning Generalizable Gaussian Human With Integrated Human Features

    by Arnab Dey, Cheng-You Lu, Andrew I. Comport, Srinath Sridhar, Chin-Teng Lin, Jean Martinet

    Recent advancements in radiance field rendering show promising results in 3D scene representation, where Gaussian splatting-based techniques emerge as state-of-the-art due to their quality and efficiency. Gaussian splatting is widely used for various applications, including 3D human representation. However, previous 3D Gaussian splatting methods can not render RGB and human features simultaneously. Furthermore, these methods either use parametric body models as additional information or fail to provide any underlying structure, like human biomechanical features, which are essential for various applications such as medical diagnosis. In this paper, we present a novel approach called HFGaussian that can estimate novel views and human features, such as the 3D skeleton, 3D key points, and dense pose, from sparse input images simultaneously in real time at 25 FPS. The proposed method leverages the generalizable Gaussian splatting technique to represent the human subject and 3D consistent human features, enabling efficient and generalizable reconstruction. By incorporating a pose regression network and the feature splatting technique with Gaussian splatting, HFGaussian demonstrates improved capabilities over existing 3D human methods, showcasing the potential of 3D human representations with integrated biomechanics. We thoroughly evaluate our HFGaussian method against the latest state-of-the-art techniques in human Gaussian splatting methods, demonstrating its real-time, state-of-the-art performance. Project page: https://github.com/arnabdeypolimi/HFGaussian_official.


  • Leveraging Local Similarity for Token Merging in Vision Transformers

    by Karim Haroun, Jean Martinet, Karim Ben Chehida, Thibault Allenet


  • Open Access

    Precise spiking motifs in neurobiological and neuromorphic data

    by Antoine Grimaldi, Amélie Gruel, Camille Besnainou, Jean-Nicolas Jérémie, Jean Martinet, Laurent U Perrinet

    Why do neurons communicate through spikes? By definition, spikes are all-or-none neural events which occur at continuous times. In other words, spikes are on one side binary, existing or not without further details, and on the other can occur at any asynchronous time, without the need for a centralized clock. This stands in stark contrast to the analog representation of values and the discretized timing classically used in digital processing and at the base of modern-day neural networks. As neural systems almost systematically use this so-called event-based representation in the living world, a better understanding of this phenomenon remains a fundamental challenge in neurobiology in order to better interpret the profusion of recorded data. With the growing need for intelligent embedded systems, it also emerges as a new computing paradigm to enable the efficient operation of a new class of sensors and event-based computers, called neuromorphic, which could enable significant gains in computation time and energy consumption -- a major societal issue in the era of the digital economy and global warming. In this review paper, we provide evidence from biology, theory and engineering that the precise timing of spikes plays a crucial role in our understanding of the efficiency of neural networks.

  • Open Access

    GHNeRF: Learning Generalizable Human Features with Efficient Neural Radiance Fields

    by Arnab Dey, Di Yang, Rohith Agaram, Antitza Dantcheva, Andrew I. Comport, Srinath Sridhar, Jean Martinet

    Recent advances in Neural Radiance Fields (NeRF) have demonstrated promising results in 3D scene representations, including 3D human representations. However, these representations often lack crucial information on the underlying human pose and structure, which is crucial for AR/VR applications and games. In this paper, we introduce a novel approach, termed GHNeRF, designed to address these limitations by learning 2D/3D joint locations of human subjects with NeRF representation. GHNeRF uses a pre-trained 2D encoder streamlined to extract essential human features from 2D images, which are then incorporated into the NeRF framework in order to encode human biomechanic features. This allows our network to simultaneously learn biomechanic features, such as joint locations, along with human geometry and texture. To assess the effectiveness of our method, we conduct a comprehensive comparison with state-of-the-art human NeRF techniques and joint estimation algorithms. Our results show that GHNeRF can achieve state-of-the-art results in near real-time.

  • Open Access

    HFNeRF: Learning Human Biomechanic Features with Neural Radiance Fields

    by Arnab Dey, Di Yang, Antitza Dantcheva, Jean Martinet

    In recent advancements in novel view synthesis, generalizable Neural Radiance Fields (NeRF) based methods applied to human subjects have shown remarkable results in generating novel views from few images. However, this generalization ability cannot capture the underlying structural features of the skeleton shared across all instances. Building upon this, we introduce HFNeRF: a novel generalizable human feature NeRF aimed at generating human biomechanic features using a pre-trained image encoder. While previous human NeRF methods have shown promising results in the generation of photorealistic virtual avatars, such methods lack underlying human structure or biomechanic features such as skeleton or joint information that are crucial for downstream applications including Augmented Reality (AR)/Virtual Reality (VR). HFNeRF leverages 2D pre-trained foundation models toward learning human features in 3D using neural rendering, and then volume rendering towards generating 2D feature maps. We evaluate HFNeRF in the skeleton estimation task by predicting heatmaps as features. The proposed method is fully differentiable, allowing to successfully learn color, geometry, and human skeleton in a simultaneous manner. This paper presents preliminary results of HFNeRF, illustrating its potential in generating realistic virtual avatars with biomechanic features using NeRF.