Fabrice Matulic
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Fabrice Matulic has a total of 28 co-authors. Here are the top co-authors by number of shared publications:
- Keita Higuchi
Preferred Networks, Tokyo, Japan
7 shared publications - Takeo Igarashi
University of Tokyo, Tokyo, Japan
7 shared publications - Daichi Suzuo
Preferred Networks Inc., Tokyo, Japan
3 shared publications - Daniel Vogel
Cheriton School of Computer Science, University of Waterloo, Waterloo, Ontario, Canada
3 shared publications - Taiga Kashima
Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan
3 shared publications - Taisuke Hashimoto
Preferred Networks, Tokyo, Japan
3 shared publications
Latest Publications
- 1 May 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Graphics and Applications
- Vol. 46 (3) , 54-67
Interactive Texture Segmentation of 3-D Scanned Models Leveraging Multiview Automatic Segmentation
In 3D model scanning, the raw texture of a 3D model often requires segmentation into distinct regions to apply different material properties to each region. Current methods, such as manual segmentation, are labor-intensive, while automatic segmentation techniques lack user control. We propose an interactive tool that combines automatic segmentation with minimal manual intervention, striking an optimal balance between efficiency and control. Following a multiview automatic segmentation process that divides the texture into small subsegments, users cluster the subsegments into segments by drawing simple scribbles in the 3D model view. We show that our approach results in more detailed subsegments compared to automatic segmentation approaches. Furthermore, a user study confirms that our approach improves segmentation accuracy and quality compared to manual segmentation with standard 3D computer graphics software. This research paves the way to more efficient texture segmentation in 3D model scanning.
- 1 May 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Graphics and Applications
- Vol. 46 (3) , 54-67
Interactive Texture Segmentation of 3-D Scanned Models Leveraging Multiview Automatic Segmentation
In 3D model scanning, the raw texture of a 3D model often requires segmentation into distinct regions to apply different material properties to each region. Current methods, such as manual segmentation, are labor-intensive, while automatic segmentation techniques lack user control. We propose an interactive tool that combines automatic segmentation with minimal manual intervention, striking an optimal balance between efficiency and control. Following a multiview automatic segmentation process that divides the texture into small subsegments, users cluster the subsegments into segments by drawing simple scribbles in the 3D model view. We show that our approach results in more detailed subsegments compared to automatic segmentation approaches. Furthermore, a user study confirms that our approach improves segmentation accuracy and quality compared to manual segmentation with standard 3D computer graphics software. This research paves the way to more efficient texture segmentation in 3D model scanning.
- Top Cited PapersOpen Access
- 22 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 2131-2146
Understanding Reader Perception Shifts upon Disclosure of AI Authorship
- 22 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 2131-2146
Top Cited PapersOpen AccessUnderstanding Reader Perception Shifts upon Disclosure of AI Authorship
- Open Access
- 7 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 9-15
An Equivalent Circuit Model for 2D Embroidery Using Conductive Threads
- 7 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 9-15
Open AccessAn Equivalent Circuit Model for 2D Embroidery Using Conductive Threads
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Interactive Texture Segmentation of 3D Scanned Models Leveraging Multiview Automatic Segmentation
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessInteractive Texture Segmentation of 3D Scanned Models Leveraging Multiview Automatic Segmentation
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Enhancing Touch Input in Desktop VR: A Hybrid Approach Combining Headset-Based Hand Tracking and Touch Detection with a Smartphone
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessEnhancing Touch Input in Desktop VR: A Hybrid Approach Combining Headset-Based Hand Tracking and Touch Detection with a Smartphone
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Typing and Pointing in Virtual Reality while Lying Down
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessTyping and Pointing in Virtual Reality while Lying Down
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Bringing Everyday Objects to Life in Augmented Reality with AI-Powered Talking Characters
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessBringing Everyday Objects to Life in Augmented Reality with AI-Powered Talking Characters
- Open Access
- 24 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 1517-1528
User-Guided Correction of Reconstruction Errors in Structure-from-Motion
- 24 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 1517-1528
Open AccessUser-Guided Correction of Reconstruction Errors in Structure-from-Motion
- Open Access
- 3 June 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Above-Screen Fingertip Tracking and Hand Representation for Precise Touch Input with a Phone in Virtual Reality
Interacting with the touchscreen of a mobile phone in virtual reality (VR) is challenging because users cannot see their fingers when aiming for targets. We propose using two mirrors reflecting the front camera of the phone and a purpose-built deep neural network to infer the 3D position of fingertips above the screen. Network training is self-supervised after only a few hundred initial labelled images and does not require any external sensor. The inferred fingertip positions can be used to control different hand models and objects in VR. Controlled experiments evaluate tracking performance for single-finger touch input, and compare several 3D hand representations with a flat 2D overlay used in previous work. The results confirm the suitability of our fingertip tracker to aid precise tapping of small targets on the phone screen and provide insights about the effect of various hand representations on control and presence. Finally, we provide several application examples showing how 3D fingertip input can complement and extend phone-based touch interaction in VR.
- 3 June 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Open AccessAbove-Screen Fingertip Tracking and Hand Representation for Precise Touch Input with a Phone in Virtual Reality
Interacting with the touchscreen of a mobile phone in virtual reality (VR) is challenging because users cannot see their fingers when aiming for targets. We propose using two mirrors reflecting the front camera of the phone and a purpose-built deep neural network to infer the 3D position of fingertips above the screen. Network training is self-supervised after only a few hundred initial labelled images and does not require any external sensor. The inferred fingertip positions can be used to control different hand models and objects in VR. Controlled experiments evaluate tracking performance for single-finger touch input, and compare several 3D hand representations with a flat 2D overlay used in previous work. The results confirm the suitability of our fingertip tracker to aid precise tapping of small targets on the phone screen and provide insights about the effect of various hand representations on control and presence. Finally, we provide several application examples showing how 3D fingertip input can complement and extend phone-based touch interaction in VR.
- Open Access
- 28 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Interactive Material Annotation on 3D Scanned Models leveraging Color-Material Correlation
3D scanning has made it possible to generate 3D models from real objects. Although 3D scanning can capture an object’s shape and color texture, it is still technically difficult to analyze and reproduce material properties such as metalness, roughness, and transparency. Therefore, they need to be explicitly annotated after the scanning process. However, existing methods are highly labor-intensive such as a simple brush painting that requires delicate and inefficient handwork. To make this process more efficient and accurate, we propose a system that mitigates the costs by introducing a texture-aware annotation pipeline. This method is based on the observation that material distribution is correlated to color distribution. We segment the 3D surface into areas based on color similarity and let users annotate materials using the segmentations as masks. In an empirical user study, the participants could make quality annotations in a short time.
- 28 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Open AccessInteractive Material Annotation on 3D Scanned Models leveraging Color-Material Correlation
3D scanning has made it possible to generate 3D models from real objects. Although 3D scanning can capture an object’s shape and color texture, it is still technically difficult to analyze and reproduce material properties such as metalness, roughness, and transparency. Therefore, they need to be explicitly annotated after the scanning process. However, existing methods are highly labor-intensive such as a simple brush painting that requires delicate and inefficient handwork. To make this process more efficient and accurate, we propose a system that mitigates the costs by introducing a texture-aware annotation pipeline. This method is based on the observation that material distribution is correlated to color distribution. We segment the 3D surface into areas based on color similarity and let users annotate materials using the segmentations as masks. In an empirical user study, the participants could make quality annotations in a short time.