Muhammad Twaha Ibrahim
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Muhammad Twaha Ibrahim has a total of 13 co-authors. Here are the top co-authors by number of shared publications:
- Aditi Majumder
Department of Computer Science, University of California, Irvine
4 shared publications Aditi Majumder
3 shared publicationsM. Gopi
3 shared publications- Gopi Meenakshisundaram
Department of Computer Science, University of California, Irvine, CA 92617, USA
2 shared publications - Chunyan Wang
Beijing Institute of Technology
1 shared publication - Isabela Figueira
University of California, Irvine, Irvine, CA, USA
1 shared publication
Latest Publications
- Open Access
- 17 November 2025
- Published by Wiley in Computer Graphics Forum
Democratising Multi‐Projector Displays
As data exploded with the advent of smartphones in the first decade of this century, the world entered an era of experiences. The advent of VR/AR headsets a decade later brought us into the age of experiences. VR/AR headsets have transformed the way people experience data, especially in gaming and entertainment. However, headsets in their current form factor can be cumbersome, sometimes causing fatigue with long‐duration use. They can be particularly isolating for applications that need multiple individuals to collaborate together. Spatially augmented reality (SAR) using multiple projectors aims to bring the surround, large field‐of‐view (FOV) collaborative experiences out of VR/AR headsets by merging digital content from multiple projectors with the physical environment around users. The vision is to use multiple projectors to project digital imagery on everyday surfaces surrounding users by employing cameras to understand the surface for correct merging of the digital with the physical. This paper presents a detailed state‐of‐the‐art survey of advancements in methodologies for multi‐projector aggregation to achieve SAR and state‐of‐the‐art hardware technologies (such as cameras, projectors, and interaction devices) available today to build multi‐projector‐based displays and interaction environments. Most importantly, we look at this space not only from the perspective of research and development, but also from the practical challenges and considerations in the deployment of such systems.
- 17 November 2025
- Published by Wiley in Computer Graphics Forum
Open AccessDemocratising Multi‐Projector Displays
As data exploded with the advent of smartphones in the first decade of this century, the world entered an era of experiences. The advent of VR/AR headsets a decade later brought us into the age of experiences. VR/AR headsets have transformed the way people experience data, especially in gaming and entertainment. However, headsets in their current form factor can be cumbersome, sometimes causing fatigue with long‐duration use. They can be particularly isolating for applications that need multiple individuals to collaborate together. Spatially augmented reality (SAR) using multiple projectors aims to bring the surround, large field‐of‐view (FOV) collaborative experiences out of VR/AR headsets by merging digital content from multiple projectors with the physical environment around users. The vision is to use multiple projectors to project digital imagery on everyday surfaces surrounding users by employing cameras to understand the surface for correct merging of the digital with the physical. This paper presents a detailed state‐of‐the‐art survey of advancements in methodologies for multi‐projector aggregation to achieve SAR and state‐of‐the‐art hardware technologies (such as cameras, projectors, and interaction devices) available today to build multi‐projector‐based displays and interaction environments. Most importantly, we look at this space not only from the perspective of research and development, but also from the practical challenges and considerations in the deployment of such systems.
- Open Access
- 5 April 2024
- Published by Elsevier in Smart Health
- Vol. 32
Illuminating precise stencils on surgical sites using projection-based augmented reality
- 5 April 2024
- Published by Elsevier in Smart Health
- Vol. 32
Open AccessIlluminating precise stencils on surgical sites using projection-based augmented reality
- 4 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 30 (5) , 2527-2537
Real-Time Seamless Multi-Projector Displays on Deformable Surfaces
Prior works on multi-projector displays have focused primarily on static rigid objects, some focusing on dynamic rigid objects. However, works on projection based displays on deformable dynamic objects have focused only on small scale single projector displays. Tracking a deformable dynamic surface and updating projections precisely in real time on it is a significantly challenging task, even for a single projector system. In this paper, we present the first end-to-end solution for achieving a real-time, seamless display on deformable surfaces using mutliple unsychronized projectors without requiring any prior knowledge of the surface or device parameters. The system first accurately calibrates multiple RGB-D cameras and projectors using the deformable display surface itself, and then using those calibrated devices, tracks the continuous changes in the surface shape. Based on the deformation and projector calibration, the system warps and blends the image content in real-time to create a seamless display on a surface that continuously changes shape. Using multiple projectors and RGB-D cameras, we provide the much desired aspect of scale to the displays on deformable surfaces. Most prior dynamic multi-projector systems assume rigid objects and depend critically on the constancy of surface normals and non-existence of local shape deformations. These assumptions break in deformable surfaces making prior techniques inapplicable. Point-based correspondences become inadequate for calibration, exacerbated with no synchronization between the projectors. A few works address non-rigid objects with several restrictions like targeting semi-deformable surfaces (e.g. human face), or using single coaxial (optically aligned) projector-camera pairs, or temporally synchronized cameras. We break loose from such restrictions and handle multiple projector systems for dynamic deformable fabric-like objects using temporally unsynchronized devices. We devise novel methods using ray and plane-based constraints imposed by the pinhole camera model to address these issues and design new blending methods dependent on 3D distances suitable for deformable surfaces. Finally, unlike all prior work with rigid dynamic surfaces that use a single RGB-D camera, we devise a method that involve all RGB-D cameras for tracking since the surface is not seen completely by a single camera. These methods enable a seamless display at scale in the presence of continuous movements and deformations. This work has tremendous applications on mobile and expeditionary systems where environmentals (e.g. wind, vibrations, suction) cannot be avoided. One can create large displays on tent walls in remote, austere military or emergency operations in minutes to support large scale command and control, mission rehearsal or training operations. It can be used to create displays on mobile and inflatable objects for tradeshows/events and touring edutainment applications.
- 4 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 30 (5) , 2527-2537
Real-Time Seamless Multi-Projector Displays on Deformable Surfaces
Prior works on multi-projector displays have focused primarily on static rigid objects, some focusing on dynamic rigid objects. However, works on projection based displays on deformable dynamic objects have focused only on small scale single projector displays. Tracking a deformable dynamic surface and updating projections precisely in real time on it is a significantly challenging task, even for a single projector system. In this paper, we present the first end-to-end solution for achieving a real-time, seamless display on deformable surfaces using mutliple unsychronized projectors without requiring any prior knowledge of the surface or device parameters. The system first accurately calibrates multiple RGB-D cameras and projectors using the deformable display surface itself, and then using those calibrated devices, tracks the continuous changes in the surface shape. Based on the deformation and projector calibration, the system warps and blends the image content in real-time to create a seamless display on a surface that continuously changes shape. Using multiple projectors and RGB-D cameras, we provide the much desired aspect of scale to the displays on deformable surfaces. Most prior dynamic multi-projector systems assume rigid objects and depend critically on the constancy of surface normals and non-existence of local shape deformations. These assumptions break in deformable surfaces making prior techniques inapplicable. Point-based correspondences become inadequate for calibration, exacerbated with no synchronization between the projectors. A few works address non-rigid objects with several restrictions like targeting semi-deformable surfaces (e.g. human face), or using single coaxial (optically aligned) projector-camera pairs, or temporally synchronized cameras. We break loose from such restrictions and handle multiple projector systems for dynamic deformable fabric-like objects using temporally unsynchronized devices. We devise novel methods using ray and plane-based constraints imposed by the pinhole camera model to address these issues and design new blending methods dependent on 3D distances suitable for deformable surfaces. Finally, unlike all prior work with rigid dynamic surfaces that use a single RGB-D camera, we devise a method that involve all RGB-D cameras for tracking since the surface is not seen completely by a single camera. These methods enable a seamless display at scale in the presence of continuous movements and deformations. This work has tremendous applications on mobile and expeditionary systems where environmentals (e.g. wind, vibrations, suction) cannot be avoided. One can create large displays on tent walls in remote, austere military or emergency operations in minutes to support large scale command and control, mission rehearsal or training operations. It can be used to create displays on mobile and inflatable objects for tradeshows/events and touring edutainment applications.
- 18 May 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 30 (8) , 4724-4738
3D Gamut Morphing for Non-Rectangular Multi-Projector Displays
In a spatially augmented reality system, multiple projectors are tiled on a complex shaped surface to create a seamless display on it. This has several applications in visualization, gaming, education and entertainment. The main challenges in creating seamless and undistorted imagery on such complex shaped surfaces are geometric registration and color correction. Prior methods that provide solutions for the spatial color variation in multi-projector displays assume rectangular overlap regions across the projectors that is possible only on flat surfaces with extremely constrained projector placement. In this article, we present a novel and fully automated method for removing color variations in a multi-projector display on arbitrary shaped smooth surfaces using a general color gamut morphing algorithm that can handle any arbitrarily shaped overlap between the projectors and assures imperceptible color variations across the display surface.
- 18 May 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 30 (8) , 4724-4738
3D Gamut Morphing for Non-Rectangular Multi-Projector Displays
In a spatially augmented reality system, multiple projectors are tiled on a complex shaped surface to create a seamless display on it. This has several applications in visualization, gaming, education and entertainment. The main challenges in creating seamless and undistorted imagery on such complex shaped surfaces are geometric registration and color correction. Prior methods that provide solutions for the spatial color variation in multi-projector displays assume rectangular overlap regions across the projectors that is possible only on flat surfaces with extremely constrained projector placement. In this article, we present a novel and fully automated method for removing color variations in a multi-projector display on arbitrary shaped smooth surfaces using a general color gamut morphing algorithm that can handle any arbitrarily shaped overlap between the projectors and assures imperceptible color variations across the display surface.
- 1 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1009-1010
Spatially Augmented Reality on Non-rigid Dynamic Surfaces
We will demonstrate a spatially augmented reality system on nonrigid dynamic surfaces like stretchable fabrics. Using a single projector and RGB-D camera, our system adapts the projection to the changing shape of the non-rigid surface automatically. Such systems have applications in various domains such as art, design, entertainment and medicine. In particular, we we will demonstrate the use of the system as a surgical guidance system for cleft palate surgery using a Simulare cleft model.
- 1 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1009-1010
Spatially Augmented Reality on Non-rigid Dynamic Surfaces
We will demonstrate a spatially augmented reality system on nonrigid dynamic surfaces like stretchable fabrics. Using a single projector and RGB-D camera, our system adapts the projection to the changing shape of the non-rigid surface automatically. Such systems have applications in various domains such as art, design, entertainment and medicine. In particular, we we will demonstrate the use of the system as a surgical guidance system for cleft palate surgery using a Simulare cleft model.
- Open Access
- 29 November 2022
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Augmented Reality Patient-Specific Registration for Medical Visualization
In recent years, medical research has made extensive use of Augmented Reality (AR) for visualization. These visualizations provide improved 3D understanding and depth perception for surgeons and medical staff during surgical planning, medical training, and procedures. Often, AR in medicine involves impractical and extensive instrumentation in order to provide the precision needed for clinical use. We propose a mobile AR 3D model registration system for use in a practical, non-instrumented hospital setting. Our registration system takes as input a patient-specific model and overlays it on the patient using an accurate pose registration technique that requires a single marker as a point of reference to initialize a point cloud-based pose refinement technique. Our method is automatic, easy to use, and runs in real-time on a mobile phone. We conduct quantitative and qualitative analysis of the registration. The results confirm that our AR pose registration system produces an accurate and visually correct overlay of the medical data in real-time.
- 29 November 2022
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Open AccessAugmented Reality Patient-Specific Registration for Medical Visualization
In recent years, medical research has made extensive use of Augmented Reality (AR) for visualization. These visualizations provide improved 3D understanding and depth perception for surgeons and medical staff during surgical planning, medical training, and procedures. Often, AR in medicine involves impractical and extensive instrumentation in order to provide the precision needed for clinical use. We propose a mobile AR 3D model registration system for use in a practical, non-instrumented hospital setting. Our registration system takes as input a patient-specific model and overlays it on the patient using an accurate pose registration technique that requires a single marker as a point of reference to initialize a point cloud-based pose refinement technique. Our method is automatic, easy to use, and runs in real-time on a mobile phone. We conduct quantitative and qualitative analysis of the registration. The results confirm that our AR pose registration system produces an accurate and visually correct overlay of the medical data in real-time.
- 17 January 2022
- Published by Elsevier in Computers & Graphics
- Vol. 103, 61-74
Dynamic projection mapping on deformable stretchable materials using boundary tracking
- 17 January 2022
- Published by Elsevier in Computers & Graphics
- Vol. 103, 61-74
Dynamic projection mapping on deformable stretchable materials using boundary tracking
- 1 November 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 448-453
Quadrotors' Low-cost Vision-based Autonomous Landing Architecture on a Moving Platform
In this paper, a low-cost vision-based autonomous landing architecture for an unmanned aerial vehicle (UAV) on a moving platform is presented. First, a novel landing pad was designed for a monocular camera to robustly detect the pad in both high and low altitudes. In order to solve mirror effect and occasional misidentification, a 3D points cluster algorithm for relative position estimation is presented. Second, the dynamics of the quadrotor is simplified for this lading task and a PD controller is designed based on the estimated relative position. Finally, the low-cost system architecture of the quadrotor and the experiment results are both presented to show the effectiveness of the proposed method.
- 1 November 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 448-453
Quadrotors' Low-cost Vision-based Autonomous Landing Architecture on a Moving Platform
In this paper, a low-cost vision-based autonomous landing architecture for an unmanned aerial vehicle (UAV) on a moving platform is presented. First, a novel landing pad was designed for a monocular camera to robustly detect the pad in both high and low altitudes. In order to solve mirror effect and occasional misidentification, a 3D points cluster algorithm for relative position estimation is presented. Second, the dynamics of the quadrotor is simplified for this lading task and a PD controller is designed based on the estimated relative position. Finally, the low-cost system architecture of the quadrotor and the experiment results are both presented to show the effectiveness of the proposed method.