MIMuhammad Twaha Ibrahim

Muhammad Twaha Ibrahim

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Muhammad Twaha Ibrahim has a total of 13 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Democratising Multi‐Projector Displays

    by Aditi Majumder, Muhammad Twaha Ibrahim

    As data exploded with the advent of smartphones in the first decade of this century, the world entered an era of experiences. The advent of VR/AR headsets a decade later brought us into the age of experiences. VR/AR headsets have transformed the way people experience data, especially in gaming and entertainment. However, headsets in their current form factor can be cumbersome, sometimes causing fatigue with long‐duration use. They can be particularly isolating for applications that need multiple individuals to collaborate together. Spatially augmented reality (SAR) using multiple projectors aims to bring the surround, large field‐of‐view (FOV) collaborative experiences out of VR/AR headsets by merging digital content from multiple projectors with the physical environment around users. The vision is to use multiple projectors to project digital imagery on everyday surfaces surrounding users by employing cameras to understand the surface for correct merging of the digital with the physical. This paper presents a detailed state‐of‐the‐art survey of advancements in methodologies for multi‐projector aggregation to achieve SAR and state‐of‐the‐art hardware technologies (such as cameras, projectors, and interaction devices) available today to build multi‐projector‐based displays and interaction environments. Most importantly, we look at this space not only from the perspective of research and development, but also from the practical challenges and considerations in the deployment of such systems.


  • Open Access

    Illuminating precise stencils on surgical sites using projection-based augmented reality

    by Muhammad Twaha Ibrahim, Aditi Majumder, M. Gopi, Lohrasb R. Sayadi, Raj M. Vyas


  • Real-Time Seamless Multi-Projector Displays on Deformable Surfaces

    by Muhammad Twaha Ibrahim, M. Gopi, Aditi Majumder

    Prior works on multi-projector displays have focused primarily on static rigid objects, some focusing on dynamic rigid objects. However, works on projection based displays on deformable dynamic objects have focused only on small scale single projector displays. Tracking a deformable dynamic surface and updating projections precisely in real time on it is a significantly challenging task, even for a single projector system. In this paper, we present the first end-to-end solution for achieving a real-time, seamless display on deformable surfaces using mutliple unsychronized projectors without requiring any prior knowledge of the surface or device parameters. The system first accurately calibrates multiple RGB-D cameras and projectors using the deformable display surface itself, and then using those calibrated devices, tracks the continuous changes in the surface shape. Based on the deformation and projector calibration, the system warps and blends the image content in real-time to create a seamless display on a surface that continuously changes shape. Using multiple projectors and RGB-D cameras, we provide the much desired aspect of scale to the displays on deformable surfaces. Most prior dynamic multi-projector systems assume rigid objects and depend critically on the constancy of surface normals and non-existence of local shape deformations. These assumptions break in deformable surfaces making prior techniques inapplicable. Point-based correspondences become inadequate for calibration, exacerbated with no synchronization between the projectors. A few works address non-rigid objects with several restrictions like targeting semi-deformable surfaces (e.g. human face), or using single coaxial (optically aligned) projector-camera pairs, or temporally synchronized cameras. We break loose from such restrictions and handle multiple projector systems for dynamic deformable fabric-like objects using temporally unsynchronized devices. We devise novel methods using ray and plane-based constraints imposed by the pinhole camera model to address these issues and design new blending methods dependent on 3D distances suitable for deformable surfaces. Finally, unlike all prior work with rigid dynamic surfaces that use a single RGB-D camera, we devise a method that involve all RGB-D cameras for tracking since the surface is not seen completely by a single camera. These methods enable a seamless display at scale in the presence of continuous movements and deformations. This work has tremendous applications on mobile and expeditionary systems where environmentals (e.g. wind, vibrations, suction) cannot be avoided. One can create large displays on tent walls in remote, austere military or emergency operations in minutes to support large scale command and control, mission rehearsal or training operations. It can be used to create displays on mobile and inflatable objects for tradeshows/events and touring edutainment applications.


  • 3D Gamut Morphing for Non-Rectangular Multi-Projector Displays

    by Mahdi Abbaspour Tehrani, Muhammad Twaha Ibrahim, Aditi Majumder, M. Gopi

    In a spatially augmented reality system, multiple projectors are tiled on a complex shaped surface to create a seamless display on it. This has several applications in visualization, gaming, education and entertainment. The main challenges in creating seamless and undistorted imagery on such complex shaped surfaces are geometric registration and color correction. Prior methods that provide solutions for the spatial color variation in multi-projector displays assume rectangular overlap regions across the projectors that is possible only on flat surfaces with extremely constrained projector placement. In this article, we present a novel and fully automated method for removing color variations in a multi-projector display on arbitrary shaped smooth surfaces using a general color gamut morphing algorithm that can handle any arbitrarily shaped overlap between the projectors and assures imperceptible color variations across the display surface.


  • Spatially Augmented Reality on Non-rigid Dynamic Surfaces

    by Muhammad Twaha Ibrahim, Aditi Majumder

    We will demonstrate a spatially augmented reality system on nonrigid dynamic surfaces like stretchable fabrics. Using a single projector and RGB-D camera, our system adapts the projection to the changing shape of the non-rigid surface automatically. Such systems have applications in various domains such as art, design, entertainment and medicine. In particular, we we will demonstrate the use of the system as a surgical guidance system for cleft palate surgery using a Simulare cleft model.


  • Open Access

    Augmented Reality Patient-Specific Registration for Medical Visualization

    by Isabela Figueira, Muhammad Twaha Ibrahim, Aditi Majumder, M. Gopi

    In recent years, medical research has made extensive use of Augmented Reality (AR) for visualization. These visualizations provide improved 3D understanding and depth perception for surgeons and medical staff during surgical planning, medical training, and procedures. Often, AR in medicine involves impractical and extensive instrumentation in order to provide the precision needed for clinical use. We propose a mobile AR 3D model registration system for use in a practical, non-instrumented hospital setting. Our registration system takes as input a patient-specific model and overlays it on the patient using an accurate pose registration technique that requires a single marker as a point of reference to initialize a point cloud-based pose refinement technique. Our method is automatic, easy to use, and runs in real-time on a mobile phone. We conduct quantitative and qualitative analysis of the registration. The results confirm that our AR pose registration system produces an accurate and visually correct overlay of the medical data in real-time.


  • Quadrotors' Low-cost Vision-based Autonomous Landing Architecture on a Moving Platform

    by Jiaqi Jiang, Yuhua Qi, Muhammad Ibrahim, Jianan Wang, Chunyan Wang, Jiayuan Shan

    In this paper, a low-cost vision-based autonomous landing architecture for an unmanned aerial vehicle (UAV) on a moving platform is presented. First, a novel landing pad was designed for a monocular camera to robustly detect the pad in both high and low altitudes. In order to solve mirror effect and occasional misidentification, a 3D points cluster algorithm for relative position estimation is presented. Second, the dynamics of the quadrotor is simplified for this lading task and a PD controller is designed based on the estimated relative position. Finally, the low-cost system architecture of the quadrotor and the experiment results are both presented to show the effectiveness of the proposed method.