NNNikhil V. Navkar

Nikhil V. Navkar

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Nikhil V. Navkar has a total of 65 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Vision-based markerless surgical tool tracking in open surgery: A scoping review

    by Hawa Hamza, Rouaa Naim, Dehlela Shabir, Khaled Shaban, Julien Abinahed, Zhigang Deng, Nikhil V. Navkar

  • Open Access

    Periodic Anderson Acceleration for GPU-based Elastic Body Simulation 61

    by Youyi Yang, Nikhil Navkar, Zhigang Deng

    Vertex Block Descent (VBD) solves implicit time integration through parallel per-vertex Newton steps, offering unconditional stability and GPU efficiency for elastic body simulation. Because its block Gauss-Seidel update propagates information only locally, low-frequency error modes spanning the mesh decay slowly across iterations. Chebyshev acceleration improves asymptotic convergence, but does not directly eliminate the globally correlated residuals. We introduce periodic Anderson Acceleration (PAA) for VBD, where a small least-squares mixing step is applied every K iterations between Chebyshev-accelerated sweeps. The two accelerators are complementary: Chebyshev drives fast local convergence while Anderson Acceleration (AA) corrects global error modes through cross-vertex coupling extracted from recent iterates. A fused GPU kernel computes the full Gram system in a single pass, limiting overhead to under 5%. We show that periodic application with a window of m=2 outperforms every-iteration AA, as Chebyshev-accelerated iterates sampled at intervals provide a more linearly independent mixing basis. Combined with per-tet stiffness ramping, PAA reduces the final elastic energy by 6-49% over Chebyshev-only VBD at less than 5% wall-clock overhead, with the largest gains on geometrically complex meshes and extreme deformations. PAA requires no global matrix assembly, no mesh hierarchy, and adds a single integer parameter.

  • Open Access

    Dynamic Augmented Reality Cues for Telementoring in Laparoscopic Surgery: Usability Study

    by Jhasketan Padhan, Hawa Hamza, Dehlela Shabir, Julien Abinahed, Panagiotis Tsiamyrtzis, Zhigang Deng, Nikhil V Navkar

    Background: Surgical telementoring enables a remote expert surgeon (mentor) to guide an operating surgeon (mentee) during surgery and facilitates the transfer of surgical skills. However, commonly used audio and static visual cues are inadequate to demonstrate complex tool-tissue interactions. To overcome this limitation, dynamic augmented reality (AR)–based visual cues are overlayed on the operative field to demonstrate precise instrument movements. Objective: The objective of this work was to evaluate dynamic AR cues and identify the most suitable cue that effectively demonstrates the required motions of surgical instruments during laparoscopy. Methods: A user study was conducted in a simulated environment among mentor-mentee pairs using 3 dynamic AR cues (hand gestures, a 3D pointer, and a virtual tool). The task assessed how closely the mentee was able to follow the mentor. The outcomes measured were (1) dynamic time warping distance, representing the closeness of the paths followed; (2) angular error in tooltip orientation; and (3) the NASA Task Load Index, assessing cognitive workload during telementoring. Results: Telementoring using the virtual tool resulted in a reduced dynamic time warping distance compared with hand gestures ( P <.01 for 12/13, 92.3% of the trials) and the 3D pointer ( P <.05 for 11/13, 84.6% of the trials). Lower orientation error was also noted while using the virtual tool as compared with hand gestures ( P <.05 for 5 of 6 poses). There were no substantial differences in the NASA Task Load Index scores. Conclusions: Use of a virtual tool (as a dynamic AR cue) enabled the mentee to follow the mentor’s instructions with fewer errors than both hand gestures and a 3D pointer without increasing cognitive workload. Further research is needed to assess the clinical effectiveness of the virtual tool during live surgery.

  • Open Access

    Evaluation of User Interfaces for Actuated Control of Endoscopes During Flexible Endoscopy

    by Sofia Basha, Mohammad Khorasani, Nihal Abdurahiman, Jhasketan Padhan, Victor Baez, Abdulla Al-Ansari, Panagiotis Tsiamyrtzis, Aaron T. Becker, Nikhil V. Navkar

    Objective: Flexible endoscopy is a valuable tool in diagnostic procedures, enabling examination of internal areas via natural orifices. An actuation system tends to improve the procedural outcomes by enabling controlled movements of the endoscope and offering a stable view of the operative field. A user interface is used to issue actuation commands to these systems. Thus, selection of an ideal user interface is vital to improve the ergonomics for the endoscopist and to ensure efficient endoscope navigation. The objective of this work is to perform an in-depth comparative analysis of various user interfaces to optimize endoscope maneuverability. Methods and procedures: A custom-built actuation system was used to maneuver a flexible endoscope. The actuation system enabled translational and rotational movement of the endoscope’s shaft as well as supported left/right and up/down steering of the endoscope’s distal end. Four user interfaces (head-motion based device, eye-gaze based device, a stylus, and a joystick) working under three interaction modes (continuous, discrete, threshold) along with a clutching mechanism were used to issue commands to the actuation system. A user study was conducted to assess the effectiveness of the user interfaces for two scenarios: Scenario-A, which involved maneuvering the endoscope’s distal end to focus on a localized operative field, and Scenario-B, which required targeting polyps during the withdrawal phase of a simulated colonoscopy. Results: In Scenario-A, the head motion-based device and stylus, when used in continuous interaction mode, resulted in the shorter task duration and fewer clutches. The joystick, operating under threshold interaction mode, also demonstrated a reduced task duration. Additionally, the joystick led to fewer instances of the endoscope’s focus shifting outside the localized operative field. In Scenario-B, eye gaze-based device under discrete interaction mode took the longest duration for task completion. The continuous mode of the stylus took the shortest duration to target polyps, once visualized in the operating field. However, it also required the highest number of clutches compared to other user interface and interaction modes. Conclusion: The joystick consistently outperformed other interfaces across all interaction modes. Performance among the other user interfaces varied based on the parameters of the scenarios. Head motion-based and eye-based user interfaces enabled hands-free manipulation of the endoscope. This study establishes a benchmark for enhancing both user interfaces and interaction modes in actuated flexible endoscopy.

  • Open Access

    A Real-Time Markerless Approach for 3D Pose Estimation of Laparoscopic Instruments in Surgical Training Simulators

    by Dehlela Shabir, Jhasketan Padhan, Nihal Abdurahiman, Julien Abinahed, Zhigang Deng, Nikhil V. Navkar

    Box trainers are widely used for laparoscopic skills training due to their ease of setup and realistic tool-tissue interaction. Automating skill assessment on these systems can enhance training by reducing analysis time and eliminating subjective evaluations. Achieving this requires accurate real-time estimation of the instrument tooltip’s three-dimensional (3D) pose. However, existing methods either depend on additional sensing hardware, which introduces ergonomic challenges, or lack real-time capabilities. A modular architecture has been developed for estimation of an instrument’s tooltip pose from video frames acquired during laparoscopic training. Our method incorporates a GPU-based algorithm that takes input from a customized deep learning model (YOLOv7), detects the edges of the surgical instrument, and computes tooltip’s 3D pose. Additionally, an automated 3D-pose dataset generation technique is introduced to generate datasets for training the model. Our method was evaluated using a vision-based tracking experiment, achieving 3D positional errors of 0.72 mm, 0.88 mm, and 3.81 mm over the X, Y, and Z-axes, and an orientation error of 5.65° with an end-to-end latency of 144 ms and sustained real-time throughput of 11.4 frames per second (fps). The proposed method enables accurate estimation of laparoscopic instrument tooltip poses without the need for additional hardware or markers. This work represents a significant step toward automated skill assessment in laparoscopic training using box trainers.


  • Open Access

    Mixed reality-based training simulator for learning scope maneuvering skills in hysteroscopy

    by Waseem Palliyali, Hawa Hamza, Mohammad Khorasani, Omar Aboumarzouk, Abdulla Al Ansari, Zhigang Deng, Nikhil V. Navkar

    Scope maneuvering skills are essential for performing hysteroscopy. Conventional methods using synthetic or animal models provide limited training value due to lack of realism, while virtual reality simulators can be prohibitively expensive. In this work we present a low-cost, portable, Mixed Reality (MR) based hysteroscopy simulator. The prototype was developed using a Head-Mounted Display (HMD) device (Meta Quest 3), and 3D printed components designed to simulate scope movements. When observed through using the pass-through feature of the HMD device, virtual elements (including the operating table, screen displaying a dynamic operative field, virtual patient, and surgical scope system) were spatially rendered around the operator. To evaluate the prototype, a user study was conducted using a real scope and the MR simulator. Subjects completed a training phase (10 trials) followed by a validation phase (2 trials), during which various outcomes were measured to assess the impact of the training environment. Training using the MR simulator was comparable to training using the real scope, resulting in similar completion times during validation trials. Perceived workload (measured using SURG-TLX scores) decreased over repeated trials, showing no significant variation between environments. Feeback survey indicated equivalent learning, confidence, and perceived usefulness in both training environments. We conclude that a low-cost simulator is feasible with MR technology. The simulator generates a realistic and immersive environment mimicking both the operating room and the operative field, enabling hands-on training to learn the hand-eye coordination skills required for maneuvering a scope during hysteroscopy.


  • Open Access

    HySim: towards development of a hybrid simulation framework with improved visual and tactile realism for minimally invasive surgeries

    by Waseem Palliyali, Hawa Hamza, Santu Paul, Ali Baig, Abdulla Al-Ansari, Omar Aboumarzouk, Zhigang Deng, Nikhil V. Navkar

    Simulation-based training is essential for developing minimally invasive surgical skills. While box trainers provide tactile feedback for practicing techniques like suturing and knot-tying, they lack visual realism. Virtual Reality (VR) simulators provide a visually realistic environment but often lack tactile feedback. This work integrates the strengths of both box trainers and VR simulators in a simulation framework. The proposed simulation framework, HySim, combines virtual and physical tissues into a unified operative view, thereby improving visual and tactile realism. HySim was assessed on: (a) simulation of surgical scenarios, (b) feedback from 10 participants specialized in robotic urology surgery on visual and tactile realism, and usefulness, and (c) the alignment of virtual and physical tissues during scope movements. HySim was successfully deployed for both laparoscopic (bowel anastomosis) and robotic (urethral dissection) scenarios. Compared to VR simulator, surgeons rated HySim higher for instrument motion and handling ( p = 0.042), tool-tissue interaction ( p = 0.022), tissue movement and behavior ( p = 0.004), and usefulness ( p = 0.042). It was also rated higher compared to box trainer for the operative view ( p = 0.042). However, all three simulation environments received similar scores for the likelihood of adoption. For a scope tilt/pan movement with speed less than 10 degrees per second, the physical and virtual tissues did not have noticeable misalignment. HySim can enhance the training environment by improving both visual realism and tactile feedback. Further user studies are required to assess HySim for simulating generic and patient-specific preoperative training scenarios.

  • Open Access

    Evaluating Human-Robot Interfaces for Maneuvering Surgical Laparoscopes using Robotic Scope Assistant Systems

    by Sofia Basha, Malek Anbatawi, Nihal Abdurahiman, Jhasketan Padhan, Victor M. Baez, Abdulla Al-Ansari, Panagiotis Tsiamyrtzis, Aaron T. Becker, Nikhil V. Navkar

    Robotic scope assistant systems allow surgeons to adjust the operative field view during surgery by robotically maneuvering laparoscopes. A Human-Robot Interface (HRI) is used for issuing commands to these systems, with an interaction mode mapping these commands to laparoscope movements. Optimizing the HRI and interaction mode can streamline laparoscope positioning as well as reduce cognitive workload, helping the surgeon focus on the surgical procedure. Comparing and assessing various HRIs and interaction modes is essential for efficient laparoscope maneuvering. This study evaluates HRIs based on head-motion, eye-motion, hand-motion, and voice-input operating under three interaction modes (namely: discrete, continuous, and threshold). The participants performed a user study comparing different HRIs under two simulated surgical scenarios (one in a real environment and the other in a virtual environment). The results indicated that head and eye-based HRIs performed well in continuous interaction mode, while the voice-based interface suffered from a delay. Conversely, hand-based HRIs demonstrated superior performance in both scenarios across all evaluation parameters. The study provides a benchmark for the comparison of different HRIs and provides insights into the effectiveness, limitations, and potential advantages of different HRIs.


  • Open Access

    Dynamic Augmented Reality Cues for Telementoring in Minimally Invasive Surgeries: Scoping Review

    by Hawa Hamza, Omar M Aboumarzouk, Abdulla Al-Ansari, Nikhil V Navkar

    Background: Remote surgeons use telementoring technologies to provide real-time guidance during minimally invasive surgeries (MIS). Such technologies are continuously improving with the integration of dynamic augmented reality (AR) cues. This includes virtual overlays of hand gestures, pointers, and surgical tools onto the operating surgeon’s view. The operating surgeon comprehends this augmented information to operate on the patient. Thus, understanding these dynamic AR cues (either during surgical training or live surgery) is crucial. Objective: In this paper, we aimed to review the existing telementoring technologies that use dynamic AR cues during MIS. This review describes the MIS (including surgery type, specialty, procedure, and clinical trial), the telementoring system, the dynamic AR cues generated by these systems, and evaluation of the technology in terms of technical aspects, user perceptions, skills gained, and patient outcomes. Methods: A scoping review was conducted using PubMed, Web of Science, Scopus, IEEE Xplore, and ACM Digital Library databases. The search terms included “telementoring,” “minimally invasive surgery,” and “augmented reality” without restrictions imposed on the publication year. Articles covering telementoring using dynamic AR cues during MIS, including laparoscopic and robot-assisted, were identified. Results: A total of 21 articles were included and categorized based on type of surgery, the telementoring technology used, and evaluation of the technology. Most of the articles reported on laparoscopic suturing performed using synthetic phantoms. Hand gestures and surgical tools were the most frequently used dynamic AR cues (10 articles on each cue), while the mentors and mentees primarily consisted of experienced surgeons and medical students. The studies assessing the telementoring technologies were either descriptive (7 articles) or analytical (14 articles) where it was compared against no cue, prerecorded visual cue, in-person guidance, audio cue, or static AR cue. Outcomes were measured mostly using skills gained (13 articles) and user perception about the telementoring system. Conclusions: In general, telementoring using dynamic AR cues resulted in positive outcomes during MIS. In some cases, they were considered on par with conventional methods such as audio cues and in-person guidance. Further randomized controlled trials are required to objectively assess its clinical benefits.