Mohamad Wahbah
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Mohamad Wahbah has a total of 34 co-authors. Here are the top co-authors by number of shared publications:
- Mohamad Chehadeh
Khalifa University
7 shared publications - Yahya Zweiri
Advanced Research and Innovation Center (ARIC), Khalifa University of Science and Technology, Abu Dhabi, UAE
7 shared publications - Abdulla Ayyad
Advanced Research and Innovation Center (ARIC), Khalifa University, Abu Dhabi, UAE
5 shared publications - Oussama Abdul Hay
Center for Autonomous Robotic Systems Khalifa University Abu Dhabi United Arab Emirates
5 shared publications - Lakmal D. Seneviratne
Khalifa University Center for Autonomous Robotic Systems (KUCARS), Khalifa University of Science and Technology, Abu Dhabi, UAE
4 shared publications - Igor Boiko
Khalifa University
3 shared publications
Latest Publications
- Open Access
- 24 September 2026
- Published by Springer Nature in PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science
- p. 1-22
Contributions to Integrity and Collaboration in Dynamic Sensor Networks
Reliable and safe navigation of autonomous systems is an active field of research, particularly in the context of complex urban environments. A key challenge is navigation integrity, defined as the trust in the correctness of the estimated system state; the transfer of this concept from aviation to collaborative multi-agent systems remains an open research challenge. Addressing this gap, this paper presents the methodological developments and key findings of the DFG-funded i.c.sens research project, which focused on navigation integrity in dynamic collaborative sensor networks. To account for key influencing factors and to structure the research activities accordingly, three central research directions are defined: Observations (sensor characteristics and uncertainties), Methodology (state estimation and integrity monitoring), and Map (dynamic, uncertainty-aware environmental representations). To evaluate the developed approaches and assess their performance under realistic conditions, extensive experiments were conducted. Based on experimental results obtained from publicly available datasets as well as datasets collected by the i.c.sens group, the paper summarizes key achievements of i.c.sens in integrity-aware state estimation under realistic urban conditions. These results show improved navigation performance through multi-agent information exchange, through rigorous uncertainty modeling and through the conception and usage of sophisticated map concepts. Based on these findings, we highlight remaining integrity challenges in dynamic sensor networks and point out promising directions for future research.
- 24 September 2026
- Published by Springer Nature in PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science
- p. 1-22
Open AccessContributions to Integrity and Collaboration in Dynamic Sensor Networks
Reliable and safe navigation of autonomous systems is an active field of research, particularly in the context of complex urban environments. A key challenge is navigation integrity, defined as the trust in the correctness of the estimated system state; the transfer of this concept from aviation to collaborative multi-agent systems remains an open research challenge. Addressing this gap, this paper presents the methodological developments and key findings of the DFG-funded i.c.sens research project, which focused on navigation integrity in dynamic collaborative sensor networks. To account for key influencing factors and to structure the research activities accordingly, three central research directions are defined: Observations (sensor characteristics and uncertainties), Methodology (state estimation and integrity monitoring), and Map (dynamic, uncertainty-aware environmental representations). To evaluate the developed approaches and assess their performance under realistic conditions, extensive experiments were conducted. Based on experimental results obtained from publicly available datasets as well as datasets collected by the i.c.sens group, the paper summarizes key achievements of i.c.sens in integrity-aware state estimation under realistic urban conditions. These results show improved navigation performance through multi-agent information exchange, through rigorous uncertainty modeling and through the conception and usage of sophisticated map concepts. Based on these findings, we highlight remaining integrity challenges in dynamic sensor networks and point out promising directions for future research.
- Open Access
- 18 January 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 39 (3) , 2276-2288
Noise-Tolerant Identification and Tuning Approach Using Deep Neural Networks for Visual Servoing Applications
Vision-based control of unmanned aerial vehicles (UAVs) has been adopted in a wide range of applications due to the availability of low-cost onboard sensors and computers. Tuning such systems to work properly requires extensive domain-specific experience, which limits the growth of emerging applications. Moreover, obtaining performance limits for UAVs performing visual servoing is difficult due to the complexity of the models used. In this article, we propose a novel noise-tolerant approach for real-time identification and tuning of visual servoing systems. This is based on the deep neural networks (DNNs) classification of the system response generated by the modified relay feedback test (MRFT). The proposed method, called DNN with noise-protected MRFT (DNN-NP-MRFT), can be used with a multitude of vision sensors and estimation algorithms despite high levels of sensor noise. The response of DNN-NP-MRFT to noise perturbations is investigated and its effect on identification and tuning performance is analyzed. The proposed DNN-NP-MRFT is able to detect performance changes induced by the use of high latency vision sensors or by integrating an inertial measurement unit sensor into the UAV states estimation pipeline. Experimental identification closely matches simulation results, which can be used to explain the system behavior and predict the closed-loop performance limits for a given hardware and software setup. We also demonstrate the ability of DNN-NP-MRFT-tuned UAVs to reject external disturbances like wind or human push and pull. Finally, we discuss the advantages of the proposed DNN-NP-MRFT visual servoing design approach compared with other approaches in the literature.
- 18 January 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 39 (3) , 2276-2288
Open AccessNoise-Tolerant Identification and Tuning Approach Using Deep Neural Networks for Visual Servoing Applications
Vision-based control of unmanned aerial vehicles (UAVs) has been adopted in a wide range of applications due to the availability of low-cost onboard sensors and computers. Tuning such systems to work properly requires extensive domain-specific experience, which limits the growth of emerging applications. Moreover, obtaining performance limits for UAVs performing visual servoing is difficult due to the complexity of the models used. In this article, we propose a novel noise-tolerant approach for real-time identification and tuning of visual servoing systems. This is based on the deep neural networks (DNNs) classification of the system response generated by the modified relay feedback test (MRFT). The proposed method, called DNN with noise-protected MRFT (DNN-NP-MRFT), can be used with a multitude of vision sensors and estimation algorithms despite high levels of sensor noise. The response of DNN-NP-MRFT to noise perturbations is investigated and its effect on identification and tuning performance is analyzed. The proposed DNN-NP-MRFT is able to detect performance changes induced by the use of high latency vision sensors or by integrating an inertial measurement unit sensor into the UAV states estimation pipeline. Experimental identification closely matches simulation results, which can be used to explain the system behavior and predict the closed-loop performance limits for a given hardware and software setup. We also demonstrate the ability of DNN-NP-MRFT-tuned UAVs to reject external disturbances like wind or human push and pull. Finally, we discuss the advantages of the proposed DNN-NP-MRFT visual servoing design approach compared with other approaches in the literature.
- Open Access
- 27 October 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 73 (00189456) , 1-12
A Neuromorphic Vision-Based Measurement for Robust Relative Localization in Future Space Exploration Missions
Space exploration has witnessed revolutionary changes upon landing of the Perseverance Rover on the Martian surface and demonstrating the first flight beyond Earth by the Mars helicopter, Ingenuity. During their mission on Mars, Perseverance Rover and Ingenuity collaboratively explore the Martian surface, where Ingenuity scouts terrain information for rover’s safe traversability. Hence, determining the relative poses between both the platforms is of paramount importance for the success of this mission. Driven by this necessity, this work proposes a robust relative localization system based on a fusion of neuromorphic vision-based measurements (NVBMs) and inertial measurements. The emergence of neuromorphic vision triggered a paradigm shift in the computer vision community, due to its unique working principle delineated with asynchronous events triggered by variations of light intensities occurring in the scene. This implies that observations cannot be acquired in static scenes due to illumination invariance. To circumvent this limitation, high frequency active landmarks are inserted in the scene to guarantee consistent event firing. These landmarks are adopted as salient features to facilitate relative localization. A novel event-based landmark identification algorithm using Gaussian Mixture Models (GMM) is developed for matching the landmarks correspondences formulating our NVBMs. The NVBMs are fused with inertial measurements in proposed state estimators, landmark tracking Kalman filter (LTKF) and translation decoupled Kalman filter (TDKF) for landmark tracking and relative localization, respectively. The proposed system was tested in a variety of experiments and has outperformed state-of-the-art approaches in accuracy and range.
- 27 October 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 73 (00189456) , 1-12
Open AccessA Neuromorphic Vision-Based Measurement for Robust Relative Localization in Future Space Exploration Missions
Space exploration has witnessed revolutionary changes upon landing of the Perseverance Rover on the Martian surface and demonstrating the first flight beyond Earth by the Mars helicopter, Ingenuity. During their mission on Mars, Perseverance Rover and Ingenuity collaboratively explore the Martian surface, where Ingenuity scouts terrain information for rover’s safe traversability. Hence, determining the relative poses between both the platforms is of paramount importance for the success of this mission. Driven by this necessity, this work proposes a robust relative localization system based on a fusion of neuromorphic vision-based measurements (NVBMs) and inertial measurements. The emergence of neuromorphic vision triggered a paradigm shift in the computer vision community, due to its unique working principle delineated with asynchronous events triggered by variations of light intensities occurring in the scene. This implies that observations cannot be acquired in static scenes due to illumination invariance. To circumvent this limitation, high frequency active landmarks are inserted in the scene to guarantee consistent event firing. These landmarks are adopted as salient features to facilitate relative localization. A novel event-based landmark identification algorithm using Gaussian Mixture Models (GMM) is developed for matching the landmarks correspondences formulating our NVBMs. The NVBMs are fused with inertial measurements in proposed state estimators, landmark tracking Kalman filter (LTKF) and translation decoupled Kalman filter (TDKF) for landmark tracking and relative localization, respectively. The proposed system was tested in a variety of experiments and has outperformed state-of-the-art approaches in accuracy and range.
- Open Access
- 21 June 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 22 (14) , 14397-14414
Real-Time Adaptive Dynamics Based State Estimation Scheme for Unmanned Aircrafts
In this paper we present a state estimation scheme for Unmanned Aircrafts (UAs) utilizing dynamics based models and multi-sensor data fusion. Employing the UA dynamics in estimation can substantially enhance the estimator performance, but obtaining accurate dynamics parameters for each UA is computationally costly and complex. To eliminate these issues, we propose two decoupled Extended Kalman Filters (EKFs), namely the Rotational Decoupled Extended Kalman Filter (RDEKF) and the Translational Decoupled Extended Kalman Filter (TDEKF). The dynamics parameters in these filters are identified in real-time using the Deep Neural Network and the Modified Relay Feedback Test (DNN-MRFT) approach. This approach doesn’t demand prior knowledge of the UA physical parameters, requiring only an Inertial Measurement Unit (IMU) and a positioning system for model classification. Our estimation scheme provides position, velocity and attitude estimates, in addition to smooth lag-free inertial acceleration estimates. We show experimentally the advantages of our approach on trajectory tracking problems that uses low rate position sensors. We also demonstrate how utilizing the estimated acceleration in feedback control can reduce the tracking error of an optimally tuned system by 43%. Moreover, the proposed estimator produces smooth estimates that leads to a reduction of controller action by 6.6%, when compared to kinematic based estimators. We compare the achieved results against other methods that require full prior knowledge of the UA parameters or the noise models, and show advantages in performance and real-time capability.
- 21 June 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 22 (14) , 14397-14414
Open AccessReal-Time Adaptive Dynamics Based State Estimation Scheme for Unmanned Aircrafts
In this paper we present a state estimation scheme for Unmanned Aircrafts (UAs) utilizing dynamics based models and multi-sensor data fusion. Employing the UA dynamics in estimation can substantially enhance the estimator performance, but obtaining accurate dynamics parameters for each UA is computationally costly and complex. To eliminate these issues, we propose two decoupled Extended Kalman Filters (EKFs), namely the Rotational Decoupled Extended Kalman Filter (RDEKF) and the Translational Decoupled Extended Kalman Filter (TDEKF). The dynamics parameters in these filters are identified in real-time using the Deep Neural Network and the Modified Relay Feedback Test (DNN-MRFT) approach. This approach doesn’t demand prior knowledge of the UA physical parameters, requiring only an Inertial Measurement Unit (IMU) and a positioning system for model classification. Our estimation scheme provides position, velocity and attitude estimates, in addition to smooth lag-free inertial acceleration estimates. We show experimentally the advantages of our approach on trajectory tracking problems that uses low rate position sensors. We also demonstrate how utilizing the estimated acceleration in feedback control can reduce the tracking error of an optimally tuned system by 43%. Moreover, the proposed estimator produces smooth estimates that leads to a reduction of controller action by 6.6%, when compared to kinematic based estimators. We compare the achieved results against other methods that require full prior knowledge of the UA parameters or the noise models, and show advantages in performance and real-time capability.
- Open Access
Noise Tolerant Identification and Tuning Approach Using Deep Neural Networks For Visual Servoing Applications
Vision based control of Unmanned Aerial Vehicles (UAVs) has been adopted by a wide range of applications due to the availability of low-cost on-board sensors and computers. Tuning such systems to work properly requires extensive domain specific experience, which limits the growth of emerging applications. Moreover, obtaining performance limits of UAV based visual servoing is difficult due to the complexity of the models used. In this paper, we propose a novel noise tolerant approach for real-time identification and tuning of visual servoing systems, based on deep neural networks (DNN) classification of system response generated by the modified relay feedback test (MRFT). The proposed method, called DNN with noise protected MRFT (DNN-NP-MRFT), can be used with a multitude of vision sensors and estimation algorithms despite the high levels of sensor's noise. Response of DNN-NP-MRFT to noise perturbations is investigated and its effect on identification and tuning performance is analyzed. The proposed DNN-NP-MRFT is able to detect performance changes due to the use of high latency vision sensors, or due to the integration of inertial measurement unit (IMU) measurements in the UAV states estimation. Experimental identification closely matches simulation results, which can be used to explain system behaviour and predict the closed loop performance limits for a given hardware and software setup. We also demonstrate the ability of DNN-NP-MRFT tuned UAVs to reject external disturbances like wind, or human push and pull. Finally, we discuss the advantages of the proposed DNN-NP-MRFT visual servoing design approach compared with other approaches in literature.
Open AccessNoise Tolerant Identification and Tuning Approach Using Deep Neural Networks For Visual Servoing Applications
Vision based control of Unmanned Aerial Vehicles (UAVs) has been adopted by a wide range of applications due to the availability of low-cost on-board sensors and computers. Tuning such systems to work properly requires extensive domain specific experience, which limits the growth of emerging applications. Moreover, obtaining performance limits of UAV based visual servoing is difficult due to the complexity of the models used. In this paper, we propose a novel noise tolerant approach for real-time identification and tuning of visual servoing systems, based on deep neural networks (DNN) classification of system response generated by the modified relay feedback test (MRFT). The proposed method, called DNN with noise protected MRFT (DNN-NP-MRFT), can be used with a multitude of vision sensors and estimation algorithms despite the high levels of sensor's noise. Response of DNN-NP-MRFT to noise perturbations is investigated and its effect on identification and tuning performance is analyzed. The proposed DNN-NP-MRFT is able to detect performance changes due to the use of high latency vision sensors, or due to the integration of inertial measurement unit (IMU) measurements in the UAV states estimation. Experimental identification closely matches simulation results, which can be used to explain system behaviour and predict the closed loop performance limits for a given hardware and software setup. We also demonstrate the ability of DNN-NP-MRFT tuned UAVs to reject external disturbances like wind, or human push and pull. Finally, we discuss the advantages of the proposed DNN-NP-MRFT visual servoing design approach compared with other approaches in literature.
- 6 October 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Control Systems Technology
- Vol. 30 (4) , 1561-1577
Multirotors From Takeoff to Real-Time Full Identification Using the Modified Relay Feedback Test and Deep Neural Networks
Low-cost real-time identification of multirotor unmanned aerial vehicle (UAV) dynamics is an active area of research supported by the surge in demand and emerging application domains. Such real-time identification capabilities shorten development time and cost, making UAVs’ technology more accessible, and enable a wide variety of advanced applications. In this article, we present a novel comprehensive approach, called DNN-MRFT, for real-time identification and tuning of multirotor UAVs using the modified relay feedback test (MRFT) and deep neural networks (DNNs). The main contribution is the development of a generalized framework for the application of DNN-MRFT to higher order systems. One of the notable advantages of DNN-MRFT is the exact estimation of identified process gain, which mitigates the inaccuracies introduced due to the use of the describing function method in approximating the response of Lure’s systems. A secondary contribution is a generalized controller based on DNN-MRFT that takes off a UAV with unknown dynamics and identifies the inner loops dynamics in-flight. Using the developed framework, DNN-MRFT is sequentially applied to the outer translational loops of the UAV utilizing in-flight results obtained for the inner attitude loops. DNN-MRFT takes on average 15 s to get the full knowledge of multirotor UAV dynamics, and without any further tuning or calibration, the UAV would be able to pass through a vertical window and accurately follow trajectories achieving state-of-the-art performance. Such demonstrated accuracy, speed, and robustness of identification pushes the limits of state of the art in real-time identification of UAVs.
- 6 October 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Control Systems Technology
- Vol. 30 (4) , 1561-1577
Multirotors From Takeoff to Real-Time Full Identification Using the Modified Relay Feedback Test and Deep Neural Networks
Low-cost real-time identification of multirotor unmanned aerial vehicle (UAV) dynamics is an active area of research supported by the surge in demand and emerging application domains. Such real-time identification capabilities shorten development time and cost, making UAVs’ technology more accessible, and enable a wide variety of advanced applications. In this article, we present a novel comprehensive approach, called DNN-MRFT, for real-time identification and tuning of multirotor UAVs using the modified relay feedback test (MRFT) and deep neural networks (DNNs). The main contribution is the development of a generalized framework for the application of DNN-MRFT to higher order systems. One of the notable advantages of DNN-MRFT is the exact estimation of identified process gain, which mitigates the inaccuracies introduced due to the use of the describing function method in approximating the response of Lure’s systems. A secondary contribution is a generalized controller based on DNN-MRFT that takes off a UAV with unknown dynamics and identifies the inner loops dynamics in-flight. Using the developed framework, DNN-MRFT is sequentially applied to the outer translational loops of the UAV utilizing in-flight results obtained for the inner attitude loops. DNN-MRFT takes on average 15 s to get the full knowledge of multirotor UAV dynamics, and without any further tuning or calibration, the UAV would be able to pass through a vertical window and accurately follow trajectories achieving state-of-the-art performance. Such demonstrated accuracy, speed, and robustness of identification pushes the limits of state of the art in real-time identification of UAVs.
- Open Access
- 1 October 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Field Robotics
- Vol. 1, 1-28
Aerial Firefighting System for Suppression of Incipient Cladding Fires
- 1 October 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Field Robotics
- Vol. 1, 1-28
Open AccessAerial Firefighting System for Suppression of Incipient Cladding Fires
- Open Access
Multirotors from Takeoff to Real-Time Full Identification Using the Modified Relay Feedback Test and Deep Neural Networks
Low cost real-time identification of multirotor unmanned aerial vehicle (UAV) dynamics is an active area of research supported by the surge in demand and emerging application domains. Such real-time identification capabilities shorten development time and cost, making UAVs' technology more accessible, and enable a wide variety of advanced applications. In this paper, we present a novel comprehensive approach, called DNN-MRFT, for real-time identification and tuning of multirotor UAVs using the Modified Relay Feedback Test (MRFT) and Deep Neural Networks (DNN). The main contribution is the development of a generalized framework for the application of DNN-MRFT to higher-order systems. One of the notable advantages of DNN-MRFT is the exact estimation of identified process gain, which mitigates the inaccuracies introduced due to the use of the describing function method in approximating the response of Lure's systems. A secondary contribution is a generalized controller based on DNN-MRFT that takes-off a UAV with unknown dynamics and identifies the inner loops dynamics in-flight. Using the developed framework, DNN-MRFT is sequentially applied to the outer translational loops of the UAV utilizing in-flight results obtained for the inner attitude loops. DNN-MRFT takes on average 15 seconds to get the full knowledge of multirotor UAV dynamics and without any further tuning or calibration the UAV would be able to pass through a vertical window, and accurately follow trajectories achieving state-of-the-art performance. Such demonstrated accuracy, speed, and robustness of identification pushes the limits of state-of-the-art in real-time identification of UAVs.
Open AccessMultirotors from Takeoff to Real-Time Full Identification Using the Modified Relay Feedback Test and Deep Neural Networks
Low cost real-time identification of multirotor unmanned aerial vehicle (UAV) dynamics is an active area of research supported by the surge in demand and emerging application domains. Such real-time identification capabilities shorten development time and cost, making UAVs' technology more accessible, and enable a wide variety of advanced applications. In this paper, we present a novel comprehensive approach, called DNN-MRFT, for real-time identification and tuning of multirotor UAVs using the Modified Relay Feedback Test (MRFT) and Deep Neural Networks (DNN). The main contribution is the development of a generalized framework for the application of DNN-MRFT to higher-order systems. One of the notable advantages of DNN-MRFT is the exact estimation of identified process gain, which mitigates the inaccuracies introduced due to the use of the describing function method in approximating the response of Lure's systems. A secondary contribution is a generalized controller based on DNN-MRFT that takes-off a UAV with unknown dynamics and identifies the inner loops dynamics in-flight. Using the developed framework, DNN-MRFT is sequentially applied to the outer translational loops of the UAV utilizing in-flight results obtained for the inner attitude loops. DNN-MRFT takes on average 15 seconds to get the full knowledge of multirotor UAV dynamics and without any further tuning or calibration the UAV would be able to pass through a vertical window, and accurately follow trajectories achieving state-of-the-art performance. Such demonstrated accuracy, speed, and robustness of identification pushes the limits of state-of-the-art in real-time identification of UAVs.