Fábio Azevedo
Research Subjects
Fábio Azevedo has a total of 35 co-authors. Here are the top co-authors by number of shared publications:
- João Pedro Matos Carvalho
Universidade de Lisboa
7 shared publications - Dário Pedro
PDMFC, 1300-609 Lisbon, Portugal
6 shared publications - André Ferreira
Beyond Vision, 3830-352 Ílhavo, Portugal
4 shared publications - André Mora
NOVA School of Science and Technology, Center of Technology and Systems (UNINOVA-CTS) and Associated Lab of Intelligent Systems (LASI), NOVA University Lisbon, 2829-516 Lisbon, Portugal
4 shared publications - Luis Miguel de Campos
Universidad de Granada
4 shared publications - Alfredo Martins
INESCTEC—Institute for Systems and Computer Engineering, Technology and Science, Rua Dr. Roberto Frias, 4200-465 Porto, Portugal
3 shared publications
Latest Publications
- 7 July 2022
- Published by Springer Nature
- p. 43-57
Open-Source Mapping Method Applied to Thermal Imagery
- 7 July 2022
- Published by Springer Nature
- p. 43-57
Open-Source Mapping Method Applied to Thermal Imagery
- Open Access
Precision Landing for Low-Maintenance Remote Operations with UAVs
This work proposes a fully integrated ecosystem composed of three main components with a complex goal: to implement an autonomous system with a UAV requiring little to no maintenance and capable of flying autonomously. For this goal, was developed an autonomous UAV, an online platform capable of its management and a landing platform to enclose and charge the UAV after flights. Furthermore, a precision landing algorithm ensures no need for human intervention for long-term operations.
Open AccessPrecision Landing for Low-Maintenance Remote Operations with UAVs
This work proposes a fully integrated ecosystem composed of three main components with a complex goal: to implement an autonomous system with a UAV requiring little to no maintenance and capable of flying autonomously. For this goal, was developed an autonomous UAV, an online platform capable of its management and a landing platform to enclose and charge the UAV after flights. Furthermore, a precision landing algorithm ensures no need for human intervention for long-term operations.
- Open Access
- 13 August 2021
- Published by MDPI AG in Remote Sensing
- Vol. 13 (16) , 3227
How to Build a 2D and 3D Aerial Multispectral Map?—All Steps Deeply Explained
The increased development of camera resolution, processing power, and aerial platforms helped to create more cost-efficient approaches to capture and generate point clouds to assist in scientific fields. The continuous development of methods to produce three-dimensional models based on two-dimensional images such as Structure from Motion (SfM) and Multi-View Stereopsis (MVS) allowed to improve the resolution of the produced models by a significant amount. By taking inspiration from the free and accessible workflow made available by OpenDroneMap, a detailed analysis of the processes is displayed in this paper. As of the writing of this paper, no literature was found that described in detail the necessary steps and processes that would allow the creation of digital models in two or three dimensions based on aerial images. With this, and based on the workflow of OpenDroneMap, a detailed study was performed. The digital model reconstruction process takes the initial aerial images obtained from the field survey and passes them through a series of stages. From each stage, a product is acquired and used for the following stage, for example, at the end of the initial stage a sparse reconstruction is produced, obtained by extracting features of the images and matching them, which is used in the following step, to increase its resolution. Additionally, from the analysis of the workflow, adaptations were made to the standard workflow in order to increase the compatibility of the developed system to different types of image sets. Particularly, adaptations focused on thermal imagery were made. Due to the low presence of strong features and therefore difficulty to match features across thermal images, a modification was implemented, so thermal models could be produced alongside the already implemented processes for multispectral and RGB image sets.
- 13 August 2021
- Published by MDPI AG in Remote Sensing
- Vol. 13 (16) , 3227
Open AccessHow to Build a 2D and 3D Aerial Multispectral Map?—All Steps Deeply Explained
The increased development of camera resolution, processing power, and aerial platforms helped to create more cost-efficient approaches to capture and generate point clouds to assist in scientific fields. The continuous development of methods to produce three-dimensional models based on two-dimensional images such as Structure from Motion (SfM) and Multi-View Stereopsis (MVS) allowed to improve the resolution of the produced models by a significant amount. By taking inspiration from the free and accessible workflow made available by OpenDroneMap, a detailed analysis of the processes is displayed in this paper. As of the writing of this paper, no literature was found that described in detail the necessary steps and processes that would allow the creation of digital models in two or three dimensions based on aerial images. With this, and based on the workflow of OpenDroneMap, a detailed study was performed. The digital model reconstruction process takes the initial aerial images obtained from the field survey and passes them through a series of stages. From each stage, a product is acquired and used for the following stage, for example, at the end of the initial stage a sparse reconstruction is produced, obtained by extracting features of the images and matching them, which is used in the following step, to increase its resolution. Additionally, from the analysis of the workflow, adaptations were made to the standard workflow in order to increase the compatibility of the developed system to different types of image sets. Particularly, adaptations focused on thermal imagery were made. Due to the low presence of strong features and therefore difficulty to match features across thermal images, a modification was implemented, so thermal models could be produced alongside the already implemented processes for multispectral and RGB image sets.
- Open Access
Efficient Reactive Obstacle Avoidance Using Spirals for Escape
The usage of unmanned aerial vehicles (UAV) has increased in recent years and new application scenarios have emerged. Some of them involve tasks that require a high degree of autonomy, leading to increasingly complex systems. In order for a robot to be autonomous, it requires appropriate perception sensors that interpret the environment and enable the correct execution of the main task of mobile robotics: navigation. In the case of UAVs, flying at low altitude greatly increases the probability of encountering obstacles, so they need a fast, simple, and robust method of collision avoidance. This work covers the problem of navigation in unknown scenarios by implementing a simple, yet robust, environment-reactive approach. The implementation is done with both CPU and GPU map representations to allow wider coverage of possible applications. This method searches for obstacles that cross a cylindrical safety volume, and selects an escape point from a spiral for avoiding the obstacle. The algorithm is able to successfully navigate in complex scenarios, using both a high and low-power computer, typically found aboard UAVs, relying only on a depth camera with a limited FOV and range. Depending on the configuration, the algorithm can process point clouds at nearly 40 Hz in Jetson Nano, while checking for threats at 10 kHz. Some preliminary tests were conducted with real-world scenarios, showing both the advantages and limitations of CPU and GPU-based methodologies.
Open AccessEfficient Reactive Obstacle Avoidance Using Spirals for Escape
The usage of unmanned aerial vehicles (UAV) has increased in recent years and new application scenarios have emerged. Some of them involve tasks that require a high degree of autonomy, leading to increasingly complex systems. In order for a robot to be autonomous, it requires appropriate perception sensors that interpret the environment and enable the correct execution of the main task of mobile robotics: navigation. In the case of UAVs, flying at low altitude greatly increases the probability of encountering obstacles, so they need a fast, simple, and robust method of collision avoidance. This work covers the problem of navigation in unknown scenarios by implementing a simple, yet robust, environment-reactive approach. The implementation is done with both CPU and GPU map representations to allow wider coverage of possible applications. This method searches for obstacles that cross a cylindrical safety volume, and selects an escape point from a spiral for avoiding the obstacle. The algorithm is able to successfully navigate in complex scenarios, using both a high and low-power computer, typically found aboard UAVs, relying only on a depth camera with a limited FOV and range. Depending on the configuration, the algorithm can process point clouds at nearly 40 Hz in Jetson Nano, while checking for threats at 10 kHz. Some preliminary tests were conducted with real-world scenarios, showing both the advantages and limitations of CPU and GPU-based methodologies.
- Open Access
- 2 March 2021
- Published by MDPI AG in Applied Sciences
- Vol. 11 (5) , 2185
Autonomous Environment Generator for UAV-Based Simulation
The increased demand for Unmanned Aerial Vehicles (UAV) has also led to higher demand for realistic and efficient UAV testing environments. The current use of simulated environments has been shown to be a relatively inexpensive, safe, and repeatable way to evaluate UAVs before real-world use. However, the use of generic environments and manually-created custom scenarios leaves more to be desired. In this paper, we propose a new testbed that utilizes machine learning algorithms to procedurally generate, scale, and place 3D models to create a realistic environment. These environments are additionally based on satellite images, thus providing users with a more robust example of real-world UAV deployment. Although certain graphical improvements could be made, this paper serves as a proof of concept for an novel autonomous and relatively-large scale environment generator. Such a testbed could allow for preliminary operational planning and testing worldwide, without the need for on-site evaluation or data collection in the future.
- 2 March 2021
- Published by MDPI AG in Applied Sciences
- Vol. 11 (5) , 2185
Open AccessAutonomous Environment Generator for UAV-Based Simulation
The increased demand for Unmanned Aerial Vehicles (UAV) has also led to higher demand for realistic and efficient UAV testing environments. The current use of simulated environments has been shown to be a relatively inexpensive, safe, and repeatable way to evaluate UAVs before real-world use. However, the use of generic environments and manually-created custom scenarios leaves more to be desired. In this paper, we propose a new testbed that utilizes machine learning algorithms to procedurally generate, scale, and place 3D models to create a realistic environment. These environments are additionally based on satellite images, thus providing users with a more robust example of real-world UAV deployment. Although certain graphical improvements could be made, this paper serves as a proof of concept for an novel autonomous and relatively-large scale environment generator. Such a testbed could allow for preliminary operational planning and testing worldwide, without the need for on-site evaluation or data collection in the future.
- Open Access
- 28 October 2020
- Published by MDPI AG in Remote Sensing
- Vol. 12 (21) , 3533
FFAU—Framework for Fully Autonomous UAVs
Unmanned Aerial Vehicles (UAVs), although hardly a new technology, have recently gained a prominent role in many industries being widely used not only among enthusiastic consumers, but also in high demanding professional situations, and will have a massive societal impact over the coming years. However, the operation of UAVs is fraught with serious safety risks, such as collisions with dynamic obstacles (birds, other UAVs, or randomly thrown objects). These collision scenarios are complex to analyze in real-time, sometimes being computationally impossible to solve with existing State of the Art (SoA) algorithms, making the use of UAVs an operational hazard and therefore significantly reducing their commercial applicability in urban environments. In this work, a conceptual framework for both stand-alone and swarm (networked) UAVs is introduced, with a focus on the architectural requirements of the collision avoidance subsystem to achieve acceptable levels of safety and reliability. The SoA principles for collision avoidance against stationary objects are reviewed and a novel approach is described, using deep learning techniques to solve the computational intensive problem of real-time collision avoidance with dynamic objects. The proposed framework includes a web-interface allowing the full control of UAVs as remote clients with a supervisor cloud-based platform. The feasibility of the proposed approach was demonstrated through experimental tests using a UAV, developed from scratch using the proposed framework. Test flight results are presented for an autonomous UAV monitored from multiple countries across the world.
- 28 October 2020
- Published by MDPI AG in Remote Sensing
- Vol. 12 (21) , 3533
Open AccessFFAU—Framework for Fully Autonomous UAVs
Unmanned Aerial Vehicles (UAVs), although hardly a new technology, have recently gained a prominent role in many industries being widely used not only among enthusiastic consumers, but also in high demanding professional situations, and will have a massive societal impact over the coming years. However, the operation of UAVs is fraught with serious safety risks, such as collisions with dynamic obstacles (birds, other UAVs, or randomly thrown objects). These collision scenarios are complex to analyze in real-time, sometimes being computationally impossible to solve with existing State of the Art (SoA) algorithms, making the use of UAVs an operational hazard and therefore significantly reducing their commercial applicability in urban environments. In this work, a conceptual framework for both stand-alone and swarm (networked) UAVs is introduced, with a focus on the architectural requirements of the collision avoidance subsystem to achieve acceptable levels of safety and reliability. The SoA principles for collision avoidance against stationary objects are reviewed and a novel approach is described, using deep learning techniques to solve the computational intensive problem of real-time collision avoidance with dynamic objects. The proposed framework includes a web-interface allowing the full control of UAVs as remote clients with a supervisor cloud-based platform. The feasibility of the proposed approach was demonstrated through experimental tests using a UAV, developed from scratch using the proposed framework. Test flight results are presented for an autonomous UAV monitored from multiple countries across the world.
- 20 July 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Multi-purpose Low Latency Streaming Using Unmanned Aerial Vehicles
The usage of Unmanned Aerial Vehicles (UAVs) has become increasingly widespread over the years, rising to meet challenges of systems in several different sectors. The high mobility and ease of deployment of the UAV, combined with the distributed nature of UAV communication, enable many useful applications that are unique to these devices. In one of the most common UAV applications, the UAV is used to capture video and send it along to a server for processing, or to users for viewing. This video feed can be used in many sectors, from surveillance and surveying, to cultural event live streaming. It is even possible to implement advanced computer vision algorithms for more advanced features. There are many publications that consider these applications, however, few works implement a complete end-to-end system. In this work a complete low latency, scalable, end-to-end system, from UAV to user, is implemented, and several different use cases are considered and implemented.
- 20 July 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Multi-purpose Low Latency Streaming Using Unmanned Aerial Vehicles
The usage of Unmanned Aerial Vehicles (UAVs) has become increasingly widespread over the years, rising to meet challenges of systems in several different sectors. The high mobility and ease of deployment of the UAV, combined with the distributed nature of UAV communication, enable many useful applications that are unique to these devices. In one of the most common UAV applications, the UAV is used to capture video and send it along to a server for processing, or to users for viewing. This video feed can be used in many sectors, from surveillance and surveying, to cultural event live streaming. It is even possible to implement advanced computer vision algorithms for more advanced features. There are many publications that consider these applications, however, few works implement a complete end-to-end system. In this work a complete low latency, scalable, end-to-end system, from UAV to user, is implemented, and several different use cases are considered and implemented.
- Open Access
LiDAR-Based Real-Time Detection and Modeling of Power Lines for Unmanned Aerial Vehicles
The effective monitoring and maintenance of power lines are becoming increasingly important due to a global growing dependence on electricity. The costs and risks associated with the traditional foot patrol and helicopter-based inspections can be reduced by using UAVs with the appropriate sensors. However, this implies developing algorithms to make the power line inspection process reliable and autonomous. In order to overcome the limitations of visual methods in the presence of poor light and noisy backgrounds, we propose to address the problem of power line detection and modeling based on LiDAR. The PL DM, Power Line LiDAR-based Detection and Modeling, is a novel approach to detect power lines. Its basis is a scan-by-scan adaptive neighbor minimalist comparison for all the points in a point cloud. The power line final model is obtained by matching and grouping several line segments, using their collinearity properties. Horizontally, the power lines are modeled as a straight line, and vertically as a catenary curve. Using a real dataset, the algorithm showed promising results both in terms of outputs and processing time, adding real-time object-based perception capabilities for other layers of processing.Open AccessLiDAR-Based Real-Time Detection and Modeling of Power Lines for Unmanned Aerial Vehicles
The effective monitoring and maintenance of power lines are becoming increasingly important due to a global growing dependence on electricity. The costs and risks associated with the traditional foot patrol and helicopter-based inspections can be reduced by using UAVs with the appropriate sensors. However, this implies developing algorithms to make the power line inspection process reliable and autonomous. In order to overcome the limitations of visual methods in the presence of poor light and noisy backgrounds, we propose to address the problem of power line detection and modeling based on LiDAR. The PL DM, Power Line LiDAR-based Detection and Modeling, is a novel approach to detect power lines. Its basis is a scan-by-scan adaptive neighbor minimalist comparison for all the points in a point cloud. The power line final model is obtained by matching and grouping several line segments, using their collinearity properties. Horizontally, the power lines are modeled as a straight line, and vertically as a catenary curve. Using a real dataset, the algorithm showed promising results both in terms of outputs and processing time, adding real-time object-based perception capabilities for other layers of processing. - Open Access
- 1 April 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Real- Time LiDAR-based Power Lines Detection for Unmanned Aerial Vehicles
The growing dependence of modern-day societies on electricity increases the importance of effective monitoring and maintenance of power lines. Endowing UAVs with the appropriate sensors for inspecting power lines, the costs and risks associated with the traditional foot patrol and helicopter-based inspections can be reduced. However, this implies the development of algorithms to make the inspection process reliable and autonomous. Visual methods are usually applied to locate the power lines and their components, but poor light conditions or a background rich in edges may compromise their results. To overcome those limitations, we propose to address the problem of power line detection and modeling based on LiDAR. A novel approach to the power line detection was developed, the PL 2 DM - Power Line LiDAR-based Detection and Modeling. It is based in a scan-by-scan adaptive neighbor minimalist comparison for all the points in a point cloud. The power line final model is obtained by matching and grouping several line segments, using their collinearity properties. Horizontally, the power lines are modeled as a straight line, and vertically as a catenary curve. The algorithm was validated with a real dataset, showing promising results both in terms of outputs and processing time, adding real-time object-based perception capabilities for other layers of processing.
- 1 April 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Open AccessReal- Time LiDAR-based Power Lines Detection for Unmanned Aerial Vehicles
The growing dependence of modern-day societies on electricity increases the importance of effective monitoring and maintenance of power lines. Endowing UAVs with the appropriate sensors for inspecting power lines, the costs and risks associated with the traditional foot patrol and helicopter-based inspections can be reduced. However, this implies the development of algorithms to make the inspection process reliable and autonomous. Visual methods are usually applied to locate the power lines and their components, but poor light conditions or a background rich in edges may compromise their results. To overcome those limitations, we propose to address the problem of power line detection and modeling based on LiDAR. A novel approach to the power line detection was developed, the PL 2 DM - Power Line LiDAR-based Detection and Modeling. It is based in a scan-by-scan adaptive neighbor minimalist comparison for all the points in a point cloud. The power line final model is obtained by matching and grouping several line segments, using their collinearity properties. Horizontally, the power lines are modeled as a straight line, and vertically as a catenary curve. The algorithm was validated with a real dataset, showing promising results both in terms of outputs and processing time, adding real-time object-based perception capabilities for other layers of processing.