António Ferreira

High resolution underwater mapping is fundamental to the sustainable development of the blue economy, supporting offshore energy expansion, marine habitat protection, and the monitoring of both living and non-living resources. This work presents a pose-graph SLAM and calibration framework specifically designed for 3D profiling sonars, such as the Coda Octopus Echoscope 3D. The system integrates a probabilistic scan matching method (3DupIC) for direct registration of 3D sonar scans, enabling accurate trajectory and map estimation even under degraded dead reckoning conditions. Unlike other bathymetric SLAM methods that rely on submaps and assume short-term localization accuracy, the proposed approach performs direct scan-to-scan registration, removing this dependency. The factor graph is extended to represent the sonar extrinsic parameters, allowing the sonar-to-body transformation to be refined jointly with trajectory optimization. Experimental validation on a challenging real world dataset demonstrates outstanding localization and mapping performance. The use of refined extrinsic parameters further improves both accuracy and map consistency, confirming the effectiveness of the proposed joint SLAM and calibration approach for robust and consistent underwater mapping.

Due to space and energy restrictions, lightweight autonomous underwater vehicles (AUVs) are usually fitted with low-power processing units, which limits the ability to run demanding applications in real time during the mission. However, several robotic perception tasks reveal a parallel nature, where the same processing routine is applied for multiple independent inputs. In such cases, leveraging parallel execution by offloading tasks to a GPU can greatly enhance processing speed. This article presents a collection of generic matrix manipulation kernels, which can be combined to develop parallelized perception applications. Taking advantage of those building blocks, we report a parallel implementation for the 3DupIC algorithm—a probabilistic scan matching method for sonar scan registration. Tests demonstrate the algorithm’s real-time performance, enabling 3D sonar scan matching to be executed in real time onboard the EVA AUV.

This work presents a six degrees of freedom probabilistic scan matching method for registration of 3D underwater sonar scans. Unlike previous works, where local submaps are built to overcome measurement sparsity, our solution develops scan matching directly from the raw sonar data. Our method, based on the probabilistic Iterative Correspondence (pIC), takes measurement uncertainty into consideration while developing the registration procedure. A new probabilistic sensor model was developed to compute the uncertainty of each scan measurement individually. Initial displacement guesses are obtained from a probabilistic dead reckoning approach, also detailed in this document. Experiments, based on real data, demonstrate superior robustness and accuracy of our method with respect to the popular ICP algorithm. An improved trajectory is obtained by integration of scan matching updates in the localization data fusion algorithm, resulting in a substantial reduction of the original dead reckoning drift.

Emerging opportunities in the exploration of inland water bodies, such as underwater mining of flooded open pit mines, require accurate real-time positioning of multiple underwater assets. In the mining operation scenarios, operational requirements deny the application of standard acoustic positioning techniques, posing additional challenges to the localization problem. This paper presents a novel underwater localization solution, implemented for the ¡VAMOS! project, based on the combination of raw measurements from a short baseline (SBL) array and an inverted ultrashort baseline (iUSBL). An extended Kalman filter (EKF), fusing IMU raw measurements, pressure observations, SBL ranges, and USBL directional angles, estimates the localization of an underwater mining vehicle in 6DOF. Sensor bias and the speed of sound in the water are estimated indirectly by the filter. Moreover, in order to discard acoustic outliers, due to multipath reflections in such a confined and cluttered space, a data association layer and a dynamic SBL master selection heuristic were implemented. To demonstrate the advantage of this new technique, results obtained in the field, during the ¡VAMOS! underwater mining field trials, are presented and discussed.

The global navigation satellite system (GNSS) constitutes an effective and affordable solution to the outdoor positioning problem. When combined with precise positioning techniques, such as the real time kinematic (RTK), centimeter-level positioning accuracy becomes a reality. Such performance is suitable for a whole new range of demanding applications, including high-accuracy field robotics operations. The RTKRCV, part of the RTKLIB package, is one of the most popular open-source solutions for real-time GNSS precise positioning. Yet the lack of integration with the robot operating system (ROS), constitutes a limitation on its adoption by the robotics community. This article addresses this limitation, reporting a new implementation which brings the RTKRCV capabilities into ROS. New features, including ROS publishing and control over a ROS service, were introduced seamlessly, to ensure full compatibility with all original options. Additionally, a new observation synchronization scheme improves solution consistency, particularly relevant for the moving-baseline positioning mode. Real application examples are presented to demonstrate the advantages of our rtkrcv_ros package. For community benefit, the software was released as an open-source package.

The project Viable Alternative Mine Operating System (¡VAMOS!) develops a novel underwater mining technique for extracting inland mineral deposits in flooded open-cut mines. From a floating launch and recovery vessel a remotely-operated underwater mining vehicle with a roadheader cutting machine is deployed. The cut material is transported to the surface via a flexible riser hose. Since there is no direct intervisibility between the operator and the mining machine, the data of the sensor systems can only be perceived via a computer interface. Therefore, part of the efforts in the project focus on enhancing the situational awareness of the operator by providing a 3D model of the mine combined with representations of the mining equipment and sensor data. We present a method how a positioning and navigation system, perception system and mapping system can be used to create a replica of the physical system and mine environment in Virtual Reality (VR) in order to assist remote control. This approach is beneficial because it allows visualizing different sensor information and data in a consistent interface, and enables showing the complete context of the mining site even if only part of the mine is currently observed by surveying equipment. We demonstrate how the system is used during tele-operation and show results achieved during the field trials of the complete system in Silvermines, Ireland.

Limited perception capabilities underwater shrink the envelope of effective localization techniques that can be applied in this environment. Long-term localization in six degrees of freedom can only be achieved by combining different sources of information. A multiple vehicle underwater localization solution, for localizing an underwater mining vehicle and its support vessel, is presented in this paper. The surface vessel carries a short baseline network, that interact with the inverted ultra-short baseline, carried by the underwater mining vehicle. A multiple antenna GNSS system provides data for localizing the surface vessel and to georeference the short baseline array. Localization of the mining vehicle results from a data fusion approach, that combines multiple sources of sensor information using the Extended Kalman Filter (EKF) framework. The developed solutions were applied in the context of the ¡VAMOS! European project. Long-term real time position errors below 0.2 meters, for the underwater machine, and 0.02 meters, for the surface vessel, were accomplished in the field. All presented results are based on data acquired in a real scenario.

This paper presents the positioning, navigation and awareness (PNA) system developed for the Underwater Robotic Mining System of the !VAMOS! project [1]. It describes the main components of the !VAMOS! system, the PNA sensors in each of those components, the global architecture of the PNA system, and its main subsystems: Position and Navigation, Realtime Mine Modeling, 3D Virtual reality HMI and Real-time grade system. General results and lessons learn during the first mining field trial in Lee Moor, Devon, UK during the months of September and October 2017 are presented.