Underwater Object Recovery Using a Hybrid-Controlled ROV with Deep Learning-Based Perception
Open Access
- 18 January 2026
- journal article
- research article
- Published by MDPI AG in Journal of Marine Science and Engineering
- Vol. 14 (2) , 198
Abstract
The deployment of large remotely operated vehicles (ROVs) or autonomous underwater vehicles (AUVs) typically requires support vessels, crane systems, and specialized personnel, resulting in increased logistical complexity and operational costs. In this context, lightweight and modular underwater robots have emerged as a cost-effective alternative, capable of reaching significant depths and performing tasks traditionally associated with larger platforms. This article presents a system architecture for recovering a known object using a hybrid-controlled ROV, integrating autonomous perception, high-level interaction, and low-level control. The proposed architecture includes a perception module that estimates the object pose using a Perspective-n-Point (PnP) algorithm, combining object segmentation from a YOLOv11-seg network with 2D keypoints obtained from a YOLOv11-pose model. In addition, a Natural Language ROS Agent is incorporated to enable high-level command interaction between the operator and the robot. These modules interact with low-level controllers that regulate the vehicle degrees of freedom and with autonomous behaviors such as target approach and grasping. The proposed system is evaluated through simulation and experimental tank trials, including object recovery experiments conducted in a 12 × 8 × 5 m test tank at CIRTESU, as well as perception validation in simulated, tank, and harbor scenarios. The results demonstrate successful recovery of a black box using a BlueROV2 platform, showing that architectures of this type can effectively support operators in underwater intervention tasks, reducing operational risk, deployment complexity, and mission costs.Keywords
Funding Information
- Ministerio de Ciencia e Innovación (PID2023-149910OB-C32)
This publication has 26 references indexed in Scilit:
- A Navigation System for ROV’s inspection on Fish Net CageIFAC-PapersOnLine, 2025
- AquaChat: An LLM-guided ROV framework for adaptive inspection of aquaculture net pensAquacultural Engineering, 2025
- Rapid detection of subterranean fauna from passive sampling of groundwater eDNAEnvironmental DNA, 2023
- Cardiovascular considerations for scuba diversHeart, 2022
- TWINBOT: Autonomous Underwater Cooperative TransportationIEEE Access, 2021
- Stonefish: An Advanced Open-Source Simulation Tool Designed for Marine Robotics, With a ROS Interface2019
- Underwater manipulators: A reviewOcean Engineering, 2018
- A benchmarking study on single image dehazing techniques for underwater autonomous vehicles2017
- Intervention AUVs: The next challengeAnnual Reviews in Control, 2015
- Cooperative Search and Survey Using Autonomous Underwater Vehicles (AUVs)IEEE Transactions on Parallel and Distributed Systems, 2010