Synergistic Hierarchical AI Framework for USV Navigation: Closing the Loop Between Swin-Transformer Perception, T-ASTAR Planning, and Energy-Aware TD3 Control
Open Access
Abstract
Autonomous Unmanned Surface Vehicle (USV) operations in complex ocean engineering scenarios necessitate robust navigation, guidance, and control technologies. These systems require reliable sensor-based object detection and efficient, safe, and energy-aware path planning. To address these multifaceted challenges, this paper proposes a novel synergistic AI framework. The framework integrates (1) a novel adaptation of the Swin-Transformer to generate a dense, semantic risk map from raw visual data, enabling the system to interpret ambiguous marine conditions like sun glare and choppy water, enabling real-time environmental understanding crucial for guidance; (2) a Transformer-enhanced A-star (T-ASTAR) algorithm with spatio-temporal attentional guidance to generate globally near-optimal and energy-aware static paths; (3) a domain-adapted TD3 agent featuring a novel energy-aware reward function that optimizes for USV hydrodynamic constraints, making it suitable for long-endurance missions tailored for USVs to perform dynamic local path optimization and real-time obstacle avoidance, forming a key control element; and (4) CUDA acceleration to meet the computational demands of real-time ocean engineering applications. Simulations and real-world data verify the framework’s superiority over benchmarks like A* and RRT, achieving 30% shorter routes, 70% fewer turns, 64.7% fewer dynamic collisions, and a 215-fold speed improvement in map generation via CUDA acceleration. This research underscores the importance of integrating powerful AI components within a hierarchical synergy, encompassing AI-based perception, hierarchical decision planning for guidance, and multi-stage optimal search algorithms for control. The proposed solution significantly advances USV autonomy, addressing critical ocean engineering challenges such as navigation in dynamic environments, object avoidance, and energy-constrained operations for unmanned maritime systems.Keywords
Funding Information
- National Key R&D Program Project (2024YFD2400103, 62303108, D-8006-23-0223)
- National Natural Science Foundation of China (2024YFD2400103, 62303108, D-8006-23-0223)
This publication has 27 references indexed in Scilit:
- UAV Path Planning Based on the Average TD3 Algorithm With Prioritized Experience ReplayIEEE Access, 2024
- Cooperative towing for double unmanned surface vehicles connected with a floating rope via vertical formation and adaptive moment controlOcean Engineering, 2023
- Recognition and interfere deceptive behavior based on inverse reinforcement learning and game theoryJournal of Systems Engineering and Electronics, 2023
- An end‐to‐end steel surface defect detection approach via Swin transformerIET Image Processing, 2022
- Marine environmental monitoring with unmanned vehicle platforms: Present applications and future prospectsScience of The Total Environment, 2022
- An Improved A-Star Algorithm for Complete Coverage Path Planning of Unmanned ShipsInternational Journal of Pattern Recognition and Artificial Intelligence, 2022
- Coverage path planning for multiple unmanned aerial vehicles in maritime search and rescue operationsComputers & Industrial Engineering, 2021
- Improved Quantum Particle Swarm Optimization Algorithm for Offline Path Planning in AUVsIEEE Access, 2020
- Smoothed A* algorithm for practical unmanned surface vehicle path planningApplied Ocean Research, 2019
- A Formal Basis for the Heuristic Determination of Minimum Cost PathsIEEE Transactions on Systems Science and Cybernetics, 1968