Development of a Reinforcement Learning-Based Ship Voyage Planning Optimization Method Applying Machine Learning-Based Berth Dwell-Time Prediction as a Time Constraint
Open Access
- 25 December 2025
- journal article
- research article
- Published by MDPI AG in Journal of Marine Science and Engineering
- Vol. 14 (1) , 43
Abstract
Global container shipping faces increasing pressure to reduce fuel consumption and greenhouse gas (GHG) emissions while still meeting strict port schedules under highly uncertain terminal operations and met-ocean conditions. However, most existing voyage-planning approaches either ignore real port operation variability or treat fuel optimization and just-in-time (JIT) arrival as separate problems, limiting their applicability in actual operations. This study presents a data-driven just-in-time voyage optimization framework that integrates port-side uncertainty and marine environmental dynamics into the routing process. A dwell-time prediction model based on Gradient Boosting was developed using port throughput and meteorological–oceanographic variables, achieving a validation accuracy of R2 = 0.84 and providing a data-driven required time of arrival (RTA) estimate. A Transformer encoder model was constructed to forecast fuel consumption from multivariate navigation and environmental data, and the model achieved a segment-level predictive performance with an R2 value of approximately 0.99. These predictive modules were embedded into a Deep Q-Network (DQN) routing model capable of optimizing headings and speed profiles under spatially varying ocean conditions. Experiments were conducted on three container-carrier routes in which the historical AIS trajectories served as operational benchmark routes. Compared with these AIS-based baselines, the optimized routes reduced fuel consumption and CO2 emissions by approximately 26% to 69%, while driving the JIT arrival deviation close to zero. The proposed framework provides a unified approach that links port operations, fuel dynamics, and ocean-aware route planning, offering practical benefits for smart and autonomous ship navigation.Keywords
Funding Information
- Korea Institute of Marine Science and Technology promotion (RS-2023-00256127)
- Ministry of Education (2025-RISE-01-019-04)
- Ministry of Science and ICT, South Korea (IITP-2024-RS-2022-00156345)
- Ministry of Trade, Industry and Energy (KEIT-20025014)
This publication has 26 references indexed in Scilit:
- Enhancing ship energy efficiency through just-in-time arrival: A comprehensive reviewOcean Engineering, 2025
- Optimal path planning for a ship in coastal waters with deep Q networkOcean Engineering, 2024
- A deep learning method for the prediction of ship fuel consumption in real operational conditionsEngineering Applications of Artificial Intelligence, 2023
- Generating a path-search graph based on ship-trajectory data: Route search via dynamic programming for autonomous shipsOcean Engineering, 2023
- Ship routing optimisation based on forecasted weather data and considering safety criteriaJournal of Navigation, 2022
- Marine route optimization using reinforcement learning approach to reduce fuel consumption and consequently minimize CO2 emissionsOcean Engineering, 2022
- Ship weather routing: A taxonomy and surveyOcean Engineering, 2020
- The multi-port berth allocation problem with speed optimization and emission considerationsTransportation Research Part D: Transport and Environment, 2017
- Integrated Berth Allocation and Quay Crane Assignment Problem: Set partitioning models and computational resultsTransportation Research Part E: Logistics and Transportation Review, 2015
- Human-level control through deep reinforcement learningNature, 2015