Deep Reinforcement Learning-Based Energy Management Strategy for Green Ships Considering Photovoltaic Uncertainty
Open Access
- 14 March 2025
- journal article
- research article
- Published by MDPI AG in Journal of Marine Science and Engineering
- Vol. 13 (3) , 565
Abstract
Owing to the global concern regarding fossil energy consumption and carbon emissions, the power supply for traditional diesel-driven ships is being replaced by low-carbon power sources, which include hydrogen energy generation and photovoltaic (PV) power generation. However, the uncertainty of shipboard PV power generation due to weather changes and ship motion variations has become an essential factor restricting the energy management of all-electric ships. In this paper, a deep reinforcement learning-based optimization algorithm is proposed for a green ship energy management system (EMS) coupled with hydrogen fuel cells (HFCs), lithium batteries, PV generation, an electric power propulsion system, and service loads. The focus of this study is reducing the total operation cost and improving energy efficiency by jointly optimizing power generation and voyage scheduling, considering shipboard PV uncertainty. To verify the effectiveness of the proposed method, real-world data for a hybrid hydrogen- and PV-driven ship are selected for conducting case studies under various sailing conditions. The numerical results demonstrate that, compared to those obtained with the Double DQN algorithm, the PPO algorithm, and the DDPG algorithm without considering the PV system, the proposed DDPG algorithm reduces the total economic cost by 1.36%, 0.96%, and 4.42%, while effectively allocating power between the hydrogen fuel cell and the lithium battery and considering the uncertainty of on-board PV generation. The proposed approach can reduce energy waste and enhance economic benefits, sustainability, and green energy utilization while satisfying the energy demand for all-electric ships.Keywords
Funding Information
- National Natural Science Foundation of China (52177101, SJCX24_2607)
- Postgraduate Research & Practice Innovation Program of Jiangsu Province (52177101, SJCX24_2607)
This publication has 30 references indexed in Scilit:
- HP3O algorithm-based all electric ship energy management strategy integrating demand-side adjustmentEnergy, 2024
- Energy management system based on economic Flexi-reliable operation for the smart distribution network including integrated energy system of hydrogen storage and renewable sourcesEnergy, 2024
- A probabilistic multi-objective design method of sail-photovoltaic-hybrid power system for an unmanned ocean surveillance trimaranApplied Energy, 2023
- Deep reinforcement learning based optimization of automated guided vehicle time and energy consumption in a container terminalAlexandria Engineering Journal, 2023
- Cloud-based health-conscious energy management of hybrid battery systems in electric vehicles with deep reinforcement learningApplied Energy, 2021
- Optimal design and energy management of hybrid storage systems for marine propulsion applicationsApplied Energy, 2020
- Joint voyage scheduling and economic dispatch for all-electric ships with virtual energy storage systemsEnergy, 2020
- A novel optimal energy-management strategy for a maritime hybrid energy system based on large-scale global optimizationApplied Energy, 2018
- A new ship energy management algorithm to the smart electricity grid systemInternational Journal of Energy Research, 2018
- Optimal sizing of hybrid PV/diesel/battery in ship power systemApplied Energy, 2015