A Deep Q-Network Approach-Based Battery-Swapping Strategy for Electric Transfer-Vehicles in Seaport
- 17 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industry Applications
- Vol. 61 (1) , 1455-1465
Abstract
Within the context of advancing environmentally sustainable practices in the domain of seaport operations, the incorporation of electric transfer vehicles (EVs) has surfaced as a plausible substitute for traditional diesel-powered counterparts in the realm of cargo transfer. A two-stage energy-transport scheduling framework is proposed, which encompasses vehicle-job matching, EV dispatch, and energy management. The goal of this framework is to enhance the efficiency of transfer operations while concurrently reducing the charging cost. The first stage of the framework focuses on the optimization of the correspondence between vehicles and transfer jobs, followed by the dispatching of EVs in the second stage to mitigate job delay and reduce charging costs. The formulation and resolution of this two-stage model are achieved through the utilization of a deep Q-network method. Empirical validation, conducted through simulation experiments with real-world data from a northern Chinese seaport, confirms the efficacy of the proposed approach and highlights the inherent flexibility of the system. The comparative findings illustrate the efficacy of the proposed approach in diminishing both the energy procurement costs and the idle driving rate for vehicles. Notably, the utilization of this method yields substantial cost reductions of 25.8%, 50.37%, and 6.51% in comparison to the application of mathematical programming, a rule-based matching scenario, and a rule-based scheduling scenario, respectively.Keywords
Funding Information
- Technology Project of State Grid Corporation of China (SGJSCZ00KJJS2400578)
This publication has 18 references indexed in Scilit:
- Energy-transport scheduling for green vehicles in seaport areas: A review on operation modelsRenewable and Sustainable Energy Reviews, 2023
- Battery Swapping Strategy for Electric Transfer-Vehicles in Seaport: A Deep Q-Network Approach2023
- Simulation model and performance evaluation of battery-powered AGV systems in automated container terminalsSimulation Modelling Practice and Theory, 2021
- Multi-AGV scheduling for conflict-free path planning in automated container terminalsComputers & Industrial Engineering, 2020
- A review of energy efficiency in ports: Operational strategies, technologies and energy management systemsRenewable and Sustainable Energy Reviews, 2019
- Reinforcement Learning for Electric Power System Decision and Control: Past Considerations and PerspectivesIFAC-PapersOnLine, 2017
- Smart Charging for Electric Vehicles: A Survey From the Algorithmic PerspectiveIEEE Communications Surveys & Tutorials, 2016
- Using battery-electric AGVs in container terminals — Assessing the potential and optimizing the economic viabilityResearch in Transportation Business & Management, 2015
- Dispatching Automated Guided Vehicles in a Container Terminal2005
- A comparison of different AGV dispatching rules in an automated container terminal2003