Automated Valet Parking and Charging: A Dynamic Pricing and Reservation-Based Framework Leveraging Multi-Agent Reinforcement Learning
- 2 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 10 (2) , 1010-1029
Abstract
Vehicle parking resource provisioning in major cities and urban areas has gradually become a challenging issue in Intelligent Transportation Systems (ITS) due to the upward trend in car ownership rates. Besides, the increasing attractiveness of Autonomous Electric Vehicle (AEV) technologies complicates the parking problem as self-parking and EV-charging solutions need to be integrated into existing parking infrastructure. Dynamic pricing and reservation-based automated parking and charging are envisioned to accommodate the increasing demand for parking and EV-charging services. This will minimize traffic congestion and enhance road safety. This paper proposes a novel intelligent framework based on dynamic pricing and in-advance parking and charging reservations for Automated Valet Parking and Charging (AVPC) scenarios. We formulate the dynamic pricing problem between a Parking Lot Manager (PLM) and multiple Autonomous Vehicles (AVs) as a two-stage Stackelberg game in which the PLM, as the leader, sets its service price in the first stage to maximize its utility, and each AV, as a follower, determines its service demand in the second stage to maximize its utility. Then, we theoretically prove the existence and uniqueness of the Stackelberg Equilibrium (SE). Considering the stochastic nature of the parking traffic, we transform the game-based optimization problem into a Multi-Agent Markov Decision Process (MAMDP) and propose a Stackelberg Game-aided Multi-Agent Dueling Deep Q-Network (SG-MADDQN) algorithm to solve the problem. Comprehensive simulation results and analysis prove that the proposed algorithm achieves convergence and can best balance the pricing and demand strategies of the PLM and AVs compared with existing solutions.Keywords
Funding Information
- National Natural Science Foundation of China (62171086)
This publication has 38 references indexed in Scilit:
- Parking Dispatch System for Infrastructure-based Automated Valet Parking2022
- The verbiage in variable message signs and traffic diversion during crash incidentsJournal of Intelligent and Connected Vehicles, 2022
- An Optimal Allocation Framework of Security Virtual Network Functions in 6G Satellite Deployments2022
- Evaluation of Environmental Benefits Caused by Reservation-Based Shared Parking: A Case Study of Beijing, ChinaIEEE Access, 2020
- Dynamic Management of Forwarding Rules in a T-SDN Architecture with Energy and Bandwidth Constraints2020
- SPA: Smart Parking Algorithm Based on Driver Behavior and Parking Traffic PredictionsIEEE Access, 2019
- Undecidability and hardness in mixed-integer nonlinear programmingRAIRO - Operations Research, 2019
- Game Theory in Wireless and Communication Networks2011
- Fundamentals of Queueing Theory2008
- Convex Optimization2004