Replicating the behaviour of electric vehicle drivers using an agent-based reinforcement learning model
Open Access
- 1 June 2026
- journal article
- Published by SAGE Publications in Environment and Planning B: Urban Analytics and City Science
Abstract
Despite the rapid expansion of electric vehicle (EV) charging networks, questions remain about their efficiency in meeting the growing needs of EV drivers. Previous rule-based ABMs have struggled to capture the adaptive behaviours of human drivers. Although reinforcement learning has been applied in EV simulation studies, its application has primarily focused on optimising fleet operations rather than modelling private drivers who make independent charging decisions. To address this gap, we propose a multi-stage reinforcement learning framework that simulates the charging demand of private EV drivers across a national-scale road network. We validate the model against real-world data and identify the training stage that most closely reflects actual driver behaviour. Based on the simulation results, we identify critical ‘charging deserts’ where EV drivers face high risks of battery depletion. Our findings further highlight recent policy shifts toward expanding rapid charging hubs along motorway corridors and urban boundaries to meet growing demand from long-distance trips.Keywords
Funding Information
- SIPHER Consortium (MR/S037578/2)
- ExAMPLER (EP/Y008839/1)
- Royal Society International Exchange Scheme (IEC/NSFC/223042)
- ESRC’s On-Going Support for the Urban Big Data Centre (ES/L011921/1)
- ESRC’s On-Going Support for the Urban Big Data Centre (ES/S007105/1)
- The Systems Science Research in Public Health (MC_UU_00022/5)
This publication has 47 references indexed in Scilit:
- Optimal placement of electric vehicle slow-charging stations: A continuous facility location problem under uncertaintyComputers & Operations Research, 2025
- An agent-based modeling approach for public charging demand estimation and charging station location optimization at urban scaleComputers, Environment and Urban Systems, 2023
- An activity-based travel and charging behavior model for simulating battery electric vehicle charging demandEnergy, 2022
- Social & locational impacts on electric vehicle ownership and charging profilesEnergy Reports, 2021
- Creating Intelligent Agents: Combining Agent-Based Modeling with Machine Learning2021
- Real-time deep reinforcement learning based vehicle navigationApplied Soft Computing, 2020
- Are travel surveys a good basis for EV models? Validation of simulated charging profiles against empirical dataApplied Energy, 2020
- Increasing electric vehicle adoption through the optimal deployment of fast-charging stations for local and long-distance travelEuropean Journal of Operational Research, 2020
- User behaviour and electric vehicle charging infrastructure: An agent-based model assessmentApplied Energy, 2019
- Simple or complicated agent-based models? A complicated issueEnvironmental Modelling & Software, 2016