A reinforcement learning-based assignment scheme for EVs to charging stations

Aljaidi, M., Aslam, N., Chen, X. ORCID: https://orcid.org/0000-0001-9267-355X, Kaiwartya, O., Al-Gumaei, Y. A. and Khalid, M. (2022) A reinforcement learning-based assignment scheme for EVs to charging stations. In: 2022 IEEE 95th Vehicular Technology Conference: (VTC2022-Spring), 19-22 June 2022, Helsinki, Finland. doi: 10.1109/VTC2022-Spring54318.2022.9860535

Abstract/Summary

Due to recent developments in electric mobility, public charging infrastructure will be essential for modern transportation systems. As the number of electric vehicles (EVs) increases, the public charging infrastructure needs to adopt efficient charging practices. A key challenge is the assignment of EVs to charging stations (CSs) in an energy efficient manner. In this paper, a Reinforcement Learning (RL)-based EV Assignment Scheme (RL-EVAS) is proposed to solve the problem of assigning EV to the optimal CS in urban environments, aiming at minimizing the total cost of charging EVs and reducing the overload on Electrical Grids (EGs). Travelling cost that is resulted from the movement of EV to CS, and the charging cost at CS are considered. Moreover, the EV’s Battery State of Charge (SoC) is taken into account in the proposed scheme. The proposed RL-EVAS approach will approximate the solution by finding an optimal policy function in the sense of maximizing the expected value of the total reward over all successive steps using Q-learning algorithm, based on the Temporal Difference (TD) learning and Bellman expectation equation. Finally, the numerous simulation results illustrate that the proposed scheme can significantly reduce the total energy cost of EVs compared to various case studies and greedy algorithm, and also demonstrate its behavioural adaptation to any environmental conditions.

Item Type	Conference or Workshop Item (Paper)
URI	https://reading-clone.eprints-hosting.org/id/eprint/116499
Identification Number/DOI	10.1109/VTC2022-Spring54318.2022.9860535
Refereed	Yes
Divisions	No Reading authors. Back catalogue items Science > School of Mathematical, Physical and Computational Sciences > Department of Computer Science
Uncontrolled Keywords	Greedy algorithms;Energy consumption;Vehicular and wireless technologies;Costs;Q-learning;Urban areas;Charging stations;Electric vehicle assignment;charging station;Q-learning;temporal difference;Bellman expectation equation;energy consumption;energy cost;electrical grids.
Download/View statistics	View download statistics for this item