Izvorni znanstveni članak
https://doi.org/10.7307/ptt.v35i5.246
Improving Traffic Efficiency in a Road Network by Adopting Decentralised Multi-Agent Reinforcement Learning and Smart Navigation
Hung Tuan Trinh
; Smart Transportation Lab, Department of Spatial Information Engineering, Pukyong National University
Sang-Hoon Bae
; Smart Transportation Lab, Department of Spatial Information Engineering, Pukyong National University3
Quang Duy Tran
; Faculty of Civil Engineering, Nha Trang University
Sažetak
In the future, mixed traffic flow will consist of human-driven vehicles (HDVs) and connected autonomous vehicles (CAVs). Effective traffic management is a global challenge, especially in urban areas with many intersections. Much research has focused on solving this problem to increase intersection network performance. Reinforcement learning (RL) is a new approach to optimising traffic signal lights that overcomes the disadvantages of traditional methods. In this paper, we propose an integrated approach that combines the multi-agent advantage actor-critic (MA-A2C) and smart navigation (SN) to solve the congestion problem in a road network under mixed traffic conditions. The A2C algorithm combines the advantages of value-based and policy-based methods to stabilise the training by reducing the variance. It also overcomes the limitations of centralised and independent MARL. In addition, the SN technique reroutes traffic load to alternate paths to avoid congestion at intersections. To evaluate the robustness of our approach, we compare our model against independent-A2C (I-A2C) and max pressure (MP). These results show that our proposed approach performs more efficiently than others regarding average waiting time, speed and queue length. In addition, the simulation results also suggest that the model is effective as the CAV penetration rate is greater than 20%.
Ključne riječi
multi-agent reinforcement learning (MARL); multi-agent advantage actor-critic (MA-A2C); deep reinforcement learning (DRL); deep neural network (DNN); connected and autonomous vehicles (CAVs); traffic signal control
Hrčak ID:
309457
URI
Datum izdavanja:
30.10.2023.
Posjeta: 586 *