Deep reinforcement learning based driving strategy for avoidance of chain collisions and its safety efficiency analysis in autonomous vehicles

Abu Jafar, Md Muzahid and Syafiq Fauzi, Kamarulzaman and Rahman, Md. Arafatur and Alenezi, Ali H. (2022) Deep reinforcement learning based driving strategy for avoidance of chain collisions and its safety efficiency analysis in autonomous vehicles. IEEE Access, 4. pp. 1-18. ISSN 2169-3536. (Published)

[img]
Preview
Pdf
Deep reinforcement learning based driving strategy for avoidance_full.pdf
Available under License Creative Commons Attribution.

Download (11MB) | Preview

Abstract

Vehicle control in autonomous traffic flow is often handled using the best decision-making reinforcement learning methods. However, unexpected critical situations make the collisions more severe and, consequently, the chain collisions. In this work, we first review the leading causes of chain collisions and their subsequent chain events, which might provide an indication of how to prevent and mitigate the crash severity of chain collisions. Then, we consider the problem of chain collision avoidance as a Markov Decision Process problem in order to propose a reinforcement learning-based decision-making strategy and analyse the safety efficiency of existing methods in driving security. To address this, A reward function is being developed to deal with the challenge of multiple vehicle collision avoidance. A perception network structure based on formation and on actor-critic methodologies is employed to enhance the decision-making process. Finally, in the safety efficiency analysis phase, we investigated the safety efficiency performance of the agent vehicle in both single-agent and multi-agent autonomous driving environments. Three state-of-the-art contemporary actor-critic algorithms are used to create an extensive simulation in Unity3D. Moreover, to demonstrate the accuracy of the safety efficiency analysis, multiple training runs of the neural networks in respect of training performance, speed of training, success rate, and stability of rewards with a trade-off between exploitation and exploration during training are presented. Two aspects (single-agent and multi-agent) have assessed the efficiency of algorithms. Every aspect has been analyzed regarding the traffic flows: (1) the controlling efficiency of unexpected traffic situations by the sudden slowdown, (2) abrupt lane change, and (3) smoothly reaching the destination. All the findings of the analysis are intended to shed insight on the benefits of a greater, more reliable autonomous traffic set-up for academics and policymakers, and also to pave the way for the actual carry-out of a driver-less traffic world.

Item Type: Article
Uncontrolled Keywords: Autonomous vehicles; Deep reinforcement learning method; Reward function; Chain collision avoidance; Autonomous traffic flow; Safety efficiency analysis
Subjects: Q Science > QA Mathematics > QA76 Computer software
T Technology > T Technology (General)
Faculty/Division: Faculty of Computing
Depositing User: Mrs Norsaini Abdul Samat
Date Deposited: 26 Apr 2022 08:03
Last Modified: 26 Apr 2022 08:03
URI: http://umpir.ump.edu.my/id/eprint/33891
Download Statistic: View Download Statistics

Actions (login required)

View Item View Item