Comparison of PPO and SAC Algorithms towards decision making strategies for collision avoidance among multiple autonomous vehicles

Abu Jafar, Md Muzahid and Syafiq Fauzi, Kamarulzaman and Md Arafatur, Rahman (2021) Comparison of PPO and SAC Algorithms towards decision making strategies for collision avoidance among multiple autonomous vehicles. In: 2021 International Conference on Software Engineering & Computer Systems and 4th International Conference on Computational Science and Information Management (ICSECS-ICOCSIM) , 21-26 August 2021 , Pekan. pp. 200-205.. ISBN 21136432

Pdf Comparison_of_PPO_and_SAC_Algorithms_Towards_Decision_Making_Strategies_for_Collision_Avoidance_Among_Multiple_Autonomous_Vehicles (1).pdf Restricted to Repository staff only Download (2MB) | Request a copy

Abstract

Multiple vehicle collision avoidance strategies with safe lane changing strategy for vehicle control using learning base technique are the most crucial concern in autonomous driving system. Statistics shows that the latest autonomous driving systems are usually prone to rear-end collision. Rear-end collisions often result in severe injuries as well as traffic jam and the consequences are much worse for multiple-vehicle collision. Many previous autonomous driving research focused solely on collision avoidance strategies for two consecutive vehicles. This study proposes a centralised control strategy for multiple vehicles using reinforcement learning focused on partner consideration and goal attainment. The system depicted as a group of vehicles are communicate and coordinate each others by a set of rays and maintain a short following move away. In order to address this challenge, a simulation was implemented in the Unity3D game engine and two state-of-the-art RL algorithms PPO (Proximal Policy Optimization) and SAC (Soft Actor-Critic) were trained by an agent using Unity ML-Agents Toolkit. In terms of success rate, performance, training speed and stability two algorithms are comparable. The potency of algorithms has been assessed by the traffic flow (1) change in vehicle speed, (2) differ in the vehicle beginning positions, and (3) switch to next lane. The agent performed similarly at a 91% success rate in PPO or SAC applications

Item Type:	Conference or Workshop Item (Paper)
Additional Information:	(ICSECS-ICOCSIM)
Subjects:	T Technology > TJ Mechanical engineering and machinery
Faculty/Division:	Institute of Postgraduate Studies Faculty of Computing
Depositing User:	Miss. Ratna Wilis Haryati Mustapa
Date Deposited:	08 Feb 2022 04:04
Last Modified:	08 Feb 2022 04:04
URI:	http://umpir.ump.edu.my/id/eprint/33324
Download Statistic:	View Download Statistics

Actions (login required)

View Item