Md Munirul, Hasan and Rahman, Md Mustafizur and Suraya, Abu Bakar and Islam, Mir Sujaul and Kabir, Muhammad Nomani (2022) An overview of effect of activation functions on training and performance of artificial neural network modelling. In: The 6th National Conference for Postgraduate Research (NCON-PGR 2022) , 15 November 2022 , Virtual Conference, Universiti Malaysia Pahang, Malaysia. p. 115..
|
Pdf
An overview of effect of activation functions on training and performance of artificial neural network modelling.pdf Download (333kB) | Preview |
Abstract
This paper presents an overview of the effect of the activation functions on the training and performance of artificial neural network modelling. An artificial neural network's activation functions are mathematical formulas that are essential to its design. Activation functions are a critical component of artificial neural networks since they impact the performance of the ANN model to a considerable extent. It is a function that is utilized in order to obtain the output of the node. In an artificial neural network, defining an activation function is critical, as it directly affects the network's success rate. A concise summary of some of the most frequent activation functions that are utilized in neural networks. Activation functions are defined, their properties are compared, and their advantages and disadvantages are described in this paper. This review is provided with the definitions, features, performance comparisons, merits and demerits and applications of activation function in various areas. The activation function has an impact on the development of ANN models. It is found that sigmoid, Tanh and ReLU are the most used activation function and give better performance compared to others.
| Item Type: | Conference or Workshop Item (Lecture) |
|---|---|
| Uncontrolled Keywords: | Activation functions; ANN; Sigmoid; Tanh; ReLU. |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science Q Science > QA Mathematics > QA76 Computer software T Technology > T Technology (General) T Technology > TA Engineering (General). Civil engineering (General) T Technology > TJ Mechanical engineering and machinery |
| Faculty/Division: | Institute of Postgraduate Studies Faculty of Computing Faculty of Mechanical and Automotive Engineering Technology College of Engineering |
| Depositing User: | Mr Muhamad Firdaus Janih@Jaini |
| Date Deposited: | 07 Feb 2023 04:17 |
| Last Modified: | 07 Feb 2023 04:17 |
| URI: | http://umpir.ump.edu.my/id/eprint/36927 |
| Download Statistic: | View Download Statistics |
Actions (login required)
 |
View Item |