Tan, Szi Hui and Ishak, Mohamad Khairi and Packeer Mohamed, Mohamed Fauzi and Mohd Fadzil, Lokman and Ahmad Afif, Ahmarofi (2021) Balancing excitation and inhibition of spike neuron using deep Q network (DQN). In: Journal of Physics: Conference Series, 5th International Conference on Electronic Design (ICED 2020) , 19 August 2020 , Perlis (Virtual Mode). pp. 1-16., 1755 (012004). ISSN 1742-6588 (print); 1742-6596 (online)
|
Pdf (Open access)
Balancing excitation and inhibition of spike neuron.pdf Available under License Creative Commons Attribution. Download (1MB) | Preview |
Abstract
Deep reinforcement learning which involved reinforcement learning with artificial neural networks allows an agent to take the best possible actions in a virtual environment to achieve goals. Spike neuron has a non-differentiable spike generation function that caused SNN training faced difficulty. In order to overcome the difficulty, Deep Q Network (DQN) is proposed to act as an agent to interact with a custom environment. A spike neuron is modelled by using NEST simulator. Rewards are given to the agent for every action taken. The model is trained and tested to validate the performance of the trained model in order to attain balance the firing rate of excitatory and inhibitory population of spike neuron. Training result showed the agent able to handle the environment. The trained model capable to balance the excitation and inhibition of the spike neuron as the actual output neuron rate is close to or same with the target neuron firing rate. The average percentage error of rate of difference between output and target neuron rate for 5 episodes achieved 0.80%.
| Item Type: | Conference or Workshop Item (Lecture) |
|---|---|
| Additional Information: | Indexed by Scopus |
| Uncontrolled Keywords: | Deep learning; Neurons; Reinforcement learning |
| Subjects: | Q Science > QA Mathematics > QA76 Computer software T Technology > TK Electrical engineering. Electronics Nuclear engineering |
| Faculty/Division: | Faculty of Industrial Management |
| Depositing User: | Mrs Norsaini Abdul Samat |
| Date Deposited: | 07 Sep 2021 04:59 |
| Last Modified: | 07 Sep 2021 04:59 |
| URI: | http://umpir.ump.edu.my/id/eprint/31934 |
| Download Statistic: | View Download Statistics |
Actions (login required)
 |
View Item |