Sutarman, na and Jasni, Mohamad Zain and Mazlina, Abdul Majid and Arief, Hermawan (2015) Malaysian Sign Language Recognition Using Skeleton Data with Neural Network. In: International Conference on Science in Information Technology (ICSITECH 2015) , 27-28 Oct 2015 , Yogjakarta, Indonesia. . (Unpublished)
![[img]](http://umpir.ump.edu.my/style/images/fileicons/application_pdf.png) |
PDF
Malaysian Sign Language Recognition Using Skeleton Data with Neural Network.pdf Restricted to Repository staff only Download (514kB) | Request a copy |
Abstract
This paper proposed the Backpropagation Neural Network (BNN) for recognition of Malaysian Sign Language. The image acquisition is done with the help of skeletal tracking using a Kinect camera. The data samples tested there are 15 dynamic signs taken from the Malaysian Sign Language (MySL). Pre-processing in this study was based on skeleton tracking the joints, to produce 3D coordinates X, Y, Z. The sample of Data 3D coordinates X, Y, and Z is taken a value relative to the Spine and head. The feature extraction is done by normalizing the position and size of the user, by taking eight out of 20 joints contributed in identifying the movement with the hand, left hand, right hand, left wrist, right wrist, left elbow, right elbow, Spine, Head. We use spherical coordinate conversion process and grouping frame used mean function. Two different approaches are evaluated: (1) the Cartesian coordinates (X, Y, and Z) of the six used joints and number of group's frames 14. The classifier used is the Neural Network (Cartesian + ANN); (2) the spherical coordinates (X, Y, and Z) and number of group's frame 14. The classifier used is Neural Network (Spherical+ANN). The experimental results of the Cartesian coordinate, and Artificial Neural Network (ANN) is the best of the neuron hidden layer 150, the best average recognition rate 80.54% with ± 2.07%, maximum 82.61% and minimum 78.47%. The increase at the recognition rate of Cartesian Coordinate+ANN with Spherical coordinates is 12.93%.
| Item Type: | Conference or Workshop Item (Lecture) |
|---|---|
| Uncontrolled Keywords: | Malaysian Sign Language, Sign Recognition, Artificial Neural Network, Kinect. |
| Subjects: | Q Science > QA Mathematics > QA76 Computer software |
| Faculty/Division: | Faculty of Computer System And Software Engineering |
| Depositing User: | Mrs. Neng Sury Sulaiman |
| Date Deposited: | 30 Sep 2015 03:33 |
| Last Modified: | 22 May 2018 02:06 |
| URI: | http://umpir.ump.edu.my/id/eprint/10543 |
| Download Statistic: | View Download Statistics |
Actions (login required)
 |
View Item |