Farag, Mohannad and Abdul Nasir, Abd Ghafar and Alsibai, Mohammed Hayyan (2019) Real-time robotic grasping and localization using deep learning-based object detection technique. In: IEEE International Conference on Automatic Control and Intelligent Systems (I2CACIS) , 29 June 2019 , Shah Alam, Selangor, Malaysia. pp. 139-144.. ISBN 978-1-7281-0784-4
|
Pdf
Real-Time Robotic Grasping and Localization1.pdf Download (178kB) | Preview |
Abstract
This work aims to increase the impact of computer vision on robotic positioning and grasping in industrial assembly lines. Real-time object detection and localization problem is addressed for robotic grasp-and-place operation using Selective Compliant Assembly Robot Arm (SCARA). The movement of SCARA robot is guided by deep learning-based object detection for grasp task and edge detection-based position measurement for place task. Deep Convolutional Neural Network (CNN) model, called KSSnet, is developed for object detection based on CNN Alexnet using transfer learning approach. SCARA training dataset with 4000 images of two object categories associated with 20 different positions is created and labeled to train KSSnet model. The position of the detected object is included in prediction result at the output classification layer. This method achieved the state-of-the-art results at 100% precision of object detection, 100% accuracy for robotic positioning and 100% successful real-time robotic grasping within 0.38 seconds as detection time. A combination of Zerocross and Canny edge detectors is implemented on a circular object to simplify the place task. For accurate position measurement, the distortion of camera lens is removed using camera calibration technique where the measured position represents the desired location to place the grasped object. The result showed that the robot successfully moved to the measured position with positioning Root Mean Square Error (0.361, 0.184) mm and 100% for successful place detection.
| Item Type: | Conference or Workshop Item (Lecture) |
|---|---|
| Additional Information: | Indexed by SCOPUS |
| Uncontrolled Keywords: | Deep learning, CNN, object detection, edge detection, real-time grasp detection, robot positioning, robot arm |
| Subjects: | T Technology > TK Electrical engineering. Electronics Nuclear engineering |
| Faculty/Division: | Faculty of Engineering Technology Institute of Postgraduate Studies |
| Depositing User: | Noorul Farina Arifin |
| Date Deposited: | 18 Jul 2019 03:17 |
| Last Modified: | 02 Dec 2019 08:15 |
| URI: | http://umpir.ump.edu.my/id/eprint/25004 |
| Download Statistic: | View Download Statistics |
Actions (login required)
 |
View Item |