Robotic Grasping System Using Convolutional Neural Networks

Pavol Bezák¹, Yury Rafailovich Nikitin¹ and Pavol Božek^2,

¹Institute of Applied Informatics, Automation and Mathematics, Faculty of Materials Science and Technology, Slovak University of Technology, Trnava, Slovakia

²Kalashnikov Izhevsk State Technical University, Mechatronic Systems Department, Izhevsk, Russia

Cite this paper:
Pavol Bezák, Yury Rafailovich Nikitin and Pavol Božek. Robotic Grasping System Using Convolutional Neural Networks. American Journal of Mechanical Engineering. 2014; 2(7):216-218. doi: 10.12691/ajme-2-7-9

Abstract

Object grasping by robot hands is challenging due to the hand and object modeling uncertainties, unknown contact type and object stiffness properties. To overcome these challenges, the essential purpose is to achieve the mathematical model of the robot hand, model the object and the contact between the object and the hand. In this paper, an intelligent hand-object contact model is developed for a coupled system assuming that the object properties are known. The control is simulated in the Matlab Simulink/ SimMechanics, Neural Network Toolbox and Computer Vision System Toolbox..

Keywords:
robot hand modeling grasping convolutional neural networks deep learning object recognition pose estimation

This work is licensed under a Creative Commons Attribution 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Figures

References:

[1]	Collet, A., Martinez M., Srinivasa, S. S., The MOPED framework: Object Recognition and Pose Estimation for Manipulation, in International Journal of Robotics Research, 2011.
[2]	Hasan, R.; Rahideh, A; Shaheed, H., Modeling and interactional control of the multifingered hand, 19th International Conference on Automation and Computing (ICAC), pp. 6-10, 13-14 Sept. 2013.
[3]	Pellerin, Ch.l, The Salisbury Hand, Industrial Robot: An International Journal, Vol. 18(1991) Issue: 4, pp. 25-26.
[4]	Townsend, W.T., The Barrett Hand grasper-programmably flexible part handling and assembly, Industrial Robot: An International Journal, Vol. 10(3), 2000, pp. 181-188.
[5]	Grebenstein, M., The DLR hand arm system, IEEE International Conference on Robotics and Automation (ICRA), 2011, pp. 3175-3182.
[6]	Jacobsen, S., Design of the Utah/M.I.T. dexterous hand, IEEE International Conference on Robotics and Automation (ICRA), Vol. 3, 1986, pp. 1520-1532.
[7]	Corrales, J.A; Jara, C.A; Torres, F., Modelling and simulation of a multi-fingered robotic hand for grasping tasks, 11th International Conference on Control Automation Robotics & Vision (ICCARV), vol., no., pp. 1577-1582, 2010.
[8]	Sang-Mun Lee; Kyoung-Don Lee; Heung-Ki Min; Tae-Sung Noh; Jeong-Woo Lee, Kinematics of the Robomec robot hand with planar and spherical four bar linkages for power grasping, IEEE International Conference on Automation Science and Engineering (CASE), pp. 1120-1125, 2012.
[9]	Akdagli, A., Toktas, A., Kayabasi, A., Develi, I., An application of artificial neural network to compute the resonant frequency of e-shaped compact microstrip antennas, Journal of Electrical Engineering, Vol. 64, No. 5, 2013, 317-322
[10]	Ficuciello, F.; Villani, L., Compliant hand-arm control with soft fingers and force sensing for human-robot interaction, 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), pp. 1961-1966, 2012.
[11]	Jincheng Yu; Kaijian Weng; Guoyuan Liang; Guanghan Xie, A vision-based robotic grasping system using deep learning for 3D object recognition and pose estimation, IEEE International Conference on Robotics and Biomimetics (ROBIO), pp.1175-1180, 2013.
[12]	Karavaev, Y., Klekovki, A., Božek, P., The implementation of microprocessor device for drilling process monitoring based on artificial neural network, International Conference on Process Control, pp.163-167, 2013.
[13]	Nagi, J.; Ducatelle, F.; Di Caro, G.A; Ciresan, D.; Meier, U.; Giusti, A; Nagi, F.; Schmidhuber, J.; Gambardella, L.M., Max-pooling convolutional neural networks for vision-based hand gesture recognition, IEEE International Conference on Signal and Image Processing Applications (ICSIPA), pp.342-347, 2011.
[14]	Lenz, I.,, Lee, H., Saxena, A., Deep learning for detecting robotic grasps, in Proc. Of Robotics: Science and Systems (RSS), 2013.
[15]	Mekk, H., Chtourou, M., Variable structure neural networks for adaptive robust control using evolutionary artificial potential fields, Journal of Electrical Engineering, Vol. 64, No. 1, 2013, 3-11
[16]	Frankovský, P., Hroncová, D., Delyová, I., Virgala, I, Modeling of Dynamic Systems in Simulation Environment MATLABSimulink-SimMechanics, American Journal of Mechanical Engineering. Vol. 1, no. 7 (2013), p. 282-288.
[17]	Virgala, I., Frankovský, P., Locomotion mechanism for pipe inspection tasks, Ad Alta. Vol. 3, no. 2 (2013), p. 84-86.