REAL TIME GESTURE MEASUREMENT OF HUMAN HAND FOR ROBOTICS ARM

Published 31 Mar 2020 •  vol 136  • 


Authors:

 

R. Satheeshkumar, Department of EEE, Annamalai University, Annamalai Nagar, Tamilnadu, India
R. Arivoli, Department of EEE, Annamalai University, Annamalai Nagar, Tamilnadu, India

Abstract:

 

In industry, Robotics needs precise control for handling various production activities. The proposed research is to measure the gesture grip value of both human hand and Robotic hand. The measured value of both human hand gripping and robotic hand gripping should be same. This leads for more perfection. Flex sensors are used to measure the value of gripping in both human hand and robotic hand. To achieve the exact control, camera visualizes the robotic hand activities from remote area. Pick and place of object is most significant task of robotic hand. Grip of robotic hand mimics human hand for handling different objects. The aim is to develop robotic hand handling of object similar to real human hand. The robotic hand design has 5 fingers 14 degree of freedom.

Keywords:

 

Camera, Human-Robot Interaction, Gripper, Gesture, Grasping and Robotic Arm

References:

 

[1] Saudabayev, Artur, and Huseyin Atakan Varol. "Sensors for robotic hands:A survey of state of the art." IEEE Access 3 (2015): 1765-1782.
[2] Park, Yeongyu, Jeongsoo Lee, and Joonbum Bae. "Development of a wearable sensing glove for measuring the motion of fingers using linear potentiometers and flexible wires." IEEE Transactions on Industria Informatics 11.1 (2014): 198-206.
[3] Tabassum, Meher, and D. D. Ray. "Intuitive control of three fingers robotic Gripper with a Data hand glove." 2013 International Conference on Control, Automation, Robotics and Embedded Systems (CARE). IEEE,2013.
[4] Wang, Zhongkui, Yuuki Torigoe, and Shinichi Hirai. "A prestressed soft gripper: design, modeling, fabrication, and tests for food handling." IEEE Robotics and Automation Letters 2.4 (2017): 1909-1916.
[5] Kawaguchi J, Yoshimoto S, Kuroda Y, Oshiro O. Estimation of finger joint angles based on electromechanical sensing of wrist shape. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2016 Nov 9;25(9):1409-18.
[6] Zhakypov Z, Heremans F, Billard A, Paik J. An origami-inspired reconfigurable suction gripper for picking objects with variable shape and size. IEEE Robotics and Automation Letters. 2018 Jun 14;3(4):2894-901.
[7] Sato K, Kamiyama K, Kawakami N, Tachi S. Finger-shaped gelforce: sensor for measuring surface traction fields for robotic hand. IEEE Transactions on Haptics. 2009 Oct 30;3(1):37-47.
[8] Tavakoli M, Lopes P, Lourenco J, Rocha RP, Giliberto L, de Almeida AT, Majidi C. Autonomous selection of closing posture of a robotic hand through embodied soft matter capacitive sensors. IEEE Sensors Journal. 2017 Jul 14;17(17):5669-77.
[9] Purohit, Ankit, and Makarand Kakatkar. "A 9-dof robotic hand Teleoperation system using haptic technology." 2015 International Conference on Pervasive Computing (ICPC). IEEE, 2015.
[10] Ohka, Masahiro, Yuki Aiba, and Yusuke Motegi. "Assembly task based on tri-axial tactile data using loose grip." 2017 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS). IEEE, 2017.
[11] Mangukiya, Yamik, Brij Purohit, and Kiran George. "Electromyography (EMG) sensor controlled assistive orthotic robotic arm for forearm movement." 2017 IEEE Sensors Applications Symposium (SAS). IEEE,2017.
[12] Leonardis D, Barsotti M, Loconsole C, Solazzi M, Troncossi M, Mazzotti C, Castelli VP, Procopio C, Lamola G, Chisari C, Bergamasco M. An EMG-controlled robotic hand exoskeleton for bilateral rehabilitation. IEEE transactions on haptics. 2015 Mar 30;8(2):140-51.
[13] Cho SG, Yoshikawa M, Baba K, Ogawa K, Takamatsu J, Ogasawara T. Hand motion recognition based on forearm deformation measured with a distance sensor array. In2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) 2016 Aug 16 (pp. 4955-4958). IEEE.
[14] Arata J, Hattori M, Ichikawa S, Sakaguchi M. Robotically enhanced rubber hand illusion. IEEE transactions on haptics. 2014 Feb 5;7(4):526-32.
[15] Hashimoto Y, Yatou D, Yamada T, Yamamoto H. Fundamental study on robotic assembly of modular fixture parts by a low cost 4-finger 12 dof hand. In2015 IEEE/SICE International Symposium on System Integration (SII) 2015 Dec 11 (pp. 930-935). IEEE.
[16] Low JH, Lee WW, Khin PM, Thakor NV, Kukreja SL, Ren HL, Yeow CH. Hybrid tele-manipulation system using a sensorized 3-D-printed soft robotic gripper and a soft fabric-based haptic glove. IEEE Robotics and Automation Letters. 2017 Jan 19;2(2):880-7.
[17] Naglot, Deepali, and Milind Kulkarni. "Real time sign language recognition using the leap motion controller." 2016 International Conference on Inventive Computation Technologies (ICICT). Vol. 3.IEEE, 2016.
[18] Ciullo, Andrea S., et al. "Analytical and experimental analysis for position optimization of a grasp assistance supernumerary robotic hand." IEEE Robotics and Automation Letters 3.4 (2018): 4305-4312.
[19] Sandesh, R. S., and Nithya Venkatesan. "Novel approach to control of robotic hand using flex sensors." IAES International Journal of Robotics and Automation 3.4 (2014): 234.
[20] Raheja, Jagdish Lal, et al. "Real-time robotic hand control using hand gestures." 2010 Second International Conference on Machine Learning and Computing. IEEE, 2010.
[21] Allen, Peter K., et al. "Automated tracking and grasping of a moving object with a robotic hand-eye system." IEEE Transactions on Robotics and Automation 9.2 (1993): 152-165.
[22] Chu, Jun-Uk, et al. "A supervised feature-projection-based real-time EMG pattern recognition for multifunction myoelectric hand control." IEEE/ASME Transactions on Mechatronics 12.3 (2007): 282-290.
[23] Enayati, Nima, Elena De Momi, and Giancarlo Ferrigno. "Haptics in robot-assisted surgery: Challenges and benefits." IEEE reviews in biomedical engineering 9 (2016): 49-65.
[24] Kofman, Jonathan, et al. "Teleoperation of a robot manipulator using a vision-based human-robot interface." IEEE transactions on industrial electronics 52.5 (2005): 1206-1219.
[25] R.Satheeshkumar and R. Arivoli , ” Real Time Virtual Human Hand For Robotics.” Journal of Computational Information Systems 15.1 (2019): 82-89.
[26] R.Satheeshkumar and R. Arivoli , "Real Time Virtual Human Hand for Diagnostic Robot (DiagBot) Arm Using IOT “ Journal of advanced research in dynamical and control system, Vol. 12, 01-Special Issue, 2020.

Citations:

 

APA:
Satheeshkumar, R., & Arivoli, R. (2020). Real Time Gesture Measurement of Human Hand for Robotics Arm. International Journal of Advanced Science and Technology (IJAST), ISSN: 2005-4238(Print); 2207-6360 (Online), NADIA, 136, 21-38. doi: 10.33832/ijast.2020.136.03.

MLA:
Satheeshkumar, R., et al. “Real Time Gesture Measurement of Human Hand for Robotics Arm.” International Journal of Advanced Science and Technology, ISSN: 2005-4238(Print); 2207-6360 (Online), NADIA, vol. 136, 2020, pp. 21-38. IJAST, http://article.nadiapub.com/IJAST/Vol136/3.html.

IEEE:
[1] R. Satheeshkumar, and R. Arivoli, "Real Time Gesture Measurement of Human Hand for Robotics Arm." International Journal of Advanced Science and Technology (IJAST), ISSN: 2005-4238(Print); 2207-6360 (Online), NADIA, vol. 136, pp. 21-38, Mar 2020.