Construction Robot Operation System with Object’s Hardness Recognition Using Force Feedback and Virtual Reality
Lingtao Huang*, Takuya Kawamura**, and Hironao Yamada**
*Mechanical and Civil Engineering Division, Gifu University
**Department of Human and Information Systems, Gifu University, 1-1 Yanagido, Gifu 501-1193, Japan
Received:April 11, 2012Accepted:June 25, 2012Published:December 20, 2012
Keywords:construction machinery, robot, hydraulic actuator, master-slave control, force feedback
We developed a master-slave operation system for a teleoperation construction robot that recognizes the hardness of a grasped object. To manipulate an object, the system uses an excavator with four degrees of freedom as a slave and two joysticks with force feedback equipment as a master. Based on creating a friendly user interface, the operation system uses multimodel sensory force and visual feedback to successfully discriminate among soft object types during operation. The construction robot measures the hardness of an object using the pressure of a piston obtained by pressure sensors on the cylinder and the closed or open state of a fork glove in the process of grasping an object. By incorporating an object-hardness calculation method with master-slave control of the system, an operator then can feel the sense of reaction force to joysticks and distinguish the hardness of an object while controlling the construction robot. In addition, parameters on object-hardness calculation are presented to the operator to improve the system’s controllability. Color prompting is provided in virtual space to enable the operator to identify the hardness of an object. To evaluate the system, object-type recognition tests were conducted, including the grasping and conveying of blocks of concrete, tires, urethane foam and sponge foam. According to statistical analysis of experimental results, we confirmed that the operation system contributes to achieving the successful discrimination of object hardness during teleoperation work.
Cite this article as:L. Huang, T. Kawamura, and H. Yamada, “Construction Robot Operation System with Object’s Hardness Recognition Using Force Feedback and Virtual Reality,” J. Robot. Mechatron., Vol.24 No.6, pp. 958-966, 2012.Data files:
-  N. V. Q. Hung, T. Narikiyo, and H. D. Tuan, “Nonlinear adaptive control of master-slave system in teleoperation,” Control Engineering Practice, Vol.11, No.1, pp. 1-10, 2003.
-  M. Dede and S. Tosunoglu, “Fault-tolerant teleoperation systems design,” Industrial Robot: An International Journal, Vol.33, No.5, pp. 365-382, 2006.
-  M. Massimino and T. B. Sherdan, “Teleoperator performance with varying force and visual feedback,” Human factors, Vol.36, No.1, pp. 145-157, 1994.
-  H. Yamada, G. Ming-de, and Z. Dingxuan, “A Master-Slave Control for a Tele-Operation system for a Construction Robot (Application of a Velocity Control Method with a Force Feedback Model),” J. of Robotics and Mechatronics, Vol.19 No.1, pp. 60-67, 2007.
-  H. Yamada, H. Kato, and T. Muto, “Master-Slave Control for Construction Robot Teleoperation,” J. of Robotics and Mechatronics, Vol.15, No.1, pp. 35-42, 2003.
-  P. S. G. Henriques, A. A. Pelegrne, and A. A. Nogueira, “Application of subepithelial connective tissue graft with or without enamel matrix derivative for root coverage: a split-mouth randomized research,” J. of Oral Science, Vol.52, No.3, pp. 463-471, 2010.
Copyright© 2012 by Fuji Technology Press Ltd. and Japan Society of Mechanical Engineers. All right reserved.