Evaluation of Construction Robot Telegrasping Force Perception Using Visual, Auditory and Force Feedback Integration

Ahmad Anas Yusof; Takuya Kawamura; Hironao Yamada

doi:10.20965/jrm.2012.p0949

single-rb.php

« previous

JRM Vol.24 No.6 pp. 949-957

doi: 10.20965/jrm.2012.p0949

(2012)

Paper:

Views over last 60 days: 729

Evaluation of Construction Robot Telegrasping Force Perception Using Visual, Auditory and Force Feedback Integration

Ahmad Anas Yusof, Takuya Kawamura, and Hironao Yamada

Department of Human and Information Systems, Faculty of Engineering, Gifu University, 1-1 Yanagido, Gifu 501-1193, Japan

Received:

December 9, 2011

Accepted:

March 8, 2012

Published:

December 20, 2012

Keywords:

construction machinery, manipulator, master-slave control, multimodal sensory feedback

Abstract

Construction robot telegrasping operation provides considerable challenges in postdisaster recovery missions. This paper presents an evaluation of construction robot telegrasping force perception, which integrates the use of visual, auditory and force feedback systems. The integration of graphically-presented feedback force is proposed to help operators visually monitor changes in grasping force. Auditory feedback is used simultaneously to provide rapid warnings, while force feedback enhances grasping sense. Sensitivity to each type of feedback is measured by using psychophysical tests, and manipulation tests are conducted to observe effects on the gripping risk index, task completion time and subjective workload. Results validate the need for multimodal sensory feedback, for accurately controlling the grasping process, and for avoiding unnecessary action due to human error.

Cite this article as:

A. Yusof, T. Kawamura, and H. Yamada, “Evaluation of Construction Robot Telegrasping Force Perception Using Visual, Auditory and Force Feedback Integration,” J. Robot. Mechatron., Vol.24 No.6, pp. 949-957, 2012.

Data files:

References

[1] K. Chayama and K. Kawashima, “Fluid power system in postdisaster recovery,” J. of The Japan Fluid Power System Society, Vol.36, No.E1, pp. 42-46, 2005.
[2] M. J. Bakari, K. M. Zied, and D. W. Seward, “Development of a multi-arm mobile robot for nuclear decommissioning tasks,” International J. of Advanced Robotic Systems, Vol.4, No.4, pp. 387-406, 2007.
[3] Husqvarna Press Release, “New demolition robot from Husqvarna: Compact, agile, and the strongest in its class,” 2010.
[4] Tepco Press Release, “Status of TEPCO’s Facilities and its services after the Great East Japan Earthquake,” 2011.
[5] H. Yamada, H. Kato, and T. Muto, “Master-slave control for construction robot tele-operation,” J. of Robotics and Mechatronics, Vol.15, No.1, pp. 534-540, 2003.
[6] H. Yamada, M. Gong, and D. Zhao, “A master-slave control for a tele-operation system for a construction robot: Application of a velocity control method with a force feedback model,” J. of Robotics and Mechatronics, Vol.19, No.1, pp. 60-67, 2006.
[7] B. T. Bethea, “Application of haptic feedback to robotic surgery,” J. of Laparoendoscopic and Advanced Surgical Techniques, Vol.14, No.3, pp. 191-195, 2004.
[8] S. B. Kesner and R. D. Howe, “Discriminating tissue stiffness with a haptic catheter: Feeling the inside of the beating heart,” IEEE World haptic Conf., Istanbul, Turkey, 2011.
[9] H. Yamada and T. Muto, “Development of hydraulic teleoperated construction robot using virtual reality: New master slave control method and an evaluation of a visual feedback system,” Int. J. of Fluid Power, Vol.4, No.2, pp. 35-42, 2003.
[10] H. Yamada, X. Tang, T. Ni, D. Zhao, and A. A. Yusof, “Teleoperation construction robot control system with virtual reality,” Proc. 9th IFAC Symposium on Robot Control, pp. 793-798, 2009.
[11] A. A. Yusof, X. Tang, T. Kawamura, and H. Yamada, “Construction robot Tele-operation with a VR-aided display: Workspace Viewpoint Manipulation Effect,” Int. J. of Robotics and Automation, Vol.26, No.4, pp. 376-388, 2011.
[12] A. A. Yusof, T. Kawamura, and H. Yamada, “Operational Evaluation of a Construction Robot Tele-operation with Force Feedback: Evaluation of Tele-robotic Force Perception using Auditory Feedback,” Trans. of The Japan Fluid Power System Society, Vol.43, No.1, pp. 1-8, 2012.
[13] S. Kimura, S. Tsuchiya, Y. Nagai, K. Nakamura, K. Satoh, H. Morikawa, and N. Takanashi, “Teleoperation Techniques for Assembling an Antenna by using Space Robots – Experiments on Engineering Test Satellite VII –,” J. of Robotics and Mechatronics, Vol.12, No.4 pp. 394-401, 2000.
[14] D. E. DiFranco, G. L. Beauregard, and M. A. Srinivasan, “The effect of auditory cues on the haptic perception of stiffness in virtual environments,” Proc. of the ASME Dynamic Systems and Control Division, pp. 17-22, 1997.
[15] S. Shinichi, O. Mikio, K. Shingo, and O. Toshihiro, “Development and practice of the tele-earthwork system,” Advanced Robotics, Vol.10, No.4, pp. 425-438, 1995.
[16] K. Kawashima, T. Sasaki, T. Miyata, N. Nakamura, M. Sekiguchi, and T. Kagawa. “Development of robot using pneumatic artificial rubber muscles to operate construction machinery,” J. of Robotics and Mechatronics, Vol.19, No.1, p. 816, 2004.
[17] S. Barrass and G. Kramer, “Using sonification,” Multimedia Systems, Vol.7, No.1, p. 23-31, 1999.
[18] R. D. Luce and C. Krumhansl, “Measurement, scaling, and psychophysics,” R. C. Atkinson, R. J. Herrnstein, G. Lindzey, and R. D. Luce (Eds.), “Stevens’ Handbook of Experimental Psychology,” New York: Wiley, pp. 60-64, 1988.
[19] S. G. Hart and L. E. Staveland, “Development of Nasa (Task load index): Results of empirical and theoretical research,” Human mental workload, Amsterdam: Elsevier, pp. 23-37, 1987.

This article is published under a Creative Commons Attribution-NoDerivatives 4.0 Internationa License.

[1] [1] K. Chayama and K. Kawashima, “Fluid power system in postdisaster recovery,” J. of The Japan Fluid Power System Society, Vol.36, No.E1, pp. 42-46, 2005.

[2] [2] M. J. Bakari, K. M. Zied, and D. W. Seward, “Development of a multi-arm mobile robot for nuclear decommissioning tasks,” International J. of Advanced Robotic Systems, Vol.4, No.4, pp. 387-406, 2007.

[3] [3] Husqvarna Press Release, “New demolition robot from Husqvarna: Compact, agile, and the strongest in its class,” 2010.

[4] [4] Tepco Press Release, “Status of TEPCO’s Facilities and its services after the Great East Japan Earthquake,” 2011.

[5] [5] H. Yamada, H. Kato, and T. Muto, “Master-slave control for construction robot tele-operation,” J. of Robotics and Mechatronics, Vol.15, No.1, pp. 534-540, 2003.

[6] [6] H. Yamada, M. Gong, and D. Zhao, “A master-slave control for a tele-operation system for a construction robot: Application of a velocity control method with a force feedback model,” J. of Robotics and Mechatronics, Vol.19, No.1, pp. 60-67, 2006.

[7] [7] B. T. Bethea, “Application of haptic feedback to robotic surgery,” J. of Laparoendoscopic and Advanced Surgical Techniques, Vol.14, No.3, pp. 191-195, 2004.

[8] [8] S. B. Kesner and R. D. Howe, “Discriminating tissue stiffness with a haptic catheter: Feeling the inside of the beating heart,” IEEE World haptic Conf., Istanbul, Turkey, 2011.

[9] [9] H. Yamada and T. Muto, “Development of hydraulic teleoperated construction robot using virtual reality: New master slave control method and an evaluation of a visual feedback system,” Int. J. of Fluid Power, Vol.4, No.2, pp. 35-42, 2003.

[10] [10] H. Yamada, X. Tang, T. Ni, D. Zhao, and A. A. Yusof, “Teleoperation construction robot control system with virtual reality,” Proc. 9th IFAC Symposium on Robot Control, pp. 793-798, 2009.

[11] [11] A. A. Yusof, X. Tang, T. Kawamura, and H. Yamada, “Construction robot Tele-operation with a VR-aided display: Workspace Viewpoint Manipulation Effect,” Int. J. of Robotics and Automation, Vol.26, No.4, pp. 376-388, 2011.

[12] [12] A. A. Yusof, T. Kawamura, and H. Yamada, “Operational Evaluation of a Construction Robot Tele-operation with Force Feedback: Evaluation of Tele-robotic Force Perception using Auditory Feedback,” Trans. of The Japan Fluid Power System Society, Vol.43, No.1, pp. 1-8, 2012.

[13] [13] S. Kimura, S. Tsuchiya, Y. Nagai, K. Nakamura, K. Satoh, H. Morikawa, and N. Takanashi, “Teleoperation Techniques for Assembling an Antenna by using Space Robots – Experiments on Engineering Test Satellite VII –,” J. of Robotics and Mechatronics, Vol.12, No.4 pp. 394-401, 2000.

[14] [14] D. E. DiFranco, G. L. Beauregard, and M. A. Srinivasan, “The effect of auditory cues on the haptic perception of stiffness in virtual environments,” Proc. of the ASME Dynamic Systems and Control Division, pp. 17-22, 1997.

[15] [15] S. Shinichi, O. Mikio, K. Shingo, and O. Toshihiro, “Development and practice of the tele-earthwork system,” Advanced Robotics, Vol.10, No.4, pp. 425-438, 1995.

[16] [16] K. Kawashima, T. Sasaki, T. Miyata, N. Nakamura, M. Sekiguchi, and T. Kagawa. “Development of robot using pneumatic artificial rubber muscles to operate construction machinery,” J. of Robotics and Mechatronics, Vol.19, No.1, p. 816, 2004.

[17] [17] S. Barrass and G. Kramer, “Using sonification,” Multimedia Systems, Vol.7, No.1, p. 23-31, 1999.

[18] [18] R. D. Luce and C. Krumhansl, “Measurement, scaling, and psychophysics,” R. C. Atkinson, R. J. Herrnstein, G. Lindzey, and R. D. Luce (Eds.), “Stevens’ Handbook of Experimental Psychology,” New York: Wiley, pp. 60-64, 1988.

[19] [19] S. G. Hart and L. E. Staveland, “Development of Nasa (Task load index): Results of empirical and theoretical research,” Human mental workload, Amsterdam: Elsevier, pp. 23-37, 1987.