Development of a Bridge Inspection Support System Using Two-Wheeled Multicopter and 3D Modeling Technology

Yoshiro Hada; Manabu Nakao; Moyuru Yamada; Hiroki Kobayashi; Naoyuki Sawasaki; Katsunori Yokoji; Satoshi Kanai; Fumiki Tanaka; Hiroaki Date; Sarthak Pathak; Atsushi Yamashita; Manabu Yamada; Toshiya Sugawara

doi:10.20965/jdr.2017.p0593

single-dr.php

« previous

JDR Vol.12 No.3 pp. 593-606

(2017)

doi: 10.20965/jdr.2017.p0593

Paper:

Views over last 60 days: 1,620

Development of a Bridge Inspection Support System Using Two-Wheeled Multicopter and 3D Modeling Technology

Yoshiro Hada^1,†, Manabu Nakao^1, Moyuru Yamada^1, Hiroki Kobayashi^1, Naoyuki Sawasaki^1, Katsunori Yokoji^1, Satoshi Kanai^2, Fumiki Tanaka^2, Hiroaki Date^2, Sarthak Pathak^3, Atsushi Yamashita^3, Manabu Yamada^4, and Toshiya Sugawara^*5

^*1Safety Solution Business Unit, Fujitsu Limited
10-1 Morinosato-Wakamiya, Atsugi, Kanagawa 243-0197, Japan

^†Corresponding author

^*2Hokkaido University, Sapporo, Japan

^*3The University of Tokyo, Tokyo, Japan

^*4Nagoya Institute of Technology, Nagoya, Japan

^*5Docon Co. Limited, Sapporo, Japan

Received:

October 24, 2016

Accepted:

May 19, 2017

Online released:

May 29, 2017

Published:

June 1, 2017

Keywords:

bridge inspection, UAV, 3D point cloud data, 3D CAD model, geotagging

Abstract

Recently, many countries have faced serious problems associated with aging civil infrastructures such as bridges, tunnels, dams, highways and so on. Aging infrastructures are increasing year by year and suitable maintenance actions are necessary to maintain their safety and serviceability. In fact, infrastructure deterioration has caused serious problems in the past. In order to prevent accidents with civil infrastructures, supervisors must spend a lot of money to maintain the safe conditions of infrastructures. Therefore, new technologies are required to reduce maintenance costs. In 2014 the Japanese government started the Cross-Ministerial Strategic Innovation Promotion Program (SIP), and technologies for infrastructure maintenance have been studied in the SIP project [1]. Fujitsu Limited, Hokkaido University, The University of Tokyo, Nagoya Institute of Technology and Docon Co. Limited have been engaged in the SIP project to develop a bridge inspection support system using information technology and robotic technology. Our system is divided into the following two main parts: bridge inspection support robots using a two-wheeled multicopter, and an inspection data management system utilizing 3D modeling technology. In this paper, we report the bridge inspection support system developed in our SIP project.

Cite this article as:

Y. Hada, M. Nakao, M. Yamada, H. Kobayashi, N. Sawasaki, K. Yokoji, S. Kanai, F. Tanaka, H. Date, S. Pathak, A. Yamashita, M. Yamada, and T. Sugawara, “Development of a Bridge Inspection Support System Using Two-Wheeled Multicopter and 3D Modeling Technology,” J. Disaster Res., Vol.12 No.3, pp. 593-606, 2017.

Data files:

References

[1] Y. Fujino, “The Cross-ministerial Strategic Innovation Promotion Program, Infrastructure Maintenance, Renovation, and Management,” Cabinet office, Government of Japan, http://www8.cao.go.jp/cstp/panhu/sip_english/34-37.pdf [accessed May 8, 2017]
[2] M. Nakao, Y. Hada et al., “Development of a bridge inspection support robot system that uses a two-wheeled quiad-rotor helicopter,” Proc. of The Fourteenth East Asia-Pacific Conf. on Structural Engineering and Construction (EASEC-14), S3.460, 2016.
[3] N. Takahashi, M. Yamada et al., “All-round two-wheeled quadrotor helicopters with protect-frames for air-land-sea vehicle,” Advanced Robotics, Vol.29, No.1, pp. 69-87, 2015.
[4] “The Aerial Robotic Infrastructure Analyst (ARIA) Project,” Carnegie Mellon University, http://aria.ri.cmu.edu/ [accessed May 8, 2017]
[5] S. Pathak, A. Moro, A. Yamashita and H. Asama, “3D Reconstruction of Structures using Spherical Camera with Small Motion,” Proc. of 16^th Int. Conf. on Control, Automation and Systems (ICCAS 2016), 2016.
[6] F. Tanaka, M. Hori, M. Onosato, H. Date, and S. Kanai, “Bridge Information Model Based on IFC Standards and Web Content Providing System for Supporting an Inspection Process,” Proc. of 16^th Int. Conf. on Computing in Civil and Building Engineering (ICCCBE 2016), 2016.
[7] H. Date, T. Yokoyama, S. Kanai, Y. Hada, M. Nakao, and T. Sugawara, “Automatic Registration of Laser-Scanned Point Clounds of Bridges Using Linear Features,” Proc. of the Asian Conf. on Design and Digital Engineering 2016 (ACDDE 2016), 2016.
[8] “SeeBridge – Automated Compilation of Semantically Rich BIM Models of Bridges,” An Infractructure Innovation Programme, Infravation, http://www.infravation.net/projects/SEEBRIDGE [accessed May 8, 2017]
[9] R. Sacks, A. Kedar et al., “SeeBridge Information Delivery Manual (IDM) for Next Generation Bridge Inspection,” Proc. of 33^rd Int. Symposium on Automation and Robotics in Costruction (ISARC 2016), 2016.
[10] S. Mizutani, Y. Okada, C. Salaan, T. Ishii, K. Ohno and S. Tadokoro, “Proposal and experimental validation of a design strategy for a UAV with a passive rotating spherical shell,” Proc. of 2015 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2015.
[11] “Self-Propelling Surface-Clinging Drone PD6-CI-L,” Prodrone Co., Ltd., 2016, https://www.youtube.com/watch?v=FjoPsWYtfxo&feature=youtu.be [accessed May 8, 2017]
[12] A. Bulgakow and S. Emeliznov, “Inspection of Flyover Bridges Using Quadrotor,” Proc. of 32^th Int. Symposium on Automation and Robotics in Costruction (ISARC 2015), 2015.
[13] C. Yang, M. Wen, Y. Chen, and S. Kang, “An Optimized Unmanned Aerial System for Bridge Inspection,” Proc. of 32^th Int. Symposium on Automation and Robotics in Costruction (ISARC 2015), 2015.
[14] M. Gillins, D. Gillins, and C. Parrish, “Cost-Effective Bridge Safety Inspection using Unmanned Aircraft Systems (UAV),” Proc. of Geotechnical and Structural Engineering Congress 2016, 2016.
[15] Ministry of Land, Infrastructure, Transport and Tourism of Japan, “The standard manual of unmanned aerial vehicle flight” (in Japanese), Aug. 2016, https://www.mlit.go.jp/common/001140548.pdf [accessed May 8, 2017]

This article is published under a Creative Commons Attribution-NoDerivatives 4.0 Internationa License.

[1] [1] Y. Fujino, “The Cross-ministerial Strategic Innovation Promotion Program, Infrastructure Maintenance, Renovation, and Management,” Cabinet office, Government of Japan, http://www8.cao.go.jp/cstp/panhu/sip_english/34-37.pdf [accessed May 8, 2017]

[2] [2] M. Nakao, Y. Hada et al., “Development of a bridge inspection support robot system that uses a two-wheeled quiad-rotor helicopter,” Proc. of The Fourteenth East Asia-Pacific Conf. on Structural Engineering and Construction (EASEC-14), S3.460, 2016.

[3] [3] N. Takahashi, M. Yamada et al., “All-round two-wheeled quadrotor helicopters with protect-frames for air-land-sea vehicle,” Advanced Robotics, Vol.29, No.1, pp. 69-87, 2015.

[4] [4] “The Aerial Robotic Infrastructure Analyst (ARIA) Project,” Carnegie Mellon University, http://aria.ri.cmu.edu/ [accessed May 8, 2017]

[5] [5] S. Pathak, A. Moro, A. Yamashita and H. Asama, “3D Reconstruction of Structures using Spherical Camera with Small Motion,” Proc. of 16^th Int. Conf. on Control, Automation and Systems (ICCAS 2016), 2016.

[6] [6] F. Tanaka, M. Hori, M. Onosato, H. Date, and S. Kanai, “Bridge Information Model Based on IFC Standards and Web Content Providing System for Supporting an Inspection Process,” Proc. of 16^th Int. Conf. on Computing in Civil and Building Engineering (ICCCBE 2016), 2016.

[7] [7] H. Date, T. Yokoyama, S. Kanai, Y. Hada, M. Nakao, and T. Sugawara, “Automatic Registration of Laser-Scanned Point Clounds of Bridges Using Linear Features,” Proc. of the Asian Conf. on Design and Digital Engineering 2016 (ACDDE 2016), 2016.

[8] [8] “SeeBridge – Automated Compilation of Semantically Rich BIM Models of Bridges,” An Infractructure Innovation Programme, Infravation, http://www.infravation.net/projects/SEEBRIDGE [accessed May 8, 2017]

[9] [9] R. Sacks, A. Kedar et al., “SeeBridge Information Delivery Manual (IDM) for Next Generation Bridge Inspection,” Proc. of 33^rd Int. Symposium on Automation and Robotics in Costruction (ISARC 2016), 2016.

[10] [10] S. Mizutani, Y. Okada, C. Salaan, T. Ishii, K. Ohno and S. Tadokoro, “Proposal and experimental validation of a design strategy for a UAV with a passive rotating spherical shell,” Proc. of 2015 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2015.

[11] [11] “Self-Propelling Surface-Clinging Drone PD6-CI-L,” Prodrone Co., Ltd., 2016, https://www.youtube.com/watch?v=FjoPsWYtfxo&feature=youtu.be [accessed May 8, 2017]

[12] [12] A. Bulgakow and S. Emeliznov, “Inspection of Flyover Bridges Using Quadrotor,” Proc. of 32^th Int. Symposium on Automation and Robotics in Costruction (ISARC 2015), 2015.

[13] [13] C. Yang, M. Wen, Y. Chen, and S. Kang, “An Optimized Unmanned Aerial System for Bridge Inspection,” Proc. of 32^th Int. Symposium on Automation and Robotics in Costruction (ISARC 2015), 2015.

[14] [14] M. Gillins, D. Gillins, and C. Parrish, “Cost-Effective Bridge Safety Inspection using Unmanned Aircraft Systems (UAV),” Proc. of Geotechnical and Structural Engineering Congress 2016, 2016.

[15] [15] Ministry of Land, Infrastructure, Transport and Tourism of Japan, “The standard manual of unmanned aerial vehicle flight” (in Japanese), Aug. 2016, https://www.mlit.go.jp/common/001140548.pdf [accessed May 8, 2017]

Development of a Bridge Inspection Support System Using Two-Wheeled Multicopter and 3D Modeling Technology

Yoshiro Hada*1,†, Manabu Nakao*1, Moyuru Yamada*1, Hiroki Kobayashi*1, Naoyuki Sawasaki*1, Katsunori Yokoji*1, Satoshi Kanai*2, Fumiki Tanaka*2, Hiroaki Date*2, Sarthak Pathak*3, Atsushi Yamashita*3, Manabu Yamada*4, and Toshiya Sugawara*5

Yoshiro Hada^1,†, Manabu Nakao^1, Moyuru Yamada^1, Hiroki Kobayashi^1, Naoyuki Sawasaki^1, Katsunori Yokoji^1, Satoshi Kanai^2, Fumiki Tanaka^2, Hiroaki Date^2, Sarthak Pathak^3, Atsushi Yamashita^3, Manabu Yamada^4, and Toshiya Sugawara^*5