Use of AR / VR in Micro Manipulation Support System for Recognition of Monocular Microscopic Images
Daigo Misaki*, Ryuhei Kurokawa*, Satoshi Nakajima*,
and Shigeomi Koshimizu**
*Department of Mechanical Systems Engineering, Kogakuin University, 1-24-2 Nishi-Shinjuku, Shinjuku-ku, Tokyo 163-8677, Japan
**Advanced Institute of Industrial Technology
This study researches the use of Augmented Reality / Virtual Reality (AR / VR) in an affordable and highly flexible micro manipulation system for the recognition of microscopic images, images that support microscopic manipulation in the interface between the manipulation space and the operator. The application of AR / VR usually requires sensing of the manipulation space with more than one microscope or sensor, not only making the system more complex and costly but also making the manipulation space under the microscope smaller. In this research, therefore, we use the background finite-difference method with background models for monocular microscopic images of the manipulation space; we can build up information needed formanipulation support with AR / VR while removing the effects of any disturbance to the recognition of the manipulation space. We also use liquid bridging forces for the manipulations. The experimental results confirmthat the information processing of the image processing method used in this research is adequate in both terms of accuracy and time efficiency to support microscopic manipulation using liquid bridging forces.
-  D. Misaki, N. Chiba, T. Usuda, O. Fuchiwaki, and H. Aoyama, “Precise Micro Robot Bio-Cell Manipulation Based on the Microscopic Image Recognition,” Mechatronics for Safety, Security and Dependability in a New Era, pp. 241-246, 2007.
-  S. Koshimizu, “Application of Liquid Bridging Force in Manipulation and Assembly of Microparts,” Int. J. of Automation Technology, Vol.3, No.3, 2009.
-  K. Furuta, “The Experimental Microfactory System for Processing and Assembling,” T.IEE Japan, Vol.122-E, No.6, pp. 326-331, 2002.
-  T. Tanikawa and K. Kaneko, “Micro-Manipulation Technology,” JRSJ, Vol.19, No.3, pp. 36-29, 2001. (in Japanese)
-  R. S. Fearing, “Survey of Sticking Effects for Micro Parts Handling,” Proc. IEEE/RSJ Int. Conf., pp. 212-217, 1995.
-  S. Saito, H. Himeno, and K. Takahashi, “Electrostatic detachment of an adhering particle from a micromanipulated probe,” J. Appl. Phys., Vol.93, pp. 2219-2224, 2003.
-  S. Maruo, “Optically-Driven Micro/Nano Machines Produced by Two-Photon Microstereolithography,” The Physical Society Japan, Vol.60, No.3, pp. 180-186, 2005. (in Japanese)
-  H. Ban Brussel et al., “Assemly of Microsystems,” Kenote papers of Annuals of the CIRP, Vol.49, No.2, pp. 451-471, 2000.
-  S. Fatikow, “Microrobot-Based Assembly of Microsystems,” NEXUS Research News, 1, pp. 12-14, 1998.
-  O. Fuchiwaki, D. Misaki, C. Kanamori, and H. Aoyama, “Development of the Orthogonal Micro Robot for Accurate Microscopic Operations,” J. of Micro-Nano Mechatronics (JMNM), Vol.4, No.1-2, pp. 85-93, Nov. 2008.
-  K. Sato, K. Lee, M. Nishimura, and K. Okutsu, “Self-alignment and bounding of microparts using liquid surface tension,” ICPT 2006, pp. 39-43, 2006.
-  F. Arai, “Nano-Micromanipulation,” Vol.46, No.5, pp. 244-251, 2002. (in Japanese)
-  Y. Harada, N. Nazir, Y. Shiote, and T. Ito, “Human-machine Collaboration System for Fine Assembly Process,” SICE-ICASE Int. Joint Conf., pp. 5355-5360, Bexco, Busan, Korea, Oct. 18-21, 2006.
-  K. Ohba, “Micro 3D Camera,” Vol.85, No.6, pp. 438-429, 2002. (in Japanese)
-  NAIST OpenCV programing team, “OpenCV Progrming book Vol.2,” Mainichi Communications, 2009. (in Japanese)