Paper:
Views over last 60 days: 632
Tool Operation Recognition Based on Robust Optical Flow and HMM from Short-Time Sequential Image Data
Hidetomo Sakaino*, Yutaka Yanagisawa**, and Tetsuji Satoh**
*NTT Communications Corp., 3-20-2 Nishishinjuku, Shinjuku-ku, Tokyo, Japan
**NTT Communication Science Labs., 2-4 Hikari-dai, Seika-cho, Soraku-gun, Kyoto, Japan
Received:August 23, 2003Accepted:December 1, 2003Published:March 20, 2004
Keywords:HMM, tool, occlusion, nonlinear robust, optical flow, output conversion diagram, short term data
Abstract
This paper discusses a method to precisely recognize which tool is to be used based on the optical flow and HMM from short-time sequential images that operate a variety of hand-operated carpenter tools in the real environment. Operation recognition from a single-eye camera includes problems on differences in the difficulty of fixing the shape of the tool and poor motion periodicity due to occlusion of the fingers, back of the hand, and arm of the operator. This paper models operation without separating the integrated motions of the hand and tool and recognizes it with four tools divided into different categories from these motions. The optical flow method via the nonlinear robust function is used to suppress possible error caused by discontinuous motion components, HMM with a flexible time axis is applied to implement learning and recognition. The average vector of the optical flow mapped into the conversion diagram was designed to output symbol numbers for the generation of symbol time series. The three subjects have been asked to operate given tools for conducting learning recognition experiments. The number of input and output symbol has been varied for comparison. This results in a maximum of 100% recognition on the average for learning and recognition by the same person and in a maximum of 88.6% for learning and recognition by different persons. This method has been proven robust and effective because an average of 79.4% or higher recognition rate has been obtained even for short data of input symbol 5 (equivalent to 0.2 seconds) difficult to recognize.
Cite this article as:H. Sakaino, Y. Yanagisawa, and T. Satoh, “Tool Operation Recognition Based on Robust Optical Flow and HMM from Short-Time Sequential Image Data,” J. Adv. Comput. Intell. Intell. Inform., Vol.8 No.2, pp. 156-167, 2004.Data files:
