JRM Vol.13 No.6 pp. 625-636
doi: 10.20965/jrm.2001.p0625


Self-Partitioning State Space for Behavior Acquisition of Vision-Based Mobile Robots

Takayuki Nakamura and Tsukasa Ogasawara

Nara Institute of Science and Technology, Graduate School of Information Sciences, Takayama-cho 8916-5, Ikoma, Nara 630-0101, Japan

October 10, 2000
December 7, 2001
December 20, 2001
self-partitioning algorithm, reinforcement learning, vision-based mobile robots, soccer robots
An input generalization problem is one of the most important in applying reinforcement learning to real robot tasks. To cope with this problem, we propose a self-partitioning state space algorithm, which can make nonuniform quantization of state space. To show that our algorithm has generalization capability, we apply our method to two tasks in which a soccer robot shoots a ball into a goal and prevent a ball from entering a goal. To show the validity of this method, the experimental results for computer simulation and a real robot are shown.
Cite this article as:
T. Nakamura and T. Ogasawara, “Self-Partitioning State Space for Behavior Acquisition of Vision-Based Mobile Robots,” J. Robot. Mechatron., Vol.13 No.6, pp. 625-636, 2001.
Data files:

*This site is desgined based on HTML5 and CSS3 for modern browsers, e.g. Chrome, Firefox, Safari, Edge, Opera.

Last updated on May. 19, 2024