JRM Vol.12 No.6 pp. 656-663
doi: 10.20965/jrm.2000.p0656


Building up Embodiment in Learning Agents Using A Gaussian Radial Basis Function Neural Network

Hajime Murao and Shinzo Kitamura

Department of Computer and Systems Engineering, Faculty of Engineering, Kobe University, 1-1 Rokkodai, Nada, Kobe 657-8501, Japan

October 24, 2000
December 8, 2000
December 20, 2000
Actor-Critic learning, Reinforcement learning, State space construction, Embodiment, Mobile robot

In this paper, we propose actor-critic learning with adaptive state space construction. The gaussian radial basis function neural network is employed for both the actor and the critic modules, where each hidden neuron covers a subspace of the sensor space and so the hidden layer corresponds to the state space. In the proposed algorithm, a robot starts without any states and a new state is generated incrementally by adding a new hidden neuron. One clear advantage of the proposed algorithm to others is the performance improvement by the minimal training after adding a new state, i.e. the adjustment of the connective strength between the new neuron and others is only required after adding a new hidden neuron. This provides an efficient method to construct the state space during the learning in the real world. Resulting state space represents aspects of the environment in which the robot works and the characteristic of the robot itself. In this sense, the obtained state space is said to represent the embodiment of the robot.

Cite this article as:
Hajime Murao and Shinzo Kitamura, “Building up Embodiment in Learning Agents Using A Gaussian Radial Basis Function Neural Network,” J. Robot. Mechatron., Vol.12, No.6, pp. 656-663, 2000.
Data files:

*This site is desgined based on HTML5 and CSS3 for modern browsers, e.g. Chrome, Firefox, Safari, Edge, Opera.

Last updated on Mar. 05, 2021