Paper:
Views over last 60 days: 368
Translated Multiplicative Neuron: An Extended Multiplicative Neuron that can Translate Decision Surfaces
Eduardo Masato Iyoda, Hajime Nobuhara, and Kaoru Hirota
Department of Computational Intelligence and Systems Science, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology
G3-49, 4259 Nagatsuta, Midori-ku, Yokohama 226-8502, Japan
Received:August 31, 2003Accepted:April 20, 2004Published:September 20, 2004
Keywords:neural networks, multiplicative neurons, XOR problem, N-bit parity problem, nonlinear regression
Abstract
A multiplicative neuron model called translated multiplicative neuron (πt-neuron) is proposed. Compared to the traditional π-neuron, the πt-neuron presents 2 advantages: (1) it can generate decision surfaces centered at any point of its input space; and (2) πt-neuron has a meaningful set of adjustable parameters. Learning rules for πt-neurons are derived using the error backpropagation procedure. It is shown that the XOR and N-bit parity problems can be perfectly solved using only 1 πt-neuron, with no need for hidden neurons. The πt-neuron is also evaluated in Hwang's regression benchmark problems, in which neural networks composed of πt-neurons in the hidden layer can perform better than conventional multilayer perceptrons (MLP) in almost all cases: Errors are reduced an average of 58% using about 33% fewer hidden neurons than MLP.
Cite this article as:E. Iyoda, H. Nobuhara, and K. Hirota, “Translated Multiplicative Neuron: An Extended Multiplicative Neuron that can Translate Decision Surfaces,” J. Adv. Comput. Intell. Intell. Inform., Vol.8 No.5, pp. 460-468, 2004.Data files:
