single-rb.php

JRM Vol.9 No.5 pp. 398-405
doi: 10.20965/jrm.1997.p0398
(1997)

Paper:

Studies on Cardinality of Solutions for Multilayer Nets and a Scaling Method in Hardware Implementations

Hiromu Gotanda*, Hiroshi Shiratsuchi,* Katsuhiro Inoue** and Kousuke Kumamaru**

*Faculty of Engineering, Kinki University in Kyushu

**Faculty of Computer Science and Systems Engineering, Kyushu Institute of Technology

Received:
June 13, 1997
Accepted:
August 1, 1997
Published:
October 20, 1997
Keywords:
Multilayer net, Net polarity, Solution cardinality, Scaling method, BP learning
Abstract

This paper shows that multilayer nets of equal structure allow the same cardinality of admissible solutions for learning tasks whose input patterns are related by affine transform, even if their sigmoid functions are different in polarity and range. This result can be applied to a scaling problem arising in building nets in analog hardware. In input patterns and sigmoid functions multiplied by scaling factor k, separation and generalization can be preserved if weights are set to 1/k times the original while keeping bias values intact. With such initial weights and biases as above, the converging behavior of back propagation (BP) learning in the scaled environment becomes equivalent to that in the original environment, provided that learning coefficients are multiplied by 1/k2 for bias and by 1/k4 for weight updates. In BP learning in an ordinary way with both weights and biases initialized by uniform random numbers of identical distribution and with the learning coefficient adopted for both weight and bias update, it is shown by simulation that initial values resulting in good convergence decease with increasing k.

Cite this article as:
Hiromu Gotanda, Hiroshi Shiratsuchi, Katsuhiro Inoue, and Kousuke Kumamaru, “Studies on Cardinality of Solutions for Multilayer Nets and a Scaling Method in Hardware Implementations,” J. Robot. Mechatron., Vol.9, No.5, pp. 398-405, 1997.
Data files:

*This site is desgined based on HTML5 and CSS3 for modern browsers, e.g. Chrome, Firefox, Safari, Edge, Opera.

Last updated on Feb. 25, 2021