Separability Conditions for Multilayer Nets Having Solutions and Convergent Superiority of Bipolar Nets
Hiroshi Shiratsuchi*, Hiromu Gotanda**, Katsuhiro Inoue***, and Kousuke Kumamaru***
*Faculty of Engineering, University of the Ryukyus, Nishihara, Okinawa 903-0213, Japan
**Kinki University School of Humanity-Oriented Science and Engineering
***Faculty of Computer Science and Systems Engineering, Kyushu Institute of Technology
Separability conditions are formulated for multilayer nets to have solutions by a set of normal vectors orthogonal to separation hyperplanes. Comparing separability conditions to distributions of normal vectors with weights and biases initialized ordinarily by random numbers with a zero mean, we found that bipolar nets are superior to unipolar nets in convergence of the back propagation learning initialized in such an ordinary manner.