single-jc.php

JACIII Vol.6 No.3 pp. 126-134
doi: 10.20965/jaciii.2002.p0126
(2002)

Paper:

Sigma-Pi Cascade Extended Hybrid Neural Network

Eduardo Masato Iyoda*, Kaoru Hirota* and Fernando J. Von Zuben**

*Department of Computational Intelligence and Systems Science Interdisciplinary Graduate School of Science and Engineering Tokyo Institute of Technology, 4259 Nagatsuta, Midori-ku, Yokohama, 226-8502 Japan

**Department of Computer Engineering and Industrial Automation School of Electrical and Computer Engineering, State University of Campinas, P.O. Box 6101, Campinas-SP, 13083-970 Brazil

Received:
October 4, 2002
Accepted:
October 18, 2002
Published:
October 20, 2002
Keywords:
artificial neural networks, nonparametric learning, function approximation, genetic algorithm
Abstract

A nonparametric neural architecture called the Sigma-Pi Cascade extended Hybrid Neural Network σπ-(CHNN) is proposed to extend approximation capabilities in neural architectures such as Projection Pursuit Learning (PPL) and Hybrid Neural Networks (HNN). Like PPL and HNN, σπ-CHNN also uses distinct activation functions in its neurons but, unlike these previous neural architectures, it may consider multiplicative operators in its hidden neurons, enabling it to extract higher-order information from given data. σπ-CHNN uses arbitrary connectivity patterns among neurons. An evolutionary learning algorithm combined with a conjugate gradient algorithm is proposed to automatically design the topology and weights of σπ-CHNN. σπ-CHNN performance is evaluated in five benchmark regression problems. Results show that σπ-CHNN provides competitive performance compared to PPL and HNN in most problems, either in computational requirements to implement the proposed neural architecture or in approximation accuracy. In some problems, σπ-CHNN reduces the approximation error on the order of 10-1 compared to PPL and HNN, whereas in other cases it achieves the same approximation error as these neural architectures but uses a smaller number of hidden neurons (usually 1 hidden neuron less than PPL and HNN).

Cite this article as:
E. Iyoda, K. Hirota, and F. Zuben, “Sigma-Pi Cascade Extended Hybrid Neural Network,” J. Adv. Comput. Intell. Intell. Inform., Vol.6, No.3, pp. 126-134, 2002.
Data files:

*This site is desgined based on HTML5 and CSS3 for modern browsers, e.g. Chrome, Firefox, Safari, Edge, Opera.

Last updated on Dec. 02, 2020