Paper:
Language: English:

Results of Bias-variance Tests on Multi-layer Perceptron Neural Networks

Wimpie D. Nortje^, Johann E. W. Holm^, Gerhard P. Hancke^, Imre. J. Rudas^, and Laszlo. Horvath^*

,,Department of Electrical, Electronic and Computer Engineering University of Pretoria Pretoria South Africa
,*Budapest Polytechnic, Budapest, Npsznhz u. 8, Budapest, H-1081 Hungary

Received: April 1, 2001

Accepted: June 1, 2001

Keywords: multi-layer perceptron, neural network, biasvariance test, multiple network, Bayesian network

Journal ref: Journal of Advanced Computational Intelligence and Intelligent Informatics, Vol.5, No.5 pp. 300-305, 2001

Abstract

Training neural networks involves selection of a set of network parameters, or weights, on account of fitting a non-linear model to data. Due to the bias in the training data and small computational errors, the neural networks\' opinions are biased. Some improvement is possible when multiple networks are used to do the classification. This approach is similar to taking the average of a number of biased opinions in order to remove some of the bias that resulted from training. Bayesian networks are effective in removing some of the bias associated with training, but Bayesian techniques are tedious in terms of computational time. It is for this reason that alternatives to Bayesian networks are investigated.

[Notice]
* "Preview" is the first 2 pages of the article. You don't need the registration.
* To read the PDF file you will then need to download and install the Adobe Reader.
Adobe Reader is free and available for download here: