Local Representation Neural Networks for Feature Selection

Abstract

Pruning methods for feature selection in neural networks start out from the idea that the representation of the data must evolve from a distributed representation of the information to a more localised representation which will represent the skeleton of the network, needing long training times imposed by the back propagation algorithm. Even the quasi-Newton algorithm spent a long computation time. We propose a three-layer network based on local representation with a step-threshold function and an algorithm called Direct Method for Structural Learning, both allow a very fast pruning of superfluous attributes.