Emergence of Learning Rule in Neural Networks Using Genetic Programming Combined with Decision Trees
Noboru Matsumoto, Kenneth J. Mackin and Eiichiro Tazaki
Department of Control & Systems Engineering, Toin University of Yokohama 1614 Kurogane-cho, Aoba-ku, Yokohama 225-8502, Japan
Received:October 11, 1998Accepted:January 10, 1999Published:August 20, 1999
Keywords:Neural network, Genetic programming, Decision tree, Emergent system, Hybrid learning
Genetic Programming (GP) combined with Decision Trees is used to evolve the structure and weights for Artificial Neural Networks (ANN). The learning rule of the decision tree is defined as a function of global information using a divide-and-conquer strategy. Learning rules with lower fitness values are replaced by new ones generated by GP techniques. The reciprocal connection between decision tree and GP emerges from the coordination of learning rules. Since there is no constraint on initial network, a more suitable network is found for a given task. Fitness values are improved using a Hybrid GP technique combining GP and Back Propagation. The proposed method is applied to medical diagnosis and results demonstrate that effective learning rules evolve.
Cite this article as:N. Matsumoto, K. Mackin, and E. Tazaki, “Emergence of Learning Rule in Neural Networks Using Genetic Programming Combined with Decision Trees,” J. Adv. Comput. Intell. Intell. Inform., Vol.3 No.4, pp. 223-233, 1999.Data files: