Our brain is constructed of modules, which share brain functions and work through stimulus from outside by cooperating and competing with each other. By analogizing the brain system, construction methods of artificial multi-module networks have been proposed. The authors have proposed a 2-layer associative memory network consisting of a pattern layer and a symbol layer. This paper presents a construction method for a multimodule network using the 2-layer models. We examine the association of facial patterns by the network.