Development of Ghost Controller for Ms Pac-Man Versus Ghost Team with Grammatical Evolution
Kenji Tamura* and Takashi Torii**
*Chuo Gakuin University, 451 Kujike, Abiko, Chiba 270-1196, Japan
**Sugiyama Jogakuen University, 17-3 Hoshigaoka-Motomachi, Chikusa-ku, Nagoya 464-8662, Japan
These days, artificial intelligence (AI) has been used in game AI. Additionally, video game AI is studied actively in late years, for example, application of commercial game or competition etc. In many video games of recent years, real-time action and non-player characters have been required to attract players. This paper describes how to develop a ghost team controller using evolutionary system to play the video game, Ms Pac-Man. Ms Pac-Man has been used as a testbed of AI, especially multi-agent system. We propose a method to generate the ghost team controller with Grammatical Evolution. In case of developingMs Pacman agent with Evolutionary Computation using fitness function, the criterion of the fitness is used its obtained high score in many cases. In contrast, ghost team has to prevent Ms Pac-man to get high score, namely hold score in check. However, if Ms Pacman is captured in low score by accident, its ghost strategy have a possibility to survive next generation, and if the ghosts pursue Ms Pac-man in a line, agent isn’t captured for all time. Therefore developing ghost team agent is required to avoid these issues, and we introduced a penalty to the fitness, grammar like instinct and to attack Ms Pac-Man on both sides. This paper introduces experimental data about the ghost team controller for Ms Pac-Man versus ghost team, we used ghost team agents and tested them Ms Pac-Man agents. The experimental results showed that proposed system could catchMs Pac-Man agent compare with simple hand-coded ghost teams, and the evolved controller we made worked effectively. These results are concluded that proposed method works effectively for generating ghost controller.
-  S. Russell and P. Norvig, “Artificial Intelligence: A Modern Approach,” Pearson, 2010.
-  S. Lucas and G. Kendall, “Evolutionary Computation and Games,” IEEE Computational Intelligence Magazine (Feb. 2006), pp. 10-18, 2006.
-  S. Lucas, “Games Technical Committee,” IEEE Computational Intelligence Magazine (May 2007), pp. 74-76, 2007.
-  R. Lopes and R. Bidarra, “Adaptivity Challenges in Games and Simulations: A Survey,” IEEE Trans. On Computational Intelligence and AI in Games, Vol.3, No.2, pp. 85-99, 2011.
-  J. Togelius and J. Schmidhuber, “An Experiment in Automatic Game Design,” 2008 IEEE Conf. on Computational Intelligence and Games (CIG’08), pp. 111-118, 2008.
-  Y. Lee and S. Cho, “Context-Aware Petri Net for Dynamic Procedural Content Generation in Role-Playing Game,” IEEE Computational Intelligence Magazine (May 2011), pp. 16-25, 2011.
-  D. Ashlock, C. Lee, and C. McGuinness, “Simultaneous Dual Level Creation for Games,” IEEE Computational Intelligence Magazine (May 2011), pp. 26-37, 2011.
-  IEEE Conf. on Computational Intelligence and Games,
-  Ms. Pac-Man Competition,
-  Ms. Pacman Versus Ghost-Team Competition,
-  X. Yu and M. Gen, “Introduction to Evolutionary Algorithms,” Springer, 2010.
-  I. Dempsey, M. O’Neill, and A. Brabazon, “Foundations in Grammatical Evolution for Dynamic Environments,” Springer, 2009.
-  M. O’Neill and C. Ryan, “Grammatical Evolution,” Kluwer Academic Publishers, 2003.
-  M. O’Neill, E. Hemberg, C. Gilligan, E. Bartley, J. McDermott, and A. Brabazon, “GEVA: Grammatical Evolution in Java (v 2.0),” Tech. Rep., UCD School of Computer Science (2011),
-  I. Szita and A. Lo rincz, “Learning to Play Using Low-Complexity Rule-Based Policies: Illustrations through Ms. Pac-Man,” J. of Artificial Intelligence Research Vol.30, No.1, pp. 659-684, 2007.
-  D. Robles and S. Lucas, “A Simple Tree Search Method for Playing Ms. Pac-Man,” 2009 IEEE Symp. on Computational Intelligence and Games, pp. 249-255, 2009.
-  N. Bell, X. Fang, R. Hughes, G. Kendall, E. O’Reilly, and S. Qi, “Ghost Direction Detection and other Innovations for Ms. Pac-Man,” 2010 IEEE Conf. on Computational Intelligence and Games (CIG’10), pp. 465-472, 2010.
-  S. Lucas, “Evolving a Neural Network Location Evaluator to Play Ms. Pac-Man,” IEEE Symp. on Computational Intelligence and Games, pp. 203-210, 2005.
-  J. R. Koza, “Genetic Programming: On the Programming of Computers by Means of Natural Selection,” The MIT Press, Cambridge, 1992.
-  M. Gallagher, “Learning to Play Pac-Man-An: Evolutionary, Rulebased Approach,” The 2003 Congress on Evolutionary Computation (CEC2003), pp. 2462-2469, IEEE, Los Alamitos, 2003.
-  E. Galvan-Lopez, J. M. Swafford, M. O’Neill, and A. Brabazon, “Evolving a Ms. PacMan Controller Using Grammatical Evolution,” EvoApplications 2010, Part I, LNCS 6024, pp. 161-170, Springer-Verlag Berlin Heidelberg, 2010.
-  D. J. Gagne and C. B. Congdon, “FRIGHT: A Flexible Rule-Based Intelligent Ghost Team for Ms. Pac-Man,” Proc. of Computational Intelligence and Games (CIG2012), pp. 273-280, 2012.