Real-time neuroevolution in the NERO video game

Publication Type  Journal Article
Year of Publication  2005
Authors  Stanley, K. O.; Bryant, B. D.; Miikkulainen, R.
Journal Title  IEEE Transactions on Evolutionary Computation
Volume  9
Pagination  653-668
ISBN Number  1089-778X
Accession Number  ISI:000233972800010
Key Words  interactive; online; neural networks; neuroevolution; augmenting topologies (NEAT); neuroevolving robotic operatives (NERO); real-time; video games; artificial neural-networks; evolution; topologies; algorithm; genes
Abstract  

In most modern video games, character behavior is scripted; no matter how many times the player exploits a weakness, that weakness is never repaired. Yet, if game characters could learn through interacting with the player, behavior could improve as the game is played, keeping it interesting. This paper introduces the real-time Neuroevolution of Augmenting Topologies (rtNEAT) method for evolving increasingly complex artificial neural networks in real time, as a game is being played. The rtNEAT method allows agents to change and improve during the game. In fact, rtNEAT makes possible an entirely new genre of video games in which the player trains a team of agents through a series of customized exercises. To demonstrate this concept, the Neuroevolving Robotic Operatives (NERO) game was built based on rtNEAT. In NERO, the player trains a team of virtual robots for combat against other players' teams. This paper describes results from this novel application of machine learning, and demonstrates that rtNEAT makes possible video games like NERO where agents evolve and adapt in real time. In the future, rtNEAT may allow new kinds of educational and training applications through interactive and adapting games.

URL  http://www.cse.unr.edu/~bdbryant/papers/stanley.ieeetec05.pdf

0

Free Registration

Registered users have the added benefit of being able to:

  • Search/filter the bibliography to find just the article you are looking for. You can search the computer games research bibliography by author, year, keyword, title or publication type.
  • Export references from the video games bibliography to a format suitable for your own work. Options currently include tagged and XML for Endnote users and BibTex for the rest of the world.
  • Post comments to discuss the paper or alert fellow researchers to other resources.
  • Add their own references using the 'create content' -> 'biblio' option in the block on the left.
  • NEW: Use the Biblio Search box located on the right hand of the page.
  • NEW: Browse by journal title, book title, author or keyword using the new Faceted Search tool.