Computational Intelligence in Games: An Overview

1. Computational Intelligence in Games: An Overview Zahid Halim Faculty of Computer Science and Engineering Ghulam Ishaq Khan Institute of Engineering Sciences and Technology, Topi. zahid.halim@giki.edu.pk

2. Layout What is AI/CI and ML Why Computer Games? How CI helps computer Games? Some Examples Key venues to publish work Future directions Computational Intelligence in Games: An Overview

3. AI vs. CI vs. ML • Artificial Intelligence (Think like human, learn from experience, recognize patterns, make complex decisions based on knowledge and reasoning) • Machine learning • Knowledge representation • Natural Language Processing • Planning Robotics etc. • Machine learning • Branch of AI • Construction and study of systems that can learn from data • Email messages to learn to distinguish between spam and non-spam messages • There is difference between ML and Data Mining too  • Computational Intelligence(www.ieee-cis.org) • Integrating the fields • Artificial Neural Networks • Evolutionary Computation • Fuzzy Logic Computational Intelligence in Games: An Overview

4. They are related… But they are all different… I hope all of us understand difference between hard and soft computing Computational Intelligence in Games: An Overview

5. Why Computer Games? 30 years The average game player age is: 49% of U.S. households own a dedicated game console Computational Intelligence in Games: An Overview

6. Why Computer Games? • 42% of game players believe that computer and video games give them the most value for their money, compared with DVDs, music or going out to the movies • Gamers who are playing more video games than they did three years ago are spending less time: • 59% playing board games • 50% going to the movies • 47% watching TV • 47% watching movies at home • 62% of gamers play games with others, either in-person or online • 78% of gamers who play with others do so at least one hour per week Computational Intelligence in Games: An Overview

7. But its not every thing! Money Matters! Total: $24.75 Billion Computational Intelligence in Games: An Overview

8. What can Computational Intelligence do? Generate complete game Creation of intelligent game characters Creation of entertaining game characters Generating tracks for racing games. Adaptable player experience. Levels for action games. Generating maps for games. Computational Intelligence in Games: An Overview

9. Procedural Content Generation • Lindenmayer system: A variant of a formal grammar, most famously used to model the growth processes of plant. • Consists of: • An alphabet of symbols that can be used to make strings • A collection of production rules which expand each symbol into some larger string of symbols • An initial "axiom" string from which to begin construction • A mechanism for translating the generated strings into geometric structures. • PCG can also generate weapons that player might require in a game • Search based PCG is different Computational Intelligence in Games: An Overview

10. Some of the PCG based Games Computational Intelligence in Games: An Overview

11. Automated Game “entertaining” Generation Computational Intelligence in Games: An Overview

12. Objective Function • 1+1 Evolutionary Strategy (ES) • 10 chromosomes are randomly initialized • The evolutionary algorithm is run for 100 iterations • Mutation only with probability of 30 percent • One parent produce one child • Fitness difference is calculated • If it is greater than 4 (at least half times better) child is promoted to the next population Computational Intelligence in Games: An Overview

13. Making Racing Fun Through Player Modelling and Track Evolution • We have one or several car racing tracks with • Walls, Waypoints, Staring position of the car • Car consist of • Sensor model to sense the environment • Discrete set of control commands • Objective of the game is to pass as many waypoints in given timesteps. • Car has 6 sensors, Speed of the car and Angle to the next waypoint • Fully connected feedforward nets (MLPs) with the tanh transfer function. • Only the weights of the networks are changed by evolution or back propagation • Nine inputs (sensors and a bias input), Six hidden neurons • Two output neurons are used. • The First output is interpreted as driving command • Second as steering command. Computational Intelligence in Games: An Overview

14. Learning Behaviour: Backpropagation • Human player drove a number of laps around a track, while the inputs from sensors and actions taken by the human were logged at each timestep. • This log was then used to train a neural network controller to associate sensor inputs with actions using a standard backpropagation algorithm. • Several variations on this idea were tried with very little success. • Training often achieved low error rates (typically 0.05), none of the trained networks managed to complete even half a lap. • A small amount of noise that is applied to sensors guarantees that the car does not simply replay the human action. Computational Intelligence in Games: An Overview

15. Evolving Neural Network Agents in the NERO Video Game • real-time NeuroEvolution of Augmenting Topologies (rt-NEAT) method for evolving increasingly complex artificial neural networks in real time, as a game is being played. • rtNEAT makes possible a new genre of video games in which the player teaches a team of agents through a series of customized training exercises. • In NEAT, the population is replaced at each generation. • Everyone’s behaviour would change at once. • Behaviours would remain static during the large gaps between generations • In rtNEAT, a single individual is replaced very few game ticks Computational Intelligence in Games: An Overview

16. Conferences and Journals IEEE Computational Intelligence and Games IEEE Transactions on Computational Intelligence and AI in Games (IF 1.8) International Journal of Computer Games Technology International Conference on Computer Games (CGAMES) CGamesUSA International Conference on Computer Games Computational Intelligence in Games: An Overview

17. Where are the opportunities? CIG for health care CIG for education Neuro Computer interface for games Physicological study via games Computational Intelligence in Games: An Overview

18. Thanks for your patience Presentation available at: http://ming.org.pk/zahid.htm

19. Bibliography Halim, Zahid, A. Rauf Baig, and HasanMujtaba. "Measuring entertainment and automatic generation of entertaining games." International Journal of Information Technology, Communications and Convergence 1.1 (2010): 92-107. Halim, Zahid, A. Rauf Baig, and MujtabaHasan. "Evolutionary Search For Entertainment In Computer Games." Intelligent Automation & Soft Computing 18.1 (2012): 33-47. Halim, Zahid, and A. RaifBaig. "Evolutionary Algorithms towards Generating Entertaining Games." Next Generation Data Technologies for Collective Computational Intelligence. Springer Berlin Heidelberg, 2011. 383-413. http://tim.hibal.org/blog/wp-content/uploads/2010/01/speciesChange.png http://www.sennir.co.uk/Journal/178 ESA 2012 Sales, Demographic and Usage Data Evolving Neural Network Agents in the NERO Video Game, Stanley et. al Acquiring Visibly Intelligent Behavior with Example-Guided Neuroevolution, Bryant et. al. Making Racing Fun Through Player Modeling, Togelius et. al. Evolutionary Search for Entertainment in Games, Halim et. al. Computational Intelligence in Games: An Overview