an introduction to evolutionary game theory l.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
An Introduction to... Evolutionary Game Theory PowerPoint Presentation
Download Presentation
An Introduction to... Evolutionary Game Theory

Loading in 2 Seconds...

play fullscreen
1 / 45

An Introduction to... Evolutionary Game Theory - PowerPoint PPT Presentation


  • 153 Views
  • Uploaded on

An Introduction to... Evolutionary Game Theory. By Jin Xiao, Jeff Thomas, Jeff Westwell. How would game theory view this?. What will we discuss?. Brief History of Game Theory Payoff Matrix Types of Games Basic Strategies Evolutionary Concepts Limitations and Problems.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

An Introduction to... Evolutionary Game Theory


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
    Presentation Transcript
    1. An Introduction to... Evolutionary Game Theory By Jin Xiao,Jeff Thomas,Jeff Westwell

    2. How would game theory view this?

    3. What will we discuss? • Brief History of Game Theory • Payoff Matrix • Types of Games • Basic Strategies • Evolutionary Concepts • Limitations and Problems

    4. Brief History of Game Theory • 1913 - E. Zermelo provided thefirst theorem of game theory asserts that chess is strictly determined • 1928 - John von Neumann proved theminimax theorem • 1944 - John von Neumann / Oskar Morgenstern’s wrote "Theory of Games and Economic Behavior” • 1950-1953, John Nash describesNash equilibrium • 1972 - John Maynard Smith wrote “Game Theory and TheEvolution of Fighting”

    5. Rationality Assumptions: • humans are rational beings • humans always seek the best alternative in a set of possible choices Why assume rationality? • narrow down the range of possibilities • predictability

    6. Utility Theory Utility Theory based on: • rationality • maximization of utility It is a quantification of a person's preferences with respect to certain objects.

    7. What is Game Theory? Game theory is a study of how to mathematically determine the best strategy for given conditions in order to optimize the outcome

    8. Game Theory • Finding acceptable, if not optimal, strategies in conflict situations. • Abstraction of real complex situation • Game theory is highly mathematical • Game theory assumes all human interactions can be understood and navigated by presumptions.

    9. Why is game theory important? • All intelligent beings make decisions all the time. • AI needs to perform these tasks as a result. • Helps us to analyze situations more rationally and formulate an acceptable alternative with respect to circumstance.

    10. Player #2 Moriarty Strategy #1 Strategy #2 Canterbury Dover Player #1 0 50 Strategy #1 Canterbury Payoff (1,1) Payoff (1,2) Holmes 0 100 Dover Strategy #2 Payoff (2,1) Payoff (2,2) The Payoff Matrix

    11. Types of Games • Sequential vs. Simultaneous moves • Single Play vs. Iterated • Zero vs. non-zero sum • Perfect vs. Imperfect information • Cooperative vs. conflict

    12. Zero-Sum Games • The sum of the payoffs remains constant during the course of the game. • Two sides in conflict • Being well informed always helps a player

    13. Non-zero Sum Game • The sum of payoffs is not constant during the course of game play. • Players may co-operate or compete • Being well informed may harm a player.

    14. Games of Perfect Information • The information concerning an opponent’s move is well known in advance. • All sequential move games are of this type.

    15. Imperfect Information • Partial or no information concerning the opponent is given in advance to the player’s decision. • Imperfect information may be diminished over time if the same game with the same opponent is to be repeated.

    16. Key Area of Interest • chance • strategy Imperfect Information Non-zero Sum

    17. Prisoner’s Dilemma

    18. Prisoner’s Dilemma Prisoner 2 Blame Don't Blame 10 , 10 0 , 20 Prisoner 1 Don't 20 , 0 1 , 1

    19. Games of Conflict • Two sides competing against each other • Usually caused by complete lack of information about the opponent or the game • Characteristic of zero-sum games

    20. Games of Co-operation Players may improve payoff through • communicating • forming binding coalitions & agreements • do not apply to zero-sum games Prisoner’s Dilemma with Cooperation

    21. Prisoner’s Dilemma with Iteration • Infinite number of iterations • Fear of retaliation • Fixed number of iteration • Domino effect

    22. Basic Strategies 1. Plan ahead and look back 2. Use a dominating strategy if possible 3. Eliminate any dominated strategies 4. Look for any equilibrium 5. Mix up the strategies

    23. Plan ahead and look back Opponent Strategy 1 Strategy 2 Strategy 1 150 1000 You Strategy 2 25 - 10

    24. Use strategy 1 If you have a Dominating strategy, use it Opponent Strategy 1 Strategy 2 Strategy 1 150 1000 You Strategy 2 25 - 10

    25. Eliminate strategy 2 as it’s dominated by strategy 1 Eliminate any Dominated strategy Opponent Strategy 1 Strategy 2 Strategy 1 150 1000 You Strategy 2 25 - 10 Strategy 3 160 -15

    26. Look for any equilibrium • Dominating Equilibrium • Minimax Equilibrium • Nash Equilibrium

    27. Maximin & Minimax Equilibrium • Minimax - to minimize the maximum loss (defensive) • Maximin - to maximize the minimum gain (offensive) • Minimax = Maximin

    28. Maximin & Minimax Equilibrium Strategies Opponent Strategy 1 Strategy 2 Min 150 Strategy 1 150 1000 You Strategy 2 25 - 10 - 10 Strategy 3 160 -15 -15 Max 160 1000

    29. Definition: Nash Equilibrium “If there is a set of strategies with the property that no player can benefit by changing her strategy while the other players keep their strategies unchanged, then that set of strategies and the corresponding payoffs constitute the Nash Equilibrium. “ Source: http://www.lebow.drexel.edu/economics/mccain/game/game.html

    30. Is this a Nash Equilibrium? Opponent Strategy 1 Strategy 2 Min 150 Strategy 1 150 1000 You Strategy 2 25 - 10 - 10 Strategy 3 160 -15 -15 Max 160 1000

    31. Boxed Pigs Example Cost to press button = 2 units When button is pressed, food given = 10 units

    32. Decisions, decisions... Little Pig Press Wait Press 5 , 1 4 , 4 Big Pig Wait 9 , -1 0 , 0

    33. Mixed Strategy Safe 1 Safe 2 $10,000 Safe 1 $ 0 $100,000 $ 0 Safe 2

    34. Mixed Strategy Solution

    35. Evolutionary Game Theory • Natural selection replaces rational behavior • Survival of the fittest • Why use evolution to determine a strategy?

    36. Hawk / Dove Game

    37. Evolutionary Stable Strategy • Introduced by Maynard Smith and Price (1973) • Strategy becomes stable throughout the population • Mutations becoming ineffective

    38. 2 2 10 0 0 10 -5 -5 Hawk Dove Dove Hawk

    39. 2 2 10 0 0 10 -5 -5 Hawk Dove Dove Hawk

    40. Where is game theory currently used? • Ecology • Networks • Economics

    41. Limitations & Problems • Assumes players always maximize their outcomes • Some outcomes are difficult to provide a utility for • Not all of the payoffs can be quantified • Not applicable to all problems

    42. Indiana Jones Scenario Incorrect Grail Correct Grail Indiana tests water before giving it to Father 1 -2 -1 Indiana Doesn't Test Water 1

    43. Summary • What is game theory? • Abstraction modeling multi-person interactions • How is game theory applied? • Payoff matrix contains each person’s utilities for various strategies • Who uses game theory? • Economists, Ecologists, Network people,... • How is this related to AI? • Provides a method to simulate a thinkingagent