1 / 12

Machine Learning

Machine Learning. A Quick look. Sources: Artificial Intelligence – Russell & Norvig Artifical Intelligence - Luger. By: H é ctor Muñoz-Avila. same. Environment. Environment. System. Action 1. Action 2. Knowledge. Knowledge. changed. What Is Machine Learning?.

MikeCarlo
Download Presentation

Machine Learning

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Machine Learning A Quick look • Sources: • Artificial Intelligence – Russell & Norvig • Artifical Intelligence - Luger By: Héctor Muñoz-Avila

  2. same Environment Environment System Action1 Action2 Knowledge Knowledge changed What Is Machine Learning? “Logic is not the end of wisdom, it is just the beginning” --- Spock time System

  3. Classification(According to the language representation) • Symbolic • Version Space • Decision Trees • Explanation-Based Learning • … • Sub-symbolic • Connectionist • Evolutionary

  4. Two extremes (temptative) solutions: too general obj(X,Y,Z) … obj(X,Y,ball) concept space obj(large,Y,ball) obj(small,Y,ball) • obj(large,white,ball) obj(small,blue,ball) … too specific Version Space Idea: Learn a concept from a group of instances, some positive and some negative • Example: • target: obj(Size,Color,Shape) • Size = {large, small} • Color = {red, white, blue} • Shape = {ball, brick, cube} • Instances: • +: • obj(large,white,ball) • obj(small,blue,ball) • −: • obj(small,red,brick) • obj(large,blue,cube)

  5. How Version Space Works If we consider positive and negatives If we consider only positives + + + + + + + + + + + + + − + − − − + + What is the role of the negative instances? to help prevent over-generalizations

  6. Explanation-Based learning C A B C A B C B A B A C ? B A ? C B ? A B C C B A B A C A C A A B C B C C B A A B C Can we avoid making this error again?

  7. Possible rule: If the initial state is this and the final state is this, don’t do that Explanation-Based learning (2) C A B ? B A ? C ? A B C C B A B A C More sensible rule: don’t stack anything above a block, if the block has to be free in the final state

  8. Step 1: start with a population (each member is a candidate solution) … Step 2: Create the next generation by considering evolutionary operations on the population from the previous generation (e.g., mutation) and a fitness function (only the more fit get to contribute to the next generation) … Evolutionary Approaches Idea: Biological analogy on how populations of species evolve over generations Continue the process until a certain condition is reached

  9. Crossover Mutation Inversion exchange Non-selected members are not necessarily eliminated The Genetic Algorithm t  0 Initialize the population P(t) While the termination condition is not met do { evaluate fitness of each member of P(t) select members of P(t) based on fitness produce the offspring of pairs of selected members using genetic operators replace, based on fitness, candidates of P(t) based on this offspring t  t + 1 }

  10. Example: CNF-satisfaction A conjunctive normal form (CNF) is a Boolean expression consisting of one or more disjunctive formulas connected by an AND symbol (). A disjunctive formula is a collection of one or more (positive and negative) literals connected by an OR symbol (). Example: (a)  (¬ a  ¬b  c  d)  (¬c  ¬d)  (¬d) Problem (CNF-satisfaction): Give an algorithm that receives as input a CNF form and returns Boolean assignments for each literal in form such that form is true Example (above): a  true, b  false, c  true, d  false

  11. 1 2 CNF as a Genetic Algorithm • A potential solution is a true/false assignment to the 4 variables a, b, c, and d in the formula: 1010 means that a and c are true and b and d are false • In particular, a solution for (a)  (¬ a  ¬b  c  d)  (¬c  ¬d)  (¬d) is 1001 • Nice: all 4 genetic operations applied on any potential solutions will result in a potential solutions (in other problems or other representations of this problem this may not be the case) • Fitness: for 0101 and 1001: which is a more suitable solution? • Fitness value? 1001 # of disjunctions in the formula that are made true

  12. Select top 30% Select among the 4 operations randomly Top N candidates The Genetic Algorithm for CNF N randomly generated strings of 4 integers t  0 Initialize the population P(t) While the termination condition is not met do { evaluate fitness of each member of P(t) select members of P(t) based on fitness produce the offspring of pairs of selected members using genetic operators replace, based on fitness, candidates of P(t) based on this offspring t  t + 1 } Solution has not been found # of disjunctions in the formula that are made true

More Related