1 / 19

COMPE 467 - Pattern Recognition

Nearest and k-nearest Neighbor Classification. COMPE 467 - Pattern Recognition. 1-NN Rule: Given an u n known sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.

cruz
Download Presentation

COMPE 467 - Pattern Recognition

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Nearest and k-nearest Neighbor Classification COMPE 467 - Pattern Recognition

  2. 1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.

  3. k-NN rule: instead of looking at the closest sample, we look at k nearest neighbors to X and we take a vote. The largest vote wins. k is usually taken as an odd number so that no ties occur.

  4. Distance Measures(Metrices) Non-negativity Reflexivity when only x=y Symmetry Triangle inequality Euclidian distance satisfies. Not always a meaningful measure. Consider 2 features with different units scaling problem. Scale of changed to half.

  5. Minkowski Metric A general definition norm – City block (Manhattan) distance norm – Euclidian Scaling: Normalize the data by re-scaling (Reduce the range to 0-1) (equivalent to changing the metric) Y b X a

  6. References • R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, New York: John Wiley, 2001. • N. Yalabık, “Pattern Classification with Biomedical Applications Course Material”, 2010.

More Related