1 / 29

Unsupervised Learning

Unsupervised Learning. A little knowledge…. Agminatics Aciniformics Q-analysis Botryology Systematics Taximetrics Clumping Morphometrics. Nosography Nosology Numerical taxonomy Typology Clustering. A few “synonyms”…. Exploratory Data Analysis.

amos-martin
Download Presentation

Unsupervised Learning

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Unsupervised Learning A little knowledge…

  2. Agminatics Aciniformics Q-analysis Botryology Systematics Taximetrics Clumping Morphometrics Nosography Nosology Numerical taxonomy Typology Clustering A few “synonyms”…

  3. Exploratory Data Analysis • Visualization methods with little or no numerical manipulation • Dimensionality Reduction • Multidimensional Scaling • Principal Components Analysis, Factor Analysis • Self-Organizing Maps • Cluster Analysis • Hierarchical • Agglomerative • Divisive • Non-hierarchical • Unsupervised: No GOLD STANDARD

  4. Outline • Proximity • Distance Metrics • Similarity Measures • Multidimensional Scaling • Clustering • Hierarchical Clustering • Agglomerative • Criterion Functions for Clustering • Graphical Representations

  5. Algorithms, similarity measures, and graphical representations • Most algorithms are not necessarily linked to a particular metric or similarity measure • Also not necessarily linked to a particular graphical representation • Be aware of the fact that old algorithms are being reused under new names!

  6. Common mistakes • Refer to dendrograms as meaning “hierarchical clustering” in general • Misinterpretation of tree-like graphical representations • Refer to self-organizing maps as clustering • Ill definition of clustering criterion • Declare a clustering algorithm as “best” • Expect classification model from clusters • Expect robust results with little/poor data

  7. Unsupervised Learning • Dimensionality Reduction • MDS • SOM Raw Data Graphical Representation Distance or Similarity Matrix • Clustering • Hierarchical • Non-hierar. • Validation • Internal • Extermal

  8. Metrics

  9. Minkowski r-metric • Manhattan • (city-block) • Euclidean j i

  10. j i h Metric spaces • Positivity Reflexivity • Symmetry • Triangle inequality

  11. More metrics j • Ultrametric • Four-point additive condition i h

  12. Similarity measures • Similarity function • For binary, “shared attributes” i = [1,0,1] j = [0,0,1]

  13. Variations… • Fraction of d attributes shared • Tanimoto coefficient i = [1,0,1] j = [0,0,1]

  14. More variations… • Correlation • Linear • Rank • Entropy-based • Mutual information • Ad-hoc • Neural networks

  15. Dimensionality Reduction

  16. Multidimensional Scaling • Geometrical models • Uncover structure or pattern in observed proximity matrix • Objective is to determine both dimensionality d and the position of points in the d-dimensional space

  17. Metric and non-metric MDS • Metric (Torgerson 1952) • Non-metric (Shepard 1961) • Estimates nonlinear form of the monotonic function

  18. Stress 20 10 5 2.5 0 Goodness of fit Poor Fair Good Excellent Perfect Stress and goodness-of-fit

  19. Clustering

  20. Non-Hierarchical: Distance threshold Duda et al., “Pattern Classification”

  21. Hierarchical

  22. Additive Trees • Commonly the minimum spanning tree • Nearest neighbor approach to hierarchical clustering • Single-linkage

  23. Other linkages • Single-linkage: proximity to the closest element in another cluster • Complete-linkage: proximity to the most distant element • Average-linkage: average proximity • Mean: proximity to the mean (centroid) [only that does not require all distances]

  24. Hierarchical Clustering • Agglomerative Technique • Successive “fusing” cases • Respect (or not) definitions of intra- and /or inter-group proximity • Visualization • Dendrogram, Tree, Venn diagram

  25. Graphical Representations

  26. Data Visualization

More Related