1 / 20

Nonparametric Modeling of Textures

Nonparametric Modeling of Textures . Outline Parametric vs. nonparametric Image patches and similarity distance Efros-Leung’s texture synthesis by non-parametric sampling Next week Application into image inpainting Application into image quilting Demos and discussions.

claude
Download Presentation

Nonparametric Modeling of Textures

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Nonparametric Modeling of Textures • Outline • Parametric vs. nonparametric • Image patches and similarity distance • Efros-Leung’s texture synthesis by non-parametric sampling • Next week • Application into image inpainting • Application into image quilting • Demos and discussions

  2. A Simple Example of Nonparametric Model Class A: blue square, Class B: red triangle

  3. What if we use parametric models? N(m1,C1) N(m2,C2)

  4. Why Nonparametric? • Nonparametric = “Distribution Free” • E.g., we might assume that X1,X2,…,Xn are independent identically distributed (iid) but we do not know its specific distribution – this is particularly useful for handling data in high-dimensional space • Advantage: the resulting inferential statements are relatively more robust than those from parametric models • Disadvantage: limited application because it is difficult, and often impossible to build into the model more sophisticated structures based on our scientific knowledge (i.e., purely data-driven)

  5. Examples • Regression analysis: predict the stock market value based on the history • Parametric regression: use AR model to fit the observation data • Nonparametric regression: use heuristics – e.g., if the value of stock A increases, then the value of stock B is likely to increase (or decrease) • Texture synthesis: • Parametric: two images will look similar if they have similar first-order/second-order statistics • Nonparametric: two images will look similar if they form similar “clouds” in high-dimensional patch space

  6. Nonparametric Sampling in Natural Language I took a walk in town one day And met a cat along the way. What do you think that cat did say? Meow, Meow, Meow I took a walk in town one day And met a pig along the way. What do you think that pig did say? Oink, Oink, Oink I took a walk in town one day And met a cow along the way. What do you think that cow did say? Moo, Moo, Moo - cited from “Wee Sing for Baby”

  7. Efros-Leung’ Scheme (1999) • Image patches • Look at a group of pixels instead of individual one • Similarity distance • Are two patches visually similar? • Scanning order • Which pixel to synthesize first? • Nonparametric sampling

  8. Image Patches For the convenience of implementation, patches are often taken as square blocks (overlapping is allowed)

  9. Similarity Distance MSE metric Weighted MSE 2D Gaussian kernel

  10. Scanning Order Onion-peel scanning Colored regions denote where synthesis is needed

  11. Putting Things Together 1. Form an inquiry patch ? 2. Find best matched patches 3. Obtain the histogram of center pixels in all matched patches 4. The ? intensity value is given by sampling the empirical distribution

  12. Pseudo-Code Implementation http://graphics.cs.cmu.edu/people/efros/research/NPS/alg.html

  13. Image Examples

  14. Image Examples (Con’d) More examples can be found at http://graphics.cs.cmu.edu/people/efros/research/EfrosLeung.html

  15. Extensions • Similarity metric • Cosine distance = normalized Euclidean distance A B

  16. Extensions (Con’t) B A Sim(A,B) is large but Sim(A,fliplr(B)) is small

  17. Scientific Puzzle Behind

  18. Photoreceptors rods cones

  19. Receptive Fields

  20. Direction Selectivity

More Related