1 / 30

Snakes, Strings, Balloons and Other Active Contour Models

Snakes, Strings, Balloons and Other Active Contour Models. Goal. Start with image and initial closed curve Evolve curve to lie along “important” features Edges Corners Detected features User input. Applications. Region selection in Photoshop Segmentation of medical images Tracking.

roch
Download Presentation

Snakes, Strings, Balloons and Other Active Contour Models

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Snakes, Strings, Balloonsand Other Active Contour Models

  2. Goal • Start with image and initial closed curve • Evolve curve to lie along “important” features • Edges • Corners • Detected features • User input

  3. Applications • Region selection in Photoshop • Segmentation of medical images • Tracking

  4. Corpus Callosum [Davatzikos and Prince]

  5. Corpus Callosum [Davatzikos and Prince]

  6. User-Visible Options • Initialization: user-specified, automatic • Curve properties: continuity, smoothness • Image features: intensity, edges, corners, … • Other forces: hard constraints, springs, attractors, repulsors, … • Scale: local, multiresolution, global

  7. Behind-the-Scenes Options • Framework: energy minimization, forces acting on curve • Curve representation: ideal curve, sampled, spline, implicit function • Evolution method: calculus of variations, numerical differential equations, local search

  8. Snakes: Active Contour Models • Introduced by Kass, Witkin, and Terzopoulos • Framework: energy minimization • Bending and stretching curve = more energy • Good features = less energy • Curve evolves to minimize energy • Also “Deformable Contours”

  9. Snakes Energy Equation • Parametric representation of curve • Energy functional consists of three terms

  10. Internal Energy • First term is “membrane” term – minimum energy when curve minimizes length(“soap bubble”) • Second term is “thin plate” term – minimum energy when curve is smooth

  11. Internal Energy • Control a and b to vary between extremes • Set b to 0 at a point to allow corner • Set b to 0 everywhere to let curve follow sharp creases – “strings”

  12. Image Energy • Variety of terms give different effects • For example,minimizes energy at intensity Idesired

  13. Edge Attraction • Gradient-based: • Laplacian-based: • In both cases, can smooth with Gaussian

  14. Corner Attraction • Can use corner detector we saw last time • Alternatively, let q = tan-1 Iy / Ixand let nbe a unit vector perpendicular to the gradient. Then

  15. Constraint Forces • Spring • Repulsion

  16. Evolving Curve • Computing forces on v that locally minimize energy gives differential equation for v • Euler-Lagrange formula • Discretize v: samples (xi, yi) • Approximate derivatives with finite differences • Iterative numerical solver

  17. Other Curve Evolution Options • Exact solution: calculus of variations • Write equations directly in terms of forces,not energy • Implicit equation solver • Search neighborhood of each (xi, yi) for pixel that minimizes energy • Shah & Williams paper

  18. Variants on Snakes • Balloons [Cohen 91] • Add inflation force • Helps avoid getting stuck on small features

  19. Balloons Balloons Snakes [Cohen 91]

  20. Balloons [Cohen 91]

  21. Other Energy or Force Terms • Results of previously-run local algorithms • e.g., Canny edge detector output convolvedwith Gaussian • Automatically-evolved control points • Others…

  22. Brain Cortex Segmentation Add energy term for constant-color regions of a single color Davatzikos and Prince

  23. Brain Cortex Segmentation Davatzikos and Prince

  24. Brain Cortex Segmentation Find features and add constraints Davatzikos and Prince

  25. Brain Cortex Segmentation Davatzikos and Prince

  26. Scale • In the simplest snakes algorithm, image features only attract locally • Greater region of attraction: smooth image • Curve might not follow high-frequency detail • Multiresolution processing • Start with smoothed image to attract curve • Finish with unsmoothed image to get details • Heuristic for global minimum vs. local minima

  27. Diffusion-Based Methods • Another way to attract curve to localized features: vector flow or diffusion methods • Example: • Find edges using Canny • For each point, compute distance tonearest edge • Push curve along gradient of distance field

  28. Gradient Vector Fields Xu and Prince

  29. Gradient Vector Fields Simple Snake With Gradient Vector Field Xu and Prince

  30. Gradient Vector Fields Xu and Prince

More Related