Image quilting for texture synthesis and transfer
Download
1 / 31

Image Quilting for Texture Synthesis and Transfer - PowerPoint PPT Presentation


  • 124 Views
  • Uploaded on

Image Quilting for Texture Synthesis and Transfer. Alexei A. Efros (UC Berkeley) William T. Freeman (MERL) Siggraph01 ’. About author?. Alexei A. Efros Assistant Professor Computer Science Department & The Robotics Institute School of Computer Science

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Image Quilting for Texture Synthesis and Transfer ' - sherise-karis


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Image quilting for texture synthesis and transfer

Image Quilting for Texture Synthesis and Transfer

Alexei A. Efros (UC Berkeley)

William T. Freeman (MERL)

Siggraph01’


About author
About author?

  • Alexei A. Efros

  • Assistant Professor

  • Computer Science Department

  • & The Robotics Institute

  • School of Computer Science

  • Carnegie Mellon University

  • From St. Petersburg, Russia

  • Got PhD from UC Berkeley in 2003

  • Then a year as a Visiting Research Fellow in Visual

  • Geometry Group of Oxford

  • Joined in CSD and RI in autumn of 2004

  • Computer graphics & computer vision


About author1
About author?

  • William T. Freeman

  • Professor of Electrical Engineering &

  • Computer Science at the

  • Artificial Intelligence

  • Laboratory at MIT(September, 2001)

  • Received a BS in physics and MS in electrical

  • engineering from Stanford (1979), and an MS

  • in applied physics from Cornell(1981)

  • Got his PhD in 1992 from the MIT

  • Worked at Mitsubishi Electric Research Labs (1992 – 2001,

  • Cambridge)

  • Computer vision


Quilting transfer

+

=

Quilting? Transfer?




The goal of texture synthesis

input image

SYNTHESIS

True (infinite) texture

generated image

The Goal of Texture Synthesis

Same in perceptual sense


The challenge
The Challenge

  • Texture analysis: how to capture the essence of texture?

  • Need to model the whole spectrum: from repeated to stochastic texture

Repeated

Stochastic

Both?


Related work
Related Work

  • Local region-growing method

  • -Pixel-based

  • -Patch-based

  • Global optimization-based method

  • Heeger and Bergen sig95,Pyramid-based texture synthesis

  • Paget and Longstaff IEEE Tran… 98,Texture synthesis via a noncausal nonparametric multiscale markov random field

  • …..

  • Physical Simulation et al


B1

B1

B2

B2

Neighboring blocks

constrained by overlap

Minimal error

boundary cut

block

Input texture

B1

B2

Random placement

of blocks


Minimum error boundary cut

2

_

=

overlap error

min. error boundary

Minimum Error Boundary Cut

overlapping blocks

vertical boundary



The image quilting algorithm
The Image Quilting Algorithm

  • Pick size of block and size of overlap

  • Synthesize blocks in raster order

  • Search input texture for block that satisfies overlap constraints (above and left)

    • Easy to optimize using NN search [Liang et.al., ’01]

  • Paste new block into resulting texture

    • Compute minimal error boundary cut








Portilla & Simoncelli

Xu, Guo & Shum

input image

Wei & Levoy

Image Quilting


Portilla & Simoncelli

Xu, Guo & Shum

input image

Wei & Levoy

Image Quilting


Portilla & Simoncelli

Xu, Guo & Shum

input image

Wei & Levoy

Image Quilting



Image quilting vs graph cut
Image Quilting vs. Graph Cut

Input

Image Quilting

Graph Cut (siggraph 03’)


Texture transfer

Luminance Constraint

+

Texture Transfer


parmesan

+

=

rice

+

=


Conclusion
Conclusion

  • No multi-scale, no one-pixel-at-a-time!

  • fast and very simple

  • Improved stability

  • Results are not bad


Thanks a lot!

Happy New Year!


Pixel based methods
Pixel-based Methods

  • Compare local causal neighbourhoods

  • Efros and Leung (ICCV ’99) Wei and Levoy (Siggraph 2000) Ashikhmin (I3D 2001)

Input

Output


Patch based methods
Patch-based Methods

  • Copy patches of pixels rather than single pixels

    Chaos Mosaic, Xu et al, 1997

    Patch-Based Sampling, Liang et al(ACM 2001)

    Image Quilting, Efros and Williams(Siggraph 2001)


ad