210 likes | 347 Views
Bringing Photographs to Life With View Morphing. Steve Seitz University of Wisconsin—Madison. Images Are Static. Photographs Lack Movement — scene is frozen in time Depth — image is two-dimensional Can we animate the scene via the image?. Objective: Scene Interaction Via Photos.
E N D
Bringing Photographs to LifeWith View Morphing Steve Seitz University of Wisconsin—Madison
Images Are Static • Photographs Lack • Movement — scene is frozen in time • Depth — image is two-dimensional • Can we animate the scene via the image?
Objective:Scene Interaction Via Photos • Scene Viewing • Move virtual camera, view real scene • Scene Interaction • Move objects — cut and paste • Change objects — paint, sculpt • Animate the scene — make things walk, talk
Adding Movement Original Image Expression Change
Adding Depth Original Image Perspective Change
Talk Outline • Adding Motion and Depth • View Morphing • Applications • Visualization, photo correction, special effects • Interacting With the Scene • Scene editing via photographs
Photograph Photograph
Virtual Camera Morphed View
1. Prewarp • align views
1. Prewarp • align views • 2. Morph • move camera
1. Prewarp • align views • 2. Morph • move camera • 3. Postwarp • point camera
Features of View Morphing • Provides • A mobile virtual camera • Better image morphs • Requires no prior knowledge • No 3D shape information • No camera information • No training on other images
Applications: Visualization • User-controlled Virtual Camera • Telepresence — visit a remote scene • Web commerce — product viewing over Internet • Viewing historical sites • Animating paintings
Applications: Photo Correction • Image Postprocessing • Alter image perspective in the lab • Image Databases • Normalize images for better indexing • Simplify face recognition tasks
Original Photographs Corrected Photographs
Applications: Better Image Transitions • Avoid bending and shearing distortions • Shapes do not need to be aligned Image Morph View Morph
The Next Step:Interacting With the Scene • Scene Editing Via Photographs • Move objects — cut and paste • Change objects — paint, warp Scene Photo Painted Photo Propagation
Original Photo Original Photo
Painted Photo Original Photo Cut Photo Original Photo
Painted Photo Original Photo Cut Photo New Views of Modified Scene
Conclusions • Photographs Come Alive • Motion, depth added by View Morphing • User-Scene Interaction Via Photos • Still images interactive movies • What kinds of scene changes are possible? • Which modes of interaction are natural?