1 / 27

Advanced 3D Scene Reconstruction and Visualization Techniques in Photo Tourism

This seminar presented by Anton Jigalin delves into the advanced topics of scene reconstruction and visualization within the realm of computer vision. It explores methods for automatically reconstructing 3D geometry from extensive online photo collections. Key challenges such as unknown camera positions, correspondence problems, and algorithmic complexity are examined alongside innovative solutions like image-based modeling and Structure from Motion (SfM). The seminar also introduces tools for 3D navigation and scene annotation, enhancing the overall photo tourism experience.

kory
Download Presentation

Advanced 3D Scene Reconstruction and Visualization Techniques in Photo Tourism

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Scene Reconstruction Seminar presented by Anton Jigalin Advanced Topics in Computer Vision (048921)

  2. SceneReconstruction SceneVisualization: Photo Tourism:3D photo browser PathFinder:3D navigation interface References: Scene Reconstruction and Visualization from Internet Photo Collections. N. Snavely. 2008.

  3. SceneReconstruction

  4. The goal Automatically reconstruct 3D geometry from large collections of photos from the Internet

  5. Motivation • New way to organize photo collections • Experience of being at a place

  6. Related works • Image based modeling • Moviemaps • Structure from motion (SfM)

  7. Challenges • Unknown cameras position • Unknown internal camera parameters • Correspondence problem • Visualization • Algorithmic complexity Running the complete pipeline on a 3.80GHz Intel Xeon machine with 4GB of core memory. The keypoint detection and matching phases were run in parallel on 10 such machines.

  8. Results

  9. How was this result achieved?

  10. Finding correspondence • Feature detection - SIFT • Feature matching - RANSAC • Epipolar constraint

  11. Structure from Motion Algorithm

  12. Structure from Motion Algorithm • Initial two-frame • reconstruction • Intermediate stage • Final reconstruction

  13. Failure modes • Repeating textures • Insufficient overlap or texture • Cascading errors • Bad initialization

  14. Connectivity graphs

  15. SceneVisualization: Photo Tourism:3D photo browser

  16. Photo Tourism: Main components • Rendering engine • Navigation interface • Tools for scene annotation

  17. Transitions between photographs

  18. Navigation interface • Object-based navigation • Stabilized slideshow

  19. Scene annotation • Register new photographs • Annotate regions

  20. SceneVisualization: PathFinder:3D navigation interface

  21. Best possible controls • The goals of 3D navigation: • Exploration • Search • Object inspection • Principles for 3D scene navigation: • Controls are scene and task dependent • Constrained and automatic navigation • User’s position and motion should be clear

  22. Pathfinder: Main components • Viewpoint scoring • Navigation controls for a scene • Rendering engine • User interface

  23. Scene-specific controls: Panoramas and Orbits • Panoramas • Orbits

  24. Path planning • Connectivity graph • High-quality rendering • Shortest path • Piecewise linear path • Path smoothing

  25. Limitations • Non circular orbits • User needs • Appearance compensation • Larger scenes Pisa Doumo Stonehenge

  26. Conclusion • Structure from motion • Photo Tourism - 3D photo browser • Path Finder - 3D navigation system Future work • Reconstructing Rome • Capturing appearance • New photo-sharing community

  27. Thank you

More Related