1 / 24

Depth-Level-Adaptive View Synthesis for 3D Video

Depth-Level-Adaptive View Synthesis for 3D Video. R99922020 黃昱翔 R99922133 屠　愚. Weixing Wan. Miska Hannuksela. Jun Zhang. Ying Chen. Authors. Houqiang Li. Moncef Gabbouj. Introduction Motivation & Goal ViSBD view synthesis Depth- l evel-adaptive view synthesis Results

taini
Download Presentation

Depth-Level-Adaptive View Synthesis for 3D Video

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Depth-Level-Adaptive View Synthesis for 3D Video R99922020 黃昱翔 R99922133 屠　愚

  2. Weixing Wan MiskaHannuksela Jun Zhang Ying Chen Authors HouqiangLi MoncefGabbouj

  3. Introduction • Motivation & Goal • ViSBD view synthesis • Depth-level-adaptive view synthesis • Results • Conclusion Outline

  4. Introduction

  5. Introduction

  6. Motivation & Goal ?

  7. ViSBD: • View Synthesis Based on Disparity/Depth • MPEG 3DV ad-hoc Group • Warping • Visibility • Blending • Hole filling ViSBD View Synthesis

  8. Camera (0,0,0) Focal plane Object in the 3D space f • Warping • Visibility • Blending • Hole Filling z 2D pixel P(X, Y) 3D vertex p(x, y, z) ViSBD View Synthesis

  9. Real Camera (0,0,0) • Warping • Visibility • Blending • Hole Filling Virtual Camera (T, 0, 0) ViSBD View Synthesis +

  10. Warping • Visibility • Blending • Hole Filling ? ViSBD View Synthesis

  11. Warping • Visibility • Blending • Hole Filling ViSBD View Synthesis

  12. Warping • Visibility • Blending • Hole Filling ViSBD View Synthesis

  13. Warping • Visibility • Blending • Hole Filling A New Virtual View!!! ViSBD View Synthesis

  14. Warping • Visibility • Blending • Hole Filling • Surviving holes!!! • Fill them with neighboring background pixels Pixel that has depth value smaller than all of its neighbors. ViSBD View Synthesis

  15. Depth clustering • Depth-level-aware visibility and blending • Hole filling Depth-Level-Adaptive View Synthesis

  16. Depth Clustering Initialization While(!Converge){ Calculate Sum of Absolute Error (SAE). Split the cluster that has max SAE. Run the K-means algorithm. Calculate . } Clustered!!! Depth-Level-Adaptive View Synthesis

  17. Depth Clustering Converge criteria: < R, for Length times, consecutively. Depth-Level-Adaptive View Synthesis

  18. Depth-Level-Aware Visibility & Blending Warping Left View Blending Visibility Warping Novel View Novel View Right View Depth-Level-Adaptive View Synthesis

  19. Hole Filling Win!! Depth-Level-Adaptive View Synthesis

  20. Experiment parameters • Depth clustering • R = 4% • Length = 6 • Visibility • Window size = 1 • Hole filling • Window size initialized to 1 Results

  21. … … n 10 9 12 8 11 7 6 1 … … Results

  22. Results

  23. Depth-level-adaptive view synthesis algorithm • Depth clustering • Better blending and hole filling • Avoids using pixels from different objects(depth clusters) Conclusion

  24. Questions Thanks for Your Attention!

More Related