1 / 20

Interactive Images: Cuboid Proxies for Smart Image Manipulation

Interactive Images: Cuboid Proxies for Smart Image Manipulation. Youyi Zheng , Xiang Chen, Mingming Cheng, Kun Zhou, Shi-Min Hu, Niloy J. Mitra Presenter : Jiapei ZHANG. Outline. Coupled 2D-3D Analysis 2D pixels 3D proxies Image Decomposition

fritzi
Download Presentation

Interactive Images: Cuboid Proxies for Smart Image Manipulation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Interactive Images: Cuboid Proxies for Smart Image Manipulation YouyiZheng, Xiang Chen, Mingming Cheng, Kun Zhou, Shi-Min Hu, NiloyJ. Mitra Presenter: Jiapei ZHANG

  2. Outline • Coupled 2D-3D Analysis 2D pixels 3D proxies • Image Decomposition Background + Textured Proxies • Interactive Editing

  3. Coupled 2D-3D Analysis

  4. Initial camera calibration Six corners Grab Cut Corner points 6 correspondence pairs Linear program Camera calibration

  5. Initial Scene Estimation Triplet of adjacent edges Candidate cuboid For each candidate cuboid in the set {Pi} minimize the total fitting error Joint Optimization

  6. Stacking & Occlusion B B A A

  7. Resolving Ambiguities MRF formulation

  8. Non-convex objects Choose the one covers the largest area of Ri Cutting plane identification Redundancy removal Greedy Algorithm

  9. Image Decomposition

  10. Light & Shadow Estimate a single light position (in a least squares sense) such that User-marked shadow correspondence

  11. Decomposition • Remove projected proxy and shadows • Image completion • For each proxy: (i) shadow effects based on light position (ii) symmetric regions to fill in missing texture for invisible faces

  12. Proxy-Based Edits

  13. Basic Operation • Extracted proxies + Relations • Relations: • Operations: placement, repetition, alignment, coplanarity, repetition, parallelism translate, rotate, scale, stack

  14. User-Indicated Relation hinge joint slide inside mark

  15. Repeated Edit

  16. Virtual Shopping

  17. User Study Original Images Editing Results V.S. Users recognized: 63.2% real images 44.5% fake images

  18. Conclusion

  19. 2D 3D 2D

  20. Thank You

More Related