1 / 21

Chong Chen Dan Schonfeld Department of Electrical and Computer Engineering

Plenoptic Imaging. Chong Chen Dan Schonfeld Department of Electrical and Computer Engineering University of Illinois at Chicago May 7 2009. Plenoptic Function (1). From plenus (complete or full) and optic .

Download Presentation

Chong Chen Dan Schonfeld Department of Electrical and Computer Engineering

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Plenoptic Imaging Chong Chen Dan Schonfeld Department of Electrical and Computer Engineering University of Illinois at Chicago May 7 2009

  2. Plenoptic Function (1) • From plenus (complete or full) and optic. • An idealized function to express the image of a scene from any possible viewing position at any viewing angle at any point in time.

  3. Plenoptic Function (2)

  4. R. Ng et al., Stanford University 2005 Plenoptic Camera (1)

  5. R. Ng et al., Stanford University 2005 Plenoptic Camera (2)

  6. Image-Base Rendering L. McMillan and G. Bishop, SIGGRAPH 1995

  7. M. Levoy and P. Hanrahan, SIGGRAPH 1996 Lightfield The lightfield data is composed of six 4D functions, where the plane of the inner box is indexed with coordinate (u, v) and that of the outer box with coordinate (s, t).

  8. Sampling and Reconstruction • The lightfield reconstruction is computed as • The sampled lightfield ls(u,v,s,t) is represented by H.Y. Shum et al., SIGGRAPH 2000

  9. Plenoptic Sampling (1) Assumptions: Lambertian surfaces and no occlusion. H.Y. Shum et al., SIGGRAPH 2000

  10. Plenoptic Sampling (2) where L’ is the 2D Fourier transform of l(x,y,0,0) The spectral support of a lightfield signal is bounded by the minimum and maximum depths only, no matter how complicated the spectral support might be because of depth variations in the scene. H.Y. Shum et al., SIGGRAPH 2000

  11. Unstructured Lumigraph M. Cohen et al., SIGGRAPH 2001

  12. Parallel Cameras Plenoptic signals taken by parallel cameras will be bandlimited, and their spectral support is bounded by the minimum and maximum depths.

  13. Unstructured Cameras (1) Plenoptic signals taken by unparallel cameras will not be bandlimited. is the Bessel Function.

  14. Unstructured Cameras (2) Assuming Plenoptic signals taken by unparallel cameras with limited FOV and rotations can be approximated to be bandlimited

  15. Concentric Mosaic (1) After linearization • for the constant depth concentric mosaic, the spectrum lies on a line with slope C. Zhang and T. Chen, Carnegie Mellon University 2001

  16. Concentric Mosaic (2) Before linearization Bernstein's inequality: if is a bounded function on with supported in the ball . Then for all multi-indices , there exist constants (depending only on and on the dimension n) such that

  17. Unoccluded Image Constraints If any point (f(x), g(x)) on the surface of the scene is differentiable, there is no occlusion with the surface if and only if which can be proved by Cauchy's Mean-Value Theorem.

  18. Plenoptic signals taken by unparallel cameras will not be bandlimited. Plenoptic signals taken by unparallel cameras with limited FOV and rotations can be approximated to be bandlimited. Sampling (light conditions, surface luminance) Reconstruction (integral imaging) Conclusions and Future Work

  19. Thank you !

More Related