1 / 39

Diffusion Coded Photography for Extended Depth of Field SIGGRAPH 2010

Diffusion Coded Photography for Extended Depth of Field SIGGRAPH 2010. Oliver Cossairt, Changyin Zhou, Shree Nayar Columbia University. Supported by ONR and NSF. Conventional Camera (F/1.8). Conventional Camera (F/18). Camera Blur Model. Spatial domain. PSF. Focused Image.

iman
Download Presentation

Diffusion Coded Photography for Extended Depth of Field SIGGRAPH 2010

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Diffusion Coded Photography for Extended Depth of FieldSIGGRAPH 2010 Oliver Cossairt, Changyin Zhou, Shree NayarColumbia University Supported by ONR and NSF

  2. Conventional Camera (F/1.8)

  3. Conventional Camera (F/18)

  4. Camera Blur Model Spatial domain PSF Focused Image Captured Image Image Noise Frequency domain Focused Image MTF Image Noise Captured Image (Modulated Transfer Function)

  5. Deblurring Problems Low SNR Focused image Problem 2: Sensor Object P Q Lens Problem 1: Low MTF values Captured image MTF Variation with depth

  6. Extending Depth of Field (EDOF): Previous Work Focal Sweep Cameras [Hausler ’72] [Nagahara et al. ’08] Wavefront Coding Cameras [Dowski and Cathey ’95] [Chi and George ’01] [Garcia-Guerrero et al. ‘07] Cubic Phase Plate Sensor Lens Sensor Lens Focal Plane Other Related Work [Levin et al. ’07] [Veeraraghavan et al. ’07] [Levin et al. ’09]

  7. near far focus Conventional Camera depth Focal Sweep Wavefront Coding Focal sweep vs. wavefront coding Note: only a single PSF will be used to deblur the whole image.

  8. Focal sweep vs. wavefront coding Deblurring Error vs. Depth Deblurring Error noise Depth Focal Sweep Wavefront Coding

  9. Achieve the performance of focal sweep without any moving parts?

  10. SEM image Diffuser sheets x Scatter function Light ray w x w Diffuser Sensor Optical Diffusers Diffuser [http://www.luminitco.com]

  11. Sensor Diffuser Kernels Without a diffuser: Light Field u x u A/2 x A -A/2 Lens

  12. Sensor Sensor Diffuser Kernels Without a diffuser: Light Field u x u A/2 x A -A/2 Lens With a diffuser: u x u A/2 x A -A/2 Lens

  13. Sensor Sensor Diffuser Kernels Without a diffuser: Light Field u x u A/2 x A -A/2 Lens With a diffuser: u x u A/2 x A -A/2 Lens

  14. A/2 -A/2 Diffusion Kernels Without diffuser Diffuser kernel With diffuser u u u Light field x x x

  15. A/2 project project project -A/2 x x x Diffusion Kernels Without diffuser Diffuser kernel With diffuser u u u Light field x x x PSF Camera PSF Scatter function Diffused PSF

  16. Radially Symmetric Diffuser Without a diffuser: PSF Lens Sensor

  17. Radially Symmetric Diffuser Without a diffuser: PSF Lens Sensor With a diffuser: Lens Sensor

  18. Radially Symmetric Diffuser Without a diffuser: PSF Lens Sensor With a diffuser: Lens Sensor

  19. Radially Symmetric Diffuser Without a diffuser: PSF Lens Sensor With a diffuser: Lens Sensor

  20. Radially Symmetric Diffuser Without a diffuser: PSF Lens Sensor With a diffuser: Lens Sensor

  21. Radially Symmetric Diffuser Without a diffuser: PSF Lens Sensor With a diffuser: Lens Sensor

  22. Radially Symmetric Diffuser Without a diffuser: PSF Lens Sensor With a diffuser: Lens Sensor

  23. Radially Symmetric Diffuser -50px 50px -50px 50px -50px 50px -50px 50px Scatter function Camera PSF PSF: PSF (1D slice) MTF (1D slice) Normalized frequency Normalized frequency Normalized frequency Normalized frequency depth

  24. Diffusion Coding Performance Diffusion Coding (light field) Diffusion Coding (wave optics) Deblurring Error vs. Depth Wavefront Coding Focus Sweep Deblurring Error noise Depth Similar performance to focal sweep without moving parts

  25. Diffuser Implementation Diffuser scatter function r(mm) Diffuser height map Fabricated diffuser Diffuser surface profile 3 2 RPC Photonics Thickness (um) [www.rpcphotonics.com] 1 6 0 3 8 11 r(mm)

  26. Comparison with Prior Work x Deblurring Error vs. Depth Diffusion Coding Garcia-Guerrero Deblurring Error Depth Diffusion coding significantly outperforms prior work.

  27. Measured PSFs Without diffuser With diffuser depth Diffusion Coding Experiments Experimental Setup Fabricated Diffuser Cannon 50mm EF lens Cannon 450D Sensor

  28. Examples

  29. Stuffed Toys Conventional Camera f-number = 1.8, exposure time = 16ms

  30. Stuffed Toys Conventional Camera f-number = 18 , exposure time = 16ms

  31. Stuffed Toys Diffusion Coding Camera: Captured f-number = 1.8, exposure time = 16ms

  32. Stuffed Toys Diffusion Coding Camera: Deblurred f-number = 1.8, exposure time = 16ms

  33. Statues Deblurred Captured f-number = 1.8; exposure time = 10ms

  34. People and Flowers Conventional Camera f-number = 1.8, exposure time = 16ms

  35. People and Flowers Diffusion Coding Camera: Captured f-number = 1.8, exposure time = 16ms

  36. People and Flowers Diffusion Coding Camera: Deblurred f-number = 1.8, exposure time = 16ms

  37. Loss of contrast • Occlusion errors Limitations Conventional Camera Diffusion Coding • Loss of image texture

  38. Radially Symmetric Diffusers Diffusion Coding Examples Diffusion Coding Implementation Conclusions Diffusion Coding Theory

  39. Diffusion Coded Photography for Extended Depth of FieldSIGGRAPH 2010 Oliver Cossairt, Changyin Zhou, Shree NayarColumbia University Supported by ONR and NSF

More Related