1 / 24

Jitter Camera: High Resolution Video from a Low Resolution Detector

Jitter Camera: High Resolution Video from a Low Resolution Detector. Moshe Ben-Ezra, Assaf Zomet and Shree K. Nayar IEEE CVPR Conference June 2004, Washington DC, USA. Plasma Display Resolution 1366x768. MiniDV Camera. Resolution: 720x480. Digital Camera. Resolution: 2592x1944.

thina
Download Presentation

Jitter Camera: High Resolution Video from a Low Resolution Detector

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Jitter Camera: High Resolution Video from a Low Resolution Detector Moshe Ben-Ezra, Assaf Zomet and Shree K. Nayar IEEE CVPR Conference June 2004, Washington DC, USA

  2. Plasma Display Resolution 1366x768 MiniDV Camera. Resolution: 720x480 Digital Camera. Resolution: 2592x1944 Video Resolution

  3. Fundamental Resolution Tradeoff Hi-resolution still Camera Conventional video camera 3M 2048x1536 330K 720x480 3 Temporal resolution (fps) 30 130 Spatial resolution (pixels)

  4. Super-Resolution Shechtman, Caspi, and Irani ECCV2002 Zomet and S. Peleg. ICIP2000 Baker and Kanade. CVPR2000 Chiang and Boult, IVC2000 Capeland, Zisserman ICPR2000 Elad and Feuer IP1997 Irani and Peleg GMIP1996 Super-Resolution Sequence taken by a moving camera High-Resolution computed image

  5. Super Resolution y = (D G)x + z Blurring Op. Noise All Sampled Images Decimation Hi Res. Image

  6. Motion Blur Hurts Us Again!

  7. Capture Images without Motion Blur

  8. Effect of Motion Blur on Super-Resolution Input: No Motion Blur Super-Resolution Result Input : With Motion Blur (known) Super-Resolution Result

  9. Input Images High-Resolution Image Blur & Decimation Noise (Quantization) Volume of Solutions 1/det(A) Quantifying The Affect of Motion Blur • Empirical tests: RMS error. • Volume of Solutions (Linear Model): Baker and Kanade

  10. How Bad is Motion Blur for Super-Resolution? 18 0 1 2 3 4 5 RMS Error After Super-Resolution Space of Super-Resolution Solutions 0 1 2 3 4 5 Motion blur in pixels Motion blur in pixels

  11. Avoid Motion Blur using Jitter Sampling Spatial Jitter Sampling Time Time Space Space Conventional Sampling

  12. The Jitter Camera Lens Detector Micro-actuator

  13. The Jitter Camera Lens Detector Micro-actuator Detector is a light weight device! Jitter is instantaneous and synchronous

  14. Computer Controlled Y Micro-Actuator Computer Controlled X Micro-Actuator Lens Board Camera

  15. Jitter Mechanism Accuracy 1μm Y Pixels X Pixels Actual locations. Desired locations.

  16. Result: Resolution Chart Four Images from the Jitter Camera Super-Resolution Image

  17. Result: Color DeMosaicing and Super-Resolution Super-Resolution 1 (out of 4) Jitter camera Image

  18. Jitter Video (Stabilized) How can we handle dynamic scenes?

  19. Adaptive Super-Resolution for Dynamic Scenes Static blocks: 4 frames used. Occlusions: 1 frame used. Moving object: 2 - 4 frames used

  20. Adaptive Super-Resolution Algorithm Estimate the aliasing error ‘’ (stdv)for each block Ikin I. Compute robust block matching between all pairs {I}{I1,2,3}. Use ‘’ as a scale factor for an M-Estimatorerror function. For each block Iktry tofind 3 matching blocks {Ix}k, s.t. : SSD(Ik, {Ix}k)-0.5< 3 {Ix}k are temporally closest to Ik (smallest x) Apply super-resolution to the selected blocks. The algorithm degrades gradually from 4-frames super-resolution to a single frame interpolation and deblurring. I-3 I-2 I-1 I I+1 I+2 I+3

  21. Scale Estimate Mean 6.4, Stdv 14 Mean 7.5, Stdv 16 Mean 8.6, Stdv 17 Low Res - Hi-Res Aliasing Error (Simulated) Mean 10.5, Stdv 27 Mean 15.2, Stdv 30 Mean 17.7, Stdv 33 Low Res 2nd derivative (Simulated)

More Related