Sponsored Links
This presentation is the property of its rightful owner.
1 / 1

Flexible Voxels for Motion-Aware Videography PowerPoint PPT Presentation

  • Uploaded on
  • Presentation posted in: General

Flexible Voxels for Motion-Aware Videography. Mohit Gupta. Amit Agrawal. Ashok Veeraraghavan. Srinivasa G. Narasimhan. y. t. Sampling of the Space-Time Volume. Motion-Aware Camera. Why is Building Such a Camera Hard?. x. Conventional Sampling Scheme:. High SR, Low TR.

Download Presentation

Flexible Voxels for Motion-Aware Videography

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript

Flexible voxels for motion aware videography

Flexible Voxels for Motion-Aware Videography

Mohit Gupta


Ashok Veeraraghavan

Srinivasa G. Narasimhan



Sampling of the Space-Time Volume

Motion-Aware Camera

Why is Building Such a Camera Hard?


Conventional Sampling Scheme:

High SR, Low TR

Low SR, High TR

Motion Aware Video

High Frame Rate (500 fps) for Fast Moving Regions

Sensor Plane

Frame 1

Frame 2

Frame N

High Spatial Resolution (1 MP) for Static Regions


Integration Time


Our Sampling Scheme:

Sensor Plane

Frame 1

Frame 2

Frame N

Thin and long voxels

Fat and short voxels

Flexible voxels

Post-Capture control of frame rate and spatial resolution

Motion-Aware video requires flexible voxels and a priori knowledge of the scene


Integration Time


Post Capture Motion-Aware Interpretation of Data

Captured Data

Different Spatio-temporal Interpretations

Diffusion Kernels

High SR

High TR


TR = 1X SR = 1X

TR = 2X SR = ½ X

TR = 4X SR = ¼X

High SR

High TR



Optical Flow Red = Fast, Green = Slow, Blue = Stationary

Diffusion Kernels Aligned Along Flow Directions

Motion-Aware Reconstruction

Pixel on

Captured Frame

Reduced Aliasing

Increasing Temporal Resolution

Pixel off

Anisotropic diffusion

Motion-Aware reconstruction using motion information

Simple re-binning results in aliasing artifacts

Hardware Implementation: Fast Per-pixel Shutter

Motion-Aware Video Results Fan Rotating (‘Wagon-wheel effect’)

Camera Integration

Projector Pattern


Coded Motion Blur

High TR

High SR

Pixel 1

Beam Splitter

Image Plane

Pixel 2


Image Plane

Pixel K

[Mukaigawa et al]



Input Frame (Captured at 7.5 FPS)

Reconstructed Frame (60 FPS) (1 out of 8)

Future work: Passive implementation using LCoS

Multi-Use Light Engine (MULE)

Co-located projector camera setup

Fast optical modulation

Pico-Projector (1440Hz.) ($350)

  • Login