Format agnostic approach for production delivery and rendering of immersive media
Download
1 / 8

Format-agnostic Approach for Production, Delivery and Rendering of Immersive Media - PowerPoint PPT Presentation


  • 90 Views
  • Uploaded on

Format-agnostic Approach for Production, Delivery and Rendering of Immersive Media. Felix Lee HPC I 28.10.2013. real-time acquisition warping & stitching blending and rendering of 6 HD video streams one panoramic video of 7k x 2k resolution on a single PC exploiting GPU processing.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Format-agnostic Approach for Production, Delivery and Rendering of Immersive Media' - kiefer


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Format agnostic approach for production delivery and rendering of immersive media

Format-agnostic Approach for Production, Delivery and Rendering of Immersive Media

Felix Lee

HPC I

28.10.2013


Real time live panoramic video omnicam

real-time acquisition Rendering of Immersive Media

warping & stitching

blending and rendering of 6 HD video streams

one panoramic video of 7k x 2k resolution

on a single PC exploiting GPU processing

Real-time Live Panoramic VideoOMNICAM


Scene acquisition 1
Scene Acquisition (1) Rendering of Immersive Media

OMNICAM

ARRI Alexa

HD Broadcast camera


Scene acquisition 2
Scene Acquisition (2) Rendering of Immersive Media

Soundfield®

Stereo pair

Eigenmike®

Gun mics


Three demo productions so far
Three Demo Productions (so far) Rendering of Immersive Media

  • Football

    • Premier League GameChelsea FC – Wolverhampton Wanderers (London, October 2010)

  • Dance Performance

    • Carmen SuiteBerlin Philharmonic Orchestra conducted by Sir Simon Rattle & Dance Compagnie Sasha Waltz (Berlin, May 2012)

  • Concert

    • BBC Proms (London, August 2012)


Saliency map
Saliency Rendering of Immersive MediaMap

  • Center-surround model

    • inspired from biological models of human visual sensory system

  • Center-surround features

    • Pixel intensity

    • Color chromatic opponents RG and BY

  • Saliency map for still images


Saliency detection
Saliency Detection Rendering of Immersive Media

  • Image pyramid based saliency map

    • Create image pyramid: blur and shrink the image

    • Build the image differences

    • Add the image differences


Spatio temporal saliency histograms
Spatio Rendering of Immersive Media-temporal SaliencyHistograms

  • Spatiotemporal saliency model

    • Split image into grid cells (cell size: e.g. 20x20 pixels for HD)

    • Compute histogram of pyramid differences for each cell

    • Compare histograms

      • Current histogram vs. average of histograms from past second

      • Distance function: earth mover distance

  • Region of interest (ROI)

    • Convert high salient regions into rectangles

  • Application: automatic view selection

  •  Demo video


ad