a flexible and standards compatible architecture for mvc streaming
Download
Skip this Video
Download Presentation
A Flexible and Standards -Compatible Architecture for MVC Streaming

Loading in 2 Seconds...

play fullscreen
1 / 14

A Flexible and Standards -Compatible Architecture for MVC Streaming - PowerPoint PPT Presentation


  • 163 Views
  • Uploaded on

Engin Kurutepe, Cagdas Bilen, Anil Aksay, Goktug Gurler, Thomas Sikora, Gozde Bozdagi Akar, Murat Tekalp A 3DTV collaboration between METU, KU and TUB ITG Fachtagung, HHI, Berlin, 22.06.2007. A Flexible and Standards -Compatible Architecture for MVC Streaming. System Overview.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'A Flexible and Standards -Compatible Architecture for MVC Streaming' - enya


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
a flexible and standards compatible architecture for mvc streaming
Engin Kurutepe, Cagdas Bilen, Anil Aksay, Goktug Gurler, Thomas Sikora, Gozde Bozdagi Akar, Murat Tekalp

A 3DTV collaboration between METU, KU and TUB

ITG Fachtagung, HHI, Berlin, 22.06.2007

A Flexible and Standards-Compatible Architecture for MVC Streaming

system overview
System Overview
  • Standards-based, flexible, end-to-end Multi-View Video (MVV) Streaming system
    • Server and streaming: TUB
    • Encoding – decoding: METU
    • Client and display: KOC
  • MVC encoded MVV representation
  • RTP/RTSP/SDP Server can serve various clients
    • Legacy 2-D
    • Static Stereo (3DV)
    • Dynamic Stereo – Head Tracking (3DV + FVV)
    • N-View (3DV + FVV)
  • Based on open-source libraries (Live Media and FFMPEG)
  • An initial demo system was shown at GRM2 in Bodrum
  • Final version will be demonstrated in IBC Amsterdam

Multi-View Streaming

m ulti view encoding
Multi-View Encoding
  • Simulcast Coding
    • JM Reference Software (H.264 monoscopic standard) (GRM2 Demo System)
  • Stereo/MultiView Coding
    • MMRG Codec (Implemented in METU, without B picture support)
    • JMVM 3.0 (Upcoming new standard)
      • Complex prediction structures
  • Encoders are not real-time

Multi-View Streaming

possible mvc coding schemes in jmvm
Possible MVC Coding Schemes in JMVM

General MVC Scheme

Multi-View Streaming

possible mvc coding schemes in jmvm5
Possible MVC Coding Schemes in JMVM

Simplified MVC Scheme (IPPP)

Multi-View Streaming

multi view decoding
Multi-View Decoding
  • Simulcast Decoding
    • JM Decoder: Slow
    • FFMPEG Decoder: Fast, doesn’t support Hierarchical B-frames correctly, compiled in Linux, can be used in Windows apps, used in some open source media players, encoders, decoders (GRM Demo)
  • Multi-View Decoding
    • JMVM Decoder: Slow
    • Modified JM Decoder: Implemented but still slow
    • Modified FFMPEG Decoder:under development

Multi-View Streaming

network overview
Network Overview
  • Standards-based streaming system
  • Session announcement and initiation: SDP
  • Control of Streaming: RTSP
  • Streaming of media: RTP

Multi-View Streaming

sdp session description protocol basics
SDP (Session Description Protocol) Basics
  • Session Description Protocol
  • Provides information to initiate RTP streaming
  • SDP Announcement lists all sessions available at the server
  • Each session consists of several media-level sections (audio, video, application…)
  • Media-level sections can be extended with new attributes for future formats

Multi-View Streaming

sdp for mvv
SDP for MVV
  • A Session for a whole MVV representation
  • N video media-level sections for N-view MVV
  • Client can request and play media-level sections independently
  • Each view is streamed to a different port on the client over RTP
  • Only streams for key-views (Intra Coded) are independently decodable.
  • Dependencies between streams are announced through a new extended media-level attribute

Multi-View Streaming

new sdp parameters
New SDP Parameters
  • The new x-reflist attribute is used to denote the immediate dependencies of a stream.
    • a:x-reflist=96 97
  • The dependencies are given in a space separated list
  • The numbers correspond to rtpmap attributes of the reference streams, which are RTP payload types and are dynamically assigned for H.264/AVC streams
  • The client should go through the reference list recursively.

Multi-View Streaming

mvv over rtp real time protocol
MVV over RTP (Real Time Protocol)
  • RFC 3984 is standard for H.264 streaming
  • MVC bit stream is “almost” H.264 compliant
    • Can be streamed in accordance with RFC 3984
  • What about 2-D clients or clients with various 3-D display systems?
  • RFC 3984 is extended to allow flexibility
    • Each view is handled as a separate H.264 Stream
    • Views synchronized using RTP Timestamps
    • Clients request streams according to their capabilities
    • Varying levels of error protection can be applied to different streams

Multi-View Streaming

on going work
On-going work
  • Server support for accurate seeking
  • Support for selective streaming
  • Real-Time decoding of MVC
  • Visits of partners from KU and METU to TUB in August 2007
  • Code will be submitted to 3DTV repository
  • SDP extensions and RTP Payload format for MVC may be candidates for IETF standardization

Multi-View Streaming

thank you
Thank you.
  • Question, suggestions, comments?

Multi-View Streaming

ad