scalable roi algorithm for h 264 svc based video streaming n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Scalable ROI Algorithm for H.264/SVC-Based Video Streaming PowerPoint Presentation
Download Presentation
Scalable ROI Algorithm for H.264/SVC-Based Video Streaming

Loading in 2 Seconds...

play fullscreen
1 / 39

Scalable ROI Algorithm for H.264/SVC-Based Video Streaming - PowerPoint PPT Presentation


  • 107 Views
  • Uploaded on

Scalable ROI Algorithm for H.264/SVC-Based Video Streaming. Jung-Hwan Lee and Chuck Yoo , Member, IEEE. Overviews. Introduction H.264/SVC Region of Interests System Architecture Experimental Results Conclusion. Introduction. Introduction. Why SVC? What is ROI?

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Scalable ROI Algorithm for H.264/SVC-Based Video Streaming' - tynice


Download Now An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
scalable roi algorithm for h 264 svc based video streaming

Scalable ROI Algorithm for H.264/SVC-Based Video Streaming

Jung-Hwan Lee and Chuck Yoo, Member, IEEE

overviews
Overviews

Introduction

H.264/SVC

Region of Interests

System Architecture

Experimental Results

Conclusion

introduction1
Introduction

Why SVC?

What is ROI?

How to combine SVC and ROI?

  • Using FGS for example
combine svc and roi
Combine SVC and ROI

Use real-time face-detection algorithms

introduction2
Introduction

The authors propose a scalable ROI algorithm, which can support fine-grained scalability in region of interests with low computing complexity.

h 264 svc1
H.264/SVC

H.264/SVC made adaptive bit rate control according to network condition and resolution control according to device capability possible.

h 264 svc enhancement
H.264/SVC Enhancement

Spatial

Temporal

SNR (Quality)

spatial enhancement
Spatial Enhancement

Reference : H.264 and MPEG-4 VIDEO COMPRESSION, Iain E.G. Richardson

temporal enhancement
Temporal Enhancement

Reference : Overview of The Scalable Video Coding Extension, SCHWARZ et al

quality enhancement
Quality Enhancement

The multilayer concept for quality scalable coding allows a few selected bit rates to be supported in a scalable bit stream.

quality enhancement cont
Quality Enhancement (cont.)

Base

layer

Encode coefficients

Texture

FDCT

Quant

Rescale

Encode each bitplane

Enhancement

layer

FigureFGS encoder block diagram (simplified)

slide18
Passive Setting of ROI

Active Setting of ROI

ROI
passive setting of roi
Passive Setting of ROI

The aim of ROI coding is to set a high resolution in ROI and low resolution in nonROI.

Methods of setting ROI

  • Passive setting of ROI
    • Define regions of interest beforehand
  • Active setting of ROI
    • Constantly change according to environment or contents
system architecture cont
System Architecture (cont.)

Two processes need to be defined beforehand.

  • H.264/SVC video file is encoded with the SNR enhancing MGS method.
  • QoE monitor is needed to regularly check the network status.

Through this process, the algorithm controls the enhancement layers and the range of ROIs.

method of structuring roi
Method of structuring ROI

Passive method of setting ROI is used in this study.

Center of the screen is set as ROI and areas far from the screen are non-ROIs.

FMO Box-Out method is applied and ROIs are divided into three stages (Slice Group) .

method of structuring roi cont
Method of structuring ROI (cont.)

After the steps mentioned, the scalable ROI layers are extracted in three different forms.

scalable roi algorithm
Scalable ROI algorithm

The scalable ROI algorithm is applied to the existing bit stream extractor functions.

Reference : JSVM 9_18 software manual

scalable roi algorithm cont
Scalable ROI algorithm (cont.)

As shown in Fig. 6, ROI algorithm extracted models needs the elements in Table below.

scalable roi algorithm cont1
Scalable ROI algorithm (cont.)

Bw() must (not) be more than the total sum of the basic layer, the layer without SR (Scalable ROI layer) application and the upper layer with SR application.

Basic layer.

The SNR level range that is not set as ROI.

Upper layers with SR application.

Enhanced layers set as ROI.

scalable roi algorithm cont2
Scalable ROI algorithm (cont.)

is the SNR dividing coefficient of selected layers, and has the maximum value of MGS division.

has a different value according to MGS quality in regions with SR application, calculated with eq(2),(3),(4)

Basic layer.

The SNR level range that is not set as ROI.

Upper layers with SR application.

Enhanced layers set as ROI.

scalable roi algorithm cont3
Scalable ROI algorithm (cont.)

(2) try to extract ROI from the overall screen. But ROI method cannot applied because the number of quality flags does not meet the minimum value for which video improvement is possible after extraction.

scalable roi algorithm cont4
Scalable ROI algorithm (cont.)

(3) is the case where the quality flags are applied most to the top layer of the overall screen. Since the layer with the highest quality flag value in the overall screen changes in quality flag number in layers according to the j value, this indicates that the size of the ROI screen changes.

scalable roi algorithm cont5
Scalable ROI algorithm (cont.)

(4) is when the quality flag value is half or more of the overall screen. The SR is applied differently to different screen sizes according to the size of the bandwidth and number of quality flags on the screen.

experiment environment
Experiment Environment

The JVSM version 9.13 is used.

experiment environment1
Experiment Environment

Figure shows PSNR between comparison between traditional and proposed methods.

Proposed method confirms ROI areas have higher PSNR than non-ROI areas.

conclusion1
Conclusion

Traditional CGS cannot provide high video quality when the network condition is unstable.

Proposed method support high subjective quality with FGS by applying ROI to H.264/SVC.