Decentralized media streaming
This presentation is the property of its rightful owner.
Sponsored Links
1 / 16

Decentralized Media Streaming PowerPoint PPT Presentation


  • 86 Views
  • Uploaded on
  • Presentation posted in: General

Decentralized Media Streaming. Jack Y. B. Lee Department of Information Engineering The Chinese University of Hong Kong. 1. Motivation. Current Media Streaming Systems Client-Server Architecture. 2. Challenges. Media Server Scalability Server Replication Parallel Server Architectures

Download Presentation

Decentralized Media Streaming

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Decentralized media streaming

Decentralized Media Streaming

Jack Y. B. Lee

Department of Information Engineering

The Chinese University of Hong Kong


1 motivation

1. Motivation

  • Current Media Streaming Systems

    • Client-Server Architecture

AoE Talk - Decentralized Media Streaming


2 challenges

2. Challenges

  • Media Server Scalability

    • Server Replication

    • Parallel Server Architectures

    • Media Proxy

    • Content Distribution Networks

  • Network Bandwidth Scalability

    • Distributed Media Proxies and Caches

    • Content Distribution Networks

    • Multicast Media Streaming

AoE Talk - Decentralized Media Streaming


3 decentralized architectures

3. Decentralized Architectures

  • Advances in the PC Industry

    • GHz Processors

    • 100’s GB Hard Drive

    • Broadband Internet Access

  • Why not eliminate the server all together?

    • Data are stored to end-user hosts

    • Hosts co-operatively serve one another

  • Benefits

    • No server -> lower cost

    • Inherently scalable

    • Localize network traffic

    • User driven; does not need a central service provider

AoE Talk - Decentralized Media Streaming


4 server less media streaming

4. Server-less Media Streaming

  • Goals

    • No central server, completely decentralized architecture

    • Scalable

    • Reliable

    • Invisible

    • Self-manageable

    • Self-adaptable

    • Deployable on the current Internet

AoE Talk - Decentralized Media Streaming


5 scalability and reliability

5. Scalability and Reliability

  • Distributed Data Storage

    • Replication

    • Host-level Striping

  • Fault Tolerance

    • Node failures are the norm rather than the exception

    • Requires capacity and data Redundancy

AoE Talk - Decentralized Media Streaming


6 invisibility

6. Invisibility

  • Interference with Host

    • CPU Utilization

    • Negligible CPU utilization.

    • No observable increase in CPU utilization when scaling up to more nodes.

AoE Talk - Decentralized Media Streaming


6 invisibility1

6. Invisibility

  • Interference with Host

    • Disk I/O Interference

      • Media streaming under 44MB/s interfering disk I/O process:

      • Mean transmission rate not affected.

      • Variance does increase but not significantly.

AoE Talk - Decentralized Media Streaming


7 self manageability

7. Self-Manageability

  • Dynamic System Reconfiguration

    • Data Reorganization (adding a new node)

      • Distribute data storage and workload

      • Example - Growing from 4 to 5 nodes:

n0

n1

n2

n3

n0

n1

n2

n3

n3

0

1

2

3

0

1

2

3

4

4

5

6

7

5

6

7

8

9

node n4 joins

8

9

10

11

10

11

12

13

14

12

13

14

15

15

16

17

18

19

16

17

18

19

AoE Talk - Decentralized Media Streaming


7 self manageability1

7. Self-Manageability

  • Dynamic System Reconfiguration

    • Data Reorganization (adding a new node)

      • Row-Permutated Data Reorganization

n0

n1

n2

n3

n0

n1

n2

n3

n4

0

1

3

2

4

0

1

3

2

4

9

8

7

5

6

7

5

6

node n4 joins

8

10

9

11

13

10

14

11

12

13

12

14

15

16

17

19

15

18

16

17

19

18

AoE Talk - Decentralized Media Streaming


7 self manageability2

7. Self-Manageability

  • Dynamic System Reconfiguration

    • Redundant Data Update (adding a new node)

AoE Talk - Decentralized Media Streaming


7 self manageability3

7. Self-Manageability

  • Dynamic System Reconfiguration

    • Redundant Data Update (adding a new node)

AoE Talk - Decentralized Media Streaming


7 self manageability4

7. Self-Manageability

  • Open Problems

    • Data re-organization and redundant data update when removing a node?

    • Batched update after adding/removing n nodes?

    • Scheduling of data movement during reorganization.

    • Load balance.

    • Interplay between streaming and reorganization.

    • Reorganization for other data placement policies?

    • Etc, etc.

AoE Talk - Decentralized Media Streaming


8 self adaptability

8. Self-Adaptability

  • Heterogeneity

    • Node and Network Heterogeneity

      • Different storage, streaming, and memory capacities.

      • Different delays between nodes.

  • Dynamic Adaptation

    • Node and Network Availability

      • Short-term streaming bandwidth variations.

      • Network congestions.

AoE Talk - Decentralized Media Streaming


9 practicality

9. Practicality

  • System Prototyping

    • Software prototype running on Windows

    • Installs as a system service, transparent to end users.

    • Supports streaming of MPEG1 video, soon MPEG4 as well.

    • Can sustain node failures using erasure correcting codes.

AoE Talk - Decentralized Media Streaming


Related publications

Related Publications

  • Jack Y. B. Lee and W. T. Leung, “Design and Analysis of a Fault-Tolerant Mechanism for a Server-Less Video-On-Demand System,” Proc. 2002 International Conference on Parallel and Distributed Systems, Taiwan, Dec 17-20, 2002, pp.489-494.

  • Jack Y. B. Lee and W. T. Leung, “Study of a Server-less Architecture for Video-on-Demand Applications,” Proc. IEEE International Conference on Multimedia and Expo., Lausanne, Switzerland, 26-29 August 2002, pp.233-236.

  • T. K. Ho and Jack Y. B. Lee, “A Row-Permutated Data Reorganization Algorithm for Server-less Video-on-Demand Systems,” Proc. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2003), Tokyo, Japan, May 12-15, 2003, pp.44-51.

  • T. K. Ho and Jack Y. B. Lee, “A Novel Redundant Data Update Algorithm for Fault-Tolerant Server-less Video-on-Demand Systems,” Proc. 2003 High Performance & Large Scale Computing (HP&LSC) Conference, Nottingham, UK, June 9-11, 2003, pp.378-384.

  • T. K. Ho and Jack Y. B. Lee, “A Transpositional Redundant Data Update Algorithm for Growing Server-less Video Streaming Systems,” Proc. IEEE Third International Conference on Peer-to-Peer Computing, 1-3 Sep 2003, Linköping, Sweden.

  • C. Y. Chan and Jack Y. B. Lee, “On Transmission Scheduling in a Server-less Video-on-Demand System,” Proc. International Conference on Parallel and Distributed Computing, Klagenfurt, Austria, August 26-29, 2003.

AoE Talk - Decentralized Media Streaming


  • Login