1 / 37

An Empirical Study of RealVideo Performance Across the Internet

An Empirical Study of RealVideo Performance Across the Internet. Yubing Wang, Mark Claypool and Zheng Zuo http://perform.wpi.edu/real-tracer. Introduction. Streaming Audio and Video is growing Traditional Internet studies, but …. video is different Bandwidth and response time not enough

amos-martin
Download Presentation

An Empirical Study of RealVideo Performance Across the Internet

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. An Empirical Study of RealVideo Performance Across the Internet Yubing Wang, Mark Claypool and Zheng Zuo http://perform.wpi.edu/real-tracer

  2. Introduction • Streaming Audio and Video is growing • Traditional Internet studies, but …. video is different • Bandwidth and response time not enough • Care about smooth rate • Packet loss rate alone is not enough • Often use repair techniques • RealVideo is big [Jup01] • RealPlayer, MediaPlayer, QuickTime Measure RealVideo on Internet SIGCOMM Internet Measurement Workshop

  3. Outline • Introduction • RealVideo • Methodology • Results • Analysis • Conclusions SIGCOMM Internet Measurement Workshop

  4. RTSP Server Data: TCP or UDP RealVideo Network Characteristics • Buffering • SureStream • Scalable Video Technology • Repair SIGCOMM Internet Measurement Workshop

  5. Outline • Introduction • RealVideo • Methodology • Results • Analysis • Conclusions SIGCOMM Internet Measurement Workshop

  6. Methodology • Build customized RealVideo player (RealTracer) • Uses RealPlayer core • Software Development Kit (SDK) • Records performance stats: frame rate, jitter …. • Select diverse set of RealVideo servers and videos • Solicit volunteers to run RealTracer • Many users to Many servers • Friends, colleagues outside of Mass., U.S. • rec.video newsgroup and end2end mailing list • 2 weeks in June 2001 • Analyze results SIGCOMM Internet Measurement Workshop

  7. Outline • Introduction • RealVideo • Methodology • Results • Analysis • Conclusions SIGCOMM Internet Measurement Workshop

  8. Results • 11 servers in 8 countries • 63 users in 12 countries • 2855 video clips played • 388 video clips watched and rated • 10% chance clip unavailable SIGCOMM Internet Measurement Workshop

  9. Geographic Location of Servers and Clients SIGCOMM Internet Measurement Workshop

  10. Clips Played per User SIGCOMM Internet Measurement Workshop

  11. Clips Served per Country SIGCOMM Internet Measurement Workshop

  12. Clips Played per Country SIGCOMM Internet Measurement Workshop

  13. Clips Played per State SIGCOMM Internet Measurement Workshop

  14. Outline • Introduction • RealVideo • Methodology • Results • Analysis • Frame Rate • Jitter • Perceived Quality • Conclusions SIGCOMM Internet Measurement Workshop

  15. Frame Rate • Basic video performance unit • frames per second (fps) • Guidelines [Rea00a]: • 24-30 fps: full-motion video • 15 fps: full-motion video approximation • 7 fps: choppy • 3 fps: very choppy • Less than 3 fps: slide show SIGCOMM Internet Measurement Workshop

  16. Overall Frame Rate SIGCOMM Internet Measurement Workshop

  17. Frame Rate vs. Network Configuration Modem: 19% (550) DSL/Cable: 30% (874) T1/LAN: 51% (1468) SIGCOMM Internet Measurement Workshop

  18. Bandwidth vs. Network Configuration SIGCOMM Internet Measurement Workshop

  19. Frame Rate vs. Transport Protocol SIGCOMM Internet Measurement Workshop

  20. Bandwidth vs. Transport Protocol SIGCOMM Internet Measurement Workshop

  21. Frame Rate vs. Server Geographic Location Asia: 344 Brazil: 297 US/Canada: 1201 Australia: 294 Europe: 656 SIGCOMM Internet Measurement Workshop

  22. Frame Rate vs. User Geographic Location SIGCOMM Internet Measurement Workshop

  23. Frame Rate vs. PC Type SIGCOMM Internet Measurement Workshop

  24. Outline • Introduction • RealVideo • Methodology • Results • Analysis • Frame Rate • Jitter • Perceived Quality • Conclusions SIGCOMM Internet Measurement Workshop

  25. Jitter • Frame rate alone not enough • Also need smooth playout • High frame rate but choppy playout can be as bad as frame loss [CT99] • Variation in frame playout interval called jitter • Standard deviation • Buffering can reduce jitter [RKTS94, SJ95] • But can still have residual jitter • Quantitative impact of residual jitter on perceived quality scarce • 50 ms imperceptible, 300 ms very rough SIGCOMM Internet Measurement Workshop

  26. Overall Jitter SIGCOMM Internet Measurement Workshop

  27. Jitter vs. Network Configuration SIGCOMM Internet Measurement Workshop

  28. Jitter vs. Server Geographic Location SIGCOMM Internet Measurement Workshop

  29. Jitter vs. User Geographic Location SIGCOMM Internet Measurement Workshop

  30. Jitter vs. Observed Bandwidth SIGCOMM Internet Measurement Workshop

  31. Outline • Introduction • RealVideo • Methodology • Results • Analysis • Frame Rate • Jitter • Perceived Quality • Conclusions SIGCOMM Internet Measurement Workshop

  32. Perceived Quality • Frame Rate and Jitter not enough • Best frame rate depends upon content [TC01] • RealServer varies • Effects of jitter depend upon content [CT99] • Perceptual Quality • Numeric rating, 0-10 SIGCOMM Internet Measurement Workshop

  33. Clips Rated per User (388 video clips rated) SIGCOMM Internet Measurement Workshop

  34. Quality vs. Network Configuration SIGCOMM Internet Measurement Workshop

  35. Conclusions • Average RealVideo clip has good quality • 10 frames per second • Nearly imperceptible jitter • Network configuration • Modems are a bottleneck • DSL/Cable modems pushing bottleneck towards server SIGCOMM Internet Measurement Workshop

  36. Future Work • RealVideo over UDP TCP-Compatible? • Perceptual quality of streaming video • Other streaming players and protocols • MediaPlayer, QuickTime • Effects of caching, CDNs • Release of customizable RealTracer • Download IP addresses, Playlist, RealTracer • From Web page SIGCOMM Internet Measurement Workshop

  37. An Empirical Study of RealVideo Performance Across the Internet Yubing Wang, Mark Claypool and Zheng Zuo http://perform.wpi.edu/real-tracer

More Related