1 / 22

NGI Summer Project

NGI Summer Project. Streaming Media Extensions to Open Mash and Indiva. Allan Gu. Multicast Backbone (Mbone). Multicast Distribution of IP packets to many hosts Many-to-many communication Mbone Tools NSDR VAT/RAT VIC. NSDR. SAP listener SAP announcer. VAT/RAT. Audio tool

kenton
Download Presentation

NGI Summer Project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NGI Summer Project Streaming Media Extensionsto Open Mash and Indiva Allan Gu

  2. Multicast Backbone(Mbone) • Multicast • Distribution of IP packets to many hosts • Many-to-many communication • Mbone Tools • NSDR • VAT/RAT • VIC

  3. NSDR • SAP listener • SAP announcer

  4. VAT/RAT • Audio tool • Participants talk to each other

  5. VIC • Viewer • Encoder

  6. OpenMash • Comprehensive toolkit • Collection of Mbone tools • Open source

  7. Problems • VIC displays useless stream • Save screen real estate • Save resources • Cache of multicast sessions • Web interface

  8. Blue Stream • Camera Off • Encoder encodes default blue

  9. Algorithm to RemoveBlue Stream • Check YUV frame • 5 blocks of 4 pixels • Compare Y, U, V with known color • Blue is (Y,U,V) = (35, 212, 114)

  10. Black Stream • Lights Off • Can’t compare • Different black • Error not black

  11. Algorithm to RemoveBlack Stream • Examine 20 blocks of 4 pixels each • Need more samples to detect • Count number of values within ranges • 4 BINS (3 Black, 1 Other) • Also compute average value of pixels • Black if satisfy certain condition • 50% of pixels is true black (Y<16, 120<U&V <136) • AvgY<28, 120<avgU&avgV<136

  12. Remove Stream • Drop packets from sender • Remove thumbnail • Callback to test stream later • Accept packet and check if still black or blue • If not black or blue, put back thumbnail • If still black or blue, register another callback

  13. Indiva: Middleware for Streaming Media Equipment and Resources • NFS metaphor • Application mounts a server and issues commands • High level commands • e.g., encode, move, copy, link, mkses, etc. • Bridge conventional audio/video environment and streaming media • Hide physical connections and control interfaces • Allocate paths through conventional routing switches • Allocate encoding/decoding resources in a broadcast center

  14. ISAP • Cache of active Mbone sessions • Clone of NSDR • Web interface • Run continuously • Well-known address for SAP • 224.2.127.254/9875 • A web-cast guide

  15. ISAP • Parse message according to IETF protocol • Execute indiva manager to create conference • Associate callback • After 30 minute, delete conference • Future – click link to participate in session

  16. Future Research • RTP a/v synchronization • A “time-based corrector” for RTP packet streams • Implement new Indiva services and applications • Ncast Telepresenter service • Webcast control apps • …

  17. Acknowledgement • NGI • Larry Rowe • Wei Tsang Ooi • Peter Pletcher • Jose Maria Gonzalez • …and the entire OpenMash community

  18. For More Information • http://www.openmash.org • http://www.bmrc.berkeley.edu/frame/projects/indiva/

More Related