1 / 32

Fundamentals of Multimedia Chapter 16 Multimedia Network Communications and Applications

Fundamentals of Multimedia Chapter 16 Multimedia Network Communications and Applications. 건국대학교 인터넷미디어공학부 임 창 훈. Outline. 16.1 Quality of Multimedia Data Transmission 16.2 Multimedia over IP 16.3 Multimedia over ATM Networks (skip) 16.4 Transport of MPEG-4 16.5 Media-on-Demand.

Download Presentation

Fundamentals of Multimedia Chapter 16 Multimedia Network Communications and Applications

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Fundamentals of Multimedia Chapter 16 Multimedia Network Communicationsand Applications 건국대학교 인터넷미디어공학부 임 창 훈

  2. Outline 16.1 Quality of Multimedia Data Transmission 16.2 Multimedia over IP 16.3 Multimedia over ATM Networks (skip) 16.4 Transport of MPEG-4 16.5 Media-on-Demand 건국대학교 인터넷미디어공학부 임창훈

  3. Characteristics of Multimedia Data • Voluminous • They demand very high data rates, possibly hundreds of Mbps. • Real-time • They should be played in real-time. • They demand low delay and synchronization between audio and video for lip sync. 건국대학교 인터넷미디어공학부 임창훈

  4. Characteristics of Multimedia Data • Interactive • They demand low delay and synchronization between audio and video for lip sync. • Applications such as video conferencing and interactive multimedia require two-way traffic. • Sometimes bursty • Data rates fluctuate drastically. • No traffic most of the time but burst to high • volume in video-on-demand. 건국대학교 인터넷미디어공학부 임창훈

  5. 16.1 Quality of Multimedia Data Transmission • Quality of Service (QoS) depends on many parameters • Data rate: a measure of transmission speed. • Latency (maximum frame/packet delay): maximum time needed from transmission to reception. • Packet loss or error rate: a measure (in percentage) of error rate of the packetized data transmission. • Playback jitter: a measure of smoothness of the audio/video playback, related to the variance of frame/packet delays (jitter) • Sync skew: a measure of multimedia data synchronization. 건국대학교 인터넷미디어공학부 임창훈

  6. Playback jitter (a) High jitter (b) Low jitter 건국대학교 인터넷미디어공학부 임창훈

  7. Multimedia Service Classes • Real-Time: two-way traffic, low latency and jitter, possibly with prioritized delivery, e.g., voice telephony and video telephony. • Priority Data: two-way traffic, low loss and low latency, with prioritized delivery, e.g., E-commerce applications. • Silver: moderate latency and jitter, strict ordering and sync. One-way traffic, e.g., streaming video, or two-way traffic, e.g., Internet games. • Best Effort: no real-time requirement, e.g., downloading or transferring large files (movies). • Bronze: no guarantees for transmission. 건국대학교 인터넷미디어공학부 임창훈

  8. Requirements on network bandwidth / bit-rate 건국대학교 인터넷미디어공학부 임창훈

  9. Perceived QoS • QoS itself is a “collective effect of service performances that determine the degree of satisfaction of the user of that service". • In real-time multimedia: • Regularity is more important than latency • - Jitter and quality fluctuation are more annoying • than slightly longer waiting. • Temporal correctness is more important than the • sound and picture quality • - Ordering and synchronization of audio and video • are of primary importance. 건국대학교 인터넷미디어공학부 임창훈

  10. QoS for IP Protocols • IP is a best-effort communications technology - Hard to provide QoS over IP by current routing technology - Abundant bandwidth improves QoS, but unlikely to be • available everywhere over a complex networks. 건국대학교 인터넷미디어공학부 임창훈

  11. QoS for IP Protocols • DiffServ (Differentiated Service) uses DiffServ code to classify packets to enable their differentiated treatment. • - DiffServ code: Type of Service octet in IPv4 packet, • and Traffic Class octet (byte) in IPv6 packet • Widely deployed in intra-domain networks and • enterprise networks as it is simpler and scales well. • Emerging as the de-facto QoS technology 건국대학교 인터넷미디어공학부 임창훈

  12. Prioritized Delivery • Prioritization for types of media: - Transmission algorithms can provide prioritized delivery to different media • Prioritization for uncompressed audio: - PCM audio bitstreams can be broken into groups of every nth sample. 건국대학교 인터넷미디어공학부 임창훈

  13. Prioritized Delivery • Prioritization for JPEG image: - The different scans in Progressive JPEG and different resolutions in Hierarchical JPEG can be given different priorities. • Prioritization for compressed video: - Set priorities to minimize playback delay and jitter by giving highest priority to I-frames for their reception, and lowest priority to B-frames. - Unequal loss (error) protection for packet loss 건국대학교 인터넷미디어공학부 임창훈

  14. 16.2 Multimedia over IP • A broadcastmessage is sent to all nodes in the domain, a unicastmessage is sent to only one node, and a multicast message is sent to a set of specified nodes. • IP-Multicast: • Anonymous membership: the source host multicasts to one of the IP-multicast addresses. • Potential problem: too many packets will be • traveling and alive in the network • - Use time-to-live (TTL) in each IP packet. 건국대학교 인터넷미디어공학부 임창훈

  15. RTP (Real-time Transport Protocol) • Designed for the transport of real-time data such as audio and video streams: • Primarily intended for multicast. • Used in network video for MBone, Microsoft Netmeeting, and Intel Videophone. • Usually runs on top of UDP which provides efficient (but less reliable) connectionless datagram service: • RTP must create its own timestamping and • sequencingmechanisms to ensure the ordering. 건국대학교 인터넷미디어공학부 임창훈

  16. RTP (Real-time Transport Protocol) RTP packet header 건국대학교 인터넷미디어공학부 임창훈

  17. Additional Parameters in RTP Header • Payload Type: the media data type, encoding scheme. • - PCM, H.261/H.263, MPEG 1, 2, 4 audio/video. • Timestamp: - The instant when the first octet of the packet is sampled. • - Receiver can play the audio/video in proper timing • order and synchronize multiple streams. • Sequence Number: - Incremented by one for each RTP data packet sent. - Packets can be reconstructed in order by receiver. 건국대학교 인터넷미디어공학부 임창훈

  18. RTCP (Real Time Control Protocol) • A companion protocol of RTP: • Monitors QoS in providing feedback to the • server (sender). • Provides the necessary information for audio and • video synchronization. • RTP and RTCP packets are sent to the same IP address (multicast or unicast) but on different ports. 건국대학교 인터넷미디어공학부 임창훈

  19. Types of RTCP Packets 1. RR (Receiver Report) - to provide quality feedback (number of last packet received, number of lost packets, jitter, timestamps for calculating round-trip delays). 2. SR (Sender Report) - to provide information about the reception of RR, number of packets/bytes sent. 3. SDES (Source Description) - to provide information about the source (e-mail address, phone number). 건국대학교 인터넷미디어공학부 임창훈

  20. RTSP (Real Time Streaming Protocol) • Streaming Audio and Video: • - Audio and video data that are transmitted from • a stored media server to the client in a data stream • that is almost instantly decoded. • RTSP Protocol: for communication between a client and a stored media server 건국대학교 인터넷미디어공학부 임창훈

  21. RTSP (Real Time Streaming Protocol) • Requesting presentation description: the client issues a • DESCRIBE (GET) request to the Stored Media Server to obtain the presentation description. • 2. Session setup: the client issues a SETUP to inform the server of the destination IP address, port number, protocols, TTL. • 3. Requesting and receiving media: after receiving a PLAY, the server started to transmit streaming audio/video data using RTP. • 4. Session closure. 건국대학교 인터넷미디어공학부 임창훈

  22. Possible scenario of RTSP operations 건국대학교 인터넷미디어공학부 임창훈

  23. Internet Telephony • Main advantages of Internet telephony over POTS (Plain Old Telephone Service): • Uses packet-switching - network usage is much more efficient. • With the technologies of multicast or multipoint • communication, multi-party calls are not much more • difficult than two-party calls. • With advanced multimedia data compression • techniques, various degrees of QoS can be supported according to the network traffic. • Good graphics user interfaces can be developed. 건국대학교 인터넷미디어공학부 임창훈

  24. Internet Telephony • The transport of real-time audio (and video) in Internet telephony is supported by RTP • Control protocol is RTCP. • Streaming media is handled by RTSP. 건국대학교 인터넷미디어공학부 임창훈

  25. Network protocol structure for Internet telephony 건국대학교 인터넷미디어공학부 임창훈

  26. 16.4 Transport of MPEG-4 • Delivery Multimedia Integration Framework (DMIF) in MPEG-4: - An interface between multimedia applications and their transport. It supports: • Remote interactive network access • (IP, ATM, PSTN, ISDN, mobile). • 2. Broadcast media (cable or satellite). • 3. Local media on disks. 건국대학교 인터넷미디어공학부 임창훈

  27. 16.4 Transport of MPEG-4 • A single application can run on different transport layers as long as the right DMIF is instantiated. • Fig. shows the integration of delivery through three • types of communication mediums. • MPEG-4 over IP: MPEG-4 sessions can be carried over IP-based protocols such as RTP, RTSP, and HTTP. 건국대학교 인터넷미디어공학부 임창훈

  28. DMIF – delivery multimedia integration framework 건국대학교 인터넷미디어공학부 임창훈

  29. 16.5 Media-on-Demand (MOD) • Interactive TV (ITV) and Set-top Box (STB) • ITV supports activities such as: • 1. TV (basic, subscription, pay-per-view). • 2. Video-on-demand (VOD). • 3. Information services (news, weather, magazines, sports events, etc.). • 4. Interactive entertainment (Internet games, etc.). • 5. E-commerce (on-line shopping, stock trading). • 6. Access to digital libraries and educational materials. 건국대학교 인터넷미디어공학부 임창훈

  30. General architecture of STB (Set-top Box) 건국대학교 인터넷미디어공학부 임창훈

  31. Set-top Box (STB) • Network Interface and Communication Unit: • - Including tuner and demodulator, security devices, • and a communication channel. • 2. Processing Unit: • - Including CPU, memory, and special-purpose operating • system for STB. • 3. Audio/Video Unit: • - Including audio and video (MPEG-2 and 4) decoders, • DSP (Digital Signal Processor), buffers, • and D/A converters. 건국대학교 인터넷미디어공학부 임창훈

  32. Set-top Box (STB) 4. Graphics Unit: - Supporting real-time 3D graphics for animations and games. 5. Peripheral Control Unit: - Controllers for disks, audio and video I/O devices (e.g., digital video cameras), CD/DVD reader and writer, etc. 건국대학교 인터넷미디어공학부 임창훈

More Related