1 / 22

Low-cost Stereoscopic High-Definition Video over IP

20th APAN Meeting in Taipei: Network Research Workshop. Low-cost Stereoscopic High-Definition Video over IP. 23 th August 2005 Kiyoung Lee and JongWon Kim {kylee, jongwon}@netmedia.gist.ac.kr Networked Media Laboratory Dept. of Information & Communications

mikeconner
Download Presentation

Low-cost Stereoscopic High-Definition Video over IP

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 20th APAN Meeting in Taipei: Network Research Workshop Low-cost Stereoscopic High-Definition Video over IP 23th August 2005 Kiyoung Lee and JongWon Kim {kylee, jongwon}@netmedia.gist.ac.kr Networked Media Laboratory Dept. of Information & Communications Gwangju Institute of Science & Technology

  2. Outline • Introduction • Motivation • Related Work • Low-cost Stereoscopic High-Definition Video Transmission System • Sender System • Receiver System • Implementation Results • Conclusion and Future Works

  3. Motivation • True Stereo HD Camera System • High cost equipments • 3D cameras, HD encoders/decoder, HD-SDI interface boards • Factors- for reducing cost • Consumer HD video camcorders (JVC, SONY) • Software HD decoding • IP Networks delivery • Applications of stereo HD video • Tele-presence surgery • Tele-monitoring • Tele-robotics • Tele-education

  4. Related work • 3D HDTV broadcasting retry [2002, ETRI] • During 2002 FIFA World Cup Korea-Japan • 3DTV broadcasting subsystems • Compatible with the existing HDTV broadcasting infrastructure • 3D camera • Horizontally multiplexed in to a single standard video frame (side by side) • Hardware decoder, multiplexer, de-multiplexer • 3DTV live broadcasting [1998, Japan] • During Nagano Winter Gamers • Transmit left and right images separately through communication satellite • ATTEST, Europe IST project [2002] • Flexible, modular and open architecture • Compatibility to today’s 2-D digital TV • Scalability in terms of receiver complexity • Adaptability to a wide rage of different 2-D and 3-D display • Base layer and at least on additional enhancement layer

  5. Previous Real System [ETRI 2002]

  6. 실감방송연구센터 System Overview

  7. Sender • Video Acquisition • Capture two HD video streams • Multiplexing • Merge two video streams into one stream • Packetizing • Send multiplexed stream using RTP/UDP/IP

  8. Sender: Stereoscopic Video Acquisition • Stereoscopic camera configuration • Parallex axex • Toed-in • Capture from consumer HD video camera • Analog video • Digital compressed video

  9. Sender: Video Multiplexing • Stereoscopic multiplexing Scheme • TS level Re-multiplexing

  10. Synchronization issues • Utilize timing information in each layer • RTP (time stamp), TS (PCR), PES (PTS, DTS)

  11. Sender : RTP based Real-time Transport • PCR (program clock reference) • 33bits time values • Linear calculation between two PCRs • Only one TS stream • Double bit rate compare to one TS stream Modification VideoLAN Server(VLS) • IEEE1394 live input • TS level muxing • Handing PCR Stereo Module

  12. Receiver • Socket receiving • Detecting RTP/UDP/IP packet • De-multiplexing • Separate the left and right videos • Decoding • Parallel decoding • Display • Decoded pictures are merged according to a proper 3D display device

  13. Receiver: Receiving and De-multiplexing • Packet receiving • After receiving 6 TS packets, one TS(188byte) packet is analyzed orderly • De-multiplexing

  14. Receiver: Decoding and Display • Parallel decoding • Two video decoding threads • 3D display • Subfields and side fields (current version)

  15. Implementation: Sender and Receiver system

  16. Implementation: Stereo HD Video Cameras

  17. Implementation: Capture from IEEE1394 • Consumer IEEE1394 device use 63 for isochronous channel • Changing a channel from one camera to 62 using libiec61883 • libiec61883 • Implementation IEC61883 • IEC61883:Consumer audio/video equipment-Digital interface

  18. Implementation: Receiver • VideoLAN Client (VLC) input • Select module • Access • Input • Demux • Decoding

  19. Implementation Results Received stereoscopic HD video Network bandwidth at the receiver

  20. Comparison with previous system

  21. Conclusion and Future work • Implementation for High-Definition stereoscopic video system • Provide users with more high quality immersive video • Software-based flexible system • Future work • Synchronization between two cameras • Using timing information in RTP, PCR, DTS, and PTS • Multiview expansion • It can be upgraded for panoramic view • Stereo camera upgrade • From JVC to SONY

  22. Thank You… Question ?

More Related