1 / 24

Videos

Videos. Mei-Chen Yeh. Outline. Video representation Basic video compression concepts Motion estimation and compensation. Some slides are modified from Prof. Chu’s slides. Videos. A natural video stream is continuous in both spatial and temporal domains.

gaurav
Download Presentation

Videos

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Videos Mei-Chen Yeh

  2. Outline • Video representation • Basic video compression concepts • Motion estimation and compensation Some slides are modified from Prof. Chu’s slides.

  3. Videos • A natural video stream is continuous in both spatialand temporal domains. • A digital video stream sample pixels in both domains.

  4. Video processing YCbCr YCbCr

  5. Video signal representation (1) • Composite color signal • R, G, B • Y, Cb, Cr • Why Y, Cb, Cr? • Backward compatibility (back-and-white to color TV) • The eye is less sensitive to changes of Cb and Cr components Luminance (Y) Chrominance (Cb + Cr)

  6. Video signal representation (2) • Y is the luma component and Cb and Cr are the blue and red chroma components. Y Cb Cr

  7. Sampling formats (1) 4:4:4 4:2:2 (DVB) 4:1:1 (DV) Slide from Dr. Ding

  8. Sampling formats (2) 4:2:0 (VCD, DVD)

  9. TV encoding system (1) • PAL • Phase Alternating Line, is a color encoding system used in broadcast television systems in large parts of the world. • SECAM • (French: SéquentialCouleur Avec Mémoire), is an analog color television system first used in France. • NTSC • National Television System Committee, is the analog television system used in most of North America, South America, Burma, South Korea, Taiwan, Japan, Philippines, and some Pacific island nations and territories.

  10. TV encoding system (2)

  11. Other frame formats • QCIF (176x144) • Quarter Common Interchange Format • CIF (352x288) • Common Interchange Format

  12. Uncompressed bitrate of videos Slide from Dr. Chang

  13. Outline • Video representation • Basic video compression concepts • Motion estimation and compensation

  14. Video compression • A video is a sequence of correlated frames. • Compression: remove redundancy • Make use of the temporal correlation! • The previous reconstructed frame is used to generate a prediction for the current frame.

  15. Video compression • Intra coding: Compress one frame without referring to other frames • Each pixel has to be compressed • DCT → Quantization → Entropy coding • Inter coding: Compress one frame depending on the previously encoded frame • Only compress moving objects and new objects • Background can be ignored ~ Image compression

  16. Example 1 2 3 4 • Compress and in frame 1. • Compress the motion of in remaining frames. • Direction and magnitude Slide from VC Lab

  17. Motion compensation (1) Objects tend to move between frames Slide from Prof. Bernd Girod

  18. Motion compensation (2) search area • Block-based motion compensation • Divide a frame into blocks • Search the previous reconstructed frame for the most matching block • Motion vector: the offsets between block locations

  19. Motion compensation: Example Slide from Prof. Bernd Girod

  20. Motion-compensated decoder Residual IDCT Reconstructed frame VLD Coded Bitstream MV Motion Compensation Previous Frame memory Slide from VC Lab

  21. Motion-compensated encoder Residuals DCT + Q iDCT + iQ Motion Compensated Predictor Previous Frame Buffer MV = (dx, dy) Slide from VC Lab

  22. Three types of coded picture • I frame (Intraframe) • Encoded without any temporal prediction • P frame (Forward Predicted Frame) • Encoded using motion prediction from the previous I or P frame • B frame (Bidirectionally Predicted Frame) • Encoded using interpolated motion prediction between the previous I or P frames and the next I or P frames

  23. Example: A typical Group of Picture (GOP) in MPEG-2

  24. Summary • Video compression concepts • Cb, Cr sampling • Motion compensation and estimation • The encoder mimics the behavior of the decoder • Unbalanced computing: searching for a good prediction can be time consuming • GOP structure

More Related