1 / 33

Concealment of Whole-Picture Loss in Hierarchical B-Picture Scalable Video Coding

Concealment of Whole-Picture Loss in Hierarchical B-Picture Scalable Video Coding. IEEE TRANSACTIONS ON MULTIMEDIA, VOL. 11, NO. 1, JANUARY 2009 Xiangyang Ji , Debin Zhao, and Wen Gao. Outline. Introduction Proposed Error Concealment Strategy Experimental Results Conclusion.

tymon
Download Presentation

Concealment of Whole-Picture Loss in Hierarchical B-Picture Scalable Video Coding

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Concealment of Whole-Picture Loss in Hierarchical B-Picture Scalable Video Coding IEEE TRANSACTIONS ON MULTIMEDIA, VOL. 11, NO. 1, JANUARY 2009 XiangyangJi, Debin Zhao, and Wen Gao

  2. Outline • Introduction • Proposed Error Concealment Strategy • Experimental Results • Conclusion

  3. Introduction • Error concealment(EC) algorithm • a post-processing tool at decoder • conceal the erroneous region due to transmission errors according to the correctly received information. • Temporal error concealment is one of the most important approaches to combat transmission errors. • temporal replacement (TR) [3]: each damaged macroblock is directly replaced by the co-located one in the temporally previous picture with zero motion. [3] J. W. Suh and Y. S. Hu, “Error concealment based on directional interpolation,” IEEE Trans. Consumer Electron., vol. 43, no. 3, pp. 295–302, Aug. 1997.

  4. Introduction • TR can be improved by a boundary matching algorithm (BMA) [4]. • a suitable motion vector for a damage MB can be selected from the candidates based on side match distortion measure. • This paper not apply BMA due to the high computational estimation. [4] W. M. Lam, A. R. Reibman, and B. Liu, “Recovery of lost or erroneously received motion vectors,” in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Process., Apr. 1993, vol. 5, pp. 417–420.

  5. Introduction • To conceal the damaged MB, its neighboring MBs need to be correctly received. • split the current MB and its neighboring MBs into different slices. • one slice data typically fits one packet. • Flexible MacroblockOrdering(FMO) • But, FMO is only supported for Baseline and Extended Profiles NOTfor Main Profile and High Profile in H.264/AVC and SVC.

  6. Purpose • Tackle the whole-picture loss problem. • The advantage of the temporal relationship can be taken when hierarchical B-picture coding is used to support temporal scalability.

  7. Proposed Strategy • Take the temporal relationship among the adjacent video pictures into account. • The motion information of the lost picture is derived simply and efficiently based on the principle of temporal direct mode (TDM).

  8. Proposed Strategy • The MV of the damaged MB can be derived from the MVs of the co-located MBs. • temporally neighboring left and/or right B-pictures at next higher temporal level. • This method could also be used to conceal lost key picture as a P-picture.

  9. Outline • Introduction • Proposed Error Concealment Strategy • Hierarchical B-Picture Coding • Motion Parameters Recovery Based on the Enhanced TDM (ETDM_EC) • Further Improvement on Motion Parameters Recovery (WTDM_EC) • Experimental Results • Conclusion

  10. Hierarchical B-Picture Coding

  11. B-Picture Prediction (1/2) • A B-picture allows two prediction blocks from List 0 and List 1 reference buffers which contain an arbitrary set of reference pictures in forward and/or backward directions [16]. • At encoder, its motion-compensated prediction signal can be obtained by [16] A. M. Tourapis, F.Wu, and S. Li, “Direct mode coding for bipredictive slices in the H.264 standard,” IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 1, pp. 119–126, Jan. 2005.

  12. B-Picture Prediction (2/2) • At decoder, for a block Sin the lost picture , which is concealed as a B-picture, its prediction signal can be achieved by

  13. Motion Parameters Recovery Based on the Enhanced TDM (ETDM_EC) • In the case of the whole-picture loss, the motion vectors of each block have to be recovered based on the temporal motion correlation. • Assume motion among the adjacent pictures is translational, the motion vector of the block in the lost B-picture can be estimated based on Temporal Direct Mode (TDM), as proposed in [17]. [17] Y. Chen, J. Boyce, and K. Xie, “Frame loss error concealment for SVC,” Joint Video Team(JVT), Doc. JVT-Q046, Oct. 2005.

  14. Temporal Direct Mode (TDM) (1/2) • of the co-located block in point to the temporally most recent List 0 picture. (4)

  15. Temporal Direct Mode (TDM) (2/2) • of the co-located block in does not point to the temporally most recent List 0 picture. (5)

  16. TDM- Cases • If the picture pointed by or of the co-located block in the corresponding or picture, can not be accessed. (4) (5)

  17. Enhanced TDM Error Concealment

  18. Further Improvement on Motion Parameters Recovery (WTDM_EC) • For a lost B-picture which is not at the highest temporal level. • the temporal motion relationship tends to considerably weaken as the temporal distances become longer. • If the key picture is lost and recovered as a P-picture, the motion vectors of its block usually can not be derived based on TDM.

  19. Further Improvement on Motion Parameters Recovery (WTDM_EC)

  20. Further Improvement on Motion Parameters Recovery (WTDM_EC) (6) (7)

  21. Further Improvement on Motion Parameters Recovery (WTDM_EC)

  22. Outline • Introduction • Proposed Error Concealment Strategy • Experimental Results • Conclusion

  23. Experimental Parameters • H.264/AVC SVC reference software: JSVM_8_6. • Test sequences: Mobile, Stefan, Foreman, Bus, Tempete and Coastguard. • Group of Pictures: 16. • Frame rate: 30 Hz. • Frame size: 352 X 288 CIF. • I-picture is inserted for every 32 pictures. • Quantization parameters for highest temporal level are composed of 28, 32, 36 and 40. • Four packet loss patterns with average packet loss rates of 3%, 5%, 10%, and 20%

  24. Rate Distortion Curves (1/2)

  25. Rate Distortion Curves (2/2)

  26. Quality Gain of Proposed Strategy

  27. Mobile (1/5) • 195th frame, temporal level 4 Anchor_EC Proposed Strategy Correct

  28. Mobile (2/5) • 230th frame , temporal level 3 ETDM_EC Anchor_EC WTDM_EC Correct

  29. Mobile (3/5) • 156thframe , temporal level 2 ETDM_EC Anchor_EC WTDM_EC Correct

  30. Mobile (4/5) • 104thframe , temporal level 1 Anchor_EC & ETDM_EC WTDM_EC Correct

  31. Mobile (5/5) • 256th key frame Anchor_EC & ETDM_EC WTDM_EC Correct

  32. Outline • Introduction • Proposed Error Concealment Strategy • Experimental Results • Conclusion

  33. Conclusion • The proposed algorithm derive the motion vector of the damaged block in the lost picture by utilizing the motion information in the temporally neighboring. • The proposed method also can be easily extended to the slice loss case with the error resilient tool like FMO. • The further improvement on motion parameters recovery perhaps introduce an extra delay for video decoding within one GOP.

More Related