Porting of Fast Intra Prediction in HM7.0 to HM9.2

1. Porting of Fast Intra Prediction in HM7.0 to HM9.2 SapnaVasudevan sapna.vasudevan@mavs.uta.edu 1000800184

2. High Efficiency Video Coding[1] • 50% more bitrate savings compared to H.264/AVC • HD and beyond HD video streaming & playback quality compared to H.264/AVC. • Efficient bandwidth utilization • New features like parallel processing • HM9.2 – latest HEVC version • HM 9.1 – Version on which fast intra prediction is to be ported • HM7.0 – Fast Intra prediction implemented

3. Fig 1:HEVC Encoder[2]

4. Fig 2: HEVC decoder [5]

5. Fig 3: Chroma Subsampling[6]

6. Fig 4:Formation of a CU. Adopted from [2]

7. Fig 5:Partitioning of a Macro block [2] CTB->CBs andTBs Solid lines indicate CB boundaries and dotted lines indicate TB boundaries Corresponding QUAD TREE

8. Fig 6: Adaptive angular Intra Prediction [2] Left: 33 modes;Right: Example of mode 29 intra prediction

9. Adaptive angular Intra Pediction contd.. • Rough Mode Decision (RMD) can be used to find the Most Probable Mode (MPM) and Rate Distortion Optimization (RDO) can be implemented on those modes. • Context Adaptive Binary Arithmetic Coding (CABAC) is used to encode the transformed residual. • Deblocking filter and Sample Adaptive Offset (SAO) filtering is used in the decoder loop and decoder side to smoothen out the effects of the processes.

10. Fast Intra prediction on HM6 proposed by Zhang and Ma [10] • 38% reduction in encoding time and 2.9% BD rate increase. • SATD determines the modes for RMD. • Progressive scanning • Early RDOQ termination Fig 7: Down sampling by averaging operator

11. Migration from HM7.0 to HM9.2 • Porting of fast Intra implemented on HM7.0 to HM9.2 is proposed. • Encoding time, bitrate, PSNR and QP are some of the metrics that can be compared. • In future, [11-18] proposed methods can be combined along with [10] to further reduce the complexity of intra prediction mode decision.

12. References • [1] B. Bross et al, “High efficiency video coding (HEVC) text specification draft 8”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 10th Meeting: Stockholm, SE, 11–20 July 2012 • [2] G. Sullivan et al, “Overview of the high efficiency video coding (HEVC) standard”, IEEE Transactions on Circuits and Systems for Video Technology, vol 22, n 12, pp 1649-1668, Dec. 2012 • [3] A. Luthra and P. Topiwala, “Overview of the H.264/AVC video coding standard”, Proceedings of SPIE - The International Society for Optical Engineering, vol 5203, pp 417-431, Applications of Digital Image Processing XXVI, 5-8 Aug. 2003 • [4] F. Bossen et al, "HEVC complexity and Implementation analysis", IEEE Transactions on Circuits and Systems for Video Technology, vol 22 , pp 1685-1696, Dec. 2012

13. References • [5] C. Fogg, “Suggested figures for the HEVC specification”, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC) document JCTVC- J0292r1, July 2012. • [6] Basics of video: http://lea.hamradio.si/~s51kq/V-BAS.HTM • [7] Y.H. Tan et al, “On residual quad-tree coding in HEVC”, MMSP 2011 - IEEE International Workshop on Multimedia Signal Processing, 17-19 Nov. 2011. • [8] A. Saxena and F.C. Fernandes, “ Mode dependent DCT/DST for intra prediction in block-based image/video coding”, Proceedings - International Conference on Image Processing, IEEE ICIP, pp 1685-1688, 11-14 Sept. 2011 • [9] V. Sze and M. Budagavi, “High throughput CABAC entropy coding in HEVC”, IEEE Transactions on Circuits and Systems for Video Technology, vol 22, n 12, pp 1778-1791, Dec. 2012

14. References • [10]HMX.X, HEVC code: http://hevc.kw.bbc.co.uk/svn/jctvc-a124/branches/ • [11] H. Zhang and Z. Ma, “Fast intra prediction for high efficiency video coding”,Advances in Multimedia Information Processing, 13th Pacific-Rim Conference on Multimedia, Proceedings, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol 7674 LNCS, pp 568-577, 4-6 Dec. 2012 • [12] A.S. Motra et al, “Fast intra mode decision for HEVC video encoder”, 2012 20th International Conference on Software, Telecommunications and Computer Networks, SoftCOM, 11-13 Sept. 2012 • [13] J. Kim et al, “Fast intra mode decision of HEVC based on hierarchical structure”, ICICS 2011 - 8th International Conference on Information, Communications and Signal Processing, 13-16 Dec. 2011

15. References • [14] K. Choi and E.S. Jang, “Early TU decision method for fast video encoding in high efficiency video coding”, IET, Electronic Letters, vol. 48, No. 12, pp 689-691, 7th June 2012 • [15] W. Jiang, H. Ma and Y. Chen, “Gradient based fast mode decision algorithm for intra prediction in HEVC”, 2nd International Conference on Consumer Electronics, Communications and Networks, pp 1836-1840, 21-23 April 2012 • [16] X. Shen, L. Yu and J. Chen, “Fast coding unit size selection for HEVC based on Bayesian decision rule”, 2012 Picture Coding Symposium, PCS 2012, Proceedings, pp 453-456, 7-9 May 2012 • [17] S.W. Teng, H.M. Hang and Y.F. Chen, “Fast mode decision algorithm for residual quadtree coding in HEVC”, Conference Article no.6116062, IEEE Visual Communications and Image Processing, 6-9 Nov. 2011

16. References • [18] J. Leng et al, “Content based hierarchical fast coding unit decision algorithm for HEVC”, International Conference on Multimedia and Signal Processing, vol 1, pp 56-59, 14-15 May 2011.

17. THANK YOU