Topics in Signal ProcessingProject Proposal

Sujatha Gopalakrishnan

1001024145

Basic Acronyms

• HEVC- High Efficiency Video Coding• TU- Transform Unit• PU- Prediction Unit• CU- Coding Unit• JCT-VC - Joint Collaborative Team on Video Coding• Tmuc – Test Model under Consideration• HM- HEVC Test Model • DCT- Discrete Cosine Transform• MC- Motion Compensation• SAO- Sample Adaptive Offset• ME- Motion estimation

HEVC

• High Efficiency Video Coding (HEVC) [1][2] is a Video Compression standard, a successor to H.264/MPEG-4 AVC [22]. HEVC is said to double the data compression ratio compared to H.264/MPEG-4 AVC [1] at the same level of video quality [2].

• The design of most video coding standards is primarily aimed at having the highest coding efficiency.

• The main goal of the HEVC standardization effort is to enable significantly improved compression performance relative to existing standards, in the range of 50% bit rate reduction for equal perceptual video quality [10] [11].

Block Diagram HEVC EncoderFigure 1: HEVC Encoder [2]

Block Diagram HEVC DecoderFigure 2: HEVC Decoder [3]

HEVC Lossless Coding • The lossless coding mode of HEVC main profile bypasses

transform quantization and in-loop filters as shown in the fig.2 [4] [19].

• Comparing it with non-lossless coding mode, it has smallest quantization parameter value.

• Lossless coding mode provides perfect fidelity and average bit rate reduction.

• Outperforms the existing lossless compression solution such as JPEG-2000 [22] and JPEG-LS [22].

• It employs Sample Angular based Intra Prediction(SAP) [4].

Block Diagram HEVC Lossless Coding Figure 3: HEVC lossless Algorithm Block Diagram [4]

Algorithm of Sample Based Angular Intra Prediction

• The SAP [4] is designed to better exploit the spatial redundancy in the lossless coding mode by generating intra prediction samples from adjacent neighbors. The design principle here is very similar to the sample-based DPCM in [21] [4] H.264/MPEG-4 AVC [20] [4] lossless coding, but SAP is fully harmonized with the HEVC block-based angular intra prediction, and can be applied to all the angular intra prediction modes specified in HEVC [4].

• As shown in the fig.7 SAP is performed sample by sample. The adjacent neighboring samples,  of the current sample   in the current PU are used for prediction.

SAP AlgorithmFigure 4: Algorithm of SAP [4]

Projected Enhancement in the Project

• Complete Study of HEVC Lossless Coding [4].

• Performance analysis of HEVC Lossless Mode using HM16.0 [18] software.

• Performance analysis of SAP [4] using HM16.0 [18] software.

References• [1] G.J. Sullivan et al, “Overview of the high efficiency video coding (HEVC)

standard”, IEEE Trans. CSVT, vol. 22, pp.1649-1668, Dec 2012.

• [2] G.J. Sullivan et al, “Standardized Extensions of High Efficiency Video

Coding (HEVC)”, IEEE Journal of selected topics in Signal Processing, vol.7, pp.1001-1016, Dec 2013.

 • [3] C. Fogg, “Suggested figures for the HEVC specification”, ITU-T/ISO/IEC

Joint Collaborative Team on Video Coding (JCT-VC) document JCTVC- J0292r1, July 2012.

• [4] M. Zhou et al, “HEVC lossless coding and improvements”, IEEE Trans. CSVT, vol.22, pp.1839-1843, Dec 2013.

• [5] N. Purnachand et al, "Fast Motion Estimation Algorithm for HEVC", IEEE Second International Conference on Consumer Electronics-Berlin (ICCE-Berlin), vol.11, pp.34-37, Sep 2012.

• [6] P. Hanhart et al, “ Subjective quality evaluation of the upcoming HEVC video compression standard”, SPIE Optical Engineering+ Applications. International Society for Optics and Photonics, vol. 8499, pp.84990v-84990v, Aug 2012.

• [7] M. Horowitz et al, “Informal subjective quality comparison of video compression performance of the HEVC and H.264/MPEG - 4 AVC standards for low delay applications”, SPIE Optical Engineering+ Applications. International Society for Optics and Photonics, vol.84990, pp.84990w-84990w, Aug 2012.

• [8] A. Abdelazim, W. Masri and B. Noaman, "Motion estimation optimization tools for the emerging high efficiency video coding (HEVC)", IS&T/SPIE Electronic Imaging. International Society for Optics and Photonics, vol. 9029, pp. 902905-902905, Feb 17.

• [9] M. Jakubowski and G. Pastuszak, “Block-based motion estimation algorithms-a survey”, Journal of Opto-Electronics Review, vol. 21, pp.86-102, Mar 2013.

• [10] B. Bross et al, “High Efficiency Video Coding (HEVC) Text Specification Draft 10”, Document JCTVC-L1003, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC), Jan. 2013, available on http://phenix.it-sudparis.eu/jct/doc_end_user/current_document.php?id=7243

• [11] J. Ascenso et al, "Improving Frame Interpolation with Spatial Motion Smoothing for Pixel Domain Distributed Video Coding", 5th EURASIP Conference on Speech and Image Processing, Multimedia Communications and Services, pp.1-6, Smolenice, Slovak Republic, July 2005. 

• [12] X. Wang et al, “Paralleling Variable Block Size Motion Estimation of HEVC on Multicore CPU plus GPU platform”, IEEE International Conference on Image Processing (ICIP), vol.22, pp. 1836-1839, Sep. 2013.

• [13] Introduction to parallel computing https://computing.llnl.gov/tutorials/parallel_comp/#Whatis

• [14] L. Zhao et al, “Group-Based Fast mode decision algorithm for intra prediction in HEVC”, IEEE Eighth international Conference on Signal Image Technology and Internet based Systems. Article no.6115979, pp. 225-229, Nov 2011.

• [15] V. Sze and M. Budagavi, "High Throughput CABAC Entropy Coding in HEVC", IEEE Transactions on Circuits and Systems for Video Technology, vol.22, no.12, pp.1778-1791, Dec 2012.

• [16] T.Nguyen et al, "Transform Coding Techniques in HEVC", IEEE Journal of Selected Topics in Signal Processing, vol.7, pp.978–989, Dec 2013.

• [17] HEVC tutorial by I.E.G. Richardson: http://www.vcodex.com/h265.html

• [18] HEVC Reference Software HM16.0. https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/tags/HM-16.0rc1/

• [19] B. Bross et al,“High Efficiency Video Coding (HEVC)Text Specification Draft 8”, JCT-VC document, JCTVC-J1003, Stockholm, Sweden, Jul. 2012.

http://phenix.it-sudparis.eu/jct/doc_end_user/current_document.php?id=6465

• [20] Joint Video Team, “Advanced Video Coding for Generic Audiovisual Services”, ITU-T Rec. H.264 and ISO/IEC, 14496-10 (MPEG-4) AVC, pp.H.100-H.869, Feb 2014.

• [21] Y.L. Lee et al, "Improved lossless intra coding for H.264/MPEG-4 AVC", IEEE Trans. Image Process., vol.15, no.9, pp.2610-2615, Sep 2006.

• [22]K.R. Rao, D.N Kim and J.J Hwang, “High Efficiency Video Coding (HEVC) Revised/Updated Chapter from the book Video Coding Standards”–Springer 2014.

• [23] ITU-T website: http://www.itu.int/ITU-T/index.html

• [24] JCT-VC documents are publicly available at http://ftp3.itu.ch/av-arch/jctvc-site and http://phenix.it-sudparis.eu/jct/

• [25] V.Sze, M. Budagavi, and G.J. Sullivan, “High Efficiency Video Coding (HEVC)” Springer, 2014.

• [26] Software reference manual for HM:

https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/branches/HM-9.2-dev/doc/software-manual.pdf

        

• [27] M. Wien, “High efficiency video coding: Tools and specification”, Springer, 2015.

• [28] I.E. Richardson, “Coding video: A practical guide to HEVC and beyond”, Wiley, 11 May 2015.

• [29] Video Sequences: http://ultravideo.cs.tut.fi/