Proposal to study objective quality assessment of 4K resolution video in the future VQEG tests

Osamu SugimotoKDDI R&D Laboratories, Inc.

Backgrounds4K video equipment in consumer market

MonitorToshiba began selling consumer grade 4K TV set in 2011. It supports input of QFHD video signal (3980x2160@60p; without super-resolution) with external 4xHDMI input box.Sony announced to launch their first consumer grade 4KTV set in the near future.

Playback DeviceSome Graphics boards (e.g. AMD FirePro ) have four 1080p outputs and can display 4K/60p resolution on PC.

Storage and CompressionBDXL: Extended specification of Blu-ray

Supports 100 and 128GB per one diskHEVC video coding

Better coding efficiency than that of H.264

External QFHD Adapter(~2000USD)

Toshiba 4K2K TV set; (~7000USD)

4K Graphics Board (~1200USD)4K video will be more popular and industry needs will also increase in the near future

Proposal

VQEG should include quality assessment of 4K video into the scope of future VQEG tests.

Subjective test methodologies for large display/screen (50-100inches)Objective metrics for quality degradation due to compression coding and transmission

SRC definition4K DCI for digital cinema (4096x2160@24fps, progressive)4K-QFHD for broadcasting applications (3840x2160@24,25,30,50,60fps, progressive)

HRC to be consideredH.264HEVCIntra coding for digital cinema (e.g. JPEG2000) ?

SRC Availability

NICT 4K/3D contentsFormat: 3840x2160@60fps. NTT introduces guidelines to use this test material.ftp://vqeg.its.bldrdoc.gov/Documents/VQEG_Seoul_Jun11/MeetingFiles/3DTV/VQEG_3DTV_2011_015_Distribution of 3D standard contents.doc

SVT High Definition Multi Format Test SetFormat: 3840x2160@50fps. You can download them from the VQEG ftp server. ftp://vqeg.its.bldrdoc.gov/HDTV/SVT_MultiFormat/2160p50_CgrLevels_Master_SVTdec05For details, see the following documents.http://svt.se/content/1/c8/02/02/85/31/svt_multiformat_v10.pdf

DCI/STeMMaximum resolution of the test sequence is 4096x1714. You need to sign the user agreement. http://www.dcimovies.com/StEM

Subjective test of 4K+HEVC

Test method: DSCQSViewing Conditions

Display: professional 4K projector (JVC)Screen size: approx. 190inchesViewing Distance: 1.5H (H=screen height)

Number of subjects: 24Test materials

14 sequences of 10 sec from KDDI’s own 4K footagesFormat: 3840x2160,30fps, progressive

Coding ConditionH.264(JM15.1): 8,16,32Mbps (IBBPBBPBBPBBPBB)Rate control enabled HEVC(HM6.1) : 4,8,16Mbps (IBBBBBBBBBBBBBB)Fixed QP

Subjective test of 4K+HEVC

35% of all the HEVC PVSs have better DMOS than those coded by H.264 at twice bitrate.54% of all the HEVC PVSs have better (smaller) DMOS than those coded by H.264 at the same bitrate.

Seq01

04M

Seq03

04M

Seq04

04M

Seq06

04M

Seq09

04M

Seq10

04M

Seq12

04M

Seq16

04M

Seq19

04M

Seq21

04M

Seq23

04M

Seq24

04M

Seq26

04M

Seq27

04M

Seq01

08M

Seq03

08M

Seq04

08M

Seq06

08M

Seq09

08M

Seq10

08M

Seq12

08M

Seq16

08M

Seq19

08M

Seq21

08M

Seq23

08M

Seq24

08M

Seq26

08M

Seq27

08M

Seq01

16M

Seq03

16M

Seq04

16M

Seq06

16M

Seq09

16M

Seq10

16M

Seq12

16M

Seq16

16M

Seq19

16M

Seq21

16M

Seq23

16M

Seq24

16M

Seq26

16M

Seq27

16M-20.0

-10.0

0.0

10.0

20.0

30.0

40.0

50.0

HEVC

H.264

Sequence number and Coding Bitrate of HEVC PVSs

Diffe

renc

e M

OS

Conclusion

As 4K will possibly be a part of the mainstream of future video formats, VQEG should begin to study on quality assessment of 4K video.

The HDTV phase2 test seems to be a good opportunity of the first study, but the opportunity is not limited to that. Any other VQEG tests may include 4K into its scope.