1 · Web viewINTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC

INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N10698London, UK – July 2009

Source: Leonardo Chiariglione Title: Report of 89th meetingStatus

Report of 89th meeting..........................................................................................................................1Annex A – Attendance list.................................................................................................................11Annex B – Agenda.............................................................................................................................14Annex C – Input contributions...........................................................................................................16Annex D – Output documents............................................................................................................23Annex E – Requirements report.........................................................................................................23Annex F – Systems report..................................................................................................................23Annex G – Video report.....................................................................................................................46Annex H – Audio report.....................................................................................................................54Annex I – 3DG report.........................................................................................................................71

Report of 89th meeting

1 OpeningThe 89th MPEG Meeting has take place from 29th June to 3rd July 2009 at Queen Mary University of London.

2 Roll call of participantsAnnex 1 provides the list of participants

3 Approval of agendaThe agenda adopted is provided by Annex 2

4 Allocation of contributionsAnnex 3 provides the list of input documents

5 Communications from ConvenorThere was no specific communication

1

6 Report of previous meetingThis was approved

7 Processing of NB Position PapersPapers were presented and, where appropriate, responses provided.

8 Work plan management

8.1 Media coding

8.1.1 AAC family of profilesThe following document was approved

10828 WD2 on AAC Family of Profiles

8.1.2 HD-AAC ProfileThe following documents were approved

10823 DoC on ISO/IEC 14496-3:2009/FPDAM 1:200X HD-AAC Profile

10824 ISO/IEC 14496-3:2009/FDAM 1:200X HD-AAC Profile and MPEG Surround Signalling

8.1.3 ALS simple profileThe following documents were approved

10825 Request for Amendment, 14496-3:200x/PDAM 210826 ISO/IEC 14496-3:200x/PDAM 2, ALS Simple Profile and Transport of SAOC

8.1.4 Constrained Baseline Profile and Stereo High ProfileThe following documents were approved

10706 Disposition of Comments on ISO/IEC 14496-10:2009/FPDAM 110707 Text of ISO/IEC 14496-10:2009/FDAM 1

8.1.5 Scalable-complexity 3D mesh compressionThe following documents were approved

10734 DoC on ISO/IEC 14496-16:2006/PDAM 4 (Scalable Complexity 3D Mesh Compression)

10735 Text of ISO/IEC 14496-16:200X/FPDAM 1 (Scalable Complexity 3D Mesh Compression)

10736 Description of AFX CE

8.1.6 Media Value Chain OntologyThe following documents were approved

2

10767 DoC on ISO/IEC CD 21000-19 Media Value Chain Ontology10768 Text of ISO/IEC FCD 21000-19 Media Value Chain Ontology

8.1.7 Codec Configuration RepresentationThe following documents were approved

10717 RVC Work Plan10718 RVC Vision10719 RVC Tutorial

8.1.8 Video Tool LibraryThe following documents were approved

10713 Disposition of Comments on ISO/IEC 23002-4/PDAM110715 WD 5 of ISO/IEC 23002-4/Amd.2 (Tools for MPEG-2 MP, MPEG-4 ASP, AVC HP

and SVC)10716 Description of Core Experiments in RVC10717 RVC Work Plan10718 RVC Vision10719 RVC Tutorial

8.1.9 Spatial Audio Object CodingThe following documents were approved

10842 DoC on ISO/IEC FCD 23003-2:200x, Spatial Audio Object Coding10843 ISO/IEC FCD 23003-2:200x, Spatial Audio Object Coding10844 Workplan on SAOC10845 Draft Verification Test Plan for SAOC10846 WD on SAOC Profiles

8.1.10 Unified Speech and Audio CodingThe following documents were approved

10847 WD4 of USAC10848 Workplan for USAC CEs10869 Workplan on MPEG USAC Reference Encoder10849 Thoughts on Efficient Bitstream Syntax

8.1.11 Media Context and Control – Control InformationThe following documents were approved

10783 Text of ISO/IEC CD 23005-2 Control Information10784 WD 3.0 of ISO/IEC 23005-2 Control Information

3

8.1.12 Media Context and Control – Sensory InformationThe following document was approved

10785 Text of ISO/IEC CD 23005-3 Sensory Information

8.1.13 Media Context and Control – Avatar InformationThe following documents were approved

10786 Text of ISO/IEC CD 23005-4 Avatar Information10787 WD 3.0 of ISO/IEC 23005-4 Avatar Information

8.1.14 3D Video CodingThe following documents were approved

10857 Applications and Requirements for 3DV10720 Description of Exploration Experiments in 3D Video Coding

8.1.15 High-Performance Video CodingThe following documents were approved

10721

Results of Call for Evidence on High Performance Video Coding

10722

Draft Call for Proposals on High Performance Video Coding

8.2 Composition coding

8.2.1 BIFS for Interactive Digital RadioThe following documents were approved

10856 Requirements v4 for a new BIFS profile to support Interactive Digital Radio10751 Request for ISO/IEC 14496-11:2005/Amd. 7 ExtendedCore2D Profile10752 Text of ISO/IEC 14496-11:2005/PDAM 7 ExtendedCore2D Profile

8.2.2 LASeR AdaptationThe following documents were approved

10758 DoC on ISO/IEC 14496-20:2008 LASeR & SAF/FPDAM 2 Technology for scene adaptation

10759 Text of ISO/IEC 14496-20:2008 LASeR & SAF/FDAM 2 Technology for scene adaptation

8.2.3 Presentation and Modification of Structured InformationThe following document was approved

4

10760 Study of ISO/IEC 14496-20:2008 LASeR & SAF/FPDAM 3 PMSI

8.2.4 Advanced User InteractionThe following document was approved

10762 Ideas on ISO/IEC 14496-20:2000 LASeR & SAF AMD 4 Advanced User Interaction

8.3 Description coding

8.3.1 Video Signature DescriptorsThe following documents were approved

10708 Text of ISO/IEC 15938-3/PDAM 4 Video Signature Tools10709 MPEG-7 Visual XM 3610710 Description of Core Experiments in Video Signature Description development

8.3.2 Extraction and Matching of Image Signature ToolsThe following documents were approved

10836 DoC on ISO/IEC TR 15938-8:2002/DAM 4, Extraction of Audio Features from Compressed Formats

10837 ISO/IEC TR 15938-8:2002/AMD 4, Extraction of Audio Features from Compressed Formats

8.3.3 Metadata driven post processing of audio signalsThe following document was approved

10850 Draft Report on the Performance of MPEG-2 AAC Dynamic Range Control

8.4 Systems support

8.4.1 MPEG-4 Systems 4th editionThe following document was approved

10748 Draft Text of ISO/IEC 14496-1 4th Edition

8.4.2 Registration Authority and Systems supportThe following document was approved

10749 Text of ISO/IEC 14496-1:2004/PDAM4 Registration Authority and System Extensions

5

8.5 IPMP

8.5.1 Protection of Presentation ElementThe following document was approved

10766 Study of ISO/IEC 21000-4:2006/PDAM 2 Protection of Presentation element

8.6 Transport and File formats

8.6.1 SAOC transportThe following documents were approved

10825 Request for Amendment, 14496-3:200x/PDAM 210826 ISO/IEC 14496-3:200x/PDAM 2, ALS Simple Profile and Transport of SAOC

8.6.2 Carriage of MVC in MPEG-2 SystemsThe following documents were approved

10744 DoC on ISO/IEC 13818-1:2007/FPDAM4 Transport of MVC10745 Text of ISO/IEC 13818-1:2007/FDAM4 Transport of MVC10747 WD 1.0 of ISO/IEC 13818-1:2007 AMD 5 Carriage of JPEG2000 over MPEG-2 TS

8.6.3 Sub-track selection & switchingThe following document was approved

10754 WD of ISO/IEC 14496-12:2008/AMD 2 Sub-track selection & switching

8.6.4 Handling of MPEG-4 Audio enhancement layersThe following document was approved

10755 Text of ISO/IEC 14496-14:2003/FPDAM 1 Handling of MPEG-4 Audio enhancement layers

8.6.5 AVC File Format extensions for MVCThe following documents were approved

10756 DoC on ISO/IEC 14496-15:2004/FPDAM 3 File Format Support for MVC 10757 Text of ISO/IEC 14496-15:2004/FDAM 3 File Format Support for MVC

8.6.6 MPEG Media TransportThe following documents were approved

10853 Presentations of MMT Workshop in London 200910854 Draft use case and requirement on MMT

6

8.7 Multimedia architecture

8.7.1 Mesh codec for 3DGCMThe following documents were approved

10737 Request for AMD 1 ISO/IEC 14496-25:2008 No 09/07/03

10738 WD 1.0 of ISO/IEC 14496-25:2008/Amd.1 (Mesh codec for 3DGCM)

No 09/07/03

8.7.2 MXM generalThe following documents were approved

10790 DoC on Proposal for New Work Item10791 MXM License

10792 Guidelines for normative APIs compliant to MXM standard for future MPEG standards

10793 Presentation material of MXM Developer’s Day Workshop

8.7.3 MXM Architecture and TechnologiesThe following documents were approved

10794 DoC on ISO/IEC CD 23006-1 MxM Architecture and Technologies10795 Text ISO/IEC FCD 23006-1 MxM Architecture and Technologies

8.7.4 MXM APIThe following documents were approved

10796 DoC on ISO/IEC CD 23006-2 MXM APIs10797 Text of ISO/IEC FCD 23006-2 MXM APIs

8.7.5 MXM ProtocolsThe following documents were approved

10812 DoC on ISO/IEC CD 29116-1 2nd Edition MXM Protocols10813 Text of ISO/IEC FCD 23006-4 MXM Protocols

8.7.6 MPEG Rich Media UIThe following documents were approved

10814 Request for New Project10815 Text of ISO/IEC CD 23007-1 Widgets

7

8.7.7 Media Context and Control – ArchitectureThe following document was approved

10782 Text of ISO/IEC CD 23005-1 Architecture

8.7.8 Advanced IPTV TerminalThe following documents were approved

10858 Context and Objectives AIT10859 Use Cases for Advanced IPTV Terminal10860 Draft Requirements on Interfaces to Payment and Cashing Systems10861 Context and Objectives for Interfaces to Payment and Cashing Systems

8.8 Application formats

8.8.1 DMB AF Harmonization of MPEG-2 TS storagev

10769 DoC on ISO/IEC 23000-9:2008/PDAM2 DMB AF Harmonization on MPEG-2 TS storage

10770 Text of ISO/IEC 23000-9:2008/FPDAM2 DMB AF Harmonization on MPEG-2 TS storage

8.8.2 Stereoscopic Video AF composition typeThe following document was approved

10774 WD of ISO/IEC 23000-11/AMD 2 (composition type)

8.8.3 Interactive Music Application FormatThe following documents were approved

10775 DoC on ISO/IEC CD 23000-12 Interactive Music AF10776 Text of ISO/IEC FCD 23000-12 Interactive Music AF

8.9 Reference implementation

8.9.1 MVC Reference SoftwareThe following document was approved

10704 Study Text of ISO/IEC 14496-5:2001/FPDAM 15 Reference Software for Multiview Video Coding

8.9.2 SC3DMC Reference SoftwareThe following documents were approved

8

10732 Draft DoC on ISO/IEC 14496-5:2001/PDAM 27 (Scalable Complexity 3D Mesh Coding Reference Software)

10733 Study Text of ISO/IEC 14496-5:2001/PDAM 27 (Scalable Complexity 3D Mesh Coding Reference Software)

8.9.3 Scene Partitioning Reference SoftwareThe following document was approved

10731 Text of ISO/IEC 14496-5:2001/FDAM 25 (Scene Partitioning Reference Software)

8.9.4 MPEG Query Format Reference SoftwareThe following documents were approved

10763 Request for ISO/IEC 15938-12:2008 AMD 1 MPQF Conf. and Ref. SW10764 Text of ISO/IEC 15938-12:2008 PDAM 1 MPQF Conf. and Ref. SW

8.9.5 Stereoscopic video AF Reference SoftwareThe following document was approved

10772 Study of ISO/IEC 23000-11/PDAM 1 Stereoscopic Vide AF Ref. Soft and Conf.

8.9.6 Interactive Music AF Reference SoftwareThe following document was approved

10777 Workplan for the Interactive Music AF Conformance & Reference SW

8.9.7 Video Tool Library Reference SoftwareThe following document was approved

10714 Text of ISO/IEC 23002-4/FPDAM1 Video Tool Library Conformance and Reference Software

8.9.8 MXM Reference SoftwareThe following documents were approved

10798 DoC on ISO/IEC CD 23006-3 MXM Conf. & Ref. SW10799 Text of ISO/IEC FCD 23006-3 MXM Conf. & Ref. SW

8.9.9 MPEG Rich Media UI Reference SoftwareThe following document was approved

10816 WD of ISO/IEC 23007-2 Conformance and Reference Software

9

8.9.10 Media Context and Control – Reference SoftwareThe following document was approved

10788 WD of ISO/IEC 23005-5 Reference Software

8.10 Conformance

8.10.1 MPEG-4 Audio ConformanceThe following documents were approved

10829 DoC on ISO/IEC 14496-4:2004/DCOR 7, Removal of Audio and 3DG Conformance from ISO/IEC 14496-4:2004 and subsequent amendments and corrigenda

10830 ISO/IEC 14496-4:2004/Cor. 7, Removal of Audio and 3DG Conformance from ISO/IEC 14496-4:2004 and subsequent amendments and corrigenda

10833 DoC on ISO/IEC 14496-26:2009/FPDAM 1, AAC-ELD, OAFI additional AAC and MPEG-1/2 on MPEG-4 Conformance

10834 ISO/IEC 14496-26:2009/FDAM 1, AAC-ELD, OAFI additional AAC and MPEG-1/2 on MPEG-4 Conformance

10835 Study on ISO/IEC 14496-26:2009/PDAM 2, BSAC Conformance for Broadcasting

8.10.2 MVC ConformanceThe following document was approved

10703 Study Text of ISO/IEC 14496-4:2004/FPDAM 38 Multiview Video Coding Conformance Testing

8.10.3 File Format ConformanceThe following document was approved

10750 Text of ISO/IEC 14496-4:2004/FPDAM 37 Additional File Format Conformance

8.10.4 3DG ConformanceThe following documents were approved

10739 ISO/IEC 14496-27:2009/FDAM 1 (Conformance testing for scene partitioning)

10740 DoC on ISO/IEC 14496-27:200x/PDAM 2 (Scalable Complexity 3D Mesh Coding Conformance)

10741 Study Text of ISO/IEC 14496-27:200x/PDAM 2 (Scalable Complexity 3D Mesh Coding Conformance)

8.10.5 MPEG Query Format ConformanceThe following documents were approved

10763 Request for ISO/IEC 15938-12:2008 AMD 1 MPQF Conf. and Ref. SW10764 Text of ISO/IEC 15938-12:2008 PDAM 1 MPQF Conf. and Ref. SW

10

8.10.6 Photo Player AF ConformanceThe following documents were approved

10711 Disposition of Comments on ISO/IEC 23000-3/PDAM 210712 Text of ISO/IEC 23000-3/FPDAM 2 Conformance Testing for Photo Player MAF

8.10.7 Stereoscopic video AF ConformanceThe following document was approved


8.10.8 Interactive Music AF ConformanceThe following document was approved

10777 Workplan for the Interactive Music AF Conformance & Reference SW

8.10.9 Video Tool Library ConformanceThe following document was approved

10714 Text of ISO/IEC 23002-4/FPDAM1 Video Tool Library Conformance and Reference Software

8.10.10 MXM ConformanceThe following documents were approved

10798 DoC on ISO/IEC CD 23006-3 MXM Conf. & Ref. SW10799 Text of ISO/IEC FCD 23006-3 MXM Conf. & Ref. SW

8.10.11 MPEG Rich Media UI ConformanceThe following document was approved

10816 WD of ISO/IEC 23007-2 Conformance and Reference Software

8.10.12 Media Context and Control – ConformanceThe following document was approved

10789 WD of ISO/IEC 23005-6 Conformance Testing

11

8.11 Maintenance

8.11.1 Systems coding standardsThe following documents were approved

10746 Text of ISO/IEC 13818-1:2007 DCOR 310753 Text of ISO/IEC 14496-12:2008/COR 3 Minor Corrections to ISO FF

8.11.2 Video coding standardsThe following document was approved

10705 Text of ISO/IEC 14496-10:2009/DCOR 1

8.11.3 Audio coding standardsThe following documents were approved

10827 Study on ISO/IEC 14496-3:200X/DCOR 110831 DoC on ISO/IEC 14496-26:2009/DCOR 1, ALS and SLS updates10832 ISO/IEC 14496-26:2009/Cor. 1, ALS and SLS updates10838 DoC on ISO/IEC 23003-1:2007/DCOR 2, Misc. Corrections10839 ISO/IEC 23003-1:2007/Cor. 2, Misc. Corrections10840 DoC on ISO/IEC 23003-1:2007/AMD 2:2008/DCOR 1, Ref. Sw. Update10841 ISO/IEC 23003-1:2007/AMD 2:2008/Cor. 1, Ref. Sw. Update

8.11.4 System description coding standardsThe following document was approved

10765 Text of ISO/IEC 15938-12:2008 DCOR 2 MPQF (missing semantics)

8.11.5 MPEG-A standardsThe following document was approved

10773 Text of ISO/IEC 23000-11/COR 1 (Signalling of voice codecs)

9 Organisation of this meeting

9.1 Tasks for subgroupsThe following tasks were assigned

Requirements Std Pt AmdV Haptics

Loudness metadataAdvanced IPTV TerminalHVC – CfE3DV

12

MMTNew standard areas Audio for HVCContribution to press release CfE CfP BIFS for DR CfP on Haptics for MPEG-V MMT workshop

Systems Std Pt Amd2 1 4 Carriage of MVC4 RA

4 37 FF conformance23 Synthesised texture RS? SVC FF RS

11 7 New BIFS Profile for Digital Radio12 Cor. 3 Minor corrections15 3 MVC File Format20 2 Adaptation technologies for Laser

3 Presentation and Modification of Structured Information4? TuC for advanced input interface

22 1? Open Font Format7 12 Amd1 C and RS21 2 Amd PDI

4 Amd Protection of presentation element19 MVCO

A 4 2 Protected Musical Slide Show MAF RS & C5 2nd Ed Media Streaming AF6 1 Professional Archival AF RS & C9 1 DMB AF RS & C9 2 DMB MPEG-2 TS storage

10 1 Video Surveillance AF RS & C11 Cor1 Stereoscopic video AF

1 Stereoscopic video AF RS & C12 Interactive music AF

M 1 MXM Architecture2 MXM API3 MXM RS & C

V 1 Architecture2 Control Information3 Sensory information4 Avatar information

U 1 Rich Media Widgets2 Communication3 Reference Software and Conformance

X Advanced IPTV TerminalUpdate MPEG technology web pageContribution to press release MXM developers’ day MPEG-V CD

13

MPEG-U CD New BIFS Profile

Video4 10 1 Constrained BL profile & supplementary enhancement info. +

Stereo High ProfileCor 1 Miscellanea

7 3 4 Video Signature Tools6 Image Signature Tools RS7 Image Signature Tools C

A 3 2 Photo Player ConformanceC 4 1 Video Tool Library Conformance & RS

2 Video Tool Library extensions3DV/FTVHVC

4 4 38 MVC Conformance5 15 MVC RS

Update MPEG technology web pageContribution to press release HVC Constrained Baseline++

Audio 4 3 1 SLS profile3 960/102426 1 AAC-ELD conformance26 2 BSAC for broadcasting

D 2 Spatial Audio Object Coding3 USAC

New audio issues (HVC)Contribution to press release

3DG4 16 4 Scalable complexity 3DMC

27 3DG Conformance1 3D Graphics Compression model Conformance

5 22 3D Graphics Compression model Reference Software25 Scene partitioning RS27 Scalability complexity 3DMC RS

3DG visionV Information exchange with virtual worlds

Reconfigurable Graphics codingContribution to press release

9.2 Joint meetingsThe following joint meetings were held

Groups What Day Time WhereR, S AIT Mon 16:00-18:00 Req3, V RVC Mon 16:00-17:00 3

14

MXM Tue 09:00-12:00 ReqS, R, 3 Haptics Tue 12:00-13:00 ReqA, V, S, 3 MXM Media Framework API Tue 12:00-13:00 318S, R, 3 Sensors Tue 14:00-15:00 ReqMP, VC HVC Wed 12:00-13:00 Plenary MMT Wed 14:00-17:30 AudioR, V, T 3DV Wed 17:30-18:30 VideoR, A Profiles Thu 09:00-09:30 AudV, S, 3 MXM Media Framework API Thu 09:00-10:00 318R, S AIT, DR, MMT Thu 10:00-13:00 ReqR, V Video Surveillance Thu 09:30-10:00 Req

10 WG management

10.1 Terms of referenceThe following document was approved

10800 Terms of reference

10.2 EditorsThe following document was approved

10804 Editors of MPEG standards

10.3 LiaisonsThe following documents were approved

10817 Liaison statement to WG1/EBU/SMPTE on JPEG2000 over MPEG-2 TS

10818 Liaison statement to IEC TC100 on Internet protocol (IP) and transport stream (TS) based service access (TA1)

10819 Liaison statement to IEC TC100 on Guidelines for implementing digital rights permission code

10820 Liaison Template on MXM10821 Liaison statement to GRN/WorldDMB on new BIFS profile10822 Liaison statement to ITU-T Q.13/16 on AIT10870 Liaison Template on MMT10723 Liaison statement to BDA re Stereo High Profile10724 Liaison statement to ITU-R SG6 re Video Coding and Media File Format10725 Liaison statement to ITU-T SG16 Q6 re HVC Collaboration

10742 Statement of benefits from establishing a Category C liaison with MCSF (Mobile Convergence Solution Forum)

10811 List of Organisations with which MPEG entertains liaisons

10.4 Responses to National BodiesThe following document was approved

15

10761 Responses to JNB, KNB and USNB position statements on video topics

10.5 Ad hoc groupsThe following ad hoc groups were established

10855 AHG on MPEG Modern Transport (MMT)10729 AHG on 3D Video Coding10743 AHG on 3DGC documents, software maintenance and core experiments10866 AHG on Advanced IPTV Terminal10864 AHG on Application Format10851 AHG on Audio Standards Maintenance10865 AHG on Font Format Representation10730 AHG on High-Performance Video Coding10726 AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and

Conformance10863 AHG on MPEG File Formats10872 AHG on MPEG Media Transport10728 AHG on MPEG-7 Visual10868 AHG on MPEG-V10867 AHG on MXM10727 AHG on Reconfigurable Video Coding10852 AHG on SAOC, USAC and MetaData10862 AHG on Scene Representation

10.6 Asset managementThe following documents were approved

10805 Schema assets10806 Software assets10807 Conformance assets10808 Content assets10809 URI assets

10.7 IPR managementThe following document was approved

10810 Standards under development for which a call for patent statements is issued

10.8 Work plan and time lineThe following documents were approved

10801 MPEG Standards10802 Table of unpublished FDISs10803 Work plan and time line

16

11 Administrative matters

11.1 Schedule of future MPEG meetingsThe following meeting schedule was approved

# City Country yy mm dd-dd89 London UK 09 06-07 29-0390 Xian CN 09 10 26-3091 Kyoto JP 10 01 18-2292 ? DE 10 04 19-2393 Geneva CH 10 07 19-2394 Guangzhou CN 10 10 18-2295 ? ? 11 01 24-2896 ? ? 11 04 18-2297 Torino IT 11 07 18-22

11.2 Promotional activitiesThe following document was approved

10700 London press release

12 Resolutions of this meetingThese were approved

13 A.O.BThere was no other business

14 ClosingThe meeting closed at 2009/07/03T20:55

17

Annex A – Attendance list

Affiliation Name Company CountryDr Christian Timmerer Klagenfurt University ATDr Mohamad Raad RaadTech Consulting AUMr Jan De Cock Ghent University - IBBT BEMr Glenn Van Wallendael Ghent University - IBBT BEMr Kenneth Vermeirsch Ghent University - IBBT BEMr Leon Denis Vrije Universiteit Brussel BEDr Demin Wang CRC Canada CADr Roch Lefebvre Université de Sherbrooke CAMr Bruno Bessette VoiceAge CADr Philippe Gournay VoiceAge Corporation CAMr Adi Kouadio EBU CH

Prof Touradj Ebrahimi EPFL CHDr Marco Mattavelli EPFL/GR-LSM CHMr Christophe Lucarz EPFL/GR-LSM CHDr Jianhua Zheng Huawei CNMr Weizhong Chen Huawei technologies CNMr Dejun Zhang Huawei Technologies CN

Prof Tiejun Huang Peking University CNMr Siwei Ma Peking University CNMs Yujie Dun XIAN JIAOTONG UNIVERSITY CNMr Yin Zhao Zhejiang University CN

Prof Lu Yu Zhejiang University CNMr Xiaolin Shen Zhejiang University CNMr Andreas Schneider Dolby Germany GmbH DEMr Ferenc Kraemer Dolby Germany GmbH DEMr Karsten Grüneberg Fraunhofer HHI DEMr Karsten Müller Fraunhofer HHI DEMr Thomas Wiegand Fraunhofer HHI DEDr Heiko Schwarz Fraunhofer HHI DEMr Gerhard Tech Fraunhofer HHI DEMr Sebastian Gerke Fraunhofer HHI DEMr Thomas Schierl Fraunhofer HHI DEDr Leonid Terentiev Fraunhofer IIS DEMr Oliver Hellmuth Fraunhofer IIS DEMr Herbert Thoma Fraunhofer IIS DEDr Ralf Geiger Fraunhofer IIS DEMr Markus Multrus Fraunhofer IIS DEMr Ralph Sperschneider Fraunhofer IIS DEDr Bernhard Grill Fraunhofer IIS DEMr Max Neuendorf Fraunhofer IIS DEDr Juergen Herre Fraunhofer IIS DEMr Julien Robilliard Fraunhofer IIS DEMr Stefan Doehla Fraunhofer IIS DEMr Herve Taddei Huawei Technologies DE

Prof Joern Ostermann Leibniz Universitaet Hannover DEMr Sven Klomp Leibniz Universität Hannover DEMr Tilman Liebchen LG Electronics DEMr Steffen Wittmann Panasonic DEMr Matthias Narroschke Panasonic DE

Prof Jens-Rainer Ohm RWTH Aachen University DE

18

Mr Steffen Kamp RWTH Aachen University DEDr Mathias Wien RWTH Aachen University DEMr Gero Bäse Siemens DEMr Peter Amon Siemens AG DEDr Oliver Wübbolt THOMSON DE

Prof Jaime Delgado DMAG-UPC ESMr Victor Rodriguez-Doncel DMAG-UPC ESMr Marc Gauvin sDae ES

Prof Francisco Morán Burgos Universidad Politécnica de Madrid ESMr Pablo Carballeira López Universidad Politécnica de Madrid ESMr David Oyarzun Vicomtech ESMr Jani Lainema Nokia FIMr Cixun Zhang Tampere University of Technology FIMr Patrice Onno Canon Research Centre France FR

Prof Luce Morin IETR - INSA Rennes FRMr Matthieu Wipliez IETR - INSA Rennes FRMr Laurent Primaux iKlax Media FRMr Emmanuel Bouix iKlax Media FRDr Cristine Guillemot INRIA FRDr Mickael Raulet INSA of Rennes FRDr Marius Preda Institut TELECOM FR

Mrs Francoise Preteux Institut TELECOM FRDr Pierrick Philippe Orange Labs FRDr Stéphane Pateux Orange Labs FRMr Jérôme Royan Orange Labs FRDr Joel Jung Orange Labs FRMr Marc Guez SCPP FRMr Arnaud Bourge ST Ericsson FRMr Jean Le Feuvre Telecom ParisTech FRDr Cyril Concolato Telecom ParisTech FRDr Edouard Francois Thomson FRMr Patrick Lopez Thomson FRMr Philippe Bordes Thomson FRDr Yu Liu HK Applied Sci. & Tech. Research Institute HKDr Leonardo Chiariglione CEDEO.net ITDr Filippo Chiariglione CEDEO.net ITMr Vittorio Baroncini FUB ITMr Daniele Alfonso ST MICROELECTRONICS ITMr Giovanni Cordara Telecom Italia Lab IT

Miss Marzia Corvaglia University of Brescia ITDr Junpei Koyama FUJITSU LABORATORIES LTD JPDr Katsuyuki Nakamura Hitachi Ltd. JP

Miss Yukiko Ogura IPSJ/ITSCJ JPMr Akihide Sei JEITA JPMr Tomonobu Yoshino KDDI Corp. JPMr Shun-ichi Sekiguchi Mitsubishi Electric Corporation JPMr Kazuo Sugimoto Mitsubishi Electric Corporation JPMr Kohtaro Asai Mitsubishi Electric Corporation JPDr Tokumichi Murakami Mitsubishi Electric Corporation JPDr Mehrdad Panahpour Tehrani Nagoya University JP

Prof Masayuki Tanimoto Nagoya University JPMr Menno Wildeboer Nagoya University JPMr Kota Iwamoto NEC Corporation JPMr Ryoma Oami NEC Corporation JPMr Keiichi Chono NEC Corporation JPDr Shin-ichi Sakaida NHK JP

19

Mr Atsuro Ichigaya NHK JP

Mr Yasushige Nakayama

NHK

JPDr Takanori Senoh NICT JPDr Takehiro Moriya NTT JPMr Noboru Harada NTT JPMr Frank Bossen NTT DOCOMO, Inc JPMr Yoshinori Suzuki NTT DOCOMO, INC. JPMr Nobuhiko Naka NTT DOCOMO, Inc. JPMr Kei Kikuiri NTT DOCOMO, Inc. JPMr Takuyo Kogure Panasonic JPMr Takeshi Norimatsu Panasonic JPMr Takahiro Nishi Panasonic JPMr Tomoyuki Yamamoto Sharp Corporation JPMr Yasuaki Tokumo Sharp Corporation JPMr Yasuhiro Toguri Sony Corp. JPMr Teruhiko Suzuki Sony Corp. JPDr Toshiaki Fujii Tokyo Institute of Technology JPDr Itaru Kaneko Tokyo Polytechnic University JPMr Yoshihiro Kikuchi Toshiba Corporation JPMr Takeshi Chujoh Toshiba Corporation JPMr Tomoo Yamakage Toshiba Corporation JPMr Akiyuki Tanizawa Toshiba Corporation JPMr Satoru Sakazume Victor Company of Japan JPMr Young Soon Kim Association of Next Generation Industry KRMr Taejin Lee ETRI KRDr Kyeongok Kang ETRI KRMs Inseon Jang ETRI KRDr Haechul Choi ETRI KRDr Jeongil Seo ETRI KRDr Jihun Cha ETRI KRDr Seung-Yun Lee ETRI KRDr Hui Yong Kim ETRI KRMr Gi-Mun Um ETRI KRMr Kugjin Yun ETRI KRMr Gun Bang ETRI KRDr Cong Thang Truong ETRI KRDr Jinwoo Hong ETRI KRMr Eung Don Lee ETRI KRMr Seungkwon Beack ETRI KRDr Miran Choi ETRI KRDr Wonsuk Lee ETRI KRMr Kangchan Lee ETRI KRDr Weongeun Oh ETRI KRMr Sang-il Na ETRI KRMr B. S. Choi ETRI KRDr Jin Lee ETRI KRMr Seung Wook Lee ETRI KRMr Seunghyun Cho ETRI KRDr Maeng-Sub Cho ETRI KRMr Sanghyun Joo ETRI KR

Prof Yo-Sung Ho GIST KRMr Cheon Lee GIST KR

Prof Jeha Ryu GIST KRMr Yeongmi Kim GIST KR

20

Dr Tae-Young Jung Hanyang University KRProf Euee S. Jang Hanyang University KR

Mr Hyungyu Kim Hanyang University

KRMr Minsoo Park Hanyang University KRMr Daiyong Kim Hanyang University KRMr Kiho Choi Hanyang University KRMr Jung Tae-Young Hanyang University KRMr Jeong Do Kim Hoseo University KR

Miss Min Sung Kim HUMAX KRMr Alex ChungKu Lee HUMAX KR

Prof Dong-Seok Jeong Inha University KRMr Jukyong Jin Inha University KR

Prof Hyung-Gi Byun Kangwon National University KRMr Hwa Seon Shin KETI KRMr Je Woo Kim KETI KRDr Yong Hwan Kim KETI KRMr Jiho Park KETI KR

Prof Yong-Goo KIM KGIT KRProf Kyoungro Yoon Konkuk University KRProf Jae-Gon Kim Korea Aerospace University KRProf Seoung-Jun Oh Kwangwoon University KRProf Gwang Hoon Park Kyung Hee University KRProf Doug Young Suh Kyunghee University KRProf Kyuheon Kim Kyunghee University KRDr Henney Oh LG Electronics KRMr Jaewon Sung LG Electronics KRDr Hyunkook Lee LG Electronics KRDr ByeongMoon Jeon LG Electronics Inc. KR

Prof Sang-Kyun Kim Myongji University KRMr Youngkwon Lim NetnTV KRDr Seungju Han Samsung Advanced Institute of Technology KRDr Jeong-Hwan Ahn Samsung Electronics KRMr Jaejoon Lee Samsung Electronics KRMrs Jaeyeon Song Samsung Electronics KRMr MyungJin Eom Samsung Electronics KRMr Jung Suk Suh Samsung Electronics KRMr Hyeoncheol Pu Samsung Electronics KRMr JeongHoon Park Samsung Electronics KRMr Kyungmo (Stanley) Park Samsung Electronics KRMr Kim Jung Hoe Samsung Electronics KRMr Kyong-Sok Seo Samsung Electronics KR

Prof Joohee Moon Sejong Univ. KRProf Hyoungmee Park Sejong Univ. KRMr Dongwon Kim Sejong Univ. KRDr Hae Kwang Kim Sejong University KR

Prof Yung-Lyul Lee Sejong University KRMr Daeil Yoon Sejong University KRMr Daeyeon Kim Sejong university KR

Prof Jong-Ki Han Sejong University KRMr Donggyu Sim Sim KR

Prof Byeungwoo Jeon SKKU KRMr Jungyoup Yang Sungkyunkwan University KRMr Seonghoon Kim Varovision KRMr Inkwon Kim Varovision KR

Prof Yoonsik Choe Yonsei University KR

21

Dr Sangyoun Lee Yonsei University KR

Mr Werner Oomen

Philips Applied Technologies

NLMr Fons Bruls Philips Research NLMr Jean H.A. Gelissen Philips Research Lifestyle NLMr Miska Hannuksela Nokia Corporation NODr Gisle Bjontegaard Tandberg NOMr Krzysztof Wegner Poznań University of Technology PLMr Olgierd Stankiewicz Poznań University of Technology PLMr Kristofer Kjoerling Dolby Sweden AB SEMr Heiko Purnhagen Dolby Sweden AB SEDr Per Frojdh Ericsson AB SEMr Rickard Sjöberg Ericsson AB SEDr Andrey Norkin Ericsson AB SEDr Yongwei Zhu Institute for Infocomm Research SGMr Ti Eu Chan Institute For Infocomm Research (A*STAR) SGDr Thiow Keng (TK) Tan NTT DOCOMO Inc SGDr Zhou Huan Panasonic Singapore Laboratories SGMr ChongSoon Lim Panasonic Singapore Laboratories SGMr Chung-Hao Wu International ITRI / NCTU TWDr Chun-Jen Tsai ITRI/NCTU TW

Prof Gwo Giun (Chris) Lee National Cheng Kung University TWMr Neil Smyth APT LICENSING LTD UKMr Andrea Gabriellini BBC UKMr Jonathan Rosser BBC UKMr David Flynn BBC UKMr James Barrett BBC UKDr Thomas Davies BBC R&D UKMr Mike Nilsson British Telecommunications plc UKMrs Jean Stride BSI UKMr David Clewer Ericsson UKDr Zhiyong Gao Imagination Technologies UKMr David Hough Imagination Technologies UKDr Leszek Cieplinski Mitsubishi Electric UKDr Paul Brasnett Mitsubishi Electric R&D Centre Europe UKDr Ping Wu Mitsubishi Electric R&D Centre Europe UKDr Stavros Paschalakis Mitsubishi Electric R&D Centre Europe B.V UKDr Kate Grant Nine Tiles UK

Prof Mark Plumbley Queen Mary University of London UKProf Andrea Cavallaro Queen Mary University of London UKDr Panos Kudumakis Queen Mary University of London UK

DrChaminda (Sampath) Kannangara The Robert Gordon University UK

Mr Yue Feng University of Glasgow UKProf Iain Richardson Vcodex/Robert Gordon University UKMr Ken McCann ZetaCast/Samsung UKDr Scott Foshee Adobe Systems Incorporated USMr Dale Stolitzka Analog Devices USMr David Singer Apple USDr Schuyler Quackenbush Audio Research Labs USMr Alex Giladi Avail Media USMr Dhawal Moghe Cable Television Laboratories USMr Alberto Duenas Cavium Networks USDr Sandeep Kanumuri DOCOMO Communications Labs USMr Walt Husak Dolby USDr Lazar Bivolarski Droplet Technology, Inc. US

22

Dr Pankaj Topiwala FastVDO USDr Hari Kalva Florida Atlantic University USMr Minjie Xie Huawei Technologies USDr Hoaping Yu Huawei Technologies USDr Yi-Jen Chiu Intel Corp. USDr Gary Sullivan Microsoft USDr Andrew G. Tescher Microsoft USMr Iraj Sodagar Microsoft USDr Anthony Vetro Mitsubishi Electric USMr Huifang Sun Mitsubishi Electric USDr Robert Cohen Mitsubishi Electric USMr Vladimir Levantovsky Monotype Imaging Inc. USDr Ajay Luthra Motorola USDr Sam Narasimhan Motorola USDr Justin Ridge Nokia USMr Jesus Sampedro Polycom USDr Marta Karczewicz Qualcomm USDr Peisong Chen Qualcomm USMr Pengjun (Jeff) Huang Qualcomm Inc USDr Geert Van der Auwera Samsung Information Systems America USMr Youngjoe Yoo Sejong University USMr Chanwon Seo Sejong University USMr Andrew Segall Sharp Labs USDr Cheung Auyeung Sony Electronics Inc USDr Minhua Zhou Texas Instruments USDr Joel Sole Thomson USDr Polin Lai Thomson Corporate Research US

23

Annex B – Agenda

1 Opening2 Roll call of participants3 Approval of agenda4 Allocation of contributions5 Communications from Convenor6 Report of previous meeting7 Processing of NB Position Papers8 Work plan management8.1 Media coding8.1.1 HD-AAC Profile8.1.2 960 frame length in MPEG-4 AAC8.1.3 Constrained Baseline Profile and Stereo High Profile8.1.4 AFX 3rd edition8.1.5 Multiresolution profile8.1.6 Scalable-complexity 3D mesh compression8.1.7 Open Font Format8.1.8 Media Value Chain Ontology8.1.9 Codec Configuration Representation8.1.10 Video Tool Library8.1.11 Spatial Audio Object Coding8.1.12 Unified Speech and Audio Coding8.1.13 Media Context and Control8.1.14 3D Video Coding8.1.15 High-Performance Video Coding8.2 Composition coding8.2.1 Interactive Digital Radio8.2.2 LASeR Adaptation8.2.3 Presentation and Modification of Structured Information8.2.4 Advanced User Interaction8.3 Description coding8.3.1 Video Signature Descriptors8.3.2 Extraction and Matching of Image Signature Tools8.3.3 Enhanced MPEG-7 Query Format8.3.4 Metadata driven post processing of audio signals8.4 Systems support8.4.1 MPEG-4 Systems 4th edition8.4.2 Registration Authority and Systems support8.5 IPMP8.5.1 Protection of Presentation Element8.6 Digital Item8.6.1 Presentation of Digital Item8.7 Transport and File formats8.7.1 Carriage of MVC in MPEG-2 Systems8.7.2 Miscellaneous additions to File Format8.7.3 Handling of MPEG-4 Audio enhancement layers8.7.4 AVC File Format extensions for MVC8.7.5 MPEG Media Transport

24

8.8 Multimedia architecture8.8.1 MXM Architecture and Technologies8.8.2 MXM API8.8.3 MPEG Rich Media UI Framework8.8.4 Advanced IPTV Terminal8.9 Application formats8.9.1 Media Streaming AF8.9.2 DMB AF Harmonization of MPEG-2 TS storage8.9.3 Interactive Music Application Format8.10 Protocols8.10.1 MXM Protocols8.11 Reference implementation8.11.1 AAC-ELD Reference Software8.11.2 MVC Reference Software8.11.3 Stereo High Profile Reference Software8.11.4 File Format Reference Software8.11.5 Geometry and Shadow Reference Software8.11.6 SC3DMC Reference Software8.11.7 Scene Partitioning Reference Software8.11.8 Synthesized Texture Reference Software8.11.9 Image Signature Tools Reference Software8.11.10 Professional Archival MAF Reference Software8.11.11 DMB AF Reference Software8.11.12 Video Surveillance AF Reference Software8.11.13 Stereoscopic video AF Reference Software8.11.14 Interactive Music AF Reference Software8.11.15 Video Tool Library Reference Software8.11.16 MXM Reference Software8.12 Conformance8.12.1 MPEG-4 Video bitstreams8.12.2 MPEG-4 Audio Conformance8.12.3 AAC-ELD, OAFI and additional AAC Conformance8.12.4 BSAC Conformance for Broadcasting8.12.5 MVC Conformance8.12.6 File Format Conformance8.12.7 Scene Partitioning Conformance8.12.8 Scalable Complexity 3DMC Conformance8.12.9 3D Graphics Compression Model Conformance8.12.10 Image Signature Tools Conformance8.12.11 Photo Player AF Conformance8.12.12 Musical Slide Show AF Conformance8.12.13 Professional Archival AF Conformance8.12.14 DMB AF Conformance8.12.15 Video Surveillance AF Conformance8.12.16 Stereoscopic video AF Conformance8.12.17 Interactive Music AF Conformancw8.12.18 Video Tool Library Conformance8.12.19 MXM Conformance8.13 Maintenance8.13.1 Systems coding standards8.13.2 Video coding standards

25

8.13.3 Audio coding standards8.13.4 3DG coding standards8.13.5 Visual description coding standards8.13.6 Audio description coding standards8.13.7 MPEG-21 standards8.13.8 MPEG-A standards9 Organisation of this meeting9.1 Tasks for subgroups9.2 Joint meetings10 WG management10.1 Terms of reference10.2 Officers10.3 Editors10.4 Liaisons10.5 Responses to National Bodies10.6 Work item assignment10.7 Ad hoc groups10.8 Asset management10.8.1 Reference software10.8.2 Conformance10.8.3 Test material10.8.4 URI10.9 IPR management10.10 Work plan and time line11 Administrative matters11.1 Schedule of future MPEG meetings11.2 Promotional activities12 Resolutions of this meeting13 A.O.B14 Closing

26

Annex C – Input contributions

No. Title Source

16495 London document register Webmaster

16496 Ad Hoc Group on Modern MPEG Transport (MMT) Jörn Ostermann, Young-Kwon Lim, Doug Suh, Jaeyeon Song

16497 Ad Hoc Group on 3DGC documents, software maintenance and core experiments

Francisco Morán Burgos

16498 Ad Hoc Group on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

Yi-Shin Tung

16499 Ad Hoc Group on Reconfigurable Video Coding Euee S. Jang, Marco Mattavelli, Kazuo Sugimoto

16500 Ad Hoc Group on MPEG-7 Visual Miroslaw Bober, Paul Brasnett, Ryoma Oami

16501 Ad Hoc Group on 3D Video Coding Karsten Müller, Anthony Vetro

16502 Ad Hoc Group on High-Performance Video Coding Jens-Rainer Ohm, Jörn Ostermann, Vittorio Baroncini, Ajay Luthra, Jason Suh, T.K. Tan

16503 Ad Hoc Group on AVC Development Gary Sullivan, Jens-Rainer Ohm; Ajay Luthra, Heiko Schwarz, Karsten Sühring, Teruhiko Suzuki, Alexis Tourapis, Anthony Vetro, Thomas Wiegand, C.S. Lim, T. Yamakage, L. Bivolarski

16504 Ad Hoc Group on Audio Standards Maintenance R. Sperschneider

16505 Ad Hoc Group on SAOC, USAC and MetaData S. Quackenbush, Pierrick Philippe

16506 Ad Hoc Group on Scene Representation Young-Kwon Lim, Jaeyeon Song, Cyril Concolato

16507 Ad Hoc Group on MPEG File Formats David Singer

16508 Ad Hoc Group on Application Format Kyuheon Kim, Hui Yong Kim, Noboru Harada

16509 Ad Hoc Group on Font Format Representation Vladimir Levantovsky

16510 Ad Hoc Group on Advanced IPTV Terminal Xin Wang, Young Kwon Lim

16511 Ad Hoc Group on MXM Filippo Chiariglione, Christian Timmerer, Victor Rodriguez, Marius Preda

16512 Ad Hoc Group on MPEG-V Marius Preda

16513 IEC CDV 62455 [SC 29 N 10369] IEC TC 100 via SC 29 Secretariat

16514 Liaison Statement from ITU-R SG 6 [SC 29 N 10373] ITU-R SG 6 via SC 29 Secretariat

16515 Summary of Voting on ISO/IEC 14496-4:2004/DCOR 7 [SC 29 N 10375] SC 29 Secretariat


16517 Summary of Voting on ISO/IEC 14496-14:2003/PDAM 1 [SC 29 N 10377] SC 29 Secretariat

16518 Summary of Voting on ISO/IEC 23000-3:2007/PDAM 2 [SC 29 N 10378] SC 29 Secretariat

16519 Summary of Voting on ISO/IEC 23000-9:2008/PDAM 2 SC 29 Secretariat

16520 Table of Replies on ISO/IEC 13818-4:2004/FDAM 3 [SC 29 N 10388] ITTF via SC 29 Secretariat

16521 Summary of Voting on ISO/IEC 23000-11:200X/DCOR 1 [SC 29 N 10380] SC 29 Secretariat

16522 Summary of Voting on ISO/IEC CD 23000-12 [SC 29 N 10381] SC 29 Secretariat


16524 Summary of Voting on ISO/IEC 23003-1:2007/Amd.2:2008/DCOR 1 [SC 29 N 10383]

SC 29 Secretariat



27

http://wg11.sc29.org/meetings/89_London/m16526/m16526.zip















http://wg11.sc29.org/meetings/89_London/m16511/



















16529 Summary of Voting on ISO/IEC 14496-27:200X/PDAM 2 SC 29 Secretariat


16531 Summary of Voting on ISO/IEC TR 15938-8:2002/DAM 4 SC 29 Secretariat

16532 Summary of Voting on ISO/IEC 23000-6:2009/FPDAM 1 SC 29 Secretariat





16537 Summary of Voting on ISO/IEC 14496-3:200X/FPDAM 1 SC 29 Secretariat




16541 Summary of Voting on ISO/IEC CD 29116-1 [2nd Edition] SC 29 Secretariat

16542 Summary of Voting on Proposal for a New Work Item, Information technology -- MPEG extensible middleware (MXM)

SC 29 Secretariat

16543 Summary of Voting on ISO/IEC CD XXXXX-1, MXM architecture and technologies

SC 29 Secretariat

16544 Summary of Voting on ISO/IEC CD XXXXX-2, MXM API SC 29 Secretariat

16545 Summary of Voting on ISO/IEC CD XXXXX-3, MXM conformance and reference software

SC 29 Secretariat




16549 Summary of Voting on ISO/IEC 14496-26:200X/DCOR 1 SC 29 Secretariat

16550 Summary of Voting on ISO/IEC 23002-4:200X/PDAM 1 SC 29 Secretariat



16553 Meeting Report on Workshop on Digital Videosurveillance Formats AFNOR via SC 29 Secretariat

16554 Options for the MXM software licences Leonardo ChiariglioneDavid Rudin

16555 Interfaces to payment systems for AIT Leonardo ChiariglioneMimmo CosenzaSergio MatoneRoberto GaravagliaStefano Quintarelli

16556 Liaison Statement from ITU-R SG 6/WP 6C [SC 29 N 10422] ITU-R SG 6/WP 6C via SC 29 Secretariat

16557 Liaison Statement from Blu-ray Disc Association [SC 29 N 10452] BDA via SC 29 Secretariat

16558 More Advanced IPTV Terminal (AIT) Use Cases Leonardo Chiariglione

16559 IEC DTR 62636 [SC 29 N 10434] IEC TC 100 via SC 29 Secretariat

16560 Olfactory Interaction Model and Services for MPEG-V Jeong-Do KimH-G Byun

16561 Evaluation of TCX improvements Core Experiment Pierrick Philippe

16562 Proposal for updated generic metadata APIs on MXM Wonsuk LeeSeungyun Lee

16563 Selection of New Perceptual Objective Video Quality Metric Lazar Biviolarski

16564 Proposal for an interoperable 3D platform Jerome Royan

16565 88th MPEG Audio Report Schuyler Quackenbush

28

mailto:[email protected]














































16566 Requirements on 3D Video Format Anthony Vetro

16567 USNB Position Statement on HVC and ITU-T Relationship A. G. Tescher for USNB

16568 USNB Position Statement on Carriage of JPEG 2000 in MPEG-2 Systems Streams

A. G. Tescher for USNB

16569 IEC CDV 61937-12 IEC TC 100 via SC 29 Secretariat

16570 Response to Call for Evidence in HVC: Decoder-side Motion Estimation for Improved Prediction

Sven KlompJörn Ostermann

16571 Signal classifier for USAC reference encoder Lijing XuMinjie XieHervé Taddei

16572 Classification Based ACELP-TCX Selection Longyin ChenHervé TaddeiMinjie Xie

16573 MPEG-V Contributions Jean H.A. Gelissen

16574 Response to Call for Evidence in HVC: Integration of Efficient Coding Tools

Taksehi ChujohTomoo Yamakage

16575 Requirements on 3D Video Coding for Mobile Services Philipp MerkleGerhard TechKarsten Müller

16576 Results of Exploration Experiments in 3D Video Coding Yongzhe WangHunn RheePhilipp MerkleKarsten Müller

16577 MPEG-U WD 1.1 Jean-Claude Dufourd

16578 MPEG-U WD improvements and proposals Jean-Claude DufourdCyril ConcolatoJean Le FeuvreKyungmo ParkSeoyoung WangJaeyeon Song

16579 Proposed Corrections to Reference Software and WD3 of USAC Max Neuendorf

16580 Use Case of Personalized Advertisement for AIT Kangchan LeeWonsuk LeeSeungyun Lee

16581 Liaison Statement from MCSF [SC 29 N 10462] MCSF via SC 29 Secretariat

16582 Improved 1D Mode in VSRS 3.1 Yin ZhaoLu YuDong Tian

16583 Enhanced LDV Background Information Generation Yin ZhaoLu YuLianhuan Xiong

16584 Peak Signal-to-Perceptible-Noise Ratio Tool: PSPNR 1.0 Yin ZhaoLu Yu

16585 3DV EE4 Report on Champagne tower sequences (LDV data) Yin ZhaoLu Yu

16586 Harmonization with the existing QoS protocols for MMT Doug Young SuhJin Woo Hong

16587 Memory and complexity reduction CE proposal for USAC LPD mode Wei XiaoFuwei MaHervé TaddeiMinjie Xie

16588 Study on MPEG-V Sensory Information Jin-Seo KimMaeng-Sub ChoBon-Ki KooYong Soo JooSang-Kyun Kim

16589 Study on Sensory Device Command in MPEG-V Control Information Jin-Seo KimMaeng-Sub Cho

29
























































Bon-Ki KooYong Soo JooSang-Kyun Kim

16590 Report of 3DV Exploration Experiment with Champagne Tower Taka SenohKenji YamamotoRyutaro OiTomoyuki MishinaTaiichiro Kurita

16591 3DV/FTV EE report on "Lovebird1" Gi-Mun UmGun BangNamho HurJinwoong Kim

16592 Samsung's response to Call for Evidence on High-Performance Video Coding

Woo-Jin HanJeongHoon ParkKen McCann

16593 Input on the use cases of Advanced IPTV Terminal(AIT) Jin Young Lee

16594 Study Text of ISO/IEC 23000-11 PDAM1 Next generation Broadcasting Forum (Korea)

16595 Comments on Sensory Device Command of MPEG-V B. S. ChoiJooJangPark

16596 Comments on User Sensory Preference & Sensory Device Capability of MPEG-V

B. S. ChoiSangHyun JooJongHyun JangKwangRo Park

16597 Response to Call for Evidence on High-Performance Video Coding Shun-ichi SekiguchiKazuo SugimotoPing WuRobert A. CohenKohtaro AsaiTokumichi Murakami

16598 Proposed CE on Spectral Noiseless Coding in USAC KiHyun ChooJungHoe KimEunmi Oh

16599 3DV EE4 on BeerGarden sequence Patrick LopezDong TianPo-Lin Lai

16600 Response to Call for Evidence in High-performance Video Coding: KTA-based Simulation Results of Class B and Class C

Keiichi ChonoKenta SenzakiHirofumi AokiJunji TajimeYuzo Senda

16601 3DV EE1 & EE4 Results on Newspaper sequence Seok LeeJaejoon LeeIlsoon LimDu-Sik Park

16602 Comments on Usage of Enhanced Karaoke/Solo (EKS) Mode Jeongil SeoHenney OhKevin SeungChul Ham

16603 Consideration on Combination of Classic and EKS Modes Jeongil SeoKyeongok Kang

16604 Consideration on MPS Payload within SAOC for MBO Jeongil SeoKyeongok Kang

16605 Depth Estimation Reference Software (DERS) 4.0 Masayuki TanimotoToshiaki FujiiMehrdad Panahpour TehraniMenno Wildeboer

16606 3DV/FTV EE1 results of "Champagne tower" Masayuki TanimotoToshiaki FujiiMehrdad Panahpour TehraniMenno Wildeboer

30




















mailto:KwangRo

mailto:JongHyun

mailto:Sang%20Hyun





















16607 Error Cancellation in Free-viewpoint Image Generation for FTV Masayuki TanimotoToshiaki FujiiMehrdad Panahpour TehraniMenno WildeboerHisayoshi Furihata

16608 Supporting Technologies for AIT Service Discovery in Heterogeneous Environments

Truong Cong ThangJung Won KangSeong-Jun BaeJeong-Ju Yoo

16609 Proposed study on BSAC Conformance for Broadcasting Miyoung KimEunmi Oh

16610 Study Text of 14496-20 FPDAM3 Jihun ChaInjae LeeYoung-kwon LimHan-Kyu LeeJinwoo Hong

16611 Considerations on SAF over MPEG-2 Systems Jihun ChaHyun-Cheol KimHan-Kyu Lee

16612 Thoughts about Adaptive Progressive Download in the file format David Singer

16613 Thoughts about Sub-track selection in the file format David Singer

16614 On Modern Media Transport (MMT) David Singer

16615 3DV/FTV EE1 Report on Pantomime sequence Shinya ShimizuHideaki Kimata

16616 Proposal for MPEG Query Format Corrigendum 2 Ruben TousJaime Delgado

16617 Proposal of amendments to MPEG Query Format Ruben TousJaime Delgado

16618 Update of WD4.0 of ISO/IEC 15938-12/Amd.1 MPEG Query Format Ref. Soft & Conf.

Ruben TousJaime Delgado

16619 Proposal to MXM regarding MPQF Ruben TousVictor RodriguezJaime Delgado

16620 iKlax Improvement Proposal fro Volume representation method Laurent PrimauxOwen LagadecEmmanuel Bouix

16621 prefix NAL unit in stereo high profile Teruhiko SuzukiAjay LuthraAnthony Vetro

16622 Revised extended template for the Advanced Surveillance AF Maria Teresa AndradeVítor BarbosaAnna CarrerasPedro CarvalhoGiovanni CordaraJaime DelgadoSafak DoganFrederic DufauxTouradj EbrahimiGianluca FranciniIsabel GallegoLutz GoldmannIvan IvanovThien Ha MinhShan JinHemantha Kodikara ArachchiGelareh MohammadiMarta MrakAdam PietrowcewToni RamaEva RodríguezThomas SikoraRubén Tous

31
















































16623 Revised contribution to the Advanced Surveillance AF Maria Teresa AndradeVítor BarbosaAnna CarrerasPedro CarvalhoGiovanni CordaraJaime DelgadoSafak DoganFrederic DufauxTouradj EbrahimiGianluca FranciniIsabel GallegoLutz GoldmannIvan IvanovThien Ha MinhShan JinHemantha Kodikara ArachchiGelareh MohammadiMarta MrakAdam PietrowcewToni RamaEva RodríguezThomas SikoraRubén Tous

16624 contribution on MMT Jaeyeon Song

16625 Advanced User Interaction on LASeR Seo-Young Hwang

16626 Proposed Corrigendum on ISO/IEC 23000-11 Stereoscopic Video Application Format

Seo-Young Hwang

16627 Report on Enhanced Temporal Envelope Shaping CE for USAC Kei KikuiriKosuke TsujinoNobuhiko Naka

16628 Response to Call for Evidence in HVC: A Hybrid Coding Based Codec Lu YuXiaolin ShenPeng LiXingguo ZhuShangwen LiSiwei MaLi ZhangXin ZhaoXiaoming LiXiaozhen Zheng

16629 LG's Response to Call for Evidence in HVC Byeongmoon JeonJungSun Kim

16630 Revision of IndexedRegionSet: Efficient Representation of Meshes with Multiple Textures

Sergio ArnaldoFrancisco MoránMarcos Avilés

16631 Cross verification result for ETRI VCE-7 proposal Sangki KimHyobin LeeSangyoun Lee

16632 LGE listening test results for USAC CE on TCX improvements Hyunkook LeeSungyong Yoon

16633 Proposed addition to ELD conformance Andreas Schneider

16634 Crosscheck report for CE on Efficient Mode-Transitions JungHoe KimEunmi Oh

16635 Proposed core experiment on improved mode transition Kiho ChoHyunkook LeeSungyong Yoon

16636 Progress report on the arithmetic coding CE for USAC Sungyong YoonHyunkook Lee

16637 Response to the CfP on additional BIFS technologies for Interactive Services for Digital Radio

Jean-Claude DufourdCyril ConcolatoJean Le FeuvreBenoit Pellan

16638 Thomson Core Experiment Proposal for USAC Oliver Wuebbolt

32



































16639 Fragments protection using MPEG-21 IPMP Components Jaime DelgadoEva Rodríguez

16640 Progress report on harmonic transposer CE for the USAC work item Kristofer KjörlingPer EkstrandLars VillemoesMax NeuendorfMarkus Multrus

16641 Comments on WD of 14496-1 PDAM4 MPEG-4 Registration Authority and systems extensions

Jean-Claude DufourdCyril ConcolatoJean Le Feuvre

16642 3DV EE results on BookArrival test sequence Jaewon SungYounghee ChoiByeong-Moon Jeon

16643 withdrawn test

16644 MPEG-U Howto, for inclusion as an informative annex Jean-Claude DufourdCyril ConcolatoJean Le Feuvre

16645 Cross verification results for Video Signature (VCE-7) Karol Wnukowicz

16646 Philips contribution on extended 3DV LDV Test Material [email protected]@[email protected]

16647 Extended 3DV LDV Test Material for Newspaper fons brulsrene klein gunnewiekpatrick van de walleYin Zhao

16648 Revision of the License Authorisation on MXM Víctor Rodríguez-DoncelJaime DelgadoEva Rodríguez

16649 Proposal of a new Profile for MPEG-4 ALS Takehiro MoriyaTilman LiebchenMichiko FunamotoNoboru HaradaYutaka Kamamoto

16650 Editor's input to ISO/IEC 23000-6/FDAM 1 (PA-AF) Noboru HaradaHouariHendryTakehiro MoriyaYutaka KamamotoMunchurl Kim

16651 Report on corrections for the MPEG SAOC FCD text Jonas EngdegårdHeiko PurnhagenLeonid TerentievCornelia FalchAndreas HölzerOliver HellmuthJohannes HilpertJeroen Koppens

16652 Proposal for additional MXM Protocols Filippo ChiariglioneSergio MatoneAngelo DifinoVíctor Rodríguez Doncel

16653 MBO embedment in SAOC payload Heiko PurnhagenLeonid TerentievOliver Hellmuth

16654 Clarifications regarding the MPS bitstream generation for the SAOC transcoding mode

Leonid TerentievOliver Hellmuth

16655 Clarifications and enhancement of the EKS processing mode Cornelia FalchLeonid TerentievOliver Hellmuth

16656 Technical provisions for low-delay SAOC multi-channel rendering Jonas EngdegårdHeiko PurnhagenWerner Oomen

33














































Erik SchuijersJohannes HilpertMaría Luis ValeroMarkus SchnellOliver HellmuthLeonid TerentievAndreas Hölzer

16657 Clarifications regarding the MCU description Heiko PurnhagenLeonid TerentievOliver Hellmut

16658 remarks wrt 3DV EEs and autostereo display capabilities fons bruls

16659 Quality Assessment of MPEG-2/4 AAC Dynamic Range Control (DRC) Wolfgang FieselJürgen HerreSebastian ScharrerStephan Schreiner

16660 Progress Report on the CE on Efficient Mode Transitions in USAC Markus MultrusMax NeuendorfJeremie LecomteRalf Geiger

16661 Response to Call for Evidence in HVC: Hybrid Video Coding with ETP and DMVD

Steffen KampJohannes BalléMathias Wien

16662 Improved Pulse indexing for ACELP fixed codeword Dejun ZhangFuwei MaHerve TaddeiMinjie Xie

16663 Reliability metric for BD measurements Rickard SjöbergKenneth AnderssonAndrey Norkin

16664 Core experiment on Unified Stereo Coding for USAC Heiko PurnhagenPontus CarlssonKristofer Kjörling Erik SchuijersWerner Oomen

16665 File format sub-track selection and switching Per FröjdhAndrey NorkinClinton Priddle

16666 Consideration on efficiency of USAC syntax elements Bernhard GrillKristofer KjorlingWerner OomenPhilippe Gournay

16667 Comments on Huawei's CE proposal on ACELP Indexing for USAC Philippe GournayBruno Bessette

16668 Report on Mode Usage for ACELP in USAC Philippe GournayBruno BessetteRoch.Lefebvre

16669 Proposed Correction for USAC Bass-Postfilter Implementation Philippe GournayBarbara Resch

16670 Results of EE1 on 'Pantomime? Sequence

Yo-Sung Ho

16671 Results of EE4 on ?Newspaper? SequenceYo-Sung Ho

16672 Report on Unvoiced Speech Coding for USAC Philippe GournayBruno BessetteRoch LefebvreEunmi Oh

16673 Bilateral Filtering of Depth Map for 3D Video CodingYo-Sung Ho

16674 Temporally Enhanced 3D Test Sequence: DeveliryYo-Sung Ho

34



















































16675 3DTV Exploration Experiments on Pantomime data set Andrey NorkinIvana RadulovicPer Fröjdh

16676 Active and reactive components for participative, distributed and collaborative BiFS scenes

Bojan JoveskiIain-James MarshallMihai MitreaFrancoise PreteuxPieter Simoens

16677 Status and progress overview of SAOC workplan items Oliver HellmuthJuergen HerreAndreas HoelzerWerner OomenHeiko PurnhagenLeonid Terentiev

16678 Proposal for a plan on SAOC verification testing Jonas EngdegardOliver HellmuthJuergen HerreJohannes HilpertWerner OomenHeiko PurnhagenLeonid Terentiev

16679 Proposal for a set of profiles and levels for SAOC Jonas EngdegardOliver HellmuthJuergen HerreJohannes HilpertWerner OomenHeiko PurnhagenLeonid Terentiev

16680 Information on SAOC Complexity Jonas EngdegårdHeiko Purnhagen

16681 Clarifications of transport and time-alignment in SAOC Heiko PurnhagenAndreas HölzerMaría Luis Valero

16682 Transport of SAOC in MPEG-4 Audio Heiko PurnhagenMarkus SchnellRalph Sperschneider

16683 Study on 23003-1:2007/DCOR.2, MPEG Surround Heiko Purnhagen

16684 Response to Call for Evidence in HVC: New High-Quality Deblocking Loop Filter

Geert Van der AuweraYeong Taeg Kim

16685 Considerations on Coding of Critical Bitstream Elements Ralf GeigerRalph SperschneiderMarkus Multrus

16686 Proposed Bugfix on eSBR Mode Transitions Markus MultrusFrederik NagelJeremie Lecomte

16687 Listening Test Report on TCX Improvements for USAC Max NeuendorfJérémie Lecomte

16688 Alternatives for windowing in USAC Bruno BessetteRoch LefebvrePhilippe GournayRedwan Salami

16689 Comments on the video database extension for reliable video signature description development

Weon Geun OhSang-Il NaDaeil YoonHae Kwang Kim

16690 Editor's Input on MPEG-V SI Christian TimmererSang Kyun KimShin-ya Hasegawa

16691 Proposed minor corrections to SEDL and SEV examples Markus WaltlChristian Timmerer

16692 Discussion input on overlapping sensory effects Markus WaltlChristian Timmerer

35






































16693 Input for the MXM Developer's Day Michael EberhardChristian TimmererHermann Hellwagner

16694 Austrian NB comments on MXM Michael EberhardChristian Timmerer(on behalf of the Austrian NB)

16695 Contribution to Workshop on MMT (Modern Media Transport) Michael EberhardChristian TimmererIngo KoflerRobert KuschnigHermann Hellwagner

16696 On AIT requirements for Interfaces to Payment Systems Lars-Erik ErikssonChristian Timmerer (editor)

16697 On metadata for AIT Michael EberhardChristian Timmerer

16698 Study of WD 15938-3:2002/Amd. 4 Video Signature Tools Paul BrasnettKota IwamotoStavros PaschalakisRyoma OamiMiroslaw Bober

16699 Proposed Update of Video Signature Tools XM (VCE7) Paul BrasnettKota IwamotoStavros PaschalakisRyoma OamiMiroslaw Bober

16700 Extension of Cal2C in a new compiler infrastructure called ORCC Mickaël RauletMatthieu Wipliez

16701 RVC CAL to C translation of MPEG-4 AVC constrained BP Mickael RauletMédéric BlestelEndri BezatiJérôme Gorin

16702 Proposed revision of WD on AAC family of profiles Ralph SperschneiderAlexander Zink

16703 Response to the VCE7 on Video Signature Tools Weon-Geun Oh Sang-il Na Ju-Kyong Jin Hae-Kwang Kim Dong-Seok Jeong

16704 Proposal on additional video modifications for VCE-7 video signature Sang-il Na Weon-Geun Oh Ju-hee Cho Dong-Seok Jeong

16705 Algorithm Complexity Metric Lazar Bivolarski

16706 Response to Call for Evidence in HVC: Real-Time Constrained Environments Codec

Lazar Bivolarski

16707 On Definng Constrained Environments MPEG-4/AVC Profile Lazar Bivolarski

16708 Response to Call for Evidence in HVC: Adaptive Frequency Weighting Jianhua ZhengXiaozhen Zheng

16709 3DV EE4 on Mobile Sehoon YeaAnthony Vetro

16710 Editor's study on ISO/IEC 23000-12 CD Interactive music application format

Inseon JangJeongil SeoHui Yong KimLaurent PrimauxOwen Lagadec

16711 Consideration on Personal-mix Usage for IM AF Inseon JangJeongil SeoHui Yong KimKyeongok Kang

16712 Brands for Interactive Music AF Inseon Jang

36



































mailto:michael.eberhard.itec.uni-klu.ac.at


















Jeongil SeoHui Yong KimKyeongok KangKevin SeungChul Ham

16713 Workplan for ISO/IEC 23000-12 Interactive Music AF Conformance and Reference Software

Inseon JangJeongil SeoHui Yong KimKyeongok Kang

16714 ETRI listening test results for USAC CE on TCX improvements Taejin LeeSeungkwon BeackMinje KimKyeongok Kang

16715 Report on TCX Improvements for USAC Taejin LeeSeungkwon BeackMinje KimKyeongok Kang

16716 *withdrawn* test

16717 *withdrawn* test

16718 3DV EE4 on Champagne_tower Carmen CHENGYan HUOYu LIU

16719 1080p,WVGA,WQVGA video coding test sequences Akira FujibayashiBoon Choong SengTK Tan

16720 Study of Merging MPEG-4:Part 10 - AVC, SVC and MVC Reference Code Lazar Bivolarski

16721 Study on MPEG-V Sensory Information Yasuaki TokumoTakuya IwanamiShuichi WatanabeShin-ya Hasegawa

16722 Study on MPEG-V Control Information Yasuaki TokumoTakuya IwanamiShuichi WatanabeShin-ya Hasegawa

16723 JNB comment on base view in Stereo High Profile Japan National Body

16724 A big picture of RGC: Primitives based graphics codec Seungwook LeeBonki KooKyoungsoo SonDaiyong KimEuee S. Jang

16725 An initial design of RGC: 3DMCe and IC Daiyong KimSeungwook LeeBonki KooMing Xiao ChenEuee S. Jang

16726 MPEG-U improvements for widget security Kyungmo ParkNhut NguyenJaeyeon Song

16727 Adding Instantiations of Haptic Interactions in N10616 Architecture Jeha RyuYeongmi Kim

16728 Extending N10617 Control Information with Haptic Effects Jeha RyuYeongmi Kim

16729 Extending N10618 Sensory Information with Haptic Effects Jeha RyuYeongmi Kim

16730 Proposal for Change of MPEG-V Requirements Version 3.2 Jeha RyuYeongmi Kim

16731 FU networks of intra prediction in AVC High Profile Gwo Giun (Chris) LeeHe-Yuan LinJia-Wei LiangMing-Jiun Wang

16732 Comments on FPDAM4 of MPEG-2 Systems: Transport of MVC Ying Chen

37





























Marta KarcewiczPeisong Chen

16733 Control Information from Real World Devices Seungju HanJae-Joon HanHyunJeong LeeWonchul BangJungHwan AnDoKyoun Kim

16734 Proposed Control Information for Avatar Jae-Joon HanSeungju HanHyunjeong LeeWonchul BangJeonghwan AhnDoKyoun Kim

16735 Virtual goods information (Characteristics) Hyunjeong LeeSeungju HanJae-Joon HanJoonah Park

16736 Status Report on MPEG-4 SP FU Conformance Testing (CE 4) Hwa Seon ShinIhab AmerHyungyu KimChris LeeSugimoto Kazuo

16737 DLL-based FU Conformance Testing Tool (CE 4) Hwa Seon ShinSowon KimMinsoo ParkHyungyu KimChungku YieByeongho ChoiEuee S. Jang

16738 Study on Token Reusability (CE 5.1) Minsoo ParkHwa Seon ShinChungku YieByeongho ChoiEuee S. Jang

16739 Coding Performance Of Stereo High Profile For Movie Sequences Tao ChenYoshiichiro KashiwagiChongSoon LimTakahiro Nishi

16740 Report of RVC CE 6 Hyungyu KimChristophe LucarzMickaël RauletMarco MattavelliEuee S. Jang

16741 minor suggestions on MPEG-V System Architecture Jae-Joon HanSeungju HanHyunjeong LeeWonchul BangJeonghwan AhnDoKyoun Kim

16742 Minor suggestions of Avatar Information Jae-Joon HanSeungju HanHyunjeong LeeWonchul BangJeonghwan AhnDoKyoun Kim

16743 Comments on Multiview Video Coding Specification ChongSoon Lim Steffen Wittmann Takahiro Nishi

16744 Conformance Bitstream Descriptions For Stereo High ChongSoon Lim Steffen Wittmann Takahiro Nishi

16745 Updated Reference Software For Stereo High ChongSoon Lim Feng Lu

38







































mailto:%[email protected]
















Takahiro Nishi

16746 MPEG-4 SP Conformance Testing Progress Report Mohamad RagabAjnadin AfifehIhab AmerMarco Mattavelli

16747 Updated version of MXM APIs Filippo Chiariglione

16748 Evaluation of Core Experiment for MPEG-7 Video Signature Tool Marzia CorvagliaFabrizio GuerriniRiccardo LeonardiPierangelo MiglioratiEliana Rossi

16749 Response to the CfP on additional BIFS technologies for Interactive Services for Digital Radio

Young-Kwon LIM

16750 Proposed text of ISO/IEC FCD 23006-3 MXM Conf. & Ref. SW Filippo ChiariglioneAngelo DifinoEmiliano Leporati

16751 Fully Configurable Video Coding, Part 1: Overview Iain RichardsonSampath KannangaraMaja BystromJames Philp

16752 Fully Configurable Video Coding, Part 2: A Platform for RVC Iain RichardsonSampath KannangaraMaja BystromYafan ZhaoJames Philp

16753 KNB comment on the Study Text of ISO/IEC 14496-10:200X/FPDAM 1 Korean National Body

16754 SC3DMC Reference Software Update Seungwook LeeBonki KooKyoungsoo SonDaiyong KimEuee S. Jang

16755 Conformance files and reference software for ISO/IEC 23000-10 Houari SabirinJames AnnesleyGero Bäse

16756 Results of Exploration Experiments in 3D Video Coding, described in w10552, for ?Newspaper? sequence

Olgierd Stankiewicz Krzysztof Wegner

16757 An enhancement of Depth Estimation Reference Software with use of soft segmentation

Krzysztof WegnerOlgierd Stankiewicz

16758 Influence of views and depth compression onto quality of synthesized views

Krzysztof KlimaszewskiKrzysztof WegnerMarek Domanski

16759 CE Report on SC3DMC: comparative evaluation of the QBCR configurations

Khaled MAMMOU

16760 Improved text of RVC Vision Euee S. JangMarco MattavelliChris Lee

16761 DELETED DELETED

16762 Motion Parallax Requirements for 3D Video Cha ZhangDinei FlorencioIraj Sodagar

39








































Annex D – Output documents

No. Source Title10695 Convener List of Documents from the 89th Meeting in London, UK10696 Convener Resolutions of the 89th Meeting in London, UK10697 Convener List of AHGs Established at the 89th Meeting in London, UK10698 Convener Report of the 89th Meeting in London, UK10699 Convener Guidelines for Electronic Distribution of MPEG M and N Documents10700 Convener Press Release of the 89th Meeting in London, UK10701 Convener Meeting Notice of the 90th Meeting in Xian, China10702 Convener Guide for WG 11 Meeting Hosts10703 Video Study Text of ISO/IEC 14496-4:2004/FPDAM 38 Multiview Video

Coding Conformance Testing10704 Video Study Text of ISO/IEC 14496-5:2001/FPDAM 15 Reference Software for

Multiview Video Coding10705 Video Text of ISO/IEC 14496-10:2009/DCOR 110706 Video Disposition of Comments on ISO/IEC 14496-10:2009/FPDAM 110707 Video Text of ISO/IEC 14496-10:2009/FDAM 110708 Video Text of ISO/IEC 15938-3/PDAM 4 Video Signature Descriptors10709 Video MPEG-7 Visual XM 3610710 Video Description of Core Experiments in Video Signature Description

development10711 Video Disposition of Comments on ISO/IEC 23000-3/PDAM 210712 Video Text of ISO/IEC 23000-3/FPDAM 2 Conformance Testing for Photo

Player MAF10713 Video Disposition of Comments on ISO/IEC 23002-4/PDAM110714 Video Text of ISO/IEC 23002-4/FPDAM1 Video Tool Library Conformance and

Reference Software10715 Video WD 5 of ISO/IEC 23002-4/Amd.2 (Tools for MPEG-2 MP, MPEG-4 ASP,

AVC HP and SVC)10716 Video Description of Core Experiments in RVC10717 Video RVC Work Plan10718 Video RVC Vision10719 Video RVC Tutorial10720 Video Description of Exploration Experiments in 3D Video Coding10721 Video Results of Call for Evidence on High Performance Video Coding10722 Video Draft Call for Proposals on High Performance Video Coding10723 Convener Liaison statement to BDA re Stereo High Profile10724 Convener Liaison statement to ITU-R SG6 re Video Coding and Media File Format10725 Convener Liaison statement to ITU-T SG16 Q6 re HVC CfP10726 Convener AHG on Maintenance of MPEG-4 Visual related Documents, Reference

Software and Conformance10727 Convener AHG on Reconfigurable Video Coding10728 Convener AHG on MPEG-7 Visual10729 Convener AHG on 3D Video Coding10730 Convener AHG on High-Performance Video Coding10731 3DGC Text of ISO/IEC 14496-5:2001/FDAM 25 (Scene Partitioning Reference

Software)

40

10732 3DGC Draft DoC on ISO/IEC 14496-5:2001/PDAM 27 (Scalable Complexity 3D Mesh Coding Reference Software)

10733 3DGC Study Text of ISO/IEC 14496-5:2001/PDAM 27 (Scalable Complexity 3D Mesh Coding Reference Software)

10734 3DGC DoC on ISO/IEC 14496-16:2006/PDAM 4 (Scalable Complexity 3D Mesh Compression)

10735 3DGC Text of ISO/IEC 14496-16:200X/FPDAM 1 (Scalable Complexity 3D Mesh Compression)

10736 3DGC Description of AFX CE10737 3DGC Request for AMD 1 ISO/IEC 14496-25:200810738 3DGC WD 1.0 of ISO/IEC 14496-25:2008/Amd.1 (Mesh codec for 3DGCM)10739 3DGC ISO/IEC 14496-27:200x/FDAM 1 (Conformance testing for scene

partitioning)10740 3DGC DoC on ISO/IEC 14496-27:200x/PDAM 2 (Scalable Complexity 3D Mesh

Coding Conformance)10741 3DGC Study Text of ISO/IEC 14496-27:200x/PDAM 2 (Scalable Complexity 3D

Mesh Coding Conformance)10742 Convener Statement of benefits from establishing a Category C liaison with MCSF

(Mobile Convergence Solution Forum)10743 Convener AHG on 3DGC documents, software maintenance and core experiments10744 Systems DoC on ISO/IEC 13818-1:2007/FPDAM4 Transport of MVC10745 Systems Text of ISO/IEC 13818-1:2007/FDAM4 Transport of MVC10746 Systems Text of ISO/IEC 13818-1:2007 DCOR 310747 Systems WD 1.0 of ISO/IEC 13818-1:2007 AMD 5 Carriage of JPEG2000 over

MPEG-2 TS10748 Systems Text of ISO/IEC CD 14496-1 4th Edition10749 Systems Text of ISO/IEC 14496-1:2004 PDAM4 Registration Authority and

System Extensions10750 Systems Text of ISO/IEC 14496-4:2004/FPDAM 37 Additional File Format

Conformance10751 Systems Request for ISO/IEC 14496-11:2005/Amd. 7 ExtendedCore2D Profile10752 Systems Text of ISO/IEC 14496-11:2005/PDAM 7 ExtendedCore2D Profile10753 Systems Text of ISO/IEC 14496-12:2008/COR 3 Minor Corrections to ISO FF10754 Systems WD of ISO/IEC 14496-12:2008/AMD 2 Sub-track selection & switching10755 Systems Text of ISO/IEC 14496-14:2003/FPDAM 1 Handling of MPEG-4 Audio

enhancement layers10756 Systems DoC on ISO/IEC 14496-15:2004/FPDAM 3 File Format Support for MVC10757 Systems Text of ISO/IEC 14496-15:2004/FDAM 3 File Format Support for MVC10758 Systems DoC on ISO/IEC 14496-20:2008 LASeR & SAF/FPDAM 2 Technology

for scene adaptation10759 Systems Text of ISO/IEC 14496-20:2008 LASeR & SAF/FDAM 2 Technology for

scene adaptation10760 Systems Study of ISO/IEC 14496-20:2008 LASeR & SAF/FPDAM 3 PMSI10761 Convener Responses to JNB, KNB and USNB position statements on video topics10762 Systems Ideas on ISO/IEC 14496-20:2000 LASeR & SAF AMD 4 Advanced User

Interaction10763 Systems Request for ISO/IEC 15938-12:200X AMD 1 MPQF Conf. and Ref. SW10764 Systems Text of ISO/IEC 15938-12:200X PDAM 1 MPQF Conf. and Ref. SW10765 Systems Text of ISO/IEC 15938-12:200X DCOR 2 MPQF (missing semantics)10766 Systems Study of ISO/IEC 21000-4:2006/PDAM 2 Protection of Presentation

41

element10767 Systems DoC on ISO/IEC CD 21000-19 Media Value Chain Ontology10768 Systems Text of ISO/IEC FCD 21000-19 Media Value Chain Ontology10769 Systems DoC on ISO/IEC 23000-9:2008/PDAM2 DMB AF Harmonization on

MPEG-2 TS storage10770 Systems Text of ISO/IEC 23000-9:2008/FPDAM2 DMB AF Harmonization on

MPEG-2 TS storage10771 Systems Text of ISO/IEC 23000-10/FPDAM 1 Conformance & Reference Software10772 Systems Study of ISO/IEC 23000-11/PDAM 1 Stereoscopic Vide AF Ref. Soft and

Conf.10773 Systems Text of ISO/IEC 23000-11/COR 1 (Signalling of voice codecs)10774 Systems Text of ISO/IEC 23000-11/DCOR 2 (composition type)10775 Systems DoC on ISO/IEC CD 23000-12 Interactive Music AF10776 Systems Text of ISO/IEC FCD 23000-12 Interactive Music AF10777 Systems Workplan for the Interactive Music AF Conformance & Reference SW10778 Systems Request for subdivision of ISO/IEC 23005-110779 Systems Request for subdivision of ISO/IEC 23005-210780 Systems Request for subdivision of ISO/IEC 23005-310781 Systems Request for subdivision of ISO/IEC 23005-410782 Systems Text of ISO/IEC CD 23005-1 Architecture10783 Systems Text of ISO/IEC CD 23005-2 Control Information10784 Systems WD 3.0 of ISO/IEC 23005-2 Control Information10785 Systems Text of ISO/IEC CD 23005-3 Sensory Information10786 Systems Text of ISO/IEC CD 23005-4 Avatar Information10787 Systems WD 3.0 of ISO/IEC 23005-4 Avatar Information10788 Systems WD of ISO/IEC 23005-5 Reference Software10789 Systems WD of ISO/IEC 23005-6 Conformance Testing10790 Systems DoC on Proposal for New Work Item10791 Systems MXM License10792 Systems Guidelines for normative APIs compliant to MXM standard for future

MPEG standards10793 Systems Presentation material of MXM Developerï¿½s Day Workshop10794 Systems DoC on ISO/IEC CD 23006-1 MxM Architecture and Technologies10795 Systems Text ISO/IEC FCD 23006-1 MxM Architecture and Technologies10796 Systems DoC on ISO/IEC CD 23006-2 MxM APIs10797 Systems Text of ISO/IEC FCD 23006-2 MXM APIs10798 Systems DoC on ISO/IEC CD 23006-3 MxM Conf. & Ref. SW10799 Systems Text of ISO/IEC FCD 23006-3 MXM Conf. & Ref. SW10800 Convener Terms of reference10801 Convener MPEG Standards10802 Convener Unpublished standards at FDIS level10803 Convener MPEG work plan and time line10804 Convener MPEG Standard Editors10805 Convener Schema assets updates10806 Convener Software assets10807 Convener Conformance assets10808 Convener Content assets10809 Convener URI assets10810 Convener Standards under development for which a call for patent statements is

issued

42

10811 Convener List of Organisations with which MPEG entertains liaisons10812 Systems DoC on ISO/IEC CD 29116-1 2nd edition MXM Protocols10813 Systems Text of ISO/IEC FCD 23006-4 MXM Protocols10814 Systems Request for New Project10815 Systems Text of ISO/IEC CD 23007-1 Widgets10816 Systems WD of ISO/IEC 23007-2 Conformance and Reference Software10817 Convener Liaison statement to WG1/EBU/SMPTE on JPEG2000 over MPEG-2 TS10818 Convener Liaison statement to IEC TC100 on Internet protocol (IP) and transport

stream (TS) based service access (TA1)10819 Convener Liaison statement to IEC TC100 on Guidelines for implementing digital

rights permission code10820 Convener Liaison Template on MXM10821 Convener Liaison statement to GRN/WorldDMB on new BIFS profile10822 Convener Liaison statement to ITU-T Q.13/16 on AIT10823 Audio DoC on ISO/IEC 14496-3:2009/FPDAM 1:200X HD-AAC Profile10824 Audio ISO/IEC 14496-3:2009/FDAM 1:200X HD-AAC Profile and MPEG

Surround Signalling10825 Audio Request for Amendment, 14496-3:200x/PDAM 210826 Audio ISO/IEC 14496-3:200x/PDAM 2, ALS Simple Profile and Transport of

SAOC10827 Audio Study on ISO/IEC 14496-3:200X/DCOR 110828 Audio WD2 on AAC Family of Profiles10829 Audio DoC on 14496-4:2004//DCOR 7, Removal of Audio and 3DG

Conformance from ISO/IEC 14496-4:2004 and subsequent amendments and corrigenda

10830 Audio ISO/IEC 14496-4:2004/Cor. 7, Removal of Audio and 3DG Conformance from ISO/IEC 14496-4:2004 and subsequent amendments and corrigenda

10831 Audio DoC on ISO/IEC 14496-26:2009/DCOR 1, ALS and SLS updates10832 Audio ISO/IEC 14496-26:2009/Cor. 1, ALS and SLS updates10833 Audio DoC on ISO/IEC 14496-26:2009/FPDAM 1, AAC-ELD, OAFI additional

AAC and MPEG-1/2 on MPEG-4 Conformance10834 Audio ISO/IEC 14496-26:2009/FDAM 1, AAC-ELD, OAFI additional AAC and

MPEG-1/2 on MPEG-4 Conformance10835 Audio Study on ISO/IEC 14496-26:2009/PDAM 2, BSAC Conformance for

Broadcasting10836 Audio DoC on ISO/IEC TR 15938-8:2002/DAM 4, Extraction of Audio Features

from Compressed Formats10837 Audio ISO/IEC TR 15938-8:2002/AMD 4, Extraction of Audio Features from

Compressed Formats10838 Audio DoC on ISO/IEC 23003-1:2007/DCOR 2, Misc. Corrections10839 Audio ISO/IEC 23003-1:2007/Cor. 2, Misc. Corrections10840 Audio DoC on ISO/IEC 23003-1:2007/AMD 2:2008/DCOR 1, Ref. Sw. Update10841 Audio ISO/IEC 23003-1:2007/AMD 2:2008/Cor. 1, Ref. Sw. Update10842 Audio DoC on ISO/IEC FCD 23003-2:200x, Spatial Audio Object Coding10843 Audio ISO/IEC FCD 23003-2:200x, Spatial Audio Object Coding10844 Audio Workplan on SAOC10845 Audio Draft Verification Test Plan for SAOC10846 Audio WD on SAOC Profiles10847 Audio WD4 of USAC10848 Audio Workplan for USAC CEs

43

10849 Audio Thoughts on Efficient Bitstream Syntax10850 Audio Draft Report on the Performance of MPEG-2 AAC Dynamic Range

Control10851 Convener AHG on Audio Standards Maintenance10852 Convener AHG on SAOC, USAC and MetaData10853 Requirements Presentations of MMT Workshop in London 200910854 Requirements Draft use case and requirement on MMT10855 Convener Adhoc on MPEG Modern Transport (MMT)10856 Requirements Requirements v4 for a new BIFS profile to support Interactive Digital

Radio10857 Requirements Applications and Requirements for 3DV10858 Requirements Context and Objectives for Advanced IPTV Terminal10859 Requirements Use Cases for Advanced IPTV Terminal10860 Requirements Draft Requirements on Interfaces to Payment and Cashing Systems10861 Requirements Context and Objectives for Interfaces to Payment and Cashing Systems10862 Convener AHG on Scene Representation10863 Convener AHG on MPEG File Formats10864 Convener AHG on Application Format10865 Convener AHG on Font Format Representation10866 Convener AHG on Advanced IPTV Terminal10867 Convener AHG on MXM10868 Convener AHG on MPEG-V10869 Audio Workplan on MPEG USAC Reference Encoder10870 Convener Liaison Template on MMT10871 Video Record of joint discussions between JTC1/SC 29/WG 11 (MPEG) and

ITU-T Q.6/16 (VCEG)10872 Convener AHG on MPEG Media Transport

44

Annex E – Requirements report

Source: Jörn Ostermann (Leibniz Universität Hannover)

Requirements documents approved at this meeting

No. Title10722 Draft Call for Proposals on High-Performance Video Coding (HVC)10771 Requirements for MPEG-V10826 ISO/IEC 14496-3:200x/PDAM 2, ALS Simple Profile and Transport of

SAOC10846 WD on SAOC Profiles10853 Presentations of MMT Workshop in London 200910854 Draft use case and requirement on MMT10855 Adhoc on MPEG Media Transport (MMT)

10856 Requirements v4 for a new BIFS profile to support Interactive Digital Radio

10857 Applications and Requirements for 3DV10858 Context and Objectives for Advanced IPTV Terminal10859 Use Cases for Advanced IPTV Terminal10860 Draft Requirements on Interfaces to Payment and Cashing Systems10861 Context and Objectives for Interfaces to Payment and Cashing Systems

1 MPEG-4 AudioThe profiles proposed for SAOC lack industry support. Therefore, the status of WD as shown in N10846 WD on SAOC Profiles was selected to allow further input. The profiles for MPEG ALS are at CD stage as captured in N10826 ISO/IEC 14496-3:200x/PDAM 2, ALS Simple Profile and Transport of SAOC. However, further input from industry is sought in order enable further progression of the standardization work.

2 MPEG-V: Information exchange with virtual worlds

In response to its Extended Call for Proposals (N10526), MPEG received two inputs related to emotions and haptics. The work was picked up by the Systems subgroup. Based on the input related to haptics, requirements for active and passive haptic devices are included in the requirements document N10771 Requirements for MPEG-V. Passive devices allow for receiving haptic sensations. Active devices add a control capability.

3 MAFInput (m16622, m16623) on the topic of Advanced Surveillance AF was received and presented by one of the 22 authors. Industry supporting the proposal was not present. No action was taken.

45

4 Explorations

4.1 Interactive RadioIn response to the Call for Proposals at the 88th meeting (N10568) to be answered by this meeting, MPEG received a sufficient amount of technology to continue its work. The technical work started in the Systems subgroup.Requirements for Interactive Radio were updated as captured in N 10856 Requirements v4 for a new BIFS profile to support Interactive Digital Radio.

4.2 3D Video CodingIn the Applications and Requirements document N10857 Applications and Requirements for 3DV, the compatibility between stereoscopic video and 3D video is clarified in order to highlight the relevance of stereoscopic video for the future 3DV market.

Data Format

Data Format

Constrained Rate(based on distribution)

LimitedCamera Inputs

• Wide viewing angle• Large number of

output views

Left

Right

Auto-stereoscopicN-view displays

Stereoscopic displays• Variable stereo baseline• Adjust depth perception

The test material for 3DV was reviewed. It appears that there is still a need for more high quality test material.

The 3DV experts were encouraged to develop a time table for developing the standard. By the end of the meeting, it was not yet available.

4.3 High Performance Video Coding (HVC)HVC targets mobile services, IPTV, and Ultra High Definition (UHD) displays with a focus on coding efficiency considering codec complexity as well. The current target is to increase coding efficiency by 25% at low complexity and 50% at full complexity. In response to its Call for Evidence on High Performance Video Coding (N10553), MPEG received a high number of submission. Subjective tests were done in order to identify evidence for the feasibility of the stated compression targets. For all tested bitrates and sequences, proposals showed significant coding gains such that MPEG concluded that there is sufficient evidence for technology suitable for HVC. Hence, a draft Call for Proposals N10722 Draft Call for Proposals on High-Performance Video Coding (HVC) was prepared. An evaluation of proposals is envisioned for January 2010.

New test material was presented and is currently evaluated.

4.4 Advanced IPTV Terminal

MPEG developed a time table for the standardization of Advanced IPTV Terminals (AIT):

46

Meeting Date output89 09/07 Draft versions of requirements documents public90 09/10 Outgoing liaison letters, draft Call for Proposals

09/11 Co-located (adhoc) meeting with ITU-T91 10/01 Call for Proposals92 10/04 Evaluation of Responses to Call for Proposals

Consequently, the current documents related to AIT N10858 Context and Objectives for Advanced IPTV Terminal and N10859 Use Cases for Advanced IPTV Terminal are published. They show use cases and requirements for basic IPTV services as well as the combination of these services. New input related to requirements for payment and cashing systems was received. These are relevant for AIT and many other applications. Therefore, these requirements and application scenarios are described in separate documents N10860 Draft Requirements on Interfaces to Payment and Cashing Systems and N10861 Context and Objectives for Interfaces to Payment and Cashing Systems.

4.5 MPEG Media Transport (MMT)According to N10496 issued at the 87th meeting, there is a need for a transport and file format friendly stream format. Error resilience of current MPEG streams might not be optimal. The potential gains of joint optimization of coding and transport are not known. Conversions between different transport mechanisms like from MPEG-2 Transport Stream to MPEG Program Stream are not straight forward or defined. Furthermore, MPEG does not provide any hint on how to adapt content to different networks.

A workshop on MPEG Media Transport was held at this meeting. The more than 80 participants listened to eight presentations from industry and universities as shown in N10853 Presentations of MMT Workshop in London 2009. MPEG technology like MPEG-2 TS and MP4 File Format are universally used. Challenges related to the current use of this MPEG technology in the context of new applications, extensibility, mobile networks, and hybrid delivery as well research challenges like FEC, QoS, P2P, and cross layer optimization were identified.

The current state of the discussion on terms of use cases and requirements is summarized in N10854 Draft use case and requirement on MMT. MPEG encourages National Bodies to analyse the document and to provide further input related to MMT.

47

48

Annex F – Systems report

Source: Young-Kwon Lim, Chair

1 List of output documents

No. Title TBP AvailableX 13818-1 MPEG-2 Systems10744 DoC on ISO/IEC 13818-1:2007/FPDAM4 Transport of MVC No 09/07/0310745 Text of ISO/IEC 13818-1:2007/FDAM4 Transport of MVC No 09/07/2410746 Text of ISO/IEC 13818-1:2007 DCOR 3 No 09/07/03

10747 WD 1.0 of ISO/IEC 13818-1:2007 AMD 5 Carriage of JPEG2000 over MPEG-2 TS

No 09/07/03

14496-1 MPEG-4 Systems10748 Text of ISO/IEC CD 14496-1 4th Edition No 09/07/03

10749 Text of ISO/IEC 14496-1:2004 PDAM4 Registration Authority and System Extensions

No 09/07/10

14496-4 Conformance testing10750 Text of ISO/IEC 14496-4:2004/FPDAM 37 Additional File Format

ConformanceNo 09/07/03

14496-11 Scene description and application engine10751 Request for ISO/IEC 14496-11:2005/Amd. 7 ExtendedCore2D Profile No 09/07/0310752 Text of ISO/IEC 14496-11:2005/PDAM 7 ExtendedCore2D Profile No 09/07/03

14496-12 ISO File Format10753 Text of ISO/IEC 14496-12:2008/COR 3 Minor Corrections to ISO FF No 09/07/0310754 WD of ISO/IEC 14496-12:2008/AMD 2 Sub-track selection & switching No 09/07/03

14496-14 MP4 File Format10755 Text of ISO/IEC 14496-14:2003/FPDAM 1 Handling of MPEG-4 Audio

enhancement layersNo 09/07/03

14496-15 AVC File Format10756 DoC on ISO/IEC 14496-15:2004/FPDAM 3 File Format Support for MVC No 09/07/0310757 Text of ISO/IEC 14496-15:2004/FDAM 3 File Format Support for MVC No 09/08/14

14496-20 LASeR& SAF

10758 DoC on ISO/EC 14496-20:2008 LASeR & SAF/FPDAM 2 Technology for scene adaptation

No 09/07/03

10759 Text of ISO/EC 14496-20:2008 LASeR & SAF/FDAM 2 Technology for scene adaptation

No 09/07/03

10760 Study of ISO/EC 14496-20:2008 LASeR & SAF/FPDAM 3 PMSI No 09/07/03

10762 Ideas on ISO/IEC 14496-20:2000 LASeR & SAF AMD 4 Advanced User Interaction

No 09/07/03

15938-12 MPEG Query Format10763 Request for ISO/IEC 15938-12:200X AMD 1 MPQF Conf. and Ref. SW No 09/07/0310764 Text of ISO/IEC 15938-12:200X PDAM 1 MPQF Conf. and Ref. SW No 09/07/1710765 Text of ISO/IEC 15938-12:200X DCOR 2 MPQF (missing semantics) No 09/07/03

21000-4 MPEG-21 IPMP

49

10766 Study of ISO/IEC 21000-4:2006/PDAM 2 Protection of Presentation element

No 09/07/03

21000-19 Media Value Chain Ontology 10767 DoC on ISO/IEC CD 21000-19 Media Value Chain Ontology No 09/07/0310768 Text of ISO/IEC FCD 21000-19 Media Value Chain Ontology No 09/07/03

23000-9 Digital Multimedia Broadcasting Application Format

10769 DoC on ISO/IEC 23000-9:2008/PDAM2 DMB AF Harmonization on MPEG-2 TS storage

No 09/07/03

10770 Text of ISO/IEC 23000-9:2008/FPDAM2 DMB AF Harmonization on MPEG-2 TS storage

No 09/07/03

23000-11 Stereoscopic Video Application Format


No 09/07/03

10773 Text of ISO/IEC 23000-11/COR 1 (Signaling of voice codecs) No 09/07/0310774 WD of ISO/IEC 23000-11/AMD 2 (composition type) No 09/07/03

23000-12 Interactive Music AF10775 DoC on ISO/IEC CD 23000-12 Interactive Music AF No 09/07/0310776 Text of ISO/IEC FCD 23000-12 Interactive Music AF No 09/07/0310777 Workplan for the Interactive Music AF Conformance & Reference SW No 09/07/03

23005 Media context and control10778 Request for subdivision of ISO/IEC 23005-1 No 09/07/0310779 Request for subdivision of ISO/IEC 23005-2 No 09/07/0310780 Request for subdivision of ISO/IEC 23005-3 No 09/07/0310781 Request for subdivision of ISO/IEC 23005-4 No 09/07/03

23005-1 Media context and control - Architecture10782 Text of ISO/IEC CD 23005-1 Architecture No 09/07/17

23005-2 Media context and control – Control Information10783 Text of ISO/IEC CD 23005-2 Control Information No 09/07/1710784 WD 3.0 of ISO/IEC 23005-2 Control Information No 09/07/17

23005-3 Media context and control – Sensory Information10785 Text of ISO/IEC CD 23005-3 Sensory Information No 09/07/17

23005-4 Media context and control – Avatar Information10786 Text of ISO/IEC CD 23005-4 Avatar Information No 09/07/1710787 WD 3.0 of ISO/IEC 23005-4 Avatar Information No 09/07/17

23005-5 Media context and control – Reference Software10788 WD of ISO/IEC 23005-5 Reference Software No 09/07/17

23005-6 Media context and control – Conformance Testing10789 WD of ISO/IEC 23005-6 Conformance Testing No 09/07/17

23006 – MPEG eXtensible Middleware10790 DoC on Proposal for New Work Item Yes 09/07/0310791 MXM License Yes 09/07/03

10792 Guidelines for normative APIs compliant to MXM standard for future MPEG standards

Yes 09/07/03

10793 Presentation material of MXM Developer’s Day Workshop Yes 09/07/0323006-1 – MXM Architecture and Technologies

10794 DoC on ISO/IEC CD 23006-1 MxM Architecture and Technologies No 09/07/0310795 Text ISO/IEC FCD 23006-1 MxM Architecture and Technologies Yes 09/09/04

23006-2 – MXM APIs10796 DoC on ISO/IEC CD 23006-2 MxM APIs No 09/07/0310797 Text of ISO/IEC FCD 23006-2 MXM APIs Yes 09/09/04

50

23006-3 – MXM Conf. & Ref. SW10798 DoC on ISO/IEC CD 23006-3 MxM Conf. & Ref. SW No 09/07/0310799 Text of ISO/IEC FCD 23006-3 MXM Conf. & Ref. SW Yes 09/09/04

23006-4 – MPEG eXtensible Middleware Protocols10812 DoC on ISO/IEC CD 23006-4 MXM Protocols No 09/07/0310813 Text of ISO/IEC FCD 23006-4 MXM Protocols Yes 09/09/04

23007– MPEG-U (MPEG Rich Media UI Framework)10814 Request for New Project No 09/07/03

23007-1– MPEG-U Widgets10815 Text of ISO/IEC CD 23007-1 Widgets Yes 09/07/17

23007-2– MPEG-U Conformance and Reference Software10816 WD of ISO/IEC 23007-2 Conformance and Reference Software No 09/07/03

Liaison10817 Liaison statement to WG1/EBU/SMPTE on JPEG2000 over MPEG-2 TS No 09/07/03

10818 Liaison statement to IEC TC100 on Internet protocol (IP) and transport stream (TS) based service access (TA1)

No 09/07/03

10819 Liaison statement to IEC TC100 on Guidelines for implementing digital rights permission code

No 09/07/03

10820 Liaison statement to XXX on MXM No 09/07/0310821 Liaison statement to GRN/WorldDMB on new BIFS profile No 09/07/0310822 Liaison statement to ITU-T Q.13/16 on AIT No 09/07/0310870 Liaison Template on MMT No 09/07/03

51

2 General issues

2.1 List of standards under developmentPr

Pt

Edit.

Project

Description CfP WD CD FCD FDIS

2 1 2007

AMD4

Transport of MVC 08/10

09/02

09/07

2 1 2007

CORX Miscellaneous 09/02

4 1 200x

AMD4

RA & Systems Extension. 09/07

09/10

10/04

4 1 200x

4th ed. 09/07

09/10

10/04

4 4 2004

AMD37

File Format Conf. 08/04

08/10

09/02

09/07

4 5 2001

AMDxx

AVC File Format Ref. Soft TBS

4 5 2001

AMDxx

SVC File Format Ref. Soft TBS

4 5 2001

AMDxx

MVC File Format Ref. Soft TBS

4 5 2001

AMD23

Synth. Texture Ref. Soft 08/04

09/04

09/10

4 11

2005

AMD7

Digital Radio BIFS Profile 09/02

09/07

09/10

10/04

4 12

2008

COR3 Minor corrections to ISO FF 09/02

09/07

4 14

2003

AMD1

Handling of MPEG-4 audio enhancement layers

09/02

09/07

10/01

4 15

200x

AMD3

MVC File Format 08/04

08/10

09/02

09/07

4 20

200X

AMD2

Scene Adaptation 08/07

09/02

09/07

4 20

200X

AMD3

PMSI 08/07

08/10

09/04

09/10

4 22

2008

AMD1.

Support for many-to-one range mappings

09/04

09/10

10/04

7 12

2008

AMD1.

MPQF reference software 09/07

09/10

10/04

21

2 2006

AMDX.

PMSI support 08/10

09/04

09/10

10/04

21

2 2006

AMDX.

Protection of Presentation Information

08/10

09/04

09/10

10/04

21

19

200x

1st Ed. Media Value Chain Ontology 08/07

08/10

09/04

09/10

A 5 200 2nd Ed. MS AF 08/0 09/0 09/0 09/1

52

x 1 2 4 0A 6 200

xAMD1

PA-AF Conf. & Ref. SW 08/07

09/02

09/07

A 8 200x

AMD1

PVP AF Soft. And Conf. TBS

A 9 200x

AMD1

DMB AF Soft. And Conf. 09/02

09/10

A 9 200x

AMD2

DMB AF MPEG-2 Storage 09/02

09/07

10/01

A 10

200x

AMD1

VS Conf. & Ref. SW 08/07

09/02

09/07

A 11

200x

1st Ed. SVAF Ref. Soft. And Conf. 09/02

A 11

200x

COR1 SVAF signaling of voice codecs 09/02

09/07

A 12

200x

1st Ed. Interactive Music AF 09/02

09/07

10/01

B 2 200x

AMD1

FRU Ref. Soft. And Conf.

V 1 200x

200x Architecture 09/02

09/07

09/10

10/04

V 2 200x

200x Control Information 09/02

09/07

09/10

10/04

V 3 200x

200x Sensory Information 09/02

09/07

09/10

10/04

V 4 200x

200x Avatar Information 09/02

09/07

09/10

10/04

M 1 200x

1st ed. MxM Architecture 08/07

09/02

09/07

10/01

M 2 200x

200x MxM APIs 08/07

09/02

09/07

10/01

M 3 200x

200x MxM Conf. & Ref. SW 08/07

09/02

09/07

10/01

M 4 200x

2nd Ed. MxM Protocols 09/02

09/07

10/01

U 1 200x

200x. Package, Delivery and Presentation of Widget

08/10

09/04

09/07

09/10

10/04

U 2 200x

200x Widget Communication 08/10

09/04

09/07

09/10

10/04

U 3 200x

200x Conf. & Ref. SW 08/10

09/04

09/10

10/04

10/10

53

2.2 Standing Documents

Pr Pt Documents No. Meeting1 1 MPEG-1 White Paper – Multiplex Format N7675 05/07 Nice1 1 MPEG-1 White Paper – Terminal Architecture N7676 05/07 Nice1 1 MPEG-1 White Paper – Multiplexing and

SynchronizationN7677 05/07 Nice

2 1 MPEG-2 White Paper – Multiplex Format N7678 05/07 Nice2 1 MPEG-2 White Paper – Terminal Architecture N7679 05/07 Nice2 1 MPEG-2 White Paper – Multiplexing and

SynchronizationN7680 05/07 Nice

2 11 MPEG-2 White Paper – MPEG-2 IPMP N7503 05/07 Poznan4 1 MPEG-4 White Paper – MPEG-4 Systems N7504 05/07 Poznan4 1 MPEG-4 White Paper – Terminal Architecture N7610 05/10 Nice4 1 MPEG-4 White Paper – M4MuX N7921 06/01 Bangkok4 1 MPEG-4 White Paper – OCI N8148 06/04 Montreux4 6 MPEG-4 White Paper – DMIF N8149 06/04 Montreux4 11 MPEG-4 White Paper – BIFS N7608 05/10 Nice4 12 MPEG-4 White Paper – ISO File Format N8150 06/04 Montreux4 14 MPEG-4 White Paper – MP4 File Format N7923 06/01 Bangkok4 15 MPEG-4 White Paper – AVC FF N7924 06/01 Bangkok4 13 White Paper on MPEG-4 IPMP N7505 05/07 Poznan4 13 MPEG IPMP Extensions Overview N6338 04/03 München4 17 White Paper on Streaming Text N7515 05/07 Poznan4 18 White Paper on Font Compression and Streaming N7508 05/07 Poznan4 20 Presentation Material on LASER N6969 05/01 Hong-

Kong4 20 White Paper on LASeR N7507 05/07 Poznan4 22 White Paper on Open Font Format N7519 05/07 Poznan7 1 MPEG-7 White Paper - MPEG-7 Systems N7509 05/07 Poznan7 1 MPEG-7 White Paper – Terminal Architecture N8151 06/04 Montreux21 9 MPEG-21 White Paper – MPEG-21 File Format N7925 06/01 BangkokA X MPEG Application Format Overview N9421 07/10 ShenzhenA X MAF Overview Document N9840 08/04

ArchampsA X MAF Overview Presentation N9841 08/04

ArchampsB X MPEG-B White Paper – BinXML N7922 06/01 BangkokE X MPEG Multimedia Middleware Context and

ObjectivesN6335 04/03 München

E X 1rst M3W White paper N7510 05/07 Poznan

54

E X 2nd M3W White Paper : Architecture N8152 06/04 MontreuxE X Tutorial on M3W N8153 06/04 MonreuxE X M3W White Paper : Multimedia Middleware

ArchitectureN8687 06/10 Hanzhou

E X M3W White Paper : Multimedia API N8688 06/10 HanzhouE X M3W White Paper : Component Model N8689 06/10 HanzhouE X M3W White Paper : Resource and Quality

ManagementN8690 06/10 Hanzhou

E X M3W White Paper : Component Download N8691 06/10 HanzhouE X M3W White Paper : Fault Management N8692 06/10 HanzhouE X M3W White Paper : System Integrity

ManagementN8693 06/10 Hanzhou

55

2.3 Mailing Lists Reminder

Topic InformationKindly Hosted

byGeneral Systems

List

Reflector : [email protected]: http://lists.uni-klu.ac.at/mailman/listinfo/gen-sysArchive: http://lists.uni-klu.ac.at/mailman/private/gen-sys/

Klagenfurt

University

File Format

Reflector : [email protected]: http://lists.uni-klu.ac.at/mailman/listinfo/mp4-sysArchive: http://lists.uni-klu.ac.at/mailman/private/mp4-sys/

Klagenfurt

University

LASeR

Reflector : [email protected]: http://lists.uni-klu.ac.at/mailman/listinfo/mpeg-laserArchive: http://lists.uni-klu.ac.at/pipermail/mpeg-laser/

Klagenfurt

University

MAFReflector : [email protected]: http://lists.uni-klu.ac.at/mailman/listinfo/maf-sysArchive: http://lists.uni-klu.ac.at/mailman/private/maf-sys/

Klagenfurt

University

ISO File Format Transpo

rt

Reflector: [email protected]: http://lists.uni-klu.ac.at/mailman/listinfo/isoff-transportArchive: http://lists.uni-klu.ac.at/mailman/private/isoff-transport/

Klagenfurt

University

AITReflector: [email protected]: http://lists.uni-klu.ac.at/mailman/listinfo/jiptvArchive: http://lists.uni-klu.ac.at/mailman/private/jiptv/

Klagenfurt

University

Metaverse

Reflector: [email protected]: http://lists.uni-klu.ac.at/mailman/listinfo/metaverseArchive: http://lists.uni-klu.ac.at/mailman/private/metaverse/

Klagenfurt

University

MXMReflector: [email protected]: http://lists.uni-klu.ac.at/mailman/listinfo/mxmArchive: http://lists.uni-klu.ac.at/mailman/listinfo/mxm

Klagenfurt

University

56

http://lists.uni-klu.ac.at/mailman/listinfo/mxm

http://lists.uni-klu.ac.at/mailman/listinfo/mxm


http://lists.uni-klu.ac.at/mailman/private/metaverse/

http://lists.uni-klu.ac.at/mailman/listinfo/metaverse


http://lists.uni-klu.ac.at/mailman/private/jiptv/

http://lists.uni-klu.ac.at/mailman/listinfo/jiptv


http://lists.uni-klu.ac.at/mailman/private/isoff-transport/

http://lists.uni-klu.ac.at/mailman/private/isoff-transport/

http://lists.uni-klu.ac.at/mailman/listinfo/isoff-transport

http://lists.uni-klu.ac.at/mailman/listinfo/isoff-transport


http://lists.uni-klu.ac.at/mailman/private/maf-sys/

http://lists.uni-klu.ac.at/mailman/listinfo/maf-sys


http://lists.uni-klu.ac.at/pipermail/mpeg-laser/

http://lists.uni-klu.ac.at/mailman/listinfo/mpeg-laser

http://lists.uni-klu.ac.at/mailman/listinfo/mpeg-laser


http://lists.uni-klu.ac.at/mailman/private/mp4-sys/

http://lists.uni-klu.ac.at/mailman/listinfo/mp4-sys


http://lists.uni-klu.ac.at/mailman/private/gen-sys/

http://lists.uni-klu.ac.at/mailman/listinfo/gen-sys


3 General Input Documents

3.1 General Technical Issues

3.1.1 AHG reportsSession Numbe

rTitle Source

General m16496 Ad Hoc Group on Modern MPEG Transport (MMT)

Jörn Ostermann, Young-Kwon Lim, Doug Suh, Jaeyeon Song

General m16506 Ad Hoc Group on Scene RepresentationYoung-Kwon Lim, Jaeyeon Song, Cyril Concolato

General m16507 Ad Hoc Group on MPEG File Formats David Singer

General m16508 Ad Hoc Group on Application FormatKyuheon Kim, Hui Yong Kim, Noboru Harada

General m16509 Ad Hoc Group on Font Format Representation Vladimir Levantovsky

General m16510 Ad Hoc Group on Advanced IPTV Terminal Xin Wang, Young Kwon Lim

General m16511 Ad Hoc Group on MXM

Filippo Chiariglione, Christian Timmerer, Victor Rodriguez, Marius Preda

General m16512 Ad Hoc Group on MPEG-V Marius Preda

All AHG reports are accepted.

3.1.2 ContributionsSession Numbe

rTitle Source

General m16639 Fragments protection using MPEG-21 IPMP Components Jaime DelgadoEva Rodríguez

m16639 Proposing new attribute to protect fragment Accepted to be included in the existing amendment

3.1.3 LiaisonsSession Numbe

rTitle Source

General m16513 IEC CDV 62455 [SC 29 N 10369] IEC TC 100 via SC 29 Secretariat

General m16559 IEC DTR 62636 [SC 29 N 10434] IEC TC 100 via SC 29 Secretariat

General m16514 Liaison Statement from ITU-R SG 6 [SC 29 N 10373] ITU-R SG 6 via SC 29 Secretariat

General m16761 Liaison Statement from SC 29/WG 1 [SC 29 N 10364] SC 29 Secretariat

57

m16513 This liaison inform us the progress of the standard on Internet protocol (IP) and transport stream (TS) based service access (TA1). Thank you and provide a list of relevant standards as reply. m16514 This liaison inform us two new questions, 12-2/6 and 34-2/6 regarding General bit-rate reduction coding of audio, video and File formats and transport for exchange of audio, video, …, respectively. Thank you and provide a list of relevant standards as reply. m16559 This liaison inform us the progess of the standard on Guidelines for implementing digital rights permission code: examples of fixed-length permission codes derived from restricted code length profiling. Thank you and provide a list of relevant standards as replym16761 This liaison inform us the FPDAM text of ISO/IEC 15444-1/AMD 4 Profiles for broadcast applications. Answer will be provided with the progress of new amendment to MPEG-2 to carry it. Summary of technical discussion related to this liaison is as follows:

JPEG 2000 broadcast profile amendment is used as basis (ISO 15444-1/Amd 4). Access unit, profiles/levels defined in 15444-1/Amd 4. Systems will define video sequence and video ES. Support for still and motion sequences. STD model is same as MPEG-2 video. STD buffer size specified in the transport

standard. Annex S will be added to specify description related to carriage of JPEG 2000

including buffer parameters. New stream_type and descriptor added. Stream_id will be same as MPEG-2 video

(0xE0). Program Stream may not be needed at this time. WD 1.0 at this meeting with plans to go to PDAM 5 at next meeting. Interest from organizations for contribution applications.

3.2 FAQThe FAQ were updated as needed.

3.3 AOBNone.

4 MPEG-2 Systems (13818-1)

4.1 Topics

4.1.1 ISO/IEC 13818-1:2007 AMD4 Transport of MVC This amendment specifies the transport of MVC video (ISO/IEC 14496-10/Amd.3 | ITU-T Rec H.264-2009) in MPEG-2 systems (both transport and program streams).

4.1.2 ISO/IEC 13818-1:2007 COR 3 Minor Corrections This corrigendum corrects the transport rate parameters when HRD parameters are present in the video. It also corrects minor errors from older versions such as vbv buffer size and splice_type semantics.

58

4.1.3 ISO/IEC 13818-1:2007 AMD 5 Carriage of JPEG2000 over MPEG-2 TS(short description)

4.2 Contributions

Session Number

Title Source

General m16536 Summary of Voting on ISO/IEC 13818-1:2007/FPDAM 4 SC 29 SecretariatGeneral m16732 Comments on FPDAM4 of MPEG-2 Systems: Transport

of MVCYing ChenMarta KarcewiczPeisong Chen

General m16611 Considerations on SAF over MPEG-2 Systems Jihun ChaHyun-Cheol KimHan-Kyu Lee

m16536 & m16732 Comments from JNB and USNB. Both suggested adoption of study text with minor

comments. Accepted all of them except for one. USNB comment requesting transmission of prefix NAL unit in enhancement layer

was accommodated by addition extra signaling in MVC descriptor to indicate presence/absence of prefix NAL unit in base layer.

This accommodates a corrigendum item in MVC which is expected to make prefix NAL unit optional.

A minor editorial change was made to support use cases that may require gaps in view order index (changed ‘consecutive’ to ‘increasing’).

Renamed DRD NAL unit to VDRD (View and Dependency Delimiter NAL unit) During this meeting an issue in supporting use cases that require different profile/level

signaling based on combinations of views was identified. Systems group requests national bodies to provide comments so that support for this

use case can also be added to the items in next corrigendum (ISO/IEC 13818-1:2007/DCOR-3).

m16611 Issues and use cases somewhat unclear. PES can be used without time stamps and with CRC enabled as it supports 65000 byte

access units. Issues related to use with MPEG-4 systems, use with MPEG-4 systems carried over

MPEG-2 and direct use with MPEG-2 systems unclear at this time.

4.3 Action Points

59

5 MPEG-4 System (14496-1)

5.1 Topics

5.1.1 ISO/IEC 14496-1:200X AMD 4 RA and Systems Extension

5.1.2 ISO/IEC 14496-1:200X 4th edition

5.2 Contributions

Session Number

Title Source

General m16641 Comments on WD of 14496-1 PDAM4 MPEG-4 Registration Authority and systems extensions

Jean-Claude DufourdCyril ConcolatoJean Le Feuvre

m16641This contribution proposed changes regarding LASeR and SAF over MPEG-2 systems. Accepted in general.

5.3 Action Points

60

6 MPEG-4 Conformance (14496-4)

6.1 Topics

6.1.1 ISO/IEC 14496-4:2007 AMD37 Additional File Format Conformance

6.2 ContributionsSession Numbe

rTitle Source

File Format m16535 Summary of Voting on ISO/IEC 14496-4:2004/FPDAM 37 SC 29 Secretariat

m16535Thank you, all approved without comment. Editors to supply FDAM.

6.3 Action Points

7 MPEG-4 Reference Software (14496-5)

7.1 Topics

7.1.1 ISO/IEC 14496-5:2007 AMD 23 Sythesized Texture Reference Software

7.2 Contributions

7.3 Action Points FPDAM ballot until 2009-10-17

8 MPEG-4 BIFS (14496-11)

8.1 Topics

8.1.1 ISO/IEC 14496-11:2005/AMD 7 New Profile

8.2 Contributions

Session Number

Title Source

Scene m16637 Response to the CfP on additional BIFS technologies for Jean-Claude Dufourd

61

Interactive Services for Digital RadioCyril ConcolatoJean Le FeuvreBenoit Pellan

Scene m16749 Response to the CfP on additional BIFS technologies for Interactive Services for Digital Radio Young-Kwon LIM

Scene m16676 Active and reactive components for participative, distributed and collaborative BiFS scenes

Bojan JoveskiIain-James MarshallMihai MitreaFrancoise PreteuxPieter Simoens

m16637 R2 Graphical elements

o Include XCurve2D, Curve2D, Layer2D, LinearGradient, LineProperties and XLineProperties

o Change limitation of Coordinate2D to 1024 or 4096 points R4 Scene Layout

o Add “JUSTIFY” to the Layout node for text alignment R5 Adaptation

o EnvTest to evaluate the environment R6 Navigation

o Focusable node for 1-D navigation R7 Delivery of Images

o BitWrapperImageContent node to cache image R8 Scene State Management

o Storage node to identify the list of attributes to store R9 Integration of external data sources

o ReplaceFromExternalData() and ReplaceToExternalData()o XReplace() to use interactively modified field value for ROUTE o How do we concatenate string? Can we use “Valuator”?

Proposed modification to the WD

m16749 R6 Navigation

o KeyNavigator node R7 Delivery of Images

o CompressedImageTexture node

m16676Providing information about the possibility of using BIFS for sharing of multimedia content and distributed and collaborative blackboard as a part of European project. More contribution will be provided.

8.3 Action Points

62

9 MPEG-4 ISO Base File Format (14496-12)

9.1 14496-12/COR 2 Usage of brands and box order in sample entry

9.1.1 ISO/IEC 14496-12:2008 COR 2 Usage of brands and box order in sample entry

9.1.2 ISO/IEC 14496-12:2008 AMD 1 General improvements

9.1.3 ISO/IEC 14496-12:2008 COR 3 Minor Corrections

9.1.4 Exploration Subtrack selection and changing Adaptive progressive download

9.2 General

Summary 1-Pager White Paper Presentation1. ISO Base Media File Format X? X? X??2. MPEG-4 File Format X X3. AVC File Format X X4. SVC File Format X ?5. MVC File Format ? ?

We also need to do an update on the Registration Authority, skimming all our latest specifications for new code points.Volunteers: Dave: to lead part 12.All: read through and comment on what others write.Thomas/Karsten: look at the SVC/AVC one-pager and ‘reduce’ the intro material we have, for that.Miska: to look at the MVC material.

Plan: a ‘larger’ white paper on the AVC FF family, and we’ll reduce that again to make a one-pager.

Once that’s done, we’ll look into new presentations.

9.3 Contributions

Session Number

Title Source

File Format m16516 Summary of Voting on ISO/IEC 14496-12:2008/DCOR 3 [SC 29 N 10376]

SC 29 Secretariat

File Format m16612 Thoughts about Adaptive Progressive Download in the file format

David Singer

File Format m16613 Thoughts about Sub-track selection in the file format David SingerFile Format m16665 File format sub-track selection and switching Per Fröjdh

Andrey NorkinClinton Priddle

63

m16516 Summary of Voting on ISO/IEC 14496-12:2008/DCOR 3 [SC 29 N 10376]Thank you, all approved without comment. Editors to supply COR, and to integrate into the running integrated edition.

m16665 File format sub-track selection and switchingThank you for the update. Indeed, we don’t seem to have a way in SVC to indicate the recommended/selected output ‘modes’ (e.g. labeling the file that you should play the EL because the user has paid for it, and not switch down to the BL). The layer_output_flag is really buried in the sample groups, alas.We issue an WD of amendment and encourage comment.

m16612 Thoughts about Adaptive Progressive Download in the file formatThank you, and thank you also to the original proponent for the continued discussion. HTTP-based streaming is an active topic of discussion, not only here in MPEG (MMT) but also in 3GPP, DVB, the Media Fragments work at W3C, and other places. There are a number of proprietary solutions.This is an area that MPEG, through the MMT, should monitor. Do we need a new, truly ‘incremental’ file/stream format that is a ‘family member’ with the ISO base media file format? Such a format would enable, for example ‘drop and play’ (tune in to a live stream), and time-based seeking when the client doesn’t have a time-to-dataoffset map yet.Let’s hold this until we understand more (from MMT, and possibly other places). Exploration and requirements contributions would be very welcome.

m16613 Thoughts about Sub-track selection in the file formatThank you. 16665 notes the issue with track-based selection, that (for example) an SVC track may contain something that should not be adapted down to (because, e.g., the user paid for better).

9.4 Action Points COR2 published 2009-05-01 FDAM 1 ballot open

10 MPEG-4 File Format (14496-14)

10.1 Topics

10.1.1 ISO/IEC 14496-14:2003 AMD 1 Handling of MPEG-4 Audio enhancement layers

10.2 ContributionsSession Numbe

rTitle Source

File Format m16517 Summary of Voting on ISO/IEC 14496-14:2003/PDAM 1 [SC 29 N 10377] SC 29 Secretariat

64

m16517Thank you, all approved without comment. Editors to supply FPDAM.

10.3 Action Points

11 MPEG-4 AVC File Format (14496-15)

11.1 Topics

11.1.1 ISO/IEC 14496-15:2004/FPDAM 3 MVC File Format

11.2 Contributions

Session Number

Title Source

File Format m16540 Summary of Voting on ISO/IEC 14496-15:2004/FPDAM 3 SC 29 Secretariat

m16540 Summary of Voting on ISO/IEC 14496-15:2004/FPDAM 3Thank you for the detailed, thoughtful, and helpful comments.

Review of the comments in the FPDAM textWe note that we haven’t got a definition of a sub-sample for MVC. The editors and group to provide one, modeled on the SVC definition. We agreed the disposition of these comments also.

11.3 Action Points

12 LASeR & SAF (14496-20)

12.1 Topics

12.1.1 ISO/IEC 14496-20:2008 AMD 2 Technologies for Scene Adaptation

12.1.2 ISO/IEC 14496-20:2008 AMD 3 Presentation and Modification of Structured Information (PMSI)

12.1.3 Exploration Advanced User Interaction

65

12.2 Contributions

Session Number

Title Source

Scene m16547 Summary of Voting on ISO/IEC 14496-20:2008/FPDAM 2 SC 29 Secretariat

Scene m16610 Study Text of 14496-20 FPDAM3

Jihun ChaInjae LeeYoung-kwon LimHan-Kyu LeeJinwoo Hong

Scene m16625 Advanced User Interaction on LASeR Seo-Young Hwang

Scene m16611 Considerations on SAF over MPEG-2 SystemsJihun ChaHyun-Cheol KimHan-Kyu Lee

m165472 negative votes from France and Japan asking to take into account the content of N 10582 "Study of ISO/EC 14496-20:2008 LASeR & SAF/FPDAM 2 Adaptation". Comments accepted.

m16610Editor's text for the FPDAM3 (PMSI) adds:- rows for the new elements with the list of supported attributes- binary syntax.- XML Schemas v4The contribution looks fine. A few typos are fixed and harmonization in the style of the text. The table of element looks ok but we are wondering what happens to the transform attribute on the externalReference and externalUpdate elements. They don't appear in the schema, so this is consistent. People should check it. Binary syntax needs to be checked to make sure it's correct. We suggest to produce a Study text with this contribution and to issue a resolution asking NB to consider that document in their vote.

m16611The contribution raises the issue that we need a more detailed solution if we want to use SAF on MPEG-2 Systems. There is an agreement that the current text mixes BIFS, LASeR, SAF, MPEG-4 Systems, MPEG-2 … This is not a proper way to do it. We agree that we need (for now) a clean solution only for:- LASeR on MPEG-4 Systems- SAF over MPEG-2 (needs further discussion with MPEG-2 experts)We may want to investigate LASeR over MPEG-2 without using SAF nor using MPEG-4 Systems

m16625Proposed to define advanced user interface standard by using technologies to be standardized in MPEG-V. Accepted in general.

12.3 Action Points FPDAM 3 ballot until 2009-08-24

66

13 Open Font Format (14496-22)

13.1 Topics

13.1.1 ISO/IEC 14496-22:200X 2nd edition

13.1.2 ISO/IEC 14496-22:200X AMD 1 Support for many-to-one range mappings

13.2 ContributionsNone.

13.3 Action Points 2nd edition FDIS ballot until 2009-07-14 PDAM1 ballot until 2009-07-24

14 MPEG Query Format (15938-12)

14.1 Topics

14.1.1 ISO/IEC 15938-12:200X AMD 1 MPQF Conf. and Ref. SW.

14.1.2 ISO/IEC 15938-12:200X AMD 2 Semantic Enhancement

14.1.3 ISO/IEC 15938-12:200X COR 1

14.2 Contributions

Session Number

Title Source

General m16616 Proposal for MPEG Query Format Corrigendum 2 Ruben TousJaime Delgado

General m16617 Proposal of amendments to MPEG Query Format Ruben TousJaime Delgado

General m16618 Update of WD4.0 of ISO/IEC 15938-12/Amd.1 MPEG Query Format Ref. Soft & Conf.

Ruben TousJaime Delgado

m16616 Empty query QueryByROI is missing

m16617 Currently respond needs to be compliant to the schema so the result would be long

XML data starting from the root. Proposed alternative solution requiring simple result Add to AMD 1

m16618Ready to produce CD.

67

14.3 Action Points

15 MPEG-21 DID (21000-2)

15.1 Topics

15.1.1 ISO/IEC 21000-2:2005 AMD 1 Presentation of Digital Item

15.2 Contributions

None.

15.3 Action Points PDAM 1 ballot until 2009-07-31

16 MPEG-21 IPMP Components (21000-4)

16.1 Topics

16.1.1 ISO/IEC 21000-4:2006 AMD 2 Protection of Presentation element

16.2 Contributions

None.

16.3 Action Points PDAM 1 ballot until 2009-07-31

17 Media Value Chain Ontology (21000-19)

17.1 Topics

17.1.1 ISO/IEC 21000-19 Media Value Chain Ontology

17.2 Contributions

Session Number

Title Source

MVCO m16354

21000-19 FCD revision Marc GauvinJaime DelgadoVictor Rodriguez

68

http://wg11.sc29.org/meetings/88_Maui/m16354/


Miran ChoiMVCO m1635

5Editors Notes on MVCO Review Marc Gauvin

Jaime DelgadoVictor RodriguezMiran Choi

m16354 & m16355Accepted to produce FCD.

17.3 Action Points

18 Musical Slide Show AF (23000-4)

18.1 Topics

18.1.1 ISO/IEC 23000-4:2009 AMD 2 Conf. and Ref. SW for Protected MSSAF

18.2 Contributions

None.

18.3 Action Points FDAM ballot until 2009-08-05

19 Media Streaming AF (23000-5)

19.1 Topics

19.1.1 ISO/IEC 23000-5 2nd edition

19.2 Contributions

None.

19.3 Action Points 2nd edition CD ballot until 2009-08-26

69



20 Professional Archival AF (23000-6)

20.1 Topics

20.1.1 ISO/IEC 23000-6:2009 AMD1 PA-AF Conf. and Ref. SW

20.2 Contributions

Session Number

Title Source

MAF m16532 Summary of Voting on ISO/IEC 23000-6:2009/FPDAM 1 SC 29 Secretariat

MAF m16650 Editor's input to ISO/IEC 23000-6/FDAM 1 (PA-AF)

Noboru HaradaHouariHendryTakehiro MoriyaYutaka KamamotoMunchurl Kim

m16532/ m16650: Due to the time required for bug fix, DoC will be produced at the next meeting. At the same time, the AMD document will be released together.

20.3 Action Points

21 DMB AF (23000-9)

21.1 Topics

21.1.1 ISO/IEC 23000-9:2008 AMD1 DMB AF Conf. and Ref. SW

21.1.2 ISO/IEC 23000-9:2008 AMD2 DMB AF Harmonization on MPEG-2 TS Storage

21.2 Contributions

Session Number

Title Source

MAF m16534 Summary of Voting on ISO/IEC 23000-9:2008/FPDAM 1 SC 29 SecretariatMAF m16519 Summary of Voting on ISO/IEC 23000-9:2008/PDAM 2 SC 29 Secretariat

m16534All accepted.

m16519The first comment is accepted , which is due to the typing error. Since DMB uses only one program for a TS, the case of the multiple programs for a TS described in the second comment is not relevant. To produce DoC on this ballot.

70

21.3 Action Points

22 Video Surveillance AF (23000-10)

22.1 Topics

22.1.1 ISO/IEC 23000-10:2009 AMD1 VS AF Conf. and Ref. SW

22.1.2 Exploration Advanced visual surveillance AF

22.2 Contributions

None.

22.3 Action Points IS is published on 2009-05-01

23 Stereoscopic Video AF (23000-11)

23.1 Topics

23.1.1 ISO/IEC 23000-11 COR1 SV AF Signaling of voice codecs

23.1.2 ISO/IEC 23000-11 AMD1 SV AF Conf. and Ref. SW

23.2 Contributions

Session Number

Title Source

MAF m16521 Summary of Voting on ISO/IEC 23000-11:200X/DCOR 1 [SC 29 N 10380] SC 29 Secretariat

MAF m16594 Study Text of ISO/IEC 23000-11 PDAM1Next generation Broadcasting Forum (Korea)

MAF m16626 Proposed Corrigendum on ISO/IEC 23000-11 Stereoscopic Video Application Format Seo-Young Hwang

m16521: No Doc. Will be produce for Corrigendum 1m16594: has been approved. Will be promoted to study of PDAM1m16626: Accepted. It is going to be Amd2.

71

23.3 Action Points FDIS ballot until 2009-XX-XX PDAM 1 ballot until 2009-07-24

24 Interactive Music AF (23000-12)

24.1 Topics

24.1.1 ISO/IEC 23000-12 Interactive Music AF

24.2 Contributions

Session Number

Title Source

MAF m16522 Summary of Voting on ISO/IEC CD 23000-12 [SC 29 N 10381] SC 29 Secretariat

MAF m16710 Editor's study on ISO/IEC 23000-12 CD Interactive music application format

Inseon JangJeongil SeoHui Yong KimLaurent PrimauxOwen Lagadec

MAF m16620 iKlax Improvement Proposal fro Volume representation method

Laurent PrimauxOwen LagadecEmmanuel Bouix

MAF m16711 Consideration on Personal-mix Usage for IM AF


MAF m16712 Brands for Interactive Music AF

Inseon JangJeongil SeoHui Yong KimKyeongok KangKevin SeungChul Ham

MAF m16713 Workplan for ISO/IEC 23000-12 Interactive Music AF Conformance and Reference Software


m16522: has been discussed with USNB. The comments from USNB has been dissolved. DoC for this ballot will be produced in this meeting.

m16620: Accepted

m16711:

72

Accepted. Do not duplicate the syntax and semantics of boxes defined in ISO FF. Change personal mix file into a IMAD file with personal mix info.

m16712: “track” shoud be more clearly explained such as in terms of FF and of audio aspect. There is no common opinion for the brand. The issue with ‘brand’ is going to be discussed in the next meeting.

m16713: accepted

24.3 Action Points

25 MPEG-V Architecture (23005-1)

25.1 Topics

25.1.1 ISO/IEC 23005-1 MPEG-V Architecture

25.1.2 Exploration on Haptics

25.2 Contributions

Session Number

Title Source

MPEG-V m16573 MPEG-V Contributions Jean H.A. GelissenMPEG-V m16564 Proposal for an interoperable 3D platform Jerome RoyanMPEG-V m16741 minor suggestions on MPEG-V System Architecture Jae-Joon Han

MPEG-V m16727 Adding Instantiations of Haptic Interactions in N10616 Architecture

Jeha RyuYeongmi Kim

MPEG-V m16728 Extending N10617 Control Information with Haptic Effects

Jeha RyuYeongmi Kim

MPEG-V m16729 Extending N10618 Sensory Information with Haptic Effects

Jeha RyuYeongmi Kim

MPEG-V m16730 Proposal for Change of MPEG-V Requirements Version 3.2

Jeha RyuYeongmi Kim

m16573- an analysis of existent olfactory displays already in the market. Same has to be done for other signals (lights, heating, …) since the CI is currently a translation from the SE and not built on analysis of existent devices.Recommendation: CI is not mature enough for promoting in CD, refinements should be performed. - The paper groups together additional contributions. We only review MLIF (proposal by Loria) for having multilingual support in virtual worlds. No specific action.

73

m16564- the current trend for web is to install browsers plug-ins for accessing virtual worlds. One problem is that there is no communication between these plug-ins. Some other open questions on are related to the non communication between different virtual worlds. A proposal is to share a common API to ensure communication between the scene graph and the different application engines (rendering, AI, …).Resolution: continue the investigation on how such API is technically implementable

m16741Not accepted.

m16727This contribution is a response for the Call for Proposal. Several use cases are presented.

m16728Two types are proposed for device capabilities: TactileDeviceControlInformation and KinestheticDeviceControlInformation. (accepted)

A new type is proposed for representing the haptic information HapticSensingType (accepted)

m16729Two types are proposed for device capabilities: TactileSensoryInformationTypeand KinestheticSensoryInformationType (accepted).

A new type is proposed for representing the haptic information HapticWidgetType (accepted)

m16730update the requirements to add more details on requirements on haptics. Resolution: review again in a joint meeting with requirements.

25.3 Action Points

26 Control Information (23005-2)

26.1 Topics

26.1.1 ISO/IEC 23005-2 Control Information

26.2 Contributions

Session Number

Title Source

MPEG-V m16722 Study on MPEG-V Control Information

Yasuaki TokumoTakuya IwanamiShuichi WatanabeShin-ya Hasegawa

74

MPEG-V m16589 Study on Sensory Device Command in MPEG-V Control Information

Jin-Seo KimMaeng-Sub ChoBon-Ki KooYong Soo JooSang-Kyun Kim

MPEG-V m16595 Comments on Sensory Device Command of MPEG-V

B. S. ChoiJooJangPark

MPEG-V m16733 Control Information from Sensors Seungju HanMPEG-V m16734 Avatar Control Information Jae-Joon Han

MPEG-V m16596 Comments on User Sensory Preference & Sensory Device Capability of MPEG-V

B. S. ChoiSangHyun JooJongHyun JangKwangRo Park

MPEG-V m16692 Discussion input on overlapping sensory effects Markus WaltlChristian Timmerer

m16722Need of separating preparationTime and responseTime (accepted)

m16589- Re-usage of the SEDL and SEVocabulary for SDCom is not possible- Proposal to use the idref for referring a device defined with ID in the top of the document to avoid conflicts when using twice same ID in a document (accepted)

m16595- not use GroupOfCommands since we send them to different devices (accepted)- keep "pts" as a provision for the future high end devices (accepted)- implement simple "intensity" meaning for the devices, use range, levels or percentage instead of measures (e.g. Richter magnitude) that the device does not usually know.- proposal for temperature type for indicating cooling and heating instead of temperature itself. There is a need to be known by the adaptation engine the ambient temperature if the device can not handle it itself.Resolution: replace the temperatureType by heatingType and coolingType

m16733- redefining the architecture to make the separation between the actuators and sensors (not accepted)

m16734- add a wrapper for being possible to update any avatar characteristicResolution: keep control only on meaningful features

m16596Proposal to include device name, manufacturer, … in terminalCapabilityBaseType.Resolution: check what exists in DIA for TerminalType and do the same.

Separate the delay time in two components: "preparation time" and "time to reach target" (same as difference between "off state" and "stand-by state") - accepted

Drop the shading effect (accepted).

75

Add color disabilities. Resolution: use the dia:UserCharacteristicsBaseType for color disabilities.

An adaptationMode is proposed (scalable or strict) to force the mapping of values out of range. The initial proposal was that in the case of "strict" the output value should be zero. Resolution: in the case of "strict" when the input value is out of range, the output should be equal with the maximum value the device is able to operate.

Change the names for detestableColor, detestableScent in unfavorableColor and unfavorableScent, respectively (accepted)

m16692- It is possible to have situations where multiple values for the same effect are specified. The proposal is to keep the maximum value.New recommendation: the decision of the right value should be implemented by the adaptation VR

26.3 Action Points

27 Sensory Information (23005-3)

27.1 Topics

27.1.1 ISO/IEC 23005-3 Sensory Information

27.2 Contributions

Session Number

Title Source

MPEG-V m16690 Editor's Input on MPEG-V SIChristian TimmererSang Kyun KimShin-ya Hasegawa

MPEG-V m16588 Study on MPEG-V Sensory Information

Jin-Seo KimMaeng-Sub ChoBon-Ki KooYong Soo JooSang-Kyun Kim

MPEG-V m16721 Study on MPEG-V Sensory Information

Yasuaki TokumoTakuya IwanamiShuichi WatanabeShin-ya Hasegawa

MPEG-V m16691 Proposed minor corrections to SEDL and SEV examples Markus WaltlChristian Timmerer

MPEG-V m16560 Olfactory Interaction Model and Services for MPEG-V Jeong-Do KimH-G Byun

76

m16690- A new introduction is proposed for ISO/IEC23005-3 (accepted)- New definitions provided in terms of reference (accepted)

Actions: change the figure 2 to specify which part is doing what, put Figure 2 and the associated text in an Informative Annex

m16588- ambiguity about behavior for fadein/fadeout, concerning the continuity. The proposal is to include a continue value to put the conditions on the border. It was demonstrated during the meeting that this is not necessary because it can be done with the current parameters

m16721- discussion on role of "activate" in combining effects. Proposal to change the semantic of "activate" element (not accepted)- fadein/fadeout: when a new intensity is specified together with fadein/fadeout, it is possible to have contradictory effect. Resolution: use only one name "fade" and specify the targeted intensity (if intensity is lower than current one then it is implicitly a fadeout)

m16691- A proposal to have intensity as a float value between 0 and 1 (accepted) - Some examples were provided (accepted)

m16560not presented

27.3 Action Points

28 Avatar Information (23005-4)

28.1 Topics

28.1.1 ISO/IEC 23005-4 Avatar Information

28.2 Contributions

Session Number

Title Source

MPEG-V m16735 Virtual goods information (Characteristics) Hyunjeong LeeMPEG-V m16742 Minor suggestions of Avatar Information Jae-Joon Han

m16735- add a wrapper for being possible to update any avatar characteristicResolution: keep control only on meaningful features such as avatar motion. Resolution implemented in the current version of the CD.

77

- a complete framework is proposed for characterizing different properties that may be attached to a virtual object: appearance, sound, smell, taste, motion control.Resolution: maintain this part in WD and continue in investigating the distinction between representing the information as part of virtual object itself (on the same level of appearance) or as part of metadata associated to it.

m16742- add pulse, blood sensors, and other metadata related to the real userResolution: not accepted because the avatar characteristics should only contains information on avatars and not related to the user

28.3 Action Points

29 Reference Software (23005-5)

29.1 Topics

29.1.1 ISO/IEC 23005-5 Reference Software

29.2 Contributions

29.3 Action Points

30 Conformance Testing (23005-6)

30.1 Topics

30.1.1 ISO/IEC 23005-5 Reference Software

30.2 Contributions

30.3 Action Points

78

31 MXM Architecture (23006-1)

31.1 Topics

31.1.1 ISO/IEC 23006-1 MXM Architecture and technologies

31.1.2 MXM License

31.1.3 MXM Developer’s Day

31.2 Contributions

Session Number

Title Source

MXM m16542Summary of Voting on Proposal for a New Work Item, Information technology -- MPEG extensible middleware (MXM)

SC 29 Secretariat

MXM m16543 Summary of Voting on ISO/IEC CD XXXXX-1, MXM architecture and technologies SC 29 Secretariat

MXM m16694 Austrian NB comments on MXM

Michael EberhardChristian Timmerer(on behalf of the Austrian NB)

MXM m16554 Options for the MXM software licencesLeonardo ChiariglioneDavid Rudin

MXM m16648 Revision of the License Authorisation on MXM

Víctor Rodríguez-DoncelJaime DelgadoEva Rodríguez

MXM m16693 Input for the MXM Developer's DayMichael EberhardChristian TimmererHermann Hellwagner

m16542Refer DoC.

m16543Refer DoC.

m16694Refer DoC

m16554Accepted. Final text will be recorded in the resolution.

m16648The APIs should be defined so that a reasonable set of requirements is satisfied. An implementation of an engine may not be capable of executing all methods. It is necessary to check that the resulting set of engines perform properly. The MXM architecture allows to have engines of the same type to operate simultaneously. Implementers of different MXM

79

engines are encouraged to commit their engines to the MXM repository in the mxm-engines sub-folder.

Decide whether we need requirements and a CfP or we can simply add new MXM Protocols to the existing ones

m16693Demo presented during the MXM Developer’s Day

31.3 Action Points Harmonization with MPEG-E

32 MXM APIs (23006-2)

32.1 Topics

32.1.1 ISO/IEC 23006-2 MXM APIs

32.2 Contributions

Session Number

Title Source

MXM m16544 Summary of Voting on ISO/IEC CD XXXXX-2, MXM API SC 29 Secretariat

MXM m16562 Proposal for updated generic metadata APIs on MXM Wonsuk LeeSeungyun Lee

MXM m16747 Updated version of MXM APIs Filippo Chiariglione

MXM m16619 Proposal to MXM regarding MPQFRuben TousVictor RodriguezJaime Delgado

m16544Refer DoC

m16562This contribution gives input in two directions: 1. The generic Metadata APIs 2. An approach to implement a Metadata Engine capable of operating on three different metadata schemes (EXIF, MediaRSS, TVA) based on a media ontology and Xpath queries. Work on the integration with existing generic metadata APIs during the week

Integrated in the current MXM API specification

m16747Noted.

m16619Proposal for extended MPQF APIs was accepted, the proposed extensions will be integrated in the FCD. Discuss the need for a (reference to the) MPQF protocol

80

The figure in 23006-1 was updated to add the ContentSearchDevice. We need to discuss with Requirements what to do for the Content Search Protocol specification

32.3 Action Points

81

33 MXM Conf. & Ref. SW (23006-3)

33.1 Topics

33.1.1 ISO/IEC 23006-3 MXM Conformance and Reference Software

33.2 Contributions

Session Number

Title Source

MXM m16545 Summary of Voting on ISO/IEC CD XXXXX-3, MXM conformance and reference software SC 29 Secretariat

MXM m16750 Proposed text of ISO/IEC FCD 23006-3 MXM Conf. & Ref. SW

Filippo ChiariglioneAngelo DifinoEmiliano Leporati

m16545Refer DoC

m16750We need further harmonisation on the MXM C++ implementation to be further discussed on Tuesday between MXM C++ experts

33.3 Action Points

34 MXM Protocol (29116-1)

34.1 Topics

34.1.1 2nd edition of ISO/IEC 29116-1 MXM Protocols

34.1.2 Change of standard number to 23000-4

34.2 Contributions

Session Number

Title Source

MXM m16541 Summary of Voting on ISO/IEC CD 29116-1 [2nd Edition] SC 29 Secretariat

MXM m16652 Proposal for additional MXM ProtocolsFilippo ChiariglioneSergio MatoneAngelo Difino

m16541Refer DoC

m16652Further discuss the requirements in Systems/Requirements in a broader scope of possibly issuing a new CfP.

82

Include the modifications to the MXMBP protocol defining BasicResultCode and ExtendableResultCode as child of ResultCodeType

Decide whether we need requirements and a CfP or we can simply add new MXM Protocols to the existing ones

34.3 Action Points

35 MPEG Rich Media UI Framework (23007)

35.1 Topics

35.1.1 Package, Delivery and Presentation of Widgets

35.1.2 Communication

35.1.3 Conf. and Ref. SW

35.2 General

Organization of the standardThe current standard is 37 pages, will probably be at most 50. That is small enough to manage as one part and does not necessarily need several parts. The reference software and conformance are definitely another part. The group agrees to ease the life of the editor and to keep only one part for now.

Conf. and Ref. SWDo we want to test conformance of bitstream (widgets) or of implementation (widget managers) or of both ? What is currently normative in our spec:- XML syntax for manifest extensions => proposed tool for reference software: a parser that validates the extension- Widget Manager Behavior:

- Composition is not a normative behaviour or at least not in MPEG-U, it is a SVG, LASeR, BIFS problem. We could reuse GPAC for that.

- Life Cycle: - Conformance of the "Processing of a Widget Package" should be done by the W3C (To

be checked) - Presentation of a widget list or widget icons is implementation specific: no

conformance. We could reuse GPAC. - Selection of a widget to activate and the state of activation (full, simple) is

implementation specific: no conformance. We could reuse GPAC. - Validation of the interfaces with the scene => proposed tool for reference software: not

difficult if no script. We can probably only provide that as a reference software. We could also use GPAC to dump the scene after init (execution of load scripts …) and then validate.

83

We could also modify the spec to mandate that either the fully scripted solution is used or all the nodes are declared in the initial scene document.

- Transition between representations is implement specific. We could use GPAC. - Event generation and handling:

- Interface Binding: depends on the network protocols. - communication privileges: implementation specific. We could use GPAC. - widget communication start and termination: implementation specific. We could use GPAC.- Widget Packaging: - Conformance of ISO BMFF widget package => we can use the libisomedia reference software.Note: "at the root level" should be changed to "at the file level".- Widget API: We could have reference software in which we could change the implementation of the API and test the replacement over a test suite of files using that API.- Predefined Services- Aggregation: we could check that references in components/interface match.

Discussion about the licence of the reference software. GPAC is LGPL and implements the whole spec but the licence is not compatible with ISO licence for reference software.

One option is to provide a minimal reference software which does only validation of XML. The other option could be to use GPAC as an environment within which the reference software could run, e.g. as a module, to check API implementation, binding algorithm, communication …

In terms of sequences, we need to test all attributes. It could be one sequence with all the possible attributes. 2 sequences: one completely declarative and the other one completely scripted.

Advertising videoPresentation of an example video and discussion on what video to produce and to put on the MPEG Web Site or on YouTube or both. The video needs to be structured to present the benefits of the standard. An idea could be to use the use cases in C&O document and in the contribution m16644 for that.Examples:- First simple widgets on different devices, with different media types (BIFS – 2D/3D, LASeR on mobile)- Then Simplified representation- Simple Communication: A widget controlling a remote service or displaying remote information- Advanced Communication: …The question is raised whether the MPEG-U standard can be made publically available for free, like LASeR.

35.3 Contributions

Session Numbe Title Source

84

rScene m16577 MPEG-U WD 1.1 Jean-Claude Dufourd

Scene m16578 MPEG-U WD improvements and proposals

Jean-Claude DufourdCyril ConcolatoJean Le FeuvreKyungmo ParkSeoyoung WangJaeyeon Song

Scene m16644 MPEG-U Howto, for inclusion as an informative annexJean-Claude DufourdCyril ConcolatoJean Le Feuvre

Scene m16726 MPEG-U improvements for widget security Kyungmo Park

M16578: Improvements and proposals.The contribution proposes:- an mw:serviceProvider attribute to be added to the mw:interface element. Accepted.- context-related additions: - mw:contextInformation element: accepted. - mw:contextConfiguration element with the following attributes:

- saveTrigger: accepted.- restoreTrigger: accepted.- saveAction: accepted with a change of definition to:"Optional. Indicates the name of a scene construct that is activated once the context

has been saved."- restoreAction: accepted with a change of definition to:"Optional. Indicates the name of a scene construct that is activated once the context

has been restored."- type (persistent | transient): the idea is accepted but the implementation is modified

as follow. The attribute is renamed "migratable". It is moved as an extension to the preference element. Its values are changed to: 'true', meaning that the associated preference value shall be transferred when the widget changes widget manager; 'false' meaning that the associated preference value shall not be transferred as part of the context information when the widget changes widget manager.

- extension to the W3C preference element: mw:connectTo attribute: accepted.

- URL syntax for context information retrieval: accepted but with two remarks:- it should be noted that if the initial widget manager has enough resources or credentials, it may modify the preference elements in the manifest to send the context information. This may be too expensive and we may need a way to reference a side context information file along with the manifest (to be investigated);- the solution not prevent a widget manager from sending the context information in a "higher-level" package (multipart/related mime package).We should add the following clarification:"In case of widget mobility, the source widget manager should provide a base url to retrieve the widget package for a given widget instance and should support requests for the associated context information of that instance in the form of <base_url>?mpeg-u-context if the base url does not contain '?' or <base_url>&mpeg-u-context if it already contains a '?'."

85

- widget aggregation: mw:component and mw:requiredInterfaces elements and associated API: accepted.

- multiple instances: mw:multiBind attribute: accepted but renamed to mw:multipleBindings.

- temporary widgets: mw:discardable attribute: accepted but the definition is changed to:"This optional Boolean attribute has a default value of false. It indicates whether the widget shall be discarded by the widget manager after its deactivation and shall no longer be used by the widget manager."

Fixes:- default on input/output: accepted- xml prefixes: accepted- IDL fixes: accepted- obsolete predefined communications: accepted to remove the text.- alignment with W3C: accepted- mw:interface@type: the idea is accepted. We need to have clear, normative behaviour defining when you can accept or reject a service.- component positioning: needs more discussion. Without this tool, the aggregation of widget will just concern the dependencies between widgets but one will not be able to present the widgets in an aggregated manner.

M16577: WD 1.1. accepted but with the modifications of the contribution above.

M16644: MPEG-U Howto, for inclusion as an informative annex- Downloadable UI: Retrieval by a TV of a widget package from either a DLNA device or a web server. This use case should be improved to show the advantage/added-value of MPEG-U. It could be using MPEG-4 LASeR or BIFS scene.- Remote UI: Widget transfer between devices. This use case should be improved to show more the added value of MPEG-U. For example, using the context information or by giving more details on how the images are transfered.- Distributed UI: A widget is made of 2 parts and one part is moved to a remote device while the other part stays on the initial device. Some sentences to be improved but the implementation should describe better the communication and use of messages between devices.- Widget Personalization- Widget Adaptation: this example uses a lot of metadata to detect. Some sentences comparing MPEG-U with other solutions could be improved.

One of the use cases should include how to use the context information or a new use case should be added.

If the standard is public, it would be fine to have it as an informative annex. If not, we should not duplicate text to avoid desynchronization. If we have two documents, then it would be complicated to maintain, we would prefer one public document.

A video should cover these use cases.

86

m16726: MPEG-U improvements for widget securityThe contribution presents network and application security considerations and then discusses some specific use cases. Following these use case, we understand that we may want to indicate that the widget needs a secure saving of some sensitive context information.

We also see that exchanging secured data between widgets is a difficult issue. It involves trusting widgets or trusting widget managers.

We agree that they are use cases for secure communication between widgets without relying on trusted widget managers. To implement such use case, we don't know if there is a need for tools in our spec.

There may be use cases where we want to trust widget managers and let them handle the secured communication. In that case, we need to investigate whether we need to indicate at the interface level, or at the message level, or at the output level, that the data sent by the widget should be communicated through secured channel.

The contribution presents requirements that authors should be able to prevent a widget to be aggregated or to be further distributed, or the opposite that widgets can be trusted for aggregation or distribution. This needs further investigation.

The contribution recommends using the W3C Widget 1.0: Digital signatures spec when security is need. This is accepted. We will add a section in the spec to describe how people can use Digital Signature for widget auhtenticy and integrriy and that the current spec does not provide tools for secured data communication and therefore it should be handled at the widget level or it may be implementation specific.

35.4 Action Points

36 Exploration – Advanced IPTV Terminal

36.1 Topics

36.1.1 Advnaced IPTV Termial

36.2 Contributions

Session Number

Title Source

AIT m16558 More Advanced IPTV Terminal (AIT) Use Cases Leonardo Chiariglione

AIT m16580 Use Case of Personalized Advertisement for AITKangchan LeeWonsuk LeeSeungyun Lee

87

AIT m16593 Input on the use cases of Advanced IPTV Terminal(AIT) Jin Young Lee

AIT m16555 Interfaces to payment systems for AIT

Leonardo ChiariglioneMimmo CosenzaSergio MatoneRoberto GaravagliaStefano Quintarelli

AIT m16696 On AIT requirements for Interfaces to Payment SystemsLars-Erik ErikssonChristian Timmerer (editor)

AIT m16608 Supporting Technologies for AIT Service Discovery in Heterogeneous Environments

Truong Cong ThangJung Won KangSeong-Jun BaeJeong-Ju Yoo

AIT m16697 On metadata for AIT Michael EberhardChristian Timmerer

M16558 Self made video and ads

o User’s parameters can be queried by the service providero Sharing personal features

Exploiting quoteso Semantic querieso Negotiation of license

Community content sharingo Sharing content with members of communities

M16580 Dynamic insertion of advertisement based on user’s context Proposed to use fragment identifier under development in W3C

M16593 Distance Learning Traffic/Accident Live-cast

M16555 Three use cases highlighting payment process

o B2Co B2Bo B2B + B2C

Analysis on the list of interface might needed to be standardized

M16696 Requirements on payment system interface

o the interface must be respectful to the legal environment the payment system is subject to

o user privacyo different level s of secure identification /authorization of usero content owner requirement regarding geographic information, time, age

limitation and so on

88

o open and flexible to make it easier to develop new business models.

M16608 Use case highlighting service discovery and contents adaptation Analysis on existing solutions regarding adaptation

M16697 Structured way allowing for easy extensions Minimal set of core metadata allowing mapping to other standard

36.3 Action Points Joint meeting with ITU-T Q.13/16

37 Exploration – MMT

37.1 Topics Transport- and file format friendly stream format Cross layer optimization between video and transport layer Error resilience for MPEG streams Conversion between transport mechanisms Content adaptation to different networks

37.2 Contributions

Session Number

Title Source

MMT m16614 On Modern Media Transport (MMT) David SingerMMT m16624 contribution on MMT Jaeyeon Song

MMT m16695 Contribution to Workshop on MMT (Modern Media Transport)

Michael EberhardChristian TimmererIngo KoflerRobert KuschnigHermann Hellwagner

MMT m16586 Harmonization with the existing QoS protocols for MMT Doug Young SuhJin Woo Hong

37.3 MMT WorkshopSession I

Motorola Introduction of MPEG-2 TS, PS General requirement of broadcast service Additional features added by application standard Non-Broadcast applications and requirements

89

Issues of MPEG-2 TS Some requirement for MMS Q : IPMP, how do you think? Unbalanced structure?

Apple Preference to file delivery instead of live stream MP4 issues (progressive download over HTTP) RTP/RTCP/IP Codec sensitivity issue Clock recovery MPEG-2 TS on UDP Needs Industry issues A recent solution Q : live vs. progressive download, protection?

Samsung Convergence Era (Fixed & Mobile Convergence) Service Innovation MMT design issues in FMC environment Post HD environment Requirements for MMT Q : QoE?

DVB DVB File Format specifications DVB IPTV specifications Open Internet TV under study (decision in fall 2009) Cross-layer designs to improve the quality of Service – NOT Q : any criticism to MPEG-2 TS? (adaptive usage of )SVC?

What does it mean “better?” efficiency, providing additional features

37.4 Action Points

38 LiaisonCf. Liaison output.

90

39 Latest References and Publication Status

Refer “Program of Work” section in SC29 Web Site : http://www.itscj.ipsj.or.jp/sc29/

91

http://www.itscj.ipsj.or.jp/sc29/

40 Resolutions of Systems

Cf. WG11 resolution.

41 Action Plan

N° What Who When Status Trace

1.

92

Annex G – Video report

Source: Jens-Rainer Ohm, Gary Sullivan

1 Development of AVC

The video subgroup and the joint video team of VCEG and MPEG members intensely discussed issues related to the ongoing development of AVC amendments and the corrigendum work related to the fifth edition. The most relevant work items in this context were

– Issuing FDAM1 of 5th edition (Constrained Baseline, Stereo High Profile, frame packing arrangement SEI): The modifications proposed in the previous study document were adopted by request of national bodies. The new Stereo High Profile, which restricts MVC to 2 views but includes support of interlaced coding tools, was strongly supported by several national bodies. As this is only a new combination of existing tools, it was considered not unusual to include this at the final amendment stage of the approval process. As a stable software implementation exists, there is additional confirmation of the lack of substantial technical risk in doing so. Further, performance gains were reported for the constellation of this new profile, showing 20-30% average benefit in terms of bit rate reduction (as tested) for the bit rate used for coding the dependent view, with the amount of gain depending on the test set and the camera baseline distance, for progressive sequences. For the interlace cases tested, the gain was a bit lower (15% average), but this was for IBBP, where the gain is generally lower than in the Hierarchical B coding case that was used for progressive stereo testing (and the software for the interlaced case may be somewhat generally less mature).

– Issuing DCOR1 of 5th edition. This includes a number of corrigendum items related to MVC, SVC and older AVC parts contained in edition 5. A high level of clarification was achieved on a number of critical issues, for which the joint discussion with VCEG members was fruitful. One important new corrigendum item is the removal of the mandatory prefix NAL unit for the MVC base view, which guarantees better compatibility with existing AVC encoder and decoder devices and reduces the complexity of the system-level support requirements by avoiding any potential need for special handing of this NAL unit. Due to the need of improving the editorial maturity combined with the goal to target a 6th edition by the time when the corrigendum will be finished, it is not possible to produce the DCOR in time for a ballot period that ends before or during the October meeting. It is therefore suggested to target the COR1 for January 2010.

– As requested by the ballot responses, the reference software and conformance testing specifications related to the Stereo High Profile will be included in the ongoing MVC reference software and conformance testing amendments, which had both been previously scheduled reached FDAM status at the London meeting. To accomplish the inclusion of support for the additional profile and to provide an opportunity to further clarify the possibility of integrating the JM and JMVC code bases, it was suggested to delay the FDAM stage for both of these amendments by one meeting cycle. New Study texts were issued on both software and comformance FPDAM texts.

Documents reviewed:m16503 Ad Hoc Group on AVC Development Gary Sullivan, Jens-Rainer

Ohmm16538 Summary of Voting on ISO/IEC 14496-4:2004/FPDAM 38 SC 29 Secretariatm16539 Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 15 SC 29 Secretariatm16551 Summary of Voting on ISO/IEC 14496-10:200X/FPDAM 1 SC 29 Secretariat

93





m16621 prefix NAL unit in stereo high profile Teruhiko SuzukiAjay LuthraAnthony Vetro

m16723 JNB comment on base view in Stereo High Profile Japan National Bodym16732 Comments on FPDAM4 of MPEG-2 Systems: Transport of MVC Ying Chen

Marta KarcewiczPeisong Chen

m16739 Coding Performance Of Stereo High Profile For Movie Sequences Tao ChenYoshiichiro KashiwagiChongSoon LimTakahiro Nishi

m16743 Comments on Multiview Video Coding Specification ChongSoon Lim Steffen Wittmann Takahiro Nishi

m16744 Conformance Bitstream Descriptions For Stereo High ChongSoon Lim Steffen Wittmann Takahiro Nishi

m16745 Updated Reference Software For Stereo High ChongSoon Lim Feng Lu Takahiro Nishi

m16753 KNB comment on the Study Text of ISO/IEC 14496-10:200X/FPDAM 1 Korean National Body

Documents approved:No. Title TBP Available10703 Study Text of ISO/IEC 14496-4:2004/FPDAM 38 Multiview

Video Coding Conformance TestingN 09/09/18

10704 Study Text of ISO/IEC 14496-5:2001/FPDAM 15 Reference Software for Multiview Video Coding

N 09/09/18

10705 Text of ISO/IEC 14496-10:2009/DCOR 1 N 09/09/1810706 Disposition of Comments on ISO/IEC 14496-10:2009/FPDAM 1 N 09/07/0310707 Text of ISO/IEC 14496-10:2009/FDAM 1 N 09/09/1810723 Liaison statement to BDA re Stereo High Profile N 09/07/03

2 MPEG-7 Visual

2.1 MPEG-7 Visual related workThe MPEG-7 breakout group was active during the whole week. Input documents related to the Visual part in 15938-3 are listed in the table below.

m16518 Summary of Voting on ISO/IEC 23000-3:2007/PDAM 2 [SC 29 N 10378] SC 29 Secretariatm16631 Cross verification result for ETRI VCE-7 proposal Sangki Kim

Hyobin LeeSangyoun Lee

m16645 Cross verification results for Video Signature (VCE-7) Karol Wnukowiczm16689 Comments on the video database extension for reliable video signature

description developmentWeon Geun OhSang-Il NaDaeil YoonHae Kwang Kim

m16698 Study of WD 15938-3:2002/Amd. 4 Video Signature Tools Paul BrasnettMiroslaw BoberRyoma OamiKota Iwamoto

m16699 Proposed Update of Video Signature Tools XM (VCE7) Paul BrasnettKota IwamotoStavros PaschalakisRyoma OamiMiroslaw Bober

m16703 Response to the VCE7 on Video Signature Tools Weon-Geun Oh Sang-il Na Ju-Kyong Jin Hae-Kwang Kim

94
















Dong-Seok Jeongm16704 Proposal on additional video modifications for VCE-7 video signature Sang-il Na

Weon-Geun Oh Ju-hee Cho Dong-Seok Jeong

m16748 Evaluation of Core Experiment for MPEG-7 Video Signature Tool Marzia CorvagliaFabrizio GuerriniRiccardo LeonardiPierangelo MiglioratiEliana Rossi

The main MPEG-7 Visual activity during the week was the evaluation of the results of Core Experiments. Documents 16698/16699 report about a minor update of the previous WD technology (removing duplication of signatures, additional bug fixing). The descriptor is using a ternary frame signature from regions of interest, from which “words” and "bags of words" (histograms) of the signature values are constructed. The total average performance over all test cases was approximately 94% hit rate average over all cases (light, medium, heavy, partial and direct matching) under the false-positive and matching-time constraints outlined in the CE description. A different method was proposed in documents 16703/16704, which is a descriptor for combined coarse and fine signature based on 5x5 block average-differences, variable descriptor size depending on temporal change. The total average hit rate under same conditions was approximately 89%.

It was therefore decided to promote the previous WD technology with the appropriate improvements to PDAM ballot, and it was recommended to concentrate upcoming Core Experiments on further improving this descriptor and the associated extraction/matching procedures in the XM. It was however noted that it may not be the ideal way to integrate the signature descriptors into the current XM structure, which would be more suitable for retrieval applications. More discussion on this is needed for the upcoming meetings, also in the context of possible future XM improvements and maintenance.

The conformance testing specification related to Photo Player MAF was promoted for FPDAM ballot.

2.2 Output documents related to MPEG-7 Visual

No. Title TBP Available15938-3 Visual

10708 Text of ISO/IEC 15938-3/PDAM 4 Video Signature Tools N 09/07/1010709 MPEG-7 Visual XM 36 N 09/07/1010710 Description of Core Experiments in Video Signature Description

developmentN 09/07/03

10711 Disposition of Comments on ISO/IEC 23000-3/PDAM 2 N 09/07/0310712 Text of ISO/IEC 23000-3/FPDAM 2 Conformance Testing for

Photo Player MAFN 09/08/03

95



3 Reconfigurable Video Coding (RVC)

3.1 General status of work

The two parts related to RVC (ISO/IEC 23001-4 Codec Configuration Representation in MPEG-B and ISO/IEC FCD 23002-4 Video Tool Library in MPEG-C) were progressed into FDIS status in Lausanne, but some final editing work had been done in Maui, in particular to guarantee a 1:1 matching between the textual description in the FDIS and the software implementation in Amd.1, which together with the conformance testing specification gives the “anchor” reference of normative functional unit (FU) input/output behavior. Some more editing was afterwards that was necessary to achieve better alignment of the texts and definitions in 23001-4 and 23002-4, such that the final texts for publication could only be delivered by the beginning of the London meeting.

Regarding conformance definitions in PDAM1, the previous round of Core Experiments was rather efficient and led to a large degree of clarification about what RVC conformance means both at the FU level and the codec level. This has led to significant improvement of the FPDAM1 text relative to the PDAM text, and was the major topic of work of the RVC breakout group during the London meeting. Further achievements were made towards Amendment 2 (tools for AVC High Profile intra coding). Further activities towards promotion of RVC were another important achievement, particularly including updating of the “RVC Vision” document and preparation of an “RVC tutorial” that gives more illustrative introduction and links to software playgrounds.

It is still the understanding that RVC is still in "phase 1", which is re-implementation of existing decoder conformance points as follows:

• MPEG-4 SP and MPEG-4 AVC CBP in FDIS

• MPEG-2 MP, MPEG-4 ASP, AVC HP and SVC to follow in Amd.2.

Due to ongoing investigation about best way of defining CABAC related parsers in the RVC/BSDL context, as well as due to the time that needed to be spent on the finalization of text and software/conformance issues, the progress on Amd.2 has been slower than expected, such that issuing the PDAM will be delayed by at least one more meeting cycle.

"Phase 2" could open up more of the options that were previously discussed in the RVC context, particularly including

• Possible simplification of standards development by adding new FUs. Whereas this approach sounds attractive, it appears clear that a real simplification (by adding / exchanging single FU modules) would only be given for cases where a preceding standard is fully implemented in RVC schema – it needs to be clarified whether RVC-based encoders are necessary in this context as well. First investigations on this were reported and will be continued in Core Experiments.

• downloadable (on the fly) decoder solutions

It should be noted that some of these aspects would already be possible for “phase 1”, as long as no complete new tool definitions are required, as would e.g. be the case for definition of a new profile.

3.2 Input contributionsDoc. No. Title Authors

m16550 Summary of Voting on ISO/IEC 23002-4:200X/PDAM 1

SC 29 Secretariat

96

http://wg11.sc29.org/meetings/89_London/m16550.zip

m16700 Extension of Cal2C in a new compiler infrastructure called ORCC

Mickaël Raulet, Matthieu Wipliez

m16701 RVC CAL to C translation of MPEG-4 AVC constrained BP

Mickael Raulet, Médéric Blestel, Endri Bezati, Jérôme Gorin

m16724 A big picture of RGC: Primitives based graphics codechan

Seungwook Lee, Bonki Koo, Kyoungsoo Son, Daiyong Kim, Euee S. Jang

m16725 An initial design of RGC: 3DMCe and IC

Daiyong Kim, Seungwook Lee, Bonki Koo, Ming Xiao Chen, Euee S. Jang

m16731 FU networks of intra prediction in AVC High Profile

Gwo Giun (Chris) Lee, He-Yuan Lin, Jia-Wei Liang

m16736 Status Report on MPEG-4 SP FU Conformance Testing (CE 4)

Hwa Seon Shin, Ihab Amer, Hyungyu Kim, Chris Lee, Sugimoto Kazuo

m16737 DLL-based FU Conformance Testing Tool (CE 4)

Hwa Seon Shin, Sowon Kim, Minsoo Park, Hyungyu Kim, Chungku Yie, Byeongho Choi, Euee S. Jang

m16738 Study on Token Reusability (CE 5.1)

Minsoo Park, Hwa Seon Shin, Chungku Yie, Byeongho Choi, Euee S. Jang

m16740 Report of RVC CE 6 Hyungyu Kim, Christophe Lucarz, Mickaël Raulet, Marco Mattavelli, Euee S. Jang

m16746 MPEG-4 SP Conformance Testing Progress Report

Mohamad Ragab, Ajnadin Afifeh, Ihab Amer, Marco Mattavelli

m16751 Fully Configurable Video Coding, Part 1: Overview

Iain Richardson, Sampath Kannangara, Maja Bystrom, James Philp

m16752 Fully Configurable Video Coding, Part 2: A Platform for RVC

Iain Richardson, Sampath Kannangara, Maja Bystrom, Yafan Zhao, James Philp

m16761 Improved text of RVC Vision Euee S. Jang, Marco Mattavelli, Chris Lee

3.3 RVC Vision One input contribution is made along with email discussions.

Doc. No.

Title Authors

m16760

Improved text of RVC Vision Euee S. Jang, Marco Mattavelli, Chris LeePoints and Recommendations

- Some modifications were made

3.4 CE, conformance testing, and other contributionsDoc. No.

Title Authors

m16700

Extension of Cal2C in a new compiler infrastructure called ORCC

Mickaël Raulet, Matthieu Wipliez

Points and Recommendations

- ORCC (open RVC CAL compiler) presented.- XDF (NL) and CAL sources are converted to C.- Using the tools, some bugs in the current MPEG-4 SP FUs in

RSM had been found.- [Recommendation] to adopt in RSM supporting tools

97







































m16701

RVC CAL to C translation of MPEG-4 AVC constrained BP

Mickael Raulet, Médéric Blestel, Endri Bezati, Jérôme Gorin


- Some RVC-CAL implementation bugs are found.- [Recommendation] to reflect the bug fixes of RVC-CAL

in RSM.- [Recommendation] to have a pointer of CAL2C examples

of AVC constrained BP in one of RVC output documents.m16731

FU networks of intra prediction in AVC High Profile

Gwo Giun (Chris) Lee, He-Yuan Lin, Jia-Wei Liang


- Two FUs proposed for managing intra prediction.- [Recommendation] to adopt the FU in VTL extensions- [Recommendation] we may need a common format to

describe conformance testing of FUs in preparing PDAM 1

m16736

Status Report on MPEG-4 SP FU Conformance Testing (CE 4)

Hwa Seon Shin, Ihab Amer, Hyungyu Kim, Chris Lee, Sugimoto Kazuo


- VC/C++ 6 is outdated and needs VC/C++ 9 to support MPEG-4 SP, which is a work ahead by Yishin.

- [Recommendation] to use VC/C++ 6 for conformance testing of MPEG-4 SP.

m16737

DLL-based FU Conformance Testing Tool (CE 4)

Hwa Seon Shin, Sowon Kim, Minsoo Park, Hyungyu Kim, Chungku Yie, Byeongho Choi, Euee S. Jang


- DLL-based conformance testing tool proposed.- [Recommendation] to initiate an output document of

RVC tutorial that contains RVC supporting tools, conformance testing procedure, etc.

m16738

Study on Token Reusability (CE 5.1) Minsoo Park, Hwa Seon Shin, Chungku Yie, Byeongho Choi, Euee S. Jang


- More investigation is necessary to analyze how the token granularity can be determined.

- [Recommendation] to continue as CEm16740

Report of RVC CE 6 Hyungyu Kim, Christophe Lucarz, Mickaël Raulet, Marco Mattavelli, Euee S. Jang


- [Recommendation] to put it in ‘tutorial’ document.

m16746

MPEG-4 SP Conformance Testing Progress Report

Mohamad Ragab, Ajnadin Afifeh, Ihab Amer, Marco Mattavelli


- Some small bugs are found in IQ FU. Will continue the investigation.

m16751

Fully Configurable Video Coding, Part 1: Overview

Iain Richardson, Sampath Kannangara, Maja Bystrom, James Philp

m16752

Fully Configurable Video Coding, Part 2: A Platform for RVC

Iain Richardson, Sampath Kannangara, Maja Bystrom, Yafan Zhao, James Philp


- Decoder description syntax (DDS) protocol is proposed.- The conversion from CAL to DDS can be investigated in the

future.

98




































3.5 Reconfigurable Graphics Codnig discussionDoc. No.

Title Authors

m16724

A big picture of RGC: Primitives based graphics codechan


m16725

An initial design of RGC: 3DMCe and IC



- Concept of ‘reconfigurable graphics coding’ explored. - Will continue its analysis till the next meeting.

3.6 Assignment of output documents & editors

Editors Documents Editors

RVC Core Experiments Kazuo-sanRVC Workplan MarcoRVC Vision Euee23002-4 FPDAM1 (SW and conformance): to delay one meeting

Chris

DoC of 23002-4 PDAM1 Chris, Hwa-Seon

WD of VTL extensions MickaelRVC tutorial Marco

3.7 Output-related recommendationsDocuments Editors

(Editing Period)Notes

RVC Core Experiments Kazuo-san (No) M16738: update of CE text?RVC Workplan Marco (Yes , 2 weeks)RVC Vision Euee (Yes, 2 weeks)23002-4 FPDAM1 (SW and conformance)

Chris (Yes, 6 weeks) M16700: add a pointer in RSM ( SVN)

M16701: bug fix on RVC-CAL FUs

Editing period neededDoC of 23002-4 FPDAM1

Chris, Hwa-Seon (No?)

WD of VTL extensions Mickael (No) - M16731: add the FU in AVC HP (+RSM)

RVC tutorial Marco (Yes, 4 weeks) - M16737- M16740

Output Document:

No. Title TBP Available10713 Disposition of Comments on ISO/IEC 23002-4/PDAM1 N 09/07/0310714 Text of ISO/IEC 23002-4/FPDAM1 Video Tool Library N 09/08/14

99





Conformance and Reference Software10715 WD 5 of ISO/IEC 23002-4/Amd.2 (Tools for MPEG-2 MP, MPEG-

4 ASP, AVC HP and SVC)N 09/07/03

10716 Description of Core Experiments in RVC N 09/07/0310717 RVC Work Plan N 09/07/1710718 RVC Vision N 09/07/1710719 RVC Tutorial N 09/07/31

4 Explorations – 3D Video

A goal of the 3D video exploration activity is to enable the generation of interpolated views from available source views of multiview camera configurations. The target application is mostly seen as being for upcoming generations of various (auto-) stereoscopic displays, either requiring multiple views internally or providing means for baseline adjustment. In the new envisioned scheme, only a low number (1-3) of video sequences would be transmitted, and the rendering of additional views would be enabled by associated depth information.

In the exploration experiments preceding the London meeting, further progress was made on improving (automatic) depth estimation and view rendering / interpolation. Two approaches were investigated, namely layered depth video (LDV, including background video plus depth) and stereo/multiview plus depth (MVD), both of which seem to be conceptually working. For the upcoming CfP, it was decided to concentrate from now on on one technology for producing anchors, namely MVD using MVC coding for both video and depth in parallel.

For the first time, reasonable results were achieved in work on "Exploration Experiment number 4" (EE4), which is the coding experiment work, by performing the second step in anchor preparation for a CfP, which is coding experiments, using AVC/MVC for both video and depth map coding. However, due to the high amount of data that were provided (combining 5 rate points each for depth and video, which amounts to 25 combinations), it was not possible to select best combinations by viewing experiments. However, it was possible to identify useful ranges of rates for each sequence, by comparing the subjective behaviour at lowest and highest rate points. This is reflected in the new EE definition. To speed up the selection of optimum rate allocation for the video and depth components, participants of EE4 were requested to perform a preview at their home lab, and make a proposal about depth/video rate combination case by case.

Further, the document “Applications and Requirements of 3D Video Coding” was slightly updated to better distinguish between representation and input/output formats (N 10857).

Regarding the application cases of 3D Video coding, it is currently unclear whether the two envisaged application scenarios – 1. Enhanced Stereo (baseline adaptation), and 2. future enhanced view-range displays (multiview, autostereoscopic) – would require identical timelines, an also whether their technical requirements are identical. National bodies are kindly requested to provide more information on this, and also the Exploration Experiments (EEs) are now defined around the 2 scenarios to become able of better judging the maturity of available technical solutions.

The planned exploration experiments are as follows, targeting the preparation of material for the CfP based on MVD technology (N 10720):

• EE1: Depth map generation

100

– Quality for 2-view / 2x baseline distance case has become good

– Generation of additional depth maps for 3-view / 4x baseline case

– Further improvement of interpolation methods

• EE4: Coding experiments

– Find best data rate combination points (video, depth) for possible CfP

– Data rates defined per sequence; are sequences sufficiently "difficult"?

In particular, multiview sequences captured with moving cameras are needed, and in general it appears that some of the sequences available have too large static background parts.

Documents reviewed (also see AHG meeting report)

m16576 Results of Exploration Experiments in 3D Video Coding Yongzhe WangHunn RheePhilipp MerkleKarsten Müller

m16582 Improved 1D Mode in VSRS 3.1 Yin ZhaoLu YuDong Tian

m16583 Enhanced LDV Background Information Generation Yin ZhaoLu YuLianhuan Xiong

m16584 Peak Signal-to-Perceptible-Noise Ratio Tool: PSPNR 1.0 Yin ZhaoLu Yu

m16585 3DV EE4 Report on Champagne tower sequences (LDV data) Yin ZhaoLu Yu

m16590 Report of 3DV Exploration Experiment with Champagne Tower Taka SenohKenji YamamotoRyutaro OiTomoyuki MishinaTaiichiro Kurita

m16591 3DV/FTV EE report on "Lovebird1" Gi-Mun UmGun BangNamho HurJinwoong Kim

m16599 3DV EE4 on BeerGarden sequence Patrick LopezDong TianPo-Lin Lai

m16601 3DV EE1 & EE4 Results on Newspaper sequence Seok LeeJaejoon LeeIlsoon LimDu-Sik Park

m16605 Depth Estimation Reference Software (DERS) 4.0 Masayuki TanimotoToshiaki FujiiMehrdad Panahpour TehraniMenno Wildeboer

m16606 3DV/FTV EE1 results of "Champagne tower" Masayuki TanimotoToshiaki FujiiMehrdad Panahpour TehraniMenno Wildeboer

m16607 Error Cancellation in Free-viewpoint Image Generation for FTV Masayuki TanimotoToshiaki FujiiMehrdad Panahpour TehraniMenno WildeboerHisayoshi Furihata

m16615 3DV/FTV EE1 Report on Pantomime sequence Shinya ShimizuHideaki Kimata

m16642 3DV EE results on BookArrival test sequence Jaewon SungYounghee ChoiByeong-Moon Jeon

m16643 A View Synthesis Tool for 3D video Jaewon SungByeong-Moon Jeon

m16646 Philips contribution on extended 3DV LDV Test Material [email protected]@philips.com

101

















[email protected] Extended 3DV LDV Test Material for Newspaper fons bruls

rene klein gunnewiekpatrick van de walleYin Zhao

m16670 Results of EE1 on 'Pantomime? Sequence

Yo-Sung Hom16671 Results of EE4 on ?Newspaper? Sequence

Yo-Sung Hom16673 Bilateral Filtering of Depth Map for 3D Video Coding

Yo-Sung Hom16674 Temporally Enhanced 3D Test Sequence: Develiry

Yo-Sung Hom16675 3DTV Exploration Experiments on Pantomime data set Ivana Radulovic

Andrey NorkinPer Fröjdh

m16709 3DV EE4 on Mobile Sehoon YeaAnthony Vetro

m16718 3DV EE4 on Champagne_tower Carmen CHENGYan HUOYu LIU

m16756 Results of Exploration Experiments in 3D Video Coding, described in w10552, for ?Newspaper? sequence

Olgierd Stankiewicz Krzysztof Wegner

m16757 An enhancement of Depth Estimation Reference Software with use of soft segmentation

Krzysztof WegnerOlgierd Stankiewicz

m16758 Influence of views and depth compression onto quality of synthesized views

Krzysztof KlimaszewskiKrzysztof WegnerMarek Domanski

Output documents:No. Title TBP Available10857 Applications and Requirements of 3D Video Coding N 09/07/0310720 Description of Exploration Experiments in 3D Video Coding N 09/07/03

5 Explorations – High-Performance Video Coding

MPEG has concluded that video bit rate (when current compression technology is used) will go up faster than the network infrastructure ability to carry it economically, both for wireless and wired networks. Therefore a new generation of video compression technology that has sufficiently higher compression capability than the existing AVC standard in its best configuration (e.g., the High Profile), would be needed, in particular expecting

Performance improvements in terms of coding efficiency at higher resolution,

Applicability to entertainment-quality services such as HD mobile, home cinema and Ultra High Definition (UHD) TV.

After first results had been reported to MPEG which indicated that compression technology giving higher compression performance than AVC might exist for such application cases, a more rigorous evaluation phase was started by issuing a Call for Evidence on new high-performance video compression technology in April 2009. A set of test sequences and rate points were defined, and anchor results were produced with an AVC High Profile codec (JM reference software) for comparison. A total of 9 responses were received following this Call, and comparisons were made based on subjective quality assessment.

Submitters were encouraged (but not required) to submit results for all test cases, and submitters were required to provide results for all sequences in any given class. Source test sequences

102












consisted of progressive scan material with 4:2:0 color sampling and 8 bits per sample for each component sample. The classes of video sequences were:

A) Cropped areas of size 2560x1600 taken from the following sequences (frame rates unchanged): Traffic (4096x2048/30), People on Street (3840x2160/30), Park Joy (3840x2160/50).

B) 1920x1080@24 frames per second: ParkScene, Tennis, Kimono1

C) 832x480@30 frames per second (WVGA): Mobisode 2, Keiba, Flowervase

D) Downsampled versions to half spatial resolution (416x240@30fps, WQVGA) of sequences in class C)

The evaluation of high quality use cases, as expected in the case of HVC, requires the participation of video coding experts as viewing subjects. Three independent experts (i.e., experts who were not contributors to the Call for Evidence) participated in the viewing tests. Display of sequences was arranged such that the original video sequence was shown first, followed by (in random order) the AVC anchor and the new technology under test for the same test case and bit rate. Considering that experts are able to immediately recognise the original video, it was considered not necessary to ask them to evaluate it (as the original should always be graded at the maximum vote) but just to score the two coded clips versus the original. The grading scale was on a scale from 0 to 10. In addition to the test demonstration material for subjective viewing, proponents were required to submit an input contribution with documentation of PSNR values (at least the average of frame PSNR for each sequence and encoding point, separate for luma and chroma components) and Bjøntegaard Delta-Rate and Delta-PSNR measurements.

Subjective testing at the highest rate points of each test case was not performed, firstly to reduce the effort, but also as the result of observing that the quality produced by the AVC anchors, at least for some cases, was already very high (close to transparent) and thus no substantial increase in quality relative to the anchor would be possible to achieve in such cases. Detailed results can be found in N 10721. The results indicated that, for a considerable number of test cases, a significant gain over the AVC High Profile encoding could be achieved, with improvements of approximately a magnitude of 2 on the 0 to 10 scale (corresponding to a full unit step on an MOS scale) not being single events. Gains were clearly highest for class B, but even for classes C and D it could be concluded that subjective improvement had been demonstrated. Class A results also showed improvement, but the results for this class may be biased due to the fact that only two sequences were tested, and those were only captured with a static camera and also showed some noise superposition. The best rate improvements that were reported based on the Bjøntegaard Delta-Rate measurement by single proposals were around 20% over all cases in all 4 classes, 30% for the entire class B, and even more for single sequences.

It was therefore concluded that evidence exists of the existence of compression technology that might – after further development – significantly outperform AVC High Profile. As a consequence, it was decided to proceed by preparing and issuing a formal Call for Proposals, with responses expected early in 2010. A draft of the CfP (N 10722) was produced as a non-public output document from the London meeting. The draft CfP definition included the following noteworthy aspects relative to the content of the Call for Evidence:

• Defining new test sequences, as some of the Call for Evidence appeared too simple or inappropriate for subjective viewing, defined now by rate points

• Five test classes: A-D as before, E new

– A: 2560x1600 cropped from 4Kx2K

103

– B: 1920x1080p 24/50-60 fps

– C: 832x480 WVGA

– D: 416x240 WQVGA

– E: 1280x720p 50-60 fps

In particular:

• Proposals must meet target rates (no 5% margin)

• Two AVC anchor configurations specify additional constraints on delay and random access to which the proposals should match

• The purpose of these anchors is different than in the Call for Evidence, they should be expected to serve as a kind of "lowest quality reference" in subjective rating

• Additional constraints: No preprocessing, no postfilter, no rate control loop

The Draft CfP can be further refined under the AHG mandate. Updates of Conditions in October should however be accompanied by a sufficient justifying rationale.

During the London meeting, two joint meeting sessions with VCEG were held, to inform VCEG about MPEG’s progress in the Call for Evidence and to discuss potential collaboration in the preparation of the CfP and subsequent standard development. Remarks made during these discussions were recorded in N 10871. The Draft Call for Proposals (N 10722) was sent to VCEG as a liaison statement attachment to serve as a basis for further discussions.

Responses to Call for Evidence as reviewed in Sunday AHGm16570 Response to Call for Evidence in HVC: Decoder-side Motion Estimation for

Improved PredictionUsage of forward motion estimation previously used for frame interpolation. Interpolated frame is used as additional reference frame. Bi-directional refinement. BD gains: Traffic -8.64/+0.34; People on Street -6.18/+0.29;Park Joy -1.10/+0.03; Park Scene -4.03/+0.15; Tennis +0.37/-0.01; Kimono -4.86/+0.15. Averag 5.3% rate gain for 4K vs 2.84% for HD.

Sven KlompJörn Ostermann

m16574 Response to Call for Evidence in HVC: Integration of Efficient Coding ToolsAdd several coding tools: Quadtree-based adaptive loop filter (Wiener filter switched on/off for variable block sizes); Internal bit-depth increase (reducing rounding errors in interpolation, de-blocking and weighted prediction); Adaptive Quantization matrix selection (macroblock based; 4 different for P, 2 different for B); Bidirectional intra prediction (weighted average of two uni-directional modes); extended macroblock size. Total average for all 4 classes 20% BR reductionSame picture structure as anchor data. Traffic 25, PoS 12, PJ 19 (avg 19)ParkS 15, Tennis 28, Kimono 30 (avg. 25)Mobisode 27, Keiba 19, FlowV19 (avg. 22)Class D 17/11/16 (avg. 15).

Taksehi ChujohTomoo Yamakage

m16592 Samsung's response to Call for Evidence on High-Performance Video CodingSame tools as in the report for the Busan workshop.Gain reported only for class B only: Park scene -21, Kimono 33, Tennis 36; average 30; Initial assessment that computational complexity would increase about 1.6 over AVC (measured decoding time)Also shows that tools can be switched off, i.e. low-complexity mode possible.

Woo-Jin HanJeongHoon ParkKen McCann

m16597 Response to Call for Evidence on High-Performance Video CodingExtended MB size 32x32, different motion partitions than AVC (“hook shaped”, remove small partitions), 16x16 DCT, modified de-blocking, adaptive Wiener filter: Gain 6.5% for class A, 5.7% for class BCurrent implementation only for P pictures, more gain expected for BTraffic -10/+0.39; PoS -0.64/0.02; PJ -8.1/0.23 ParkS -0.07/2.08; Tennis -6/0.26; Kimono -13/0.43Some issues for possible CfP: More test material; higher quality than 4:2:0

Shun-ichi SekiguchiKazuo SugimotoPing WuRobert A. CohenKohtaro AsaiTokumichi Murakami

104





m16600 Response to Call for Evidence in High-performance Video Coding: KTA-based Simulation Results of Class B and Class CUses new tools Extended block sizes, quadtree-based Wiener filter, 16x16 transform, modified de-blockingKimono -28/1.09; ParkSc -15/0.58; Tennis -30/1.15; Flower -12/0.51; Keiba -13/0.6; Mobisode -11/0.37Average class B -25/0.94 C -12/0.49

Keiichi ChonoKenta SenzakiHirofumi AokiJunji TajimeYuzo Senda

m16628 Response to Call for Evidence in HVC: A Hybrid Coding Based CodecLarger compensation blocks, transform 16x16, bit-depth increase; enhanced interpolation & loop filter (QT based Wiener); second prediction (intra) of MC residualClass B -9/0.35; C -7/0.27; D -2/0.11

Lu YuXiaolin ShenPeng LiXingguo ZhuShangwen LiSiwei MaLi ZhangXin ZhaoXiaoming LiXiaozhen Zheng

m16629 LG’s Response to MPEG’s Call for Evidence32x32 MB, several tools adapted to that basis. Adaptive filter. Smallest MC unkit 8x8. New tool partial skip mode. Intra/inter mixed mode in one MB. Intra MB types over all sizes 4…32, New mixed intra mode allowing I4 and I8 prediction in one MB. New transforms 16x16, 16x8, 8x16. BALF, HPIF and MVC used from KTA. Coding structure same as in anchors. Comparison only for 237 frames. Class B average -25/1 dB

Byeongmoon JeonJungSun KimJoonyoung ParkSeunguk Park

m16661 Response to Call for Evidence in HVC: Hybrid Video Coding with ETP and DMVDUse as additional tools displacement intra predictionClass B average around 4% BR reduction (7% in RD optimized mode that is said to be inferior in terms of subjective quality), Class C 7% reduction.Park scene at one point (lowest in Park Scene) does not

Steffen KampJohannes BalléMathias Wien

m16684 Response to Call for Evidence in HVC: New High-Quality Deblocking Loop FilterNew de-blocking filter (claimed to improve de-blocking while preserving texture). BR savings only around 2%, but it is claimed that most effect is subjective.

Geert Van der AuweraYeong Taeg Kim

Other:m16563 Selection of New Perceptual Objective Video Quality Metric

Based on DVQ (Watson) – „VQM Plus model“. Watson DWT (SpaTemp sensitivity based on DCT, masking, SSIM).No results shown based on conpression, no comparison against results of subjective testing. No decision to be taken based on the evidence that the contribution brings (only some artificially constructed artifacts).

Lazar Bivolarski

m16705 Algorithm Complexity Metric Lazar Bivolarski

m16719 1080p,WVGA,WQVGA video coding test sequences Various indoor, outdoor and sports scenes shot by Sony F35 cine camera. Performed initial coding using JM 15. Proposal for target bitrates: 512 WVGA/30 and WQVGA/60,, 768 for WVGA/50/60, 2/3/4 Mbit/s for 720p, 1080/24p and 1080/50/60p, respectively. Usual conditions „for developing, testing and promulgating standards“. Could also be provided in 4:4:4 10 bit, also longer clips could be made available.

Akira FujibayashiBoon Choong SengTK Tan

m16763 1080p/50, 720p/50 video coding test sequencesSequences previously proposed in Lausanne (captured by a Sony HDC-1500), now with post-processing (de-noising). Same sequences available in various sizes and frame rates.Has blurring increased due to the de-noising?Usual conditions „for developing, testing and promulgating standards“.

Adi KouadioHans HoffmannMassimo Visca

m16764 BBC 1080p50 test materials for HVC studySequences capured by Sony HDC-1500, available in 1080p/50 and 720p/50. „Artificial“ scenes with high amount of detail, but some with low amount of motion. Longer sequences would be available.Conditions: Only for MPEG and research (does not match with the current copyright statement)..

Thomas Davies

m16663 Reliability metric for BD measurements Based on overlap range of test and anchor PSNR plots.

Rickard SjöbergKenneth AnderssonAndrey Norkin

105












Output documents:No. Title TBP Available10721 Results of Call for Evidence on High Performance Video Coding N 09/07/1710722 Draft Call for Proposals on High Performance Video Coding N 09/07/0310725 Liaison statement to ITU-T SG16 Q6 re HVC Collaboration N 09/07/0310871 Record of discussions with VCEG N 09/07/03

106

Annex H – Audio report

Source: Schuyler Quackenbush, Chair, Audio Subgroup

1 Opening Audio Plenary.............................................................................................................32 Administrative matters...............................................................................................................3

2.1 Communications from the Chair 32.2 Approval of agenda and allocation of contributions 32.3 Creation of Task Groups 32.4 Approval of previous meeting report 32.5 Review of AHG reports 32.6 Joint meetings 32.7 Received National Body Comments and Liaison matters 32.8 Audio Plenary Discussion 3

2.8.1 Audio Reference Code and MPEG SVN Server.............................................................32.8.2 “Round-Trip Coding” and audio conformance and reference software..........................3

2.9 Record of AhG meetings 32.10 AhG Meeting on SAOC and USAC -- Sunday 1000-1800 3

2.10.1...........................................................................................Spatial Audio Object Coding3

2.10.2...................................................................................Unified Speech and Audio Coding5

3 Task group activities..................................................................................................................73.1 Joint meetings 8

3.1.1 MXM and Audio on MPEG eXtensible Middleware (MXM) and Audio reference software....................................................................................................................................83.1.2 Requirements and Audio on Audio Profiles....................................................................9

3.2 Task Group discussions 93.2.1 MPEG-2, MPEG-4, Audio Conformance, Reference Software, MPEG Surround.........93.2.2 MPEG-D Spatial Audio Object Coding........................................................................113.2.3 MPEG-D Unified Speech and Audio Coding................................................................133.2.4 Exploration: Meta-Data.................................................................................................18

4 Audio closing plenary discussions...........................................................................................195 MPEG Plenary Discussion......................................................................................................196 Meeting deliverables................................................................................................................19

6.1 Responses to Liaison and NB comments 196.2 Recommendations for final plenary 196.3 Establishment of Ad-hoc Groups 196.4 Approval of output documents 196.5 Press statement 19

7 Future activities.......................................................................................................................197.1 Schedule of future meetings 197.2 Agenda for next meeting 20

107

7.3 All other business 207.4 Closing of the meeting 20

Annex A Participants.................................................................................................................21Annex B Audio Contributions and Schedule.............................................................................22Annex C Task Groups...............................................................................................................23Annex D Output Documents......................................................................................................24Annex E Agenda for the 90th MPEG Audio Meeting................................................................25

108

6Opening Audio PlenaryThe MPEG Audio Subgroup meeting was held during the 89th meeting of WG11, June 29 – July 3, 2009 in London, UK. The list of participants is given in Annex A.

7Administrative matters7.1 Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.

7.2 Approval of agenda and allocation of contributionsThe agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in Annex B.

7.3 Creation of Task GroupsTask groups were convened for the duration of the MPEG meeting, as shown in Annex C. Results of task group activities are reported below.

7.4 Approval of previous meeting reportThe 88th Audio Subgroup meeting report was registered as a contribution, and was approved.

7.5 Review of AHG reportsThere were no requests to review any of the AHG reports.

7.6 Joint meetingsThe joint meetings held are shown below.Groups What Where Day TimeReq, Audio

m16649 Proposal of a new Profile for MPEG-4 ALSm16679 Proposal for a set of profiles and levels for SAOC

Audio Thu 0900-0930

7.7 Received National Body Comments and Liaison mattersThe NB Comments and Liaison documents for the meeting that require a response are as shown below.No. From Title Responsem16765 IFPI Statement on MPEG-4 ALS Profile Chair

109

7.8 Plenary Discussion7.8.1 Audio Reference Code and MPEG SVN Server

7.8.2 “Round-Trip Coding” and audio conformance and reference software

7.9 Record of AhG meetings7.10 AhG Meeting on SAOC and USAC -- Sunday 1000-18007.10.1 Spatial Audio Object Coding

Oliver Hellmuth, FhG, presentedm16677 Status and progress overview of SAOC workplan items Oliver Hellmuth, Juergen Herre, Andreas

Hoelzer, Werner Oomen, Heiko Purnhagen, Leonid Terentiev

This overview indicated the topics that will be covered in separate contributions and ones that require more development, and so are not covered in any contribution to this meeting.One topic is presented in this contribution, which is a method for dynamic update of objects (in a teleconferencing application, this would be the number of talkers or locations in a conference call). The conclusion is that the current technology is sufficient to accommodate this, so no action is needed.Leonid Terentiev, FhG, presentedm16651 Report on corrections for the MPEG SAOC FCD text Jonas Engdegård, Heiko Purnhagen,

Leonid Terentiev, Cornelia Falch, Andreas Hölzer, Oliver Hellmuth, Johannes Hilpert, Jeroen Koppens

The contribution lists a number of editorial corrections to the FCD text. It is the recommendation of the AhG to incorporate these changes into the FCD text.Jeongil Seo, ETRI, presentedm16602 Comments on the Usage of the Enhanced Karaoke/Solo Mode Jeongil Seo, Henney Oh, Kevin SeungChul

Ham

The contribution reviewed the Music 2.0 product, which launched in 2007 in Korea. This has between 4 and 8 tracks which are in stereo so that aspects of spaciousness. ETRI expresses concern that the current limitations in EKS make it insufficient to support the Music 2.0 application.Jeongil Seo, ETRI, presentedm16603 Technical Consideration on Combination of Classic and EKS Modes Jeongil Seo, Kyeongok Kang

The contribution presents a possible technical solution to address the concerns raised in the previous contribution. It suggests that “classic” SAOC mix could be uses as a BGO in the EKS mix. It also gives preliminary evaluation of complexity of the proposed scheme.Leonid Terentiev, FhG, presentedm16655 Clarifications and enhancement of the EKS processing mode Cornelia Falch, Leonid Terentiev, Oliver

Hellmuth

The contribution clarification of IOC parameters gives a technical solution for combing EKS and “classic” SAOC processing proposes a means to signal a flexible transition between prediction and energy mode

For combining EKS and classic SAOC, it proposes to permit an SOAC bitstream to have a number of “regular” objects a smaller number of “enhanced” objects

The unified EKS/SAOC encoding would first apply EKS processing on the “enhanced” objects to produce a Foreground (stereo) signal and (typically) a residual signal plus a Background (stereo) signal. The latter is processed as a downmix for “regular” SAOC processing, in which any number of “regular” SOAC objects can be manipulated. The Chair suggested that a figure giving a very specific and tutorial example of EKS/SAOC processing should be in the specification.It appears that the concerns of ETRI and LG are addressed by this contribution, but there will be further discussion and the issue will be re-visited mid-week.

110

Finally, the contribution proposes a means to signal a flexible transition between prediction and energy mode for use in upmixing, which can be advantageously used with residual coding. The AhG recommends incorporating this into the FCD text.Jeongil Seo, ETRI, presentedm16604 Consideration on the MPS Payload within SAOC for MBO Jeongil Seo

The contribution proposes a container mechanism for carrying the MPEG Surround Multi-channel Background Object in the SAOC bitstream. The container is identical what is currently used for the SAOC residual signal. The presenter noted that the proposal in this contribution is identical to what is proposed in m16653 (the next presentation).Leonid Terentiev, FhG, asked why an explicit bsMPOFlag bit is required since the presence of the container seems to be sufficient to signal that MBO is present. Heiko Purnhagen, Dolby, noted that is it not necessary to indicate the position of the BMP in the bitstream, as it is assumed to be that last stereo element.Leonid Terentiev, FhG, presentedm16653 MBO embedment in SAOC payload Heiko Purnhagen, Leonid Terentiev,

Oliver Hellmuth

The contribution proposes a container mechanism for carrying the MPEG Surround Multi-channel Background Object in the SAOC bitstream that is identical to what is proposed in the previous contribution. In addition, it proposed to clarify a number of parameters associated with MPEG Surround parameters. The AhG recommends incorporating this into the FCD text.Leonid Terentiev, FhG, presentedm16654 Clarifications regarding the MPS bitstream generation for the SAOC

transcoding mode Leonid Terentiev, Oliver Hellmuth

The contribution proposes clarifications to the FCD text associated with transcoding of SAOC parameters for MPEG Surround decoding. The Chair suggested that Table 1 which indicates how to map parameters from SAOC to MPS be re-arranged to suggest a signal flow something like thisSAOC parameter Maps to MPS parameter Default MPS value

(if no SAOC parameter)

Described in MPS Specification

xxx xxx Table 5yyy 0 Table 5

The AhG recommends incorporating this into the FCD text.Heiko Purnhagen, Dolby, presentedm16656 Technical provisions for low-delay SAOC multi-channel rendering Jonas Engdegård, Heiko Purnhagen,

Johannes Hilpert, María Luis Valero, Markus Schnell, Oliver Hellmuth, Leonid Terentiev, Andreas Hölzer

The contribution is a progress report on implementing a low-delay SOAC/MPEG Surround system. It shows subjective test results that indicate that the low-delay implementation has quality comparable to that of the regular system. The low-delay filterbank used in MPEG Surround was exactly the one that is used in low-delay SAOC. The presenter anticipates that the filterbank structure is stable, but other aspects of the decoder may still need to be adapted to get the desired level of performance. It is anticipated that the low-delay flavour of MPEG Surround will be specified as a clause in the SAOC specification. As to next steps, it is suggested that a workplan be drafted that coordinates subjective tests of system performance.

7.10.2 Unified Speech and Audio Coding

Max Nuendorf, FhG, presentedm16687 Listening Test Report on TCX Improvements for USAC Max Neuendorf, Jérémie Lecomte

The contribution shows results of a listening test of WD3 system and WD3 with proposed TCX windowing. Two subjective tests were conducted and, on average, there was no difference between the two systems at the 95% level of significance. When examining the difference evaluation of individual items, at 12kbit/s there was one item that was better and two items that were worse for

111

system WD3 with proposed TCX windowing. At 16kbit/s there were two items that were better and one item that was worse for system WD3 with proposed TCX windowing.Taejin Lee, ETRI, presentedm16714 ETRI listening test results for USAC CE on TCX improvements Taejin Lee, Seungkwon Beack, Minje

Kim, Kyeongok Kang

The contribution shows listening test results for the proposed technology on adaptive TCX windowing technology. When examining individual items, at 12 kbp/s there were two items that were better for system WD3 with proposed TCX windowing and at 12 kb/s there were four items that was better for system WD3 with proposed TCX windowing.Pierrick Philippe, Orange Labs, presentedm16561 Evaluation of TCX improvements Core Experiment Pierrick Philippe

The contribution shows a listening test result (at 12 kb/s mono) for the proposed technology on adaptive TCX windowing technology. The results showed that, overall, there as no difference between the two systems, at the 95% level of significance. When examining individual items, for one item the system WD3 with proposed TCX windowing was better. Hyunkook Lee, LG, presentedm16632 LGE listening test results for USAC CE on TCX improvements Hyunkook Lee, Sungyong Yoon

At 12 kb/s the listening test showed, on average, no difference at the 95% level of significance. When examining difference scores for individual items, the listening tests showed

at 12kb/s there were four items that were better at the 95% level of significance at 16 kb/s there were two items that were better at the 95% level of significance

Taejin Lee, ETRI, presentedm16715 Report on TCX Improvements for USAC Taejin Lee, Seungkwon Beack, Minje

Kim, Kyeongok Kang

The contribution shows an analysis of the frequency characteristics of the proposed adaptive TCX windows. In all cases the proposed windows, as compared to WD3 windows, have:

narrower main lobe lower first sidelobe Higher sidelobes rolloff at a faster rate

The presenter also showed listening test results for pooling over all test sites. An analysis of the difference scores showed that

at 12 kb/s there were two items better (es01, phi7) at the 95% level of significance at 16 kb/s there were two items better (es01, phi7) at the 95% level of significance

There was considerable discussion on the contribution’s term “data rate gain,” where it was noted that for every MDCT window shown in the contribution the MDCT is a critically sampled filterbank. Roch Lefebvre, VoiceAge, noted that the left-side (ACELP side) of the RM3 window show in the contribution neglected to account for the effect of subtracting the ACELP’s LP filter zero-impulse response.Bruno Bessette, VoiceAge, asked whether open-loop or closed-loop analysis was used to select coding mode at (potential) ACELP to TCX transitions. The Chair noted that there is a “3x3 matrix” of coding mode transitions (at least on a superframe boundary), and that it would be beneficial to evaluate the extent that the WD3 technology is mature (or not) for each of the 9 transition cases. Finally, considering the amount of discussion, it appears that the proposal needs some time to be better understood. It will be brought up again later in the week.Roch Lefebvre, VoiceAge, presentedm16688 Alternatives for windowing in USAC Bruno Bessette, Roch Lefebvre, Philippe

Gournay, Redwan Salami

The contribution concerns transitions between ACELP and TCX modes in the LP processing modes. It notes that, classically:

ACELP uses rectangular, non-overlapping windowing TCX uses non-rectangular, overlapping windows

112

It also notes that TCX window tails start at the beginning of the TCX frame TCX windows are not centered on the TCX frame In WD3, critical sampling is possible in TCX to TCX transitions WD3 uses many different TCX windows, depending on adjacent frame processing mode

(e.g. ACELP)

It proposes to select optimal TCX windows and adapt the processing of adjacent non-TCX frames (as opposed to adapting TCX processing to adjacent frame mode). The contribution notes that, for ACELP to TCX transitions the first half of the TCX frame needs to compensate for the following two effects:

time-domain aliasing compensate for the non-unitary level of the window

It reports on the results of an experiment in which the encoder was forces to run in the following three modes:

TCX-256 frame surrounded on both sides by ACELP frames TCX-512 frame surrounded on both sides by ACELP frames TCX-1024 frame surrounded on both sides by ACELP frames

A table was presented that showed segmental SNR, calculated in the Weighted LPC residual domain and the bits used for coding the TCX MDCT coefficients and the FAC information. The table was adjusted to weight the FAC bit allocation by the relative frequency of the ACELP to TCX transitions seen by the WD3 system.A final set of plots showed the distribution of the noise, in the Weighted LPC residual domain, at the various positions within the TCX frame.In summary, the contribution proposes a TCX coding method that:

Treats all TCX frames identically Centers TCX decision on the frame Avoids the need for special radix MDCTs Improves segSNR within the TCX frame Flattens the distribution of the noise floor in the TCX frame

The Chair asked the following questions: Why not use asymmetrical windows to achieve maximal overlap in TCX to TCX

transitions? The presenter noted that this could be done, but this tradeoff was not investigated.

Why not just multiply decoded TCX samples by know factors to achieve unity gain? The presenter noted that this would amplify the noise floor most at the window edges, making the distribution of noise power less flat across the TCX frame.

Why not use TCX quantizer for FAC as opposed to algebraic VQ? The presenter noted that the TCX quantizer would require a new PDF for this signal, and that algebraic VQ is appropriate for a noise-like signal (which this is).

There quite a bit of additional discussion. The Chair suggested that the group develop a statement, with respect to the “3x3 matrix”of possible transitions, of what they feel WD3 does right and where CEs in hand offer alternatives for better performance, and that these alternatives be described in a “common vocabulary.” Hyunkook Lee, LG, presentedm16635 Proposed core experiment on improved mode transition Kiho Cho, Hyunkook Lee, Sungyong

Yoon

The contribution proposes a different processing for ACELP to TCX transitions, with many of the transitions employing synthetic TDAC data generated from adjacent ACELP frames. Subjective listening tests show that, for difference score analysis, two items are better at the 95% level if significance for the proposed technology (the items being music3 and phi7). The presenter noted

113

that the overlap between ACELP and TCX reduces the noise “blocking” beyond what would be obtained by the LP synthesis filter.Ralf Geiger, FhG, noted that a 1088 block length MDCT requires a radix 17 transform which may have complexity implications.Philippe Gournay, VoiceAge, presentedm16672 Report on Unvoiced Speech Coding for USAC

The contribution reports on joint work of VoiceAge and Samsung. The goal was to merge two coding modes from CfP Sys4 (unvoiced coding mode and low-energy coding mode) into the USAC RM. These coding modes used a Gaussian codebook which is know to be very efficient for weakly structured, noise-like signals such as are unvoiced and low-energy segments. At the last MPEG meeting it was noted that TCX supports “noise fill-in” for regions of the audio spectrum. It was investigated how this feature could be used for such unvoiced or low-energy modes. Based on internal experiments, it was concluded that the TCX noise-fill tool performed at least as well as the proposed unvoiced coding mode and low-energy coding mode. Hence there is no need to alter the current WD3 technology and the CE is concluded.Kristofer Kjörling, Dolby, presented m16640 Progress report on harmonic transposer CE for the USAC work item Kristofer Kjörling, Per Ekstrand, Lars

Villemoes, Max Neuendorf, Markus Multrus

The contribution reports the current status of the CE. It is envisioned that the work will try to reduce complexity and harmonize to perhaps only one synthesis filterbank instead of three. Furthermore, it will try to make the transpose tool do only the “transpose” function and have other tools (e.g. the noise fill tool) bring the performance of the decoder to the level expected.The Chair presented the AhG report, received comments from the group, made modifications and the report was approved.

8Task group activities8.1 Joint meetings8.1.1 MXM and Audio on MPEG eXtensible Middleware (MXM) and Audio reference

software

Information on the MXM project can be found at mxm.wg11.sc29.org. Phillippo Chiariglione, SmartRM, presented an overview of the MXM APIs. The categories of APIs are as follows:

Creation Decoding Rendering Editing

MXM provides an API the permits “black box” modules that play audio-visual encoders and decoders. The APIs are defined under the “C++ APIs” on the MXM website. Whenever possible, MXM provides a standardized wrapper for existing multimedia APIs. Some of these may be to media-centric (i.e. decode an AccessUnit) or platform-centric (i.e. change the audio volume). One could then construct interface code below the MXM API to provide access to e.g. the ffmpeg media coding tools and also the unique media coding tools found in the MPEG Audio Reference Code repository (e.g. SAOC or USAC).This was elaborated in an email circulated to interested experts, which is quoted here:

The APIs to access media-related technologies are part of the MediaFramework MXM Engine. The APIs are divided into the following categories:

Creation: APIs to create an object (e.g. create a compressed audio stream from an uncompressed one, create a LASeR object having certain characteristics, etc.)

Access: APIs to access an object (e.g. decode a compressed video stream, etc.) Rendering: APIs to render an object (e.g. render a 2D or 3D graphics object, an audio stream, etc.)

114

Editing: APIs to edit an object (e.g. add an elementary stream to an existing multiplexed content, transcode an elementary stream from one format to another, etc.)

The possible types of "Objects" on which the APIs shall allow operating are the following: Elementary Streams:

o Imageo Audioo Video

Muxed Content Graphics-related

o Scene 2D/layout 3D/scene graph

Graphics primitiveso 2D graphicso 3D graphics

The type of input that MXM would like to receive from the various Audio/Video/System/Graphics experts in MPEG is of the following type

feedback on the classification of APIs and "Objects" feedback on the Creation (http://tinyurl.com/kody4o) and Access (http://tinyurl.com/km55s6) APIs

already specified in MXM input for defining the remaining APIs currently not covered yet

The Audio Chair suggested that audio experts could propose a revised MXM audio API that will cover, at a minimum, the following:

instantiate a new audio encoder or decoder encode an audio segment to an AccessUnit or bitstream segment decode an AccessUnit or bitstream segment to get an audio segment free resources associated with the audio encoder or decoder

The Audio Chair will take the lead in drafting a contribution to the next MPEG meeting on a proposed MXM audio API.There was discussion on meda-data, specifically on “signal-derived” meta-data. Examples would be audio program level and meta-data required to implement dynamic range control. The Audio Chair volunteered to be a contact point for further discussions on this topic.

8.1.2 Requirements and Audio on Audio Profiles

m16649 Proposal of a new Profile for MPEG-4 ALSThe Requirements Chair questioned what users are need lossless coding for media delivery to mobile phones and portable players. Takehiro Moriya, NTT, responded that NTT DOCOMO wished to differentiate itself in the marketplace and lossless coding is a vehicle. The Requirements Chair requested additional supporting companies, deployment timeline, or other such information. It was agreed that this profile would issue with CD status at this meeting.m16679 Proposal for a set of profiles and levels for SAOCThe Requirements Chair noted that documented industry support is a prerequisite for any profile. It was agreed that this profile would issue with WD status at this meeting. The timetable for standardization will be defined after industry support is documented.

8.2 Task Group discussions8.2.1 MPEG-2, MPEG-4, Audio Conformance, Reference Software, MPEG Surround

JungHoe Kim, Samsung, presentedm16609 Proposed study on BSAC Conformance for Broadcasting Miyoung Kim, Eunmi Oh

The contribution defines one new conformance stream that uses the intensity stereo tool in combination with other tools. It is the consensus of the Audio Subgroup to produce a “Study on

115

http://tinyurl.com/km55s6

http://tinyurl.com/kody4o

ISO/IEC 14496-26:2009/PDAM 2, BSAC Conformance for Broadcasting” containing the new bitstream. Ferenc Kraemer, Dolby, presentedm16633 Proposed addition to ELD conformance Andreas Schneider

The presentation notes that the AAC-ELD conformance suite did not have AAC-LD / SBR test sequences and no test procedure for such sequences. Hence is it proposed to submit an AAC-LD / SBR conformance tool and define four new AAC-LD / SBR conformance streams. Both the streams and the conformance tool are available now, It is the consensus of the Audio Subgroup to add the new definitions to the 14496-26/AMD 1 FDAM text. The conformance criteria will be specified at a future date, most likely via corrigendum.Heiko Purnghagen, Dolby, presentedm16683 Study on 23003-1:2007/DCOR.2, MPEG Surround Heiko Purnhagen

The only changes with respect to the DCOR 2 document is that the proposed Study document incorporates “hard-wired” references so that a published Cor 2 document with print correctly. It is the consensus of the Audio Subgroup to produce a “Study on 23003-1:2007/DCOR.2, MPEG Surround” containing the printable references.Takehiro Moriya, NTT, presentedm16649 Proposal of a new Profile for MPEG-4 ALS Takehiro Moriya, Tilman Liebchen,

Noboru Harada, Yutaka Kamamoto

The contribution proposes an “ALS Baseline Profile” entailing the following restrictions: No RLS-LMS tool No BGMC (block Gilbert-Moore code) tool Maximum amplitude resolution: 16 bits Maximum sampling frequency: 48 kHz Maximum number of channels: 2 Maximum number of samples per frame: 4096 Maximum prediction order: 15 Maximum BS (block switching) stages: 3 Maximum MCC (multi-channel coding) stages: 1 (stop_flag=0 is allowed only once.）

With these restrictions, the ALS decoder has complexity comparable to an AAC-LC stereo decoder when operating on an ARM platform.It is envisioned that the primary application are for this profile is music delivery to mobile phone or mobile player.Companies that have pledged to support the proposed standard are:

NTT DOCOMO LG Electronics NTT Electronics Napster/Tower Records RIAA

This contribution will be reviewed in a joint meeting with Requirements.Further discussionThe Chair presentedm16765 Audio Liaison Statement from IFPI IFPI via SC29 SecretariatThe Chair noted that IFPI and RIAA appear to give full support to the proposed profile.Takehiro Moriya, NTT, made a short presentation concerning the resources that NTT Electronics and Napster Japan/Tower Records could bring to support the proposed profile.It is the consensus of the Audio Subgroup to adopt the proposed MPEG-4 ALS Baseline Profile and to issue it at this meeting as PDAM, assuming the review by Requirements is positive and Requirements also endorses starting at the PDAM level.Ralph Sperschneider, FhG, presented

116

m16702 Proposed revision of WD on AAC family of profiles Ralph Sperschneider

The contribution notes that the current text specifies profiles as follows:

ToolsBlock Lengths Supported

1024 960 & 1024AAC AAC ProfileAAC + SBR HE-AAC ProfileAAC + SBR + PS HE-AAC V2 Profile AAC Common Profile

It proposes to add text that explains the intent of the profile change and clarifies some portions of the text. In addition, proposes to create new profiles such that all combinations of tools and block lengths are available as profiles, as shown here:

ToolsBlock Lengths Supported

1024 960 & 1024AAC AAC Profile AAC Common ProfileAAC + SBR HE-AAC Profile HE-AAC ProfileAAC + SBR + PS HE-AAC V2 Profile HE-AAC V2 Profile

Finally, it proposes to share profile and level indications as is used by the existing “1024 only” profiles.Kristofer Kjörling, Dolby, presented a few slides giving Dolby’s view on the proposal. He anticipates a problem in the following case:

DAB+ 960 block length “over the air” content is stored in an MP4 file The profile and level indication does not convey whether the content is 960 or 1024 block

length Devices that do not support 960 may play this incorrectly.

Finally, the presenter stated emphatically that it is a bad idea to have a profile and level indication that means two things (e.g. AAC Profile or AAC Common Profile).Bernhard Grill, FhG, noted that there is a bit in the audioConfig information that signals the block length (960 or 1024). Hence the question is what fraction of fielded equipment read this bit (and can decide not to play 960 block length material) and what fraction of equipment does not have to read it since they can play both 960 and 1024.Concerning Profile and Level signalling , Kristofer Kjörling, Dolby, make the following summary of the situation:

• Dolby proposal: new Profile and Level signalling for new profile– Clean solution, new Profile and Level indication for new profile– Small number of legacy players won’t play new profile (current Profile and Level

aware 960 AAC family implementations)– Does not remove the old profiles

• FhG proposal, use the same Profile and Level signalling for old and new profiles– All legacy 960 devices will play – Creates new confusion -- you cannot distinguish profiles on a file level– The old profiles are ”paper tigers,” i.e. they are part of the text but cannot be

explicitly indicated (basically re-doing the old standard with new name)– Risk of malfunction on a large number of legacy devices

It is the consensus of the Audio Subgroup to adopt the text from the contribution that explains the intent of the profile change and clarifies some portions of the text into the WD on AAC family of profiles.

8.2.2 MPEG-D Spatial Audio Object Coding

Leonid Terentiev, FhG, presented

117

m16657 Clarifications regarding the MCU description Heiko Purnhagen, Leonid Terentiev, Oliver Hellmut

The contribution clarifies which aspects of the MCU are normative and which are informative. The normative components include:

MCU interface and SAOC parameter estimation Energy estimation in the SAOC encoder Parameters of the combined bitstreams

Remaining components are informative. The normative text and an informative annex are supplied in the contribution. It was the consensus of the Audio Subgroup that the proposed changes be adopted into the FCD text.Heiko Purnhagen, Dolby, presentedm16681 Clarifications of transport and time-alignment in SAOC Heiko Purnhagen, Andreas Hölzer, María

Luis Valero

The contribution provides revised text for Clauses 4 and 7 of the SAOC FCD. The changes to Clause 4, on delay and synchronization, can be summarized as:

specifying time-alignment in SAOC decoder specifying time-alignment in SAOC decoder and MPEG Surround decoder. This text

presents decoding for “separate” and “integrated” SAOC/MPEG Surround processing. specifying time-alignment for arbitrary core coders and for HE-AAC core coders with

integrated processing.

These items are treated for “high-quality” and “low-delay” filterbank processing. Some aspects of this specification are still under development, with additional information expected at the next meeting.The changes to Clause 7, transport, are in line with what is already specified in MPEG Surround, and can be summarized as:

clarification of time-alignment signaling

It was the consensus of the Audio Subgroup that the proposed changes be adopted into the FCD text.Heiko Purnhagen, Dolby, presentedm16682 Transport of SAOC in MPEG-4 Audio Heiko Purnhagen, Markus Schnell, Ralph

Sperschneider

The contribution proposes a specification for how to transport SAOC in MPEG-4 Audio. This includes changes to MPEG-4 Audio (ISO/IEC 14496-3) and changes to SAOC (ISO/IEC 23003-2). It is patterned after the method used for MPEG Surround. Special care is taken in the specification when AAC-ELD is the core coder since AAC-ELD uses the error resilient bitstream structure. The proposal does this in a way that may support per-frame payloads for other MPEG Audio codecs that might be specified in the future. It was noted that this part of the proposal has not been implemented in the MPEG-4 Audio reference code. It was the consensus of the Audio Subgroup that the proposed text be incorporated into the CD on ALS Simple Profile.Heiko Purnhagen, Dolby, presentedm16680 Information on SAOC Complexity Jonas Engdegård, Heiko Purnhagen

The contribution gives information on the complexity of the various component tools of SAOC and combines these per-tool figures to give figures for a profile proposed in a companion input document.It was the consensus of the Audio Subgroup that the portions of the text specifying complexity be incorporated into the SAOC FCD text. Depending on the decision on m16679, “Proposal for a set of profiles and levels for SAOC,” the text associated with Profiles may also be included in the FCD text.Oliver Hellmuth, FhG, presentedm16679 Proposal for a set of profiles and levels for SAOC Jonas Engdegard, Oliver Hellmuth,

Juergen Herre, Johannes Hilpert, Werner

118

Oomen, Heiko Purnhagen, Leonid Terentiev

The contribution defines two profiles for SAOC: SAOC Baseline Profile SAOC Low Delay Profile

The profile and level definition is summarized here:Profiles Baseline profile Low delay profileLevels 1 2 3 4 1 2

Hybrid QMF bank X X X X - -LD QMF bank - - - - X XResidual decoding - - X X - -Max sampling rate [kHz] 48 48 48 96 48 48Max number of objects 8 32 32 32 8 32Stereo downmix X X X X - X

The Chair suggested that: in the table above that “Stereo downmix” be replaced by “Maximum number of downmix

channels” and the table entries be “1” or “2” rather than “X” or “-.” it be made very clear that it binaural rendering, and the associated interface for HRTF, must

be supported. it may be beneficial to have a means to mandate support for multi-channel output using

MPEG Surround.

Jeongil Seo, ETRI, noted that Music 2.0 might require up to 16 objects rather than just 8 and require up to 4 residuals. It was also noted that it is important to specify levels whose complexity reflects the needs of the marketplace. Heiko Purnhagen, Dolby, showed an Excel spreadsheet that calculates complexity based on e.g. number of objects and residuals. A break-out will use this tool to refine the level definitions of the profiles and levels. The SAOC FCD text will be reviewed Thursday afternoon.It was the consensus of the Audio Subgroup that the proposed text be incorporated into incorporated into the FCD text. Based on this consensus, the complexity for the profile and levels (found in m16680) will also be incorporated into the FCD text.Oliver Hellmuth, FhG, presentedm16678 Proposal for a plan on SAOC verification testing Jonas Engdegard, Oliver Hellmuth,

Juergen Herre, Johannes Hilpert, Werner Oomen, Heiko Purnhagen, Leonid Terentiev

The contribution proposes two sets of tests, one oriented toward evaluating applications and the other toward evaluating technology. Each set is composed of a number of component tests, as shown below:Application-oriented tests:

1. Interactive Remix oriented test-casesA) Remix (Low Bitrate)B) Karaoke (High Bitrate)

2. Teleconferencing oriented test-case with 4-5 talkers and a varying degree of doubletalkA) Stereo loudspeaker presentationB) 3-front 2-rear (5.0) loudspeaker presentation

Technology-oriented tests:1) MCU CombinerDetails TBD2) Binaural RenderingDetails TBD

119

It was the consensus of the Audio Subgroup to have as an output document a Draft SAOC Verification Test Plan. The Chair noted that the following schedule is anticipated:

issue final test plan at 90th meeting (October) conduct test near 1st week of December register and upload test report approx. 2nd week of December FCD ballot closes approx January 1

8.2.3 MPEG-D Unified Speech and Audio Coding

Core ExperimentsHervé Taddei, Huawei, presentedm16587 Memory and complexity reduction CE proposal for USAC LPD mode Wei Xiao, Fuwei Ma, Hervé Taddei,

Minjie Xie

The contribution proposes to use a new indexing scheme for the AVQ quantized data. The new coding scheme is lossless relative to the current coding scheme, and so its contribution is not enhancing compression but rather:

Required memory for the AVQ decoding is reduced by 43% Complexity of decoding the AVQ vector is reduced

It was noted that when the MPEG Reference Encoder is given a 48 kHz sampling rate mono file to code at e.g. 12 kb/s it prints an “informational message” and exits. Further discussion confirmed that the MPEG Reference Encoder requires an input file of lower sampling rate in order to code at 12 kb/s. It was decided to create a shell script that illustrates the required resampling, if any, for all coding modes when reading and writing 48 kHz signal files.There was considerable discussion concerning the complexity reduction of the proposal versus potential additional complexity reduction in the WD3 implementation. Philippe Gournay, VoiceAge, noted that, in the context of the entire decoder, the proposal provides a ROM savings of 0.42%. He further stated that the decoder complexity is 20 WMOPS and in this context the proposal provides a WMOPS savings of 0.085%.The Chair noted that the proposal still requires as part of the CE Proposal phase:

The RM changes (syntax and description) which are necessary to incorporate the proposed technology.

and requires a cross-check as part of the CE Check phase of the CE process. He further noted that, considering the large amount of discussion, it would be beneficial for experts to further study the proposal prior to further discussion later in the week.Further discussionHervé Taddei, Huawei, presented a revised document m16587. A review by the group confirmed that it was a complete CE Proposal. Jeff Huang, Qualcomm, presented m16766, “Crosscheck report of Huawei’s CE proposal for memory and complexity reduction of USAC LPD.” Philippe Gournay, VoiceAge, noted that alternate implementations may produce equivalent savings in memory. Hervé Taddei, Huawei, requested that he please product the alternate implementation or justify the basis of for his position. Mohammed Raad, Raadtech, noted that the technology provides ROM table savings and there is no reason to ignore this savings. Bernhard Grill, FhG, noted that it is typical for an audio coder to have 1% to 3% redundancy for a given signal. The Chair noted that there was considerable discussion on this proposal and the tone of the discussion suggests that there is no consensus on the CE proposal at this time.Oliver Wuebbolt, Thomson, presentedm16638 Thomson Core Experiment Proposal for USAC Oliver Wuebbolt

The presentation describes an alternative context adaptive arithmetic coder for coding the USAC FD spectrum that uses one preceding spectrum but different generation and definition of contexts. The principal advantage of the new proposal is that it reduces decoder RAM and ROM requirements. It notes that, in this context, computational complexity is difficult to assess in a consistent manner, and so no comparison is given. In addition, it provides some additional compression in the lossless representation.

120

JungHo, Samsung, noted that the evidence was supplied only for FD mode (and not TCX mode). The presenter indicated that Thomson used an HE-AAC encoder to develop the PDF, and so no platform for TCX was available.It is proposed that this work be progressed via a workplan to coordinate next development steps, e.g. getting WD3 bitstreams to calculate more robust PDFs and getting third parties to do cross-checks on the experiment.JungHoe Kim, Samsung, presentedm16598 Proposed CE on Spectral Noiseless Coding in USAC KiHyun Choo, JungHoe Kim, Eunmi Oh

The contribution proposes a new tool for noiseless coding of the FD and TCX spectral coefficients. The primary value of the tool is that it provides greater coding efficiency by having a larger number of contexts. In addition, it has smaller arithmetic coding tables sizes. The tool uses the same contexts as WD3 and adds MSB and LSB context-dependent coding. Arithmetic coding PDF was estimated using 28 minutes of music signal and 25 minutes of speech signal. The experiment used the WD3 bitstreams but inserted into them the new arithmetic coding data. Bit reservoir constraints were always met and, in the case that the new tools provided some additional compression, fewer bits were written into the bitstream. Over the nine CfP operating modes, the tool provides a bitrate savings of from 0.5% to 1.13%, when considering only the frames coded in FD or TCX modes. Arithmetic coding table sizes are reduced by a factor of 1.7.Hervé Taddei, Huawei, asked how the complexity of the proposed tool compares to that of WD3. The presenter noted that in WD3 arithmetic coding is a small component with respect to the overall coder complexity, and so suspects that this will not be an issue. However, complexity figures will be reported at the next meeting.Max Neuendorf, FhG, noted that in WD3 the PDF for the LSB is flat, and hence provides no basis for lossless coding gain. The presenter indicated that the proposed tool provides a transformation of the symbol during the coding process such that the LSB PDF is no longer flat.The Chair asked that Samsung and Thomson experts work together to draft a workplan for these two CEs, and in particular, that they agree on a common framework for reporting results at the next meeting.Philippe Gournay, VoiceAge, presentedm16667 Comments on Huawei's CE proposal on ACELP Indexing for USAC Philippe Gournay, Bruno Bessette

The contribution revises a table given in m16338 from Huawei in which some bitrates were corrected. In addition, the contribution notes that WD3 can be optimized such that it has complexity comparable to that of the new tool by Huawei.Philippe Gournay, VoiceAge, presentedm16668 Report on Mode Usage for ACELP in USAC Philippe Gournay, Bruno Bessette,

Roch.Lefebvre

The contribution reports that relative frequency of selection of coding modes at two operating modes:Operating Point ACELP Mode Usage30 kbps mono 39% ACELP mode MODE_18k4 (64 bits per subframe)32 kbps mono 32% ACELP mode MODE_18k4 (64 bits per subframe)

The contribution notes that ACELP provides best performance when coding lower bandwith (typically lower bitrate) signals with no more than 4 ACELP pulses. It further discussed the legacy nature of the MODE_20k and MODE_23k2 modes in the context of AMR-WB+ and noted that in USAC the TCX and FD coding modes are more efficient that ACELP MODE_20k and MODE_23k2.The Chair noted that the bitstreams for 30 kb/s and 32 kb/s mono operation can be uploaded to the SVN server. Hervé Taddei, Huawei, presentedm16662 Improved Pulse indexing for ACELP fixed codeword Dejun Zhang, Fuwei Ma, Herve Taddei,

Minjie Xie

121

The contribution extends Huawei’s pulse-indexing proposal of m16338 from the 88th MPEG meeting to other operating modes. It shows that the proposed tool provides additional compression of the ACELP frames of up to 4.4% and overall compression improvement of up to 0.56%. Philippe Gournay, VoiceAge, questioned whether coding quality will increase based on an increase in compression efficiency of 0.56%. The presenter responded that if many CEs are adopted that provide small improvements the result may be sufficient to produce a significant improvement in audio quality.The Chair noted that it might be helpful to compile a list of CEs and their overall improvement in compression efficiency. It might also be worthwhile to compile a list of “open issues” that the group agrees are of significant importance.Huawei will work to provide information on decoding syntax and semantics this week, and to provide a cross-check on the proposal. The proposal will be discussed later in the week.There was some discussion on error resilience. It was noted that the lower bitrates of USAC might be attractive for mobile transmission using IP packetization.Further discussion Later in the week Hervé Taddei, Huawei, presented new information on this CE proposal, consisting of a revised proposal and a cross-check contribution m16767, “Cross check of pulse indexing module for ACELP” that was registered and uploaded during the MPEG meeting. The revised contribution was reviewed. Max Neuendorf, FhG, noted that the ACELP decoding semantics references the AMR-WB+ specification.Heiko Purnhagen, Doby, noted that the revised contribution does not have any text on decoding process. It was agreed that text on how to decode relative to the referenced AMR-WB+ specification is sufficient to understand the proposal and will satisfy the CE “Proposal” step.The Chair stated that he is obliged to acknowledge Heiko Purnhagen’s request to review the decoding semantics. Hence, it is premature to make a decision on the technology.Nevertheless, the Chair asked for opinions on whether there is consensus on adopting the proposed technology. Max Neuendorf, FhG, did not feel that 0.5% improvement in compression performance is sufficient for adopting the CE proposal. Philippe Gournay, VoiceAge, did not feel that the bit savings per frame was significant to affect subjective quality. The Chair closed discussion on the topic, noting that 1) he requests that Huawei kindly provide the decoding semantics and 2) that he does not see consensus in the Audio Subgroup on accepting the CE at this time.Kei Kikuiri, NTT DOCOMO, presentedm16627 Report on Enhanced Temporal Envelope Shaping CE for USAC Kei Kikuiri, Kyeongok Kang, Kosuke

Tsujino, Nobuhiko Naka

The contribution provides some improvements to the proposal at the 88th meeting. The modifications can be summarizes as:

Introduction of temporal envelope shaping in the “frequency” direction of the QMF subband array using a 1st order filter (“intra-TES”),

Change in the order of the LP filter when processing in the “time” direction of the QMF subband array (“inter-TES”),

Change to the coding method of the side-information bits

Listening test results for 16 kb/s mono and 24 kb/s mono are provided. Analysis of absolute scores shows that the proposed technology is not different from WD3, but analysis of difference scores shows an improvement for a several individual items.

The tool is active when there are transients in region of the signal that will be coded using SBR, i.e. in the upper frequency of the bank. Time-domain plots showed that when using the proposed tool, the fine-grain temporal dynamics of the decoded signal is closer to that of the original signal.

Kristofer Kjörling, Dolby, noted that shaping the temporal envelope of the additional noise components in the SBR coder might be the major benefit of the proposed tool. He further discussed how the proposal would sharpen the temporal envelope in the SBR region.

122

JungHo Kim, Samsung, presentedm16634 Crosscheck report for CE on Efficient Mode-Transitions JungHoe Kim, Eunmi Oh

The contribution is a cross-check of a CE presented at the 88th meeting. It presents listening test results at 12 kb/s mono and 24 kb/s. Test results showed that the performance of WD2 and WD2+CE was not different at the 95% level of significance. This is true for both the average score over all items and for core for the individual items.

Markus Multrus, FhG, presentedm16660 Progress Report on the CE on Efficient Mode Transitions in USAC Markus Multrus, Max Neuendorf, Jeremie

Lecomte, Ralf Geiger

The contribution presents intermediate results on this CE. It follows up on m16439, where critical sampling was proposed for transitions from TCX to FD. At that time, it was requested by the group to investigate if critical sampling can also be achieved for transitions from FD to TCX. Further investigation of this issue revealed that it is not only a problem of transitions, but also a filter startup-problem. Some progress was made, but the work not yet ready. It is anticipate that a complete CE proposal will be presented at the 90th meeting.Philippe Gournay, VoiceAge, presentedm16669 Proposed Correction for USAC Bass-Postfilter Implementation Philippe Gournay, Barbara Resch

The contribution proposes a correction to the bass-postfilter implementation in USAC. This correction consists of applying the bass-postfilter on audio superframes (1024 samples) rather than on audio frames (256 samples). This results in a less frequent use of the asymmetrical version of the transfer function, which is slightly less efficient than the symmetrical version. The proposed correction also makes the implementation in line with the original AMR-WB+ implementation. It was the consenus of the Audio Subgroup to check the possible impact via a listening test on a limited number of well-chosen audio samples before integrating the change into the reference model. A workplan will specify the details of the test.Markus Multrus, FhG, presentedm16686 Proposed Bugfix on eSBR Mode Transitions Markus Multrus, Frederik Nagel, Jeremie

Lecomte

The contribution addresses the transitions between two SBR patching methods. In USAC, a blending between these two patching methods has always been envisioned to smooth transitions in which there is the potential for slightly different sound signaturesIt was noted that blending was not present in the CfP submission, due to an error in the implementation. Blending was added in WD2 to align the reference software to the WD text. However, it is now determined that blending causes problems (e.g. "click" artifacts) for stationary signals (e.g. pitchpipe). The contribution proposes to resolve this issue by decoupling the switching of patching method and switching of core coder, so that the switching of patching method can be done at points where it will be the least audible. This will require therefore explicit signalling of patching method. The contribution presented a listening test at 12kb/s mono, analyized as difference scores. The test showed that there was:

degradation for Music_3, phi7 in WD3 as compared to CfP no significant impairment after application of bugfix phi7 improved after bugfix

There was a considerable amount of discussion on: understanding the degradation in quality from WD2 on understand why it is beneficial to signal the patching method independently (although it was

noted by some parties that explicit signaling is welcome) understanding why this is presented as a bugfix, and not as a CE? If this is a

Continued discussionIt was acknowledged that this CE is a complete proposal, with respect to the MPEG Audio CE methodology. It was agreed that a cross-check, as a listening test, is needed prior to making a

123

decision on the CE. The Chair suggested that the cross-check could be in hand and resulting decision on the CE could be make at the end of July, or alternatively at the 90th MPEG meeting. A decision on which date (July 31 or at the October MPEG meeting) will be made later in the week.Hyunkook Lee, LG, presentedm16636 Progress report on the arithmetic coding CE for USAC Sungyong Yoon, Hyunkook Lee

The contribution Context adaptation for differential scalefactors Differential coding for global gain

The proposed tool provides an increase in compression efficiency of 1.03 percent when averaged over the 9 operating points, but only considering FD mode frames.

Experimental condition Compression gain

(FD frames only)8-bit PCM global gain, arithmetic coding of scalefactors, separate arithmetic coding of spectrum

0.62 %

8-bit PCM global gain, joint arithmetic coding of scalefactors and spectrum

0.71 %

joint arithmetic coding of differential global gain, scalefactors and spectrum

1.03 %

Ralf Geiger, FhG, presentedm16685 Considerations on Coding of Critical Bitstream Elements Ralf Geiger, Ralph Sperschneider, Markus

Multrus

The contribution observes that global gain, as an 8-bit PCM value, permits very simple level adjustment. It further observes that jointly coding scalefactors and spectum in a single arithmetic coding token means that the token “crosses” syntax element boundaries, and also does not permits scalefactors and spectrum to be put in different error sensitivity categories.

Henley Oh, LG, noted that there is no global gain in ACELP or TCX, or if there is, its stepsize if much greater than what is provided in 8-bit global gain. Hence, in USAC, there is currently no unified way to adjust global gain.

The Chair encourages experts to investigate: a method for adjusting the level of the entire USAC decoded wavform (i.e. FD, ACELP and

TCX frames) whether there are practical applications for such level adjustment

As a separate but related issue, the Chair requests that experts in the group should clarify how error resilience might be relevant in CE evaluation.

Werner Oomen, Philips, presentedm16664 Core experiment on Unified Stereo Coding for USAC Heiko Purnhagen, Pontus Carlsson,

Kristofer Kjörling, Erik Schuijers, Werner Oomen

The contribution notes that USAC currently uses parametric coding of stereo at low bit rates and M/S, L/R coding at higher rates. It proposes to integrate these two methods by using parametric stereo coding with a residual signal. At the lowest bit rates, no residual is used, at intermediate rates, a bandlimited residual is used, and at highest bitrates a full-band residual may is used. The “downmix” and “residual” signals are treated as a regular monophonic coder channel. The contribution has been evaluated at 64 kb/s, which implies that only FD mode can be used.

Listening test results were presented for 12 subjects, 15 CfP test items and 2 additional items. The test results show a improvement in average performance of the absolute MUSHRA scores that is

124

statistically significant at the 95% level of significance for all items together and for five individual items (3 from the CfP set).

The proponent requests that interested experts help draft a workplan and interested companies assist in a performing a cross-check. It is anticipated that the CE proponents will profile all components of CE proposal at the next meeting.

Max Neuendorf, FhG, presentedm16579 Proposed Corrections to Reference Software and WD3 of USAC Max Neuendorf

The contribution proposes a number of editorial changes to WD3. It was the consensus of the Audio Subgroup to adopt these changes into a WD4 to issue at this meeting.

Werner Oomen, Philips, presentedm16666 Consideration on efficiency of USAC syntax elements Bernhard Grill, Kristofer Kjorling, Werner

Oomen, Philippe Gournay

The contribution notes that there are a number of CEs that whose performance might be modest. It asserts that adoption of these tools early in the standardization process might unduly impact the flexibility of the codec architecture. It reports on an investigation of two tools that are currently in USAC, that appear to offer only modest increase in compression performance, but that present difficulties in decoding architecture. These are

Time slot position coding Pilot coding

The contribution proposes to move these tools to “Syntax Elements under Consideration” for assessment no later that when the standard progresses to CD stage.

The Chair noted that this is a first step in an ongoing process of evaluating tools in USAC to verify that all bring a meaningful level of performance.

There was considerable discussion on the proposal. The proposal will continue to be discussed during the week.

Further discussion

The proposal of the contribution was discussed later in the week, which is to move the technologies “Time slot position coding” and “Pilot coding” from the USAC WD3 to the document “Thoughts on Efficient Bitstream Syntax” and to modify the USAC syntax and semantics as indicated in the contribution.

Heiko Purnhagen, Dolby, noted that proponents of technology in the “Thoughts on Efficient Bitstream Syntax” have ample opportunity to show evidence of merit of their technology.

Hervé Taddei, Huawei, noted that an alternative would be leave the tools in the USAC WD but also put them on the “Thoughts on…” document and to consider whether to remove all of these technologies prior to the specification progressing to CD.

Roch Lefebvre, VoiceAge, noted that “clean up” in USAC has already started with e.g. the complexity reduction of the number of arithmetic codebooks from 256 to 32 and reduction of storage requirements from 105 kB to 15 kB.

Henney Oh, LG, presented some viewgraphs on Pilot Coding, which motivated retaining the technology. The points were 1) that the complexity of Pilot-based Coding is not great, 2) the specification of USAC and MPEG Surround would no longer be aligned and USAC would have to specify unique aspects of MPEG Surround, 3) that experts in the Audio Subgroup advocated during the development of SAOC that it could be extended to multi-channel using MPEG Surround, where Pilot-based Coding would be an valuable tool and 4) performance for some individual items may be greater than the average performance.

125

KK, Dolby, pointed out that MPEG Surround as used in USAC has already diverged from the MPEG Surround specification, so that point 2), above, is not valid.

It was the consensus of the Audio Subgroup to move the technologies “Time slot position coding” and “Pilot coding” from the USAC WD3 to the document “Thoughts on Efficient Bitstream Syntax” and to modify the USAC syntax and semantics as indicated in contribution m16666. However, this action is subject to a cross-check of the performance information provided in m16666, to be conducted by interested experts. If such a cross-check shows that the information is m16666 is incorrect by a wide margin, then this decision will be reversed at the 90th MPEG meeting.

Software

Hervé Taddei, Huawei, presentedm16571 Signal classifier for USAC reference encoder Lijing Xu, Minjie Xie, Hervé Taddei

The contribution documents a method for selecting between FD an LP modes in the USAC encoder.

It is the consensus of the Audio Subgroup to integrate the text of m16571 into the appropriate clause of WD4 informative annex where

the USAC encoder is discussed (Hervé Taddei and Max Neuendorf). add the source code to the MPEG Reference Encoder SVN repository (the Chair. and

integrate it into the source code such that it drives the mode decision (Dejun Zhang, Huawei). The integration is expected to be complete prior to July 31.

Hervé Taddei, Huawei, presentedm16572 Classification Based ACELP-TCX Selection Longyin Chen, Hervé Taddei, Minjie Xie

The contribution documents a method for selecting between ACELP and TCX modes when in the LP coding mode in the USAC encoder.

It is the consensus of the Audio Subgroup to integrate the text of m16572 into the appropriate clause of WD4 informative annex where

the USAC encoder is discussed (Hervé Taddei and Max Neuendorf). add the source code to the MPEG Reference Encoder SVN repository (the Chair) and, if

possible, integrate it into the source code such that it drives the mode decision (no resource identified).

8.2.4 Exploration: Meta-Data

Jürgen Herre, FhG, presentedm16659 Audio Quality Assessment of MPEG-2/4 AAC Dynamic Range Control

(DRC)Wolfgang Fiesel, Jürgen Herre, Sebastian Scharrer, Stephan Schreiner

The contribution reviewed the fact that MPEG AAC supports multi-band dynamic range control and noted that

the DRC syntax is normative, but the implementation of DRC is optional very few, if any, MPEG AAC decoders have implemented DRC there is no information on the subjective audio quality of the MPEG AAC DRC tool

Hence the contribution presents a subjective audio quality test of MPEG-2 AAC DRC tool. A new test set was selected that had high signal dynamics, ranging from stereo single instrument material to 5.1 live concert material. It further noted that the MPEG-2 AAC DRC tool has a more coarse time resolution as compared to some widely-deployed DRC meta-data and post-processing equipment. The purpose of the test was to benchmark the performance of the MPEG-2 AAC DRC tool, particularly considering that the AAC DRC tool has:

rather coarse time resolution (21 ms) may have time-domain aliasing cancellation (TDAC) effects (i.e. the lack of aliasing

cancellation)

126

Metadata for the signal was derived by the Dolbly DP570, which extracted the meta-data from the PCM originals.The systems under test are shown below. Note that the coding rate is sufficiently high that coding artifacts were not a significant component of the perceived audio impairment.

AC-3 encoder/decoder plugin (Steinberg Nuendo suite) receiving meta-data directly from the Dolby DP570. The coding was done at 384 kb/s for stereo and 640 kb/s for 5.1 channel

AAC encoder/decoder receiving meta-data transcoded from the Dolby DP570. The coding was done at 128 kb/s for stereo and 320 kb/s for 5.1 channel

The listening test showed that the DRC of MPEG-2 AAC has performance not different from that of AC-3 at the 95% level of significance.After a bit of brainstorming, it is envisioned that next steps could be

publicity efforts – make this contribution an WG11 private document at this meeting, with the intent of makig it a WG11 public document at the next meeting. Here the intent is to get input from many experts in DRC that might coment on, edit and hence improve the final public document.

assess whether any current or defecto standards mandate MPEG-2 AAC DRC

9Audio closing plenary discussionsThe Chair noted that the following informal guidelines are used in Video when CEs are observed to deliver only a modest increment in performance:Video CE evaluation questions for “modest performance improvements”:

Is it a "bug fix" (does it make the design more sensible and conceptually justifiable)? Does it significantly reduce complexity (computational/memory/...) of the encoder or

decoder? How long has the affected part of the design been stable? (The longer it is untouched the

more you shouldn't touch it). Does anyone not affiliated with the proponent support its adoption? Is the new proposal with “modest performance” come from the same proponent as did the

technology that is being modified? If it is an improvement to what they originally did, be more lenient about required level of performance.

10 MPEG Plenary DiscussionsOn Wednesday, the Audio Chair presented work on assessing the performance of MPEG-2 AAC Dynamic Range Control (m16659). Kate Grant, Nine Tiles, noted that since this is a tool that is responsive to “user environment,” it would be appropriate to explore whether it could be made available to the MPEG-V work.On Friday during the Audio presentation, the Convenor noted that the MPEG USAC Reference Encoder software project has fewer contributions that he had anticipated, and had future commitments for only one module. He requested that the Audio Chair draft a Workplan for this software project and emphasised that this software project is an opportunity for companies interested in participating in the USAC standardization work. He further emphasised that this opportunity has a limited lifetime in that development of the USAC standard will proceed in parallel with the software development project. The Audio Chair drafted the workplan during plenary and also drafted a resolution calling attention to the workplan. It is expected that companies will, at the 90th MPEG meeting, be prepared to state whether they are able commit to contributing software modules to this project.

11 Meeting deliverables

127

11.1 Responses to Liaison and NB commentsThere were no Liaison and NB comments.

11.2 Recommendations for final plenaryThe Audio recommendations were presented and approved.

11.3 Establishment of Ad-hoc GroupsThe following ad-hoc groups were established by the Audio subgroup:

No. Title Mtg10851 AHG on Audio Standards Maintenance No

10852 AHG on Unified Speech and Audio Coding and Spatial Audio Object Coding

Yes

11.4 Approval of output documentsAll output documents, shown in Annex D, were presented in Audio plenary and were approved.

11.5 Press statementThere was no Audio contribution to the press statement.

12 Future activities12.1 Schedule of future meetingsAd Hoc group meetings are indicated in Section 11.3. Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting.

12.2 Agenda for next meetingThe agenda for the next MPEG meeting is shown in Annex F.

12.3 All other businessThere was none.

12.4 Closing of the meeting The 89th Audio Subgroup meeting was adjourned Friday at 13:30

128

Annex A Participants

First Name Last Name Country AffiliationBruno Bessette CA Voiceage CorporationTi Eu Chan SG I2RYujie Dun CN XJTURalf Geiger DE Fraunhofer IISPhilippe Gournay Canada VoiceAge Corp. / Univ. of SherbrookeBernhard Grill DE Fraunhofer IISNoboru Harada JP NTTOliver Hellmuth DE Fraunhofer IISJürgen Herre DE Fraunhofer IISJeff Huang USA Qualcomm Inc.Kei Kikuiri JP NTT DOCOMOJunghoe Kim KR Samsung AITKristofer Kjörling SE DolbyFerenc Krämer DE DolbyHyunkook Lee KR LG electronicsTaejin Lee KR ETRIRoch Lefebvre Canada VoiceAge Corp. / Univ. of SherbrookeTilman Liebchen DE LG ElectronicsTakehiro Moriya JP NTTMarkus Multrus DE Fraunhofer IISNobuhiko Naka JP NTT DOCOMOYasushige Nakayama JP NHKMax Neuendorf DE Fraunhofer IISTakeshi Norimatsu JP PanasonicHenney Oh KR LG ElectronicsWerner Oomen NL Philips Applied TechnologiesPierrick Philippe FR Orange LabsHeiko Purnhagen SE DolbySchuyler Quackenbush USA ARLMohamad Raad Australia RaadTech ConsultingJulien Robilliard DE Fraunhofer IISAndreas Schneider DE DolbyJeongil Seo KR ETRIRalph Sperschneider DE Fraunhofer IISHerve Taddei DE Huawei TechnologiesLeonid Terentiev DE Fraunhofer IISYasuhiro Toguri JP SonyOliver Wuebbolt DE ThomsonMinjie Xie USA HuaweiDejun Zhang CN HuaweiHuan Zhou SG Panasonic Singapore Laboratories

Annex B Audio Contributions and Schedule

Sunday1000-1300 AhG on SAOC

MPEG-D SAOC 13m16677 Status and progress overview of SAOC workplan items Oliver Hellmuth, Juergen Herre, Andreas

Hoelzer, Werner Oomen, Heiko X

129

Purnhagen, Leonid Terentiev m16651 Report on corrections for the MPEG SAOC FCD text Jonas Engdegård, Heiko Purnhagen,

Leonid Terentiev, Cornelia Falch, Andreas Hölzer, Oliver Hellmuth, Johannes Hilpert, Jeroen Koppens

X

m16602 Comments on the Usage of the Enhanced Karaoke/Solo Mode Jeongil Seo, Henney Oh, Kevin SeungChul Ham

X

m16603 Technical Consideration on Combination of Classic and EKS Modes Jeongil Seo, Kyeongok Kang Xm16655 Clarifications and enhancement of the EKS processing mode Cornelia Falch, Leonid Terentiev, Oliver

Hellmuth X

m16604 Consideration on the MPS Payload within SAOC for MBO Jeongil Seo, Xm16653 MBO embedment in SAOC payload Heiko Purnhagen, Leonid Terentiev,

Oliver Hellmuth X

m16654 Clarifications regarding the MPS bitstream generation for the SAOC transcoding mode

Leonid Terentiev, Oliver Hellmuth X

m16656 Technical provisions for low-delay SAOC multi-channel rendering Jonas Engdegård, Heiko Purnhagen, Johannes Hilpert, María Luis Valero, Markus Schnell, Oliver Hellmuth, Leonid Terentiev, Andreas Hölzer

X

1300-1400 Lunch1400-1800 AhG on USAC

MPEG-D USAC – ongoing CEs 9m16687 Listening Test Report on TCX Improvements for USAC Max Neuendorf, Jérémie Lecomte Xm16714 ETRI listening test results for USAC CE on TCX improvements Taejin Lee, Seungkwon Beack, Minje

Kim, Kyeongok Kang X

m16561 Evaluation of TCX improvements Core Experiment Pierrick Philippe Xm16632 LGE listening test results for USAC CE on TCX improvements Hyunkook Lee, Sungyong Yoon Xm16715 Report on TCX Improvements for USAC Taejin Lee, Seungkwon Beack, Minje

Kim, Kyeongok Kang X

m16688 Alternatives for windowing in USAC Bruno Bessette, Roch Lefebvre, Philippe Gournay, Redwan Salami

X

m16635 Proposed core experiment on improved mode transition Kiho Cho, Hyunkook Lee, Sungyong Yoon

X

m16672 Report on Unvoiced Speech Coding for USAC Philippe Gournay, Bruno Bessette, Roch Lefebvre, Eunmi Oh

X

m16640 Progress report on harmonic transposer CE for the USAC work item Kristofer Kjörling, Per Ekstrand, Lars Villemoes, Max Neuendorf, Markus Multrus

X

1800- Chairs Meeting

Monday0900-1300 MPEG Plenary1300-1400 Lunch1400-1500 Audio Plenary

WelcomeReport on Sunday Chairs meetingReview main tasks for the weekSAOC

Make progress on workplanUSAC

Ongoing and new CEsReview progress on USAC Reference Encoder

MetadataMaintenance

Normative start-up and shut-down General Documents

m16565 87th MPEG Audio Report S. Quackenbush Xm16504 Ad Hoc Group on Audio Standards Maintenance R. Sperschneider Xm16505 Ad Hoc Group on SAOC, USAC S. Quackenbush X

NB Position PapersLiaisonPlenary DiscussionSVN Repository and USAC code X

1500-1600 MPEG-D USAC – new CEs 4m16587 Memory and complexity reduction CE proposal for USAC LPD mode Wei Xiao, Fuwei Ma, Hervé Taddei,

Minjie Xie X

m16598 Proposed CE on Spectral Noiseless Coding in USAC KiHyun Choo, JungHoe Kim, Eunmi Oh Xm16638 Thomson Core Experiment Proposal for USAC Oliver Wuebbolt X1600-1700 MPEG-4 3m16609 Proposed study on BSAC Conformance for Broadcasting Miyoung Kim, Eunmi Oh Xm16633 Proposed addition to ELD conformance Andreas Schneider X

MPEG-D MPEG Surround 1m16683 Study on 23003-1:2007/DCOR.2, MPEG Surround Heiko Purnhagen X

130

1800- HOD meeting

Tuesday0900-1300 MPEG-D USAC – related to onging CEs 10m16667 Comments on Huawei's CE proposal on ACELP Indexing for USAC Philippe Gournay, Bruno Bessette Xm16668 Report on Mode Usage for ACELP in USAC Philippe Gournay, Bruno Bessette,

Roch.Lefebvre X

m16662 Improved Pulse indexing for ACELP fixed codeword Dejun Zhang, Fuwei Ma, Herve Taddei, Minjie Xie

X

m16627 Report on Enhanced Temporal Envelope Shaping CE for USAC Kei Kikuiri, Kyeongok Kang, Kosuke Tsujino, Nobuhiko Naka

X

m16634 Crosscheck report for CE on Efficient Mode-Transitions JungHoe Kim, Eunmi Oh Xm16660 Progress Report on the CE on Efficient Mode Transitions in USAC Markus Multrus, Max Neuendorf,

Jeremie Lecomte, Ralf Geiger X

1200-1300 MPEG Reference Software and MXM (Room 328)MPEG-D USAC maintenance

m16669 Proposed Correction for USAC Bass-Postfilter Implementation Philippe Gournay, Barbara Resch Xm16686 Proposed Bugfix on eSBR Mode Transitions Markus Multrus, Frederik Nagel, Jeremie

Lecomte X

1300-1400 Lunch1400-1430 Metadata and Dynamic Range Control 1m16659 Audio Quality Assessment of MPEG-2/4 AAC Dynamic Range

Control (DRC)Wolfgang Fiesel, Jürgen Herre, Sebastian Scharrer, Stephan Schreiner

X

1430-1500 MPEG-D USAC – ongoing CEsm16636 Progress report on the arithmetic coding CE for USAC Sungyong Yoon, Hyunkook Lee Xm16685 Considerations on Coding of Critical Bitstream Elements Ralf Geiger, Ralph Sperschneider,

Markus Multrus X

1500-1530 MPEG-4 Profiles 2m16649 Proposal of a new Profile for MPEG-4 ALS Takehiro Moriya, Tilman Liebchen,

Noboru Harada, Yutaka KamamotoX

1530-1600 MPEG-D USAC – new CEsm16664 Core experiment on Unified Stereo Coding for USAC Heiko Purnhagen, Pontus Carlsson,

Kristofer Kjörling, Erik Schuijers, Werner Oomen

X

m16579 Proposed Corrections to Reference Software and WD3 of USAC Max Neuendorf Xm16666 Consideration on efficiency of USAC syntax elements Bernhard Grill, Kristofer Kjorling,

Werner Oomen, Philippe Gournay X

1800- Chairs Meeting

Wednesday0900-1100 MPEG Plenary1130 Report on Tuesday Chairs meeting

Update on presentation of m16669 and m16686SAOC

m16657 Clarifications regarding the MCU description Heiko Purnhagen, Leonid Terentiev, Oliver Hellmut

X

m16681 Clarifications of transport and time-alignment in SAOC Heiko Purnhagen, Andreas Hölzer, María Luis Valero

X

1400-1800 (Audio Meeting will meet in room 326)MPEG-D USAC – software 2

m16571 Signal classifier for USAC reference encoder Lijing Xu, Minjie Xie, Hervé Taddei Xm16572 Classification Based ACELP-TCX Selection Longyin Chen, Hervé Taddei, Minjie Xie X

SAOC 6

m16682 Transport of SAOC in MPEG-4 Audio Heiko Purnhagen, Markus Schnell, Ralph Sperschneider

X

m16680 Information on SAOC Complexity Jonas Engdegård, Heiko Purnhagen Xm16679 Proposal for a set of profiles and levels for SAOC Jonas Engdegard, Oliver Hellmuth,

Juergen Herre, Johannes Hilpert, Werner Oomen, Heiko Purnhagen, Leonid Terentiev

X

m16678 Proposal for a plan on SAOC verification testing Jonas Engdegard, Oliver Hellmuth, Juergen Herre, Johannes Hilpert, Werner Oomen, Heiko Purnhagen, Leonid Terentiev

X

1700- Signaling eSBR transposer type 1800- Social -- Doors open at 7:30

District line to Tower Hill station

Thursday0830-0900 Review of USAC CEs0900-9300 Joint with Req at Audio on MPEG Profiles

m16649 Proposal of a new Profile for MPEG-4 ALS X

131

m16679 Proposal for a set of profiles and levels for SAOC1000-1030 Interactive MAF presentation at Systems (Room 326)

Review of USAC CEsOpen issues

- “important problems”- “common framework / metrics”- CE status- CE decisions- removal of technology from USAC

1300-1400 Lunch1400-1800

MPEG-4 m16702 Proposed revision of WD on AAC family of profiles Ralph Sperschneider X

Task groups on open issues1800- Chairs Meeting

Friday0900-1300 Audio Plenary

Report on Thursday Chairs meeting XRecommendations for final plenary XEstablishment Ad-hoc groups and review AhG Mandates X

1000 Get document numbers X1030 Submit AhG Mandates and Resolutions X

Approve Responses to NB comments and Liaison XApproval of output documentsTitle: N10xxxFile: w10xxx (short title).doc (NOT *.docx!)Zip: w10xxx.zipAgenda for next meetingReview of Audio presentation to MPEG plenary A.O.B.Closing of the Audio meeting

1300-1400 Lunch1400- MPEG Plenary

Annex C Task Groups

1. MPEG-2 and MPEG-4 Audio, MPEG Audio Conformance, MPEG reference software, MPEG Surround

2. MPEG-D Spatial Audio Object Coding3. MPEG-D Unified Speech and Audio Coding4. Exploration: Meta-Data

132

Annex D Output DocumentsNo. Title TBP Available

14496-3 Audio10823 DoC on ISO/IEC 14496-3:2009/FPDAM 1:200X HD-AAC Profile No 09/07/03

10824 ISO/IEC 14496-3:2009/FDAM 1:200X HD-AAC Profile and MPEG Surround Signaling

No 09/07/03

10825 Request for Amendment, 14496-3:200x/PDAM 2 No 09/07/03

10826 ISO/IEC 14496-3:200x/PDAM 2, ALS Simple Profile and Transport of SAOC

No 09/07/03

10827 Study on ISO/IEC 14496-3:200X/DCOR 1 No 09/07/0310828 WD2 on AAC Family of Profiles No 09/07/03No. Title TBP Available

14496-4 Conformance

10829 DoC on ISO/IEC 14496-4:2004/DCOR 7, Removal of Audio and 3DG Conformance

No 09/07/03

10830 ISO/IEC 14496-4:2004/Cor. 7, Removal of Audio and 3DG Conformance

No 09/07/03

No. Title TBP Available14496-26 Audio Conformance

10831 DoC on ISO/IEC 14496-26:2009/DCOR 1, ALS and SLS updates No 09/07/0310832 ISO/IEC 14496-26:2009/Cor. 1, ALS and SLS updates No 09/08/07

10833 DoC on ISO/IEC 14496-26:2009/FPDAM 1, AAC-ELD, OAFI additional AAC and MPEG-1/2 on MPEG-4 Conformance

No 09/07/03

10834 ISO/IEC 14496-26:2009/FDAM 1, AAC-ELD, OAFI additional AAC and MPEG-1/2 on MPEG-4 Conformance

No 09/08/07

10835 Study on ISO/IEC 14496-26:2009/PDAM 2, BSAC Conformance for Broadcasting

No 09/07/03

No. Title TBP Available15938-8 Extraction and Use of MPEG-7 Descriptions

10836 DoC on ISO/IEC 15938-8:2002/DAM 4, Extraction of Audio Features from Compressed Formats

No 09/07/03

10837 ISO/IEC 15938-8:2002/AMD 4, Extraction of Audio Features from Compressed Formats

No 09/07/17

No. Title TBP Available23003-1 MPEG Surround

10838 DoC on ISO/IEC 23003-1:2007/DCOR 2, Misc. Corrections No 09/07/0310839 ISO/IEC 23003-1:2007/Cor. 2, Misc. Corrections No 09/07/03

10840 DoC on ISO/IEC 23003-1:2007/AMD 2:2008/DCOR 1, Ref. Sw. Update

No 09/07/03

10841 ISO/IEC 23003-1:2007/AMD 2:2008/Cor. 1, Ref. Sw. Update No 09/08/14No. Title TBP Available

23003-2 SAOC10842 DoC on ISO/IEC FCD 23003-2:200x, Spatial Audio Object Coding No 09/07/0310843 ISO/IEC FCD 23003-2:200x, Spatial Audio Object Coding No 09/08/1410844 Workplan on SAOC No 09/07/0310845 Draft Verification Test Plan for SAOC No 09/07/0310846 WD on SAOC Profiles No 09/07/03No. Title TBP Available

133

23003-3 Unified Speech and Audio Coding10847 WD4 of USAC No 09/08/1410848 Workplan for USAC CEs No 09/07/0310849 Thoughts on Efficient Bitstream Syntax No 09/07/0310869 Workplan on MPEG USAC Reference Encoder No 09/07/03No. Title TBP Available

Exploration – Audio Metadata10850 Draft Report on the Performance of MPEG-2 AAC Dynamic

Range ControlNo 09/07/03

134

Annex E Agenda for the 90th MPEG Audio Meeting

Agenda Item1. Opening of the meeting2. Administrative matters

2.1. Communications from the Chair2.2. Approval of agenda and allocation of contributions2.3. Review of task groups and mandates2.4. Approval of previous meeting report2.5. Review of AhG reports 2.6. Joint meetings2.7. Received national body comments and liaison matters

3. Plenary issues4. Task group activities

4.1. MPEG-1, MPEG-2, MPEG-4, and MPEG Surround4.2. Spatial Audio Object Coding4.3. Unified Speech and Audio Coding4.4. Exploration: Meta-Data

5. Discussion of unallocated contributions6. Meeting deliverables

6.1. Responses to Liaison and NB comments6.2. Recommendations for final plenary6.3. Establishment of new Ad-hoc groups6.4. Approval of output documents6.5. Press statement

7. Future activities8. Agenda for next meeting9. A.O.B10. Closing of the meeting

135

Annex I – 3DG report

Source: Marius Preda, Chair

1 Opening of the meeting

1.1 Approval of the agendaThe agenda is approved.

1.2 Goals for the weekThe goals of this week are:Review SC-3DMC contributions and issue the associated FPDAM as well as the CE documentDiscuss the software and conformance status for SC-3DMC

Discuss FAMC, Scene Partitioning RefSoftware and ConformanceStatus of software implementation in MP25 (especially the IC integration issues)Finalize 14496-27

Check the validity and re-generate when necessary conformance data for 3DGC Review contributions related to 3D graphics engines in MXMReview contributions related to 3D graphics aspects of MPEG-VInvestigate future developments of MPEG 3D Graphics Compression

Review new representation (IndexedRegionSet) and codec (SIM)Review RGC (reconfigurable graphics codec) contribution

Review Liaisons Review the votes

1.3 Standards from 3DGC

4 4 200x Cor.7 (Audio & 3DG) 09/02 09/07 34 5 2001 Amd.25 Scene partitioning

RefSof08/10 09/02 09/07 3

4 5 200x Amd.27 Scalable compl. 3DMC RS

09/02 09/10 10/04 3

4 16 200x Amd.1 Scalable complexity 3D mesh coding

08/01 08/10 09/02 09/07 10/01 3

4 25 200x Amd.1 Mesh Codec for 3DGCM

09/07 09/10 10/01 10/04 3

4 27 200x Amd.1 Scene partitioning conformance

08/10 09/02 09/07 3

4 27 200x Amd.2 Scalable compl. 09/02 09/10 10/04 3

136

3DMC conformance

1.4 Room allocation3DGC: 315

137

1.5 Allocation of contributions

N° Title Schedule ObservationD1 Monday D1

MPEG Plenary 09:00~11:30

Lunch Break 13:00~14:00

3DG Plenary

Roll call, Agenda, Goals, FAQ, etc., Marius Preda14:00~15:0

0m16238 Report of AHG on 3DGC documents, experiments and software maintenance Francisco MoranResults of voting Marius Preda

Coffee Break 15:00~15:30

Scalable Complexity 3D Mesh Coding (SC-3DMC)

m16754 SC3DMC Reference Software Update


15:30 – 17:00

m16759 CE Report on SC3DMC: comparative evaluation of the QBCR configurations Khaled Mammou

Player for SC3DMC AllMPEG-4 Part 25 AMD 1 for SC3DMC All 17:00 –

17:30

Explorations m16564 Proposal for an interoperable 3D platform Jerome Royan 17:30 – 18:00

D2 Tuesday D2MXM Developers Day

09:00~11:00

138

N° Title Schedule Observation

MPEG-V Haptics, adding haptic properties on 3D graphics objects 12:00 – 13:00

Joint with S and R


MPEG-V Sensors, controlling 3D graphics objects in virtual worlds 14:00~15:00

Joint with S and R

MPEG-V Wrap-up and planning for MPEG-V 15:00~16:00

Joint with S

AFX Conformance Check IM1 and regenerate conformance bitstreams All 16:00~17:0

0

Reconfigurable Graphics Coding

m16724 A big picture of RGC: Primitives based graphics codec

Seungwook Lee, Bonki Koo, Kyoungsoo Son, Daiyong Kim, Euee S. Jang 17:00~18:0

0 Joint with V

m16725 An initial design of RGC: 3DMCe and IC


D3 Wednesday D3

MPEG Plenary 09:00~11:00

SC3DMC Status on syntax update and reference software implementation

11:00 – 12:00


MPEG-4 Part 25 Request for AMD1, Appoint editors, Draft version 14:00~15:00Software Implementation Status

Coffee Break 15:00~15:30

139

N° Title Schedule Observation

Liaison Establishment of permanent liaison with MSIF Euee Jang 15:30~16:00

AFX Conformance Check IM1 and regenerate conformance bitstreams 16:00~18:0

0D4 Thursday

MXM MultimediaFrameworkEngine 09:00~11:00

Joint with V and S

Votes DoC review 11:00~11:15

AFX Core Experiment Document review 11:15~11:30

AFX Conformance

Review of Conformance Cor7 11:30~13:00Review of Part 27 (AFX Conformance)


MPEG-V Review of Avatar Characteristics 14:00~16:30

Joint with Systems

3DG Explorations

m16630 Revision of “IndexedRegionSet: Efficient Representation of Meshes with Multiple Textures”

Sergio Arnaldo, Francisco Morán, Marcos Avilés

16:30~17:00

3DG Plenary Preparation for output documents related to MPEG-4 Parts 16, 25 and 27

17:00~18:00

D5 Friday D5

3DG Plenary Review 3DG output documents, AhGs and resolutions 09:00~12:00


MPEG Plenary 14:00~

140

1.6 Attendance listName Country CompanyMarius Preda France Institut TELECOMFrancisco Morán Burgos Spain UPMSeung Wook Lee Korea ETRIEuee S. Jang Korea Hanyang Univ.Byoungjun Kim Korea Hanyang Univ.D.Y. Kim Korea Hanyang Univ.Jeong-Hwan Ahn Korea SamsungLeon Denis Belgium VUBJerome Royan France OrangeLab

2 General issues

2.1 General discussion

2.1.1 Reference SoftwareIt is recalled that the source code of both decoder AND encoder should be provided as part of the Reference Software for all technologies to be adopted in MPEG standards. Moreover, not providing the complete software for a published technology shall conduct to the removal of the corresponding technical specification from the standard.Currently all the AFX tools published in the third edition are supported by both encoder and decoder implementation.

2.1.2 Web siteOrangeLabs announced interrupting the maintenance of the group web-site. A call for volunteers is now issued. In the meantime 3DGC contributors are asked to check the web-site and provide comments on the current version of the web-site.

3 Current Voting

Document title DoC Editor of DoCSummary of Voting on Combined PDAM Registration and

PDAM Consideration Ballot on ISO/IEC 14496-27:200X/PDAM 2: Information technology -- Coding of audio-visual objects -- Part 27: 3D Graphics conformance, AMENDMENT 2: Scalable complexity 3D mesh coding conformance

Yes Seungwook Lee

Summary of Voting on Combined PDAM Registration and PDAM Consideration Ballot on ISO/IEC 14496-5:2001/PDAM 27: Information technology -- Coding

Yes Seungwook Lee

141

of audio-visual objects -- Part 5: Reference software, AMENDMENT 27: Scalable complexity 3D mesh coding reference software

Summary of Voting on Combined PDAM Registration and PDAM Consideration Ballot on ISO/IEC 14496-16:2006/PDAM 4: Information technology -- Coding of audio-visual objects -- Part 16: Animation Framework eXtension (AFX), AMENDMENT 4: Scalable complexity 3D mesh coding

Yes Seungwook Lee

4 General 3DG related activities

4.1 AhG on 3DG activitiesTitle Report of AHG on 3DGC documents, experiments and software maintenance

Authors Francisco MoranSummary See AhG reportResolution Accepted

4.2 Scene partitioning (14496-11 Amd.6)SP is followed as a joint activity between Systems and 3DGC. The technology is integrated in Part 11. There was no joint meeting with Systems on this topic during this meeting. The conformance and reference software documents were reviewed during 3DG Plenary and promoted as FDAM.

4.3 Promotions

4.3.1 Web SiteTitle Status of www.mpeg-3dgc.com

AuthorsSummary The web site is not more maintained by OrangeLab.

Resolution Action Point: Transfer the web-site to other location and call for volunteers for maintanace.

4.4 Joint activities

4.4.1 MPEG-V - Information Exchange with Virtual Worlds (formally Metaverse)

Several joints meetings were carried out during the week related to MPEG-V. The 3DG interests were related to avatar characteristics, virtual object characteristics, manners to control the avatar by using real devices and manners to attach haptic properties on virtual objects.

142

http://www.mpeg-3dgc.com/

The extensive summary of these activities is provided in MPEG-V AhG Report (m16512) and Systems final report.

4.4.2 MXM

Title Demonstration of 3DG @ MXM Developers DayAuthors Ivica Arsov, Marius Preda

Summary

A demonstration of the 3D graphics engine implementing the MXM API was performed during the MXM DevDay. The 3DGraphicsEngine was integrated in Ogre (an Open Source rendering engine) making possible to load MP4 3D graphics files.

Additional joints meetings were carried out during the week related to MXM MultimediaFrameworkEngine. 3DG tools are part of this engine and harmonization with Video, Audio and FileFormat API is needed. The resolutions are reported in Systems final report.

4.4.3 Reconfigurable Graphics Coding

Title m16724 A big picture of RGC: Primitives based graphics codecAuthors Seungwook Lee, Bonki Koo, Kyoungsoo Son, Daiyong Kim, Euee S. Jang

Summary

This contribution presents an approach of considering the compression at the level of graphics primitives and not at the level of object graph. The advantages would be the reusability of different modules (shared between the codecs) and the applicability of the new codec on formalisms that are not fixed (as it is today the case of direct connection between 3DMC and IFS for static objects).

Resolution Continue the exploration as established in the AFX core experiment document (output of this meeting).

Title m16725 An initial design of RGC: 3DMCe and ICAuthors Daiyong Kim, Seungwook Lee, Bonki Koo, Ming Xiao Chen, Euee S. Jang

SummaryThis contribution presents the design of two AFX decoders (3DMCe and IC) compliant with the RVC framework. The functional units for the two decoders as well as connection between them were identified.

Resolution Continue the exploration by considering the other AFX codecs.

4.5 Explorations

Title M16564: Proposal for an Interoperable 3D PlatformAuthors Jerome Royan

Summary This contribution emphasizes the need of interoperability between virtual worlds at the level of functionality. The envisaged scenario consists in using

143

different formalisms for defining sub-parts of the scene graph while being able to communicate events captured in a sub-part to the systems and to the others sub-parts. The contribution does not propose a full technical solution but gives some possible approaches

ResolutionContinue the investigation and monitor MPEG-V and MXM developments related to 3D graphics that may address (or that can be extended for doing so) the issue.

Title M16630: Revision of “IndexedRegionSet: Efficient Representation of Meshes with Multiple Textures”

Authors Sergio Arnaldo, Francisco Morán, Marcos Avilés

Summary

The contribution presents a comparative evaluation of IndexedRegionSet vs. IndexedWedgeSet. It is recognized that both classify the corners of a vertex in sets but IRS is less versatile because it assumes that changes of texture happen along mesh edges and IRS is probably more practical since it allows there to be more that one texture, while IWS can only use one.

Resolution Proceed with the Integration of IRS in the MPEG-4 RSW and perform the IRS vs. IFS bitstream size comparison

5 AFX (14496-16) related activities

5.1 Scalable Complexity 3D Mesh Compression (14496-16 Amd.4 -> become 14496-16:2009 Amd. 1)

Title m16754 SC3DMC Reference Software UpdateAuthors Seungwook Lee, Bonki Koo, Daiyong Kim, Kyoungsoo Son, Euee S. Jang

Summary

- some bugs in SVA were identified- more information is needed in the spec for defining the different prediction modes - more information is needed to explain the two parallelogram prediction schemas

Resolution- fix the SVA bugs during the week- during the editing period the refsoft and bitstream syntax description should be aligned. This will be done by ETRI and crosschecked by IT and UPM

Title m16759 CE Report on SC3DMC: comparative evaluation of the QBCR configurations

Authors Khaled MammouSummary An extensive test was performed to show the advantages and disadvantages or

different encoding parameters. The first conclusion is that 4C binarisation outperforms the BP binarisation in terms of execution time. The second is that

144

combination of AC and EGC outperforms AC in terms of coding efficiency.

Resolution Keep only the mode AC+EGC.Investigate if BP implementation can be improved.

Title Player for SC3DMCAuthors Open discussion

SummaryCurrently the SC3DMC reference software consists in an encoder and decoder of the elementary streams. The discussion is about finding the acceptable solution for generating MP4 formatted files.

Resolution

- use IM1 for obtaining MP4 formatted file (Khaled Mammou will integrate SC3DMC in IM1)- regenerate the conformance file with different encoding combination - use files that contains the maximum number of attribute types and play with the compression settings - use files with different number of vertices to cover low and high resolution content- update the CE description for IM1 integration

5.2 Maintenance

5.2.1 Reference SoftwareAll the AFX tools have associated encoder and decoder implementations available on the SVN.

5.2.2 FAMC Conformance and Reference SoftwareFNB reports on a problem related to FAMC reference software, namely the usage of little endian convention when writing the bitstream. This conducts to errors in parsing the FAMC bitstream when encapsulated in MP4. Resolution: issue a corrigendum on FAMC ref soft and conformance and ask the contributors to update the software and regenerate the bitstreams.

5.2.3 AFX ConformanceSeveral working sessions were carried out for crosschecking the entire set of AFX conformance bitstreams. The final version of the document integrating all AFX conformance was issued as output of this meeting.

5.3 Dataset and benchmarking

For Scalable Complexity 3D Mesh Coding, the www.MyMultimediaWorld.com will be used for benchmarking.

145

6 3D Graphics Compression Model (14496-25) activities

6.1 Amendment 1

Title Request for AMD1 of Part 25Authors Open discussion

Summary Since SC3DMC is now in mature status, this AMD allows including it as a geometry codec for generic XML scene graph.

Resolution Accepted. Nominating Marius Preda and Seung Wook Lee as editors.

6.2 Software and conformance

Title MPEG-4 Part 25 Software implementationAuthors Open discussion

SummaryIntegration of IC elementary stream was done in inconsistent manner: while the bitstream is correctly encapsulated it is signalized as a BBA ES in the meta atom.

Resolution Update the code to ensure consistency between the meta atom and the ES in the case of IC elementary streams.

7 Liaison

Title Establishment of a permanent liaison with MSIFAuthors

Summary

MCSF members are contributors to MPEG and Open Mobile Alliances (OMA). MCSF is interested in aligning their contributions to the two standard bodies and ensure smooth integration between technical recommendations and standards issued by the two bodies in the field of interest mentioned above. Establishing a formal liaison between WG11 and MCSF would facilitate to follow the technical developments and take actions when necessary.

Resolution Accepted. Nominating Seung Wook Lee as representative for WG11.

8 Output documents and Resolutions of 3DGC

146

9 Resolutions related to MPEG-4

9.1 Part 5 Reference Software 9.1.1 The 3DG subgroup recommends approval of the following documents

No. Title TBP Available14496-5 Reference Software

10731 Text of ISO/IEC 14496-5:2001/FDAM 25 (Scene Partitioning Reference Software)

No 09/07/03

10732 Draft DoC on ISO/IEC 14496-5:2001/PDAM 27 (Scalable Complexity 3D Mesh Coding reference Software)

No 09/07/03

10733 Study Text of ISO/IEC 14496-5:2001/PDAM 27 (Scalable Complexity 3D Mesh Coding reference Software)

No 09/07/10

9.2 Part 16 Animation Framework eXtension (AFX) 9.2.1 The 3DG subgroup recommends approval of the following documents

No. Title TBP Available14496-16 Animation Framework eXtension (AFX)

10734 DoC on ISO/IEC 14496-16:2006/PDAM 4 (Scalable Complexity 3D Mesh Compression)

No 09/07/03

10735 Text of ISO/IEC 14496-16:200X/FPDAM 1 (Scalable Complexity 3D Mesh Compression)

No 09/07/17

10736 Description of AFX CE No 09/07/03

9.2.2 The 3DG subgroup thanks FNB for comments on ISO/IEC 14496-16:2006/PDAM 4.

9.3 Part 25 3D Graphics Compression Model9.3.1 The 3DG subgroup recommends approval of the following documents

No. Title TBP Available14496-25 3D Graphics Compression Model

10737 Request for AMD 1 ISO/IEC 14496-25:2008 No 09/07/03

10738 WD 1.0 of ISO/IEC 14496-25:2008/Amd.1 (Mesh codec for 3DGCM)

No 09/07/03

9.3.2 The 3DG subgroup recommends appointing Marius Preda (Institut TELECOM) and Seung Wook Lee (ETRI) as editors of ISO/IEC 14496-25:2008/Amd.1.

9.4 Part 27 3DG Conformance9.4.1 The 3DG subgroup recommends approval of the following documents

No. Title TBP Available14496-27 3DG Conformance

10739 ISO/IEC 14496-27:2009/FDAM 1 (Conformance testing for scene partitioning)

No 09/07/03

10740 DoC on ISO/IEC 14496-27:200x/PDAM 2 (Scalable Complexity 3D No 09/07/03

147

Mesh Coding Conformance)

10741 Study Text of ISO/IEC 14496-27:200x/PDAM 2 (Scalable Complexity 3D Mesh Coding Conformance)

No 09/07/10

9.4.2 The 3DG recommends integrating ISO/IEC 14496-27:2009/FDAM 1 (Conformance testing for scene partitioning) in ISO/IEC FDIS 14496-27.

9.5 Liaisons9.5.1 The 3DG group recommends approval of the following documents

No. Title TBP AvailableRequest for Establishment of Liaison

10742 Statement of benefits from establishing a Category C liaison with MCSF (Mobile Convergence Solution Forum)

Yes 09/07/03

9.6 Establishment of 3DGC Ad-Hoc Groups10743 AHG on 3DGC documents, software maintenance and core experimentsMandate: 1. Conduct the experiments in Scalable Complexity Mesh Compression

2. Coordinate 3DGC related conformance and reference software3. Maintain and edit 3DGC documents4. Coordinate editing of the www.mpeg-3dgc.com web site5. Coordinate exploration activities related to RGC6. Coordinate exploration activities related to IRS

Chairman: Francisco Morán BurgosDuration: Until 90th MeetingMeetings Sunday before 90th meetingReflector: mpeg-3dgc AT gti. ssr. upm. esSubscribe: https://mx.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc

10 Closing of the MeetingSee you in Xian.

148

https://mx.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc

http://www.mpeg-3dgc.com/