INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N7521Nice, FR – October 2005

Source: Leonardo Chiariglione Title: Report of 74th meetingStatus:

Report of WG11 meeting

Report of WG11 meetingAttendance ListAgendaList of input documentsList of output documentsReport of RequirementsReport of SystemsReport of MDSReport of Video and JVTReport of AudioReport of 3DGReport of IntegrationReport of TestReport of ISGReport of Liaison

1 Opening The 74th WG11 meeting was held in Nice on 2005/10/17-21, at the kind invitation of the French National Body.

2 Roll call of participants Annex 1 provides the list of participants.

3 Approval of agenda Annex 2 provides the approved agenda.

4 Allocation of contributionsAnnex 3 provides the list of input contributions

1

5 Communications from Convenor There we no specific communications made.

6 Report of previous meeting This was approved, see7267 Report of 73rd meeting

7 Processing of NB Position PapersResponses were provided as appropriate, see7655 Responses to National Body Comments

8 Work plan 8.1 Media coding

8.1.1 Generic inverse DCT specification The following document was approved7546 Study of ISO/IEC 11172-6

FCD

8.1.2 Fixed point implementation of DCT/IDCTThe following documents were approved7565 Analysis and Summary of fixed-point DCT/IDCT Proposals 7566 SW Testbed for fixed-point DCT/IDCT Proposals

8.1.3 Colour spacesThe following documents were approved7547 Request for 13818-2:2000 Amd.27548 Text of ISO/IEC 13818-2:2000 PDAM2 Support for Colour Spaces7549 Request for 14496-2:2004 Amd.37550 Text of ISO/IEC 14496-2:2004 PDAM3 Support for Colour Spaces7551 Request for 14496-10:200x Amd.17552 Text of ISO/IEC 14496-10:200x PDAM1 Support for Colour Spaces and Aspect Ratios

8.1.4 Scalable Video Coding The following documents were approved7555 Working Draft 4 of ISO/IEC 14496-10:200x Amd.3 Scalable Video Coding7556 Joint Scalable Video Model (JSVM) 47557 JSVM 4 Software

8.1.5 3D AV CodingThe following documents were approved7239 Requirements on Multiview Video Coding7567 Updated Call for Proposals on Multi-View Video Coding

8.1.6 Audio Lossless CodingThe following documents were approved7686 Verification Report on MPEG-4 ALS 7687 Verification Report on MPEG-4 SLS

2

8.1.7 MPEG Surround The following documents were approved7529 Request for Amendment: ISO/IEC 14496-3:2005/AMD 4 MPEG Surround7530 Text of ISO/IEC 14496-3:2005/PDAM 4 MPEG Surround

8.1.8 Symbolic Music RepresentationThe following document was approved7690 WD on Symbolic Music Representation

8.1.9 AFX extensions The following documents were approved7625 WD 3.0 of 14496-16/AMD2 (Geometry & Shadow)7627 MPEG-4 Animation Framework eXtension (AFX) VM 19.0

8.1.10 Video Coding Tool RepositoryThe following documents were approved7540 Draft Requirements on VCTR7568 Study of Video Coding Tools Repository V6.07569 VCTR Textual Description V5.07570 VCTR Software V4.0

8.2 Composition coding

8.2.1 Lightweight Scene RepresentationThe following documents were approved7587 DoC on ISO/IEC 14496-20/FCD7588 Text of ISO/IEC 14496-20/FDIS7589 Request for Amendment on ISO/IEC 14496-207590 Text of ISO/IEC 14496-20/PDAM1 (SVGT1.2

Support)

8.2.2 Symbolic Music Representation The following documents were approved7579 Request for Amendment of ISO/IEC 14496-117580 Text of ISO/IEC 14496-11/PDAM1 (SMR)

8.3 Media Description

8.3.1 Visual Descriptor Extensions The following documents were approved7559 Disposition of Comments on ISO/IEC 15938-3:2002/FPDAM27560 Text of ISO/IEC 15938-3:2002/FDAM2 Perceptual Shape

Descriptor7561 MPEG-7 Visual XM Document version 26.0

8.4 Systems support

8.4.1 MPEG-7 Random Access in BiMThe following documents were approved7592 DoC on ISO/IEC 15938-1/FPDAM2 (Fast Access Extension)7532 Text on ISO/IEC 15938-1/FDAM2 (Fast Access Extension)

3

8.4.2 XML Binarisation The following documents were approved7596 DoC on ISO/IEC 23001-1/FCD7597 Text on ISO/IEC 23001-1/FDIS

8.5 IPMP

8.5.1 MPEG-21 IPMP Components The following documents were approved7660 Disposition of Comments on ISO/IEC 21000-4 IPMP Components FCD7661 Supporting Text to Disposition of Comments on ISO/IEC 21000-4 IPMP Components FCD7717 Text of ISO/IEC 21000-4 IPMP Components FDIS

8.6 Digital Item

8.6.1 DIA Conversions and Permission Extensions The following documents were approved7722 DoC on ISO/IEC 21000-7 FPDAM/1 Conversions and Permissions7723 Text of ISO/IEC 21000-7 FDAM/1 Conversions and Permissions

8.6.2 Dynamic and Distributed AdaptationsThe following documents were approved7724 Request for Amendment 2 of ISO/IEC 21000-7 DIA7725 TuC for DIA AMD/2 7726 ISO/IEC 21000-7 PDAM/2 Dynamic and Distributed Adaptation

8.7 Transport and File Format

8.7.1 Description of timed metadataThe following documents were approved7581 Request for Amendment ISO/IEC 14496-12/PDAM1 (Description of timed metadata)7582 Text of ISO/IEC 14496-12/PDAM1 (Description of timed metadata)

8.7.2 AVC File Format extensions for FRExtThe following documents were approved7751 DoC report on ISO/IEC 14496-15/FPDAM17585 Text of ISO/IEC 14496-15/FDAM1 (Support for

FREXT)

8.7.3 AVC File Format extensions for SVCThe following document was approved7586 WD x.0 of ISO/IEC 14496-15/PDAM2 (SVC File Format)

8.7.4 Digital Item Streaming The following documents were approved7738 Request for subdivision of ISO/IEC 21000-18 MPEG-21 DI Streaming7739 ISO/IEC 21000-18 CD MPEG-21 DI Streaming

4

8.8 Multimedia architecture

8.8.1 MPEG-J GFX The following document was approved7629 Referencing Explanatory Report to JSR-135 Mobile Multimedia API

8.8.2 MPEG Multimedia Middleware The following documents were approved7599 WD3.0 of ISO/IEC 23004-2 Multimedia API7606 WD3.0 of ISO/IEC 23004-3 Component Model

8.9 Application formats

8.9.1 PhotoPlayer Application Format The following document was approved7564 Text of ISO/IEC 23000-3 CD Photo Player Multimedia Application Format

9 Liaison matters The following documents were approved7531 Liaison to DVB on IP Datacast over DVB-H7659 Liaison to WG17662 Liaison to DVB on LASeR, MPEG-B and File Format7663 Liaison to TC 1007664 Liaison to ATSC7665 Liaison to DMP7666 Liaison to IFPI7667 Liaison to CEN/ISSS7668 Liaison to CEA7669 Liaison to NISO7671 Liaison to 3GPP7672 Liaison to ATIS7673 Liaison to ECMA7674 Liaison to OMA7595 Liaison to W3C

10 Organisation of this meeting 10.1 Tasks for subgroupsThe following tasks were identified and assigned

S P ARequirements

4 10 AVC profiles7 JPSearch21 5 REL Profiling

6 RDD Implementation Issues18 DI streaming

A 1 PDTR2 Protected Audio player MAF3 Photo player MAF

MAFs

5

BX Content-Based Search Framework

VCTRColour spaces3D AV requirements

Systems2 1 3rd edition

1 6 Support of streaming text on MP2 TS4 15 1 AVC File Format extensions for FRExt

15 2 SVC File Format20 Lightweight Scene Representation22 Open Font Format

7 1 2 XML Structure Binarization and StreamingA MAFsB 1 XML Structure Binarization and StreamingE MPEG Multimedia MiddlewareX XML Fragments request

MDS21 3 Related identifiers

4 IPMP Components6 RDD Implementation Issues7 DIA Conversions and Permission Extensions

10 1 Digital Item Processing15 Event Reporting17 Fragment Identification of MPEG Resources18 Digital Item Streaming

SchemasA 2 Encrypted Audio player MAF

3 Photo player MAFMAF landscape

Video1 6 Video IDCT Specification4 10 1 Scalable Video Coding

? 4:4:4 profiles7 3 2 New Visual Extensions

8 2 Extraction and use of Ds and DSsA 3 Photo PlayerC 2 Fixed-point 8x8 IDCT and DCTX Colour spaces

3DAV Coding CfPVideo Coding Tools RepositoryWavelet Video CodingFuture Directions in Video Compression

Audio4 3 Low delay AAC profile

3 Lossless Audio Coding VT3 Symbolic Music Representation4 11 Parametric stereo

11 Symbolic Music Representation

6

7 4 2 New Audio ExtensionsA 2 Protected Music Player MAFD 1 MPEG SurroundX Scalable Audio and Speech Coding

Audio codec behaviourSNHC

4 4 12 Conformance of AFX Amd 15 9 Reference software of AFX Amd 1

16 2 AFX (Geometry and shadow)21 MPEG-J GFX

X U3DIntegration

1 4 Conformance5 Reference Software

2 4 Conformance5 Reference Software

4 4 Conformance5 Reference Software

7 7 Conformance21 8 Reference Software

12 Test Bed for MPEG-21 Resource Delivery14 Conformance

A 2 Reference Software2 Conformance

TestX Vidwav results

3DAV Coding CfPISG

4 Reference Hardware Description7 6 Reference software

Liaison124721ABX

10.2 Joint meetings The following joint meetings were held

Groups What Wh. Day TimeReq, Vid MPEG-7 Visual, CBsearch, PP MAF Req Mon 15:30-17:00Req, Vid VCTR, ISG Req Mon 17:00-18:00Req, Mds MPEG-21 Profiles, DI Streaming Req Tue 09:00-12:00Sys, Mds IPMP Sys Tue 09:00-10:00Req, Vid, Jvt Colour spaces, ASVC profiles, MV Video Req Tue 12:00-13:00Req, Mds, Aud, Vod, Sys MAF Req Tue 14:00-18:003DG, Int 3DG conformance and reference sw 3DG Tue 17:30-18:00

7

Aud, Sys Miscellanea Sys Wed 11:00-13:00Req, Vid CBSearch Req Wed 11:00-12:00Mds, Vid, Jvt SVC and DIA Mds Wed 14:00-14:30Vid, ISG MP7 SW Vid Wed 14:00-14:30Req, Vid VCTR Req Wed 16:00-17:00Mds, Vid MPEG-7 Visual Mds Wed 17:00-17:30Req, Vid, Sys Stereo application Req Wed 17:00-18:00Jvt, Sys SVC FF Sys Thu 09:00-10:00Req, Aud, MDS, Sys Protected Music MAF Req Thu 12:00-13:00

11 Administrative matters 11.1 Schedule of future MPEG meetings The following plan was approved

City Country yy mm dd-ddNice FR 05 10 17-21Bangkok TH 06 01 16-20Montreux CH 06 04 03-07Klagenfurt AT 06 07 17-21Hangzhou CN 06 10 23-27Marrakech MA 07 01 15-19

?? ? 07 04 16-20?? ? 07 07 09-13

11.2 Promotional activities The following documents were approved7608 MPEG-4 White Paper - MPEG-4 BIFS (Revision 1)7609 MPEG File Formats White Paper7610 MPEG-4 White Paper - Terminal Architecture7675 MPEG-1 White Paper - Multiplex Format7676 MPEG-1 White Paper – Terminal Architecture7677 MPEG-1 White Paper – Multiplexing and Synchronization7678 MPEG-2 White Paper - Multiplex Format7679 MPEG-2 White Paper – Terminal Architecture7680 MPEG-2 White Paper – Multiplexing and Synchronization7607 M3W Tutorial7558 Introducing MPEG-7 DDL – an Overview7703 MPEG Technologies: MPEG-1/2 Layer 37704 MPEG Technologies: Advanced Audio Coding7705 MPEG Technologies: Structured Audio7706 MPEG Technologies: ALS7707 MPEG Technologies: SLS7708 MPEG Technologies: MPEG-7 Low-level audio descriptors7709 MPEG Technologies: MPEG-7 High-level audio descriptors7710 MPEG Technologies: Music Player7630 Overview of 3DMC7631 Overview of AFX7645 Description of MPEG-1 Conformance7646 Description of MPEG-1 Reference Software7647 Description of MPEG-2 Conformance

8

7648 Description of MPEG-2 Reference Software7649 Description of MPEG-4 Conformance7650 Description of MPEG-4 Reference Software7651 Description of MPEG-7 Conformance7652 Description of MPEG-7 Reference SoftwareN7544 Overview of MPEG-7 Part 6 reference SW: Experimentation Model (XM)N7543 Overview of MPEG-4 Part-9 Reference HW Description

12 Planning of future activitiesThe following ad hoc groups were established7619 AHG on 3D Video Coding 7632 AHG on AFX documents, CEs, and software7711 AHG on Audio Standards Maintenance7623 AHG on Depth/Disparity Representation 7618 AHG on Description Tools for MPEG-7 New Visual Extensions7743 AHG on Development of RDD Corrigendum/27748 AHG on Digital Item Streaming7742 AHG on DII amendment7621 AHG on Exploration in Wavelet Video Coding 7716 AHG On Exploration of Scalable Audio and Speech Coding7535 AHG on MAFs7616 AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and

Conformance7617 AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software7613 AHG on MPEG File Formats7614 AHG on MPEG Multimedia Middleware7713 AHG on MPEG Surround7745 AHG on MPEG-21 DIA7744 AHG on MPEG-21 DIP7746 AHG on MPEG-21 Event Reporting7747 AHG on MPEG-21 Fragment Identifiers7714 AHG on MPEG-4 Lossless Audio Coding7545 AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.7712 AHG on MPEG-7 Audio7534 AHG on MPEG-7 Query Format7633 AHG on MPEG-J Graphics Framework eXtensions7622 AHG on Photo Player MAF7612 AHG on Scene Representation7715 AHG on Symbolic Music Representation7620 AHG on Video Coding Tools Repository 7615 AHG on Video IDCT Specification 7611 AHG on XML Structure Binarization and Streaming

13 Resolutions of this meeting These were approved, see7521 Resolutions of 74th meeting

14 A.O.B There were no other businesses

9

15 ClosingPlenary closed at 2005/10/21T20:00

10

Annex 1Attendance list

First name Last Name Affiliation CountryChang Ahn Kwangwoon University KRJeong-Hwan Ahn Samsung Ait KRIhab Amer University Of Calgary CAMyriam Amielh CISRA AUPeter Amon Siemens Ag DEIsabelle Amonou France Telecom FRTerumasa Aoki The University Of Tokyo JPKohtaro Asai Mitsubishi Electric JPOlivier Avaro Streamezzo FRMarcos Avilés

RodrigálvarezUniversidad Politécnica De Madrid ES

Wael Badawy University Of Calgary CATae Meon Bae Information And Communication University KRRaphaèle Balter France Telecom R&D FRYukihiro Bandoh NTT JPYiliang Bao Nokia FIChris Barlas Rightscom Limited UKJerome Barthelemy Ircam FRGero Bäse Siemens DEOliver Baum Fraunhofer Iis DEMartin Beck 3d Image Processing Gmbh DETanya Beech Qinetiq UKJeroen Bekaert Niso/Lanl BEPierfrancesco Bellini Univ. Of Florence - Dsi Disit ITAbdellatif Benjelloun Touimi France Telecom FRUlrich Benzler Robert Bosch Gmbh DELazar Bivolarski Connex Technology USMiroslaw Bober Mitsubishi Electric Ite Bv UKJohannes Boehm Thomson DEMarina Bosi MPEG LA, Llc USFrank Bossen   CHVincent Bottreau Thomson FRArnaud Bourge Philips FRSebastien Brangoulo Enst FRFons Bruls Philips Research NLIan S. Burnett University Of Wollongong AURichard Cam Pmc-Sierra CANathalie Cammas France Telecom R&D FRMaurizio Campanai Exitech ITLouis-Xavier Carbonnel France Telecom FRRenaud Cazoulat France Telecom FRDan Cernea Vrije Universiteit Brussels BEH.Jean Cha LG Electronics KREun Young Chang ETRI KRWo Chang NIST USYing Chen Thomson Broadband R&D (Beijing) Co.,

Ltd.CN

11

Lulin Chen Mobilygen Corporation USFilippo Chiariglione Cedeo.net ITLeonardo Chiariglione Cedeo.net ITElion Chin Moodlogic Incorporation USYi-Jen Chiu Intel Corporation USDae-Sung Cho Samsung Ait KRYongju Cho ETRI KRHwan Serk Choi Pixtree KRByeongho Choi Keti KRHaechul Choi ETRI KRJae-Gwi Choi ETRI KRYong Soo Choi Kangwon National University KRSang Bae Chon Seoul National University KRKok Seng Chong Panasonic Singapore Labs Pte Ltd SGHyon-Gon Choo ETRI KRChi-Cheng Chu Mediatek Inc. CNTakeshi Chujoh Toshiba Corporation JPLeszek Cieplinski Mitsubishi Electric Ite-Vil UKGregory W. Cook Thomson USGiovanni Cordara Telecom Italia ITAlexandre Cotarmanac'h France Telecom FRPierre Davy Miralab CHPhilippe De Cuetos Expway FRRobbie De Sutter Ghent University - Multimedia Lab BESaar De Zutter Ghent University - Multimedia Lab BERudi Deklerck Vrije Universiteit Brussels (Ibbt-Etro) BEJaime Delgado Dmag-Upf ESSylvain Devillers France Telecom FRThomas Di Giacomo Miralab, University Of Geneva CHKlaus Diepold TUM DESascha Disch Fraunhofer IIS DEPeder Drege Adactus NOGerrard Drury University Of Wollongong / Enikos AUJulien Dubois Le2i FRJean-Claude Dufourd Streamezzo FRMélanie Dulong De Rosnay Medialive FRTouradj Ebrahimi EPFL CHAlex Eleftheriadis Layered Media Inc. USUlrich Fecker University Of Erlangen-Nuremberg DEChristoph Fehn Fraunhofer HHI DEBernhard Feiten Deutsche Telekom T-Systems DEGabriel Fernandez Ramon Llull Univ. La Salle ESOctavian Folea Medialive FRScott Foshee Adobe USEyvind Fossbakk NRK - Norwegian Broadcasting NOEdouard Francois Thomson FRPer Fröjdh Ericsson SEHarald Fuchs Fraunhofer IIS DEToshiaki Fujii Nagoya University JPArild Fuldseth Tandberg NOMarc Gauvin Sdae ES

12

Ralf Geiger Fraunhofer Iis DEJean H.A. Gelissen Philips Research NLDiego Gibellino Telecom Italia ITPatrick Gioia France Telecom FRCristina Gomila Thomson USKate Grant Nine Tiles UKBernhard Grill Fraunhofer Iis DEMarc Guez Vucher SCPP FRChristine Guillemot INRIA FROnur Guleryuz DoCoMo Communications Laboratories

Usa, Inc.US

Bang Gun ETRI KRRich Hall Polycom USJong-Ki Han Sejong University KRKi Hun Han Sejong University KRMahnjin Han Samsung Ait KRMing Hang NCTU/ITRI USWoo Jin Hann Samsung Electronic KRMunsi A Haque Intel Corporation USNoboru Harada NTT JPBarry G Haskell Apple Computer USYun He Tsinghua University CNZhongli He Freescale Semiconductor USHendry Hendry ICU KRXavier Henocq Canon Crf FRJohannes Hilpert Fraunhofer Iis DEArianne Hinds IBM USYo-Sung Ho Gist KRMichael Horowitz Covi Technologies USShih-Ta Hsiang Motorola USAndreas Hutter Siemens DEDaijiroh Ichimura Ma JPFaisal Ishtiaq Motorola USMichael Isnardi Sarnoff Corporation USSatoshi Ito Toshiba Corporation JPTakashi Itoh Fujitsu Laboratories Ltd. JPEuee Seon Jang Hanyang University KRByeong-Moon Jeon LG Electronics KRJin Hwan Jeong ETRI KRSeyoon Jeong ETRI KRPaul Jessop IFPI UKKyunghee Ji Suv KRJie Jia Sejong University KRXu Jizheng Microsoft Research Asia CNYe Sun Joung ETRI KRJoel Jung France Telecom FRYang-Won Jung LG Electronics KRYang Jungyoup Sungkyunkwan University KRItaru Kaneko Tokyo Polytechnic University JPHogab Kang Drm Inside KRJung Won Kang ETRI KR

13

Marta Karczewicz Nokia FINaoya Katoh Sony Corp. JPSylvain Kervadec France Telecom FRTae Hyeaon Kim LG Electronics KRTae Hyun Kim DRM Inside KRDae Yeon Kim Sejong University KRDong Soo Kim Lg Electronics KRHae Kwang Kim Sejong University KRHyun Mun Kim Samsung Ait KRJae-Gon Kim ETRI KRJong-Lak Kim Nextreaming KRJung Hoe Kim Samsung Ait KRMunchurl Kim ICU KRNam Hyoeng Kim Korea University KRS.Y. Kim Samsung Electronics Co. KRSang-Kyun Kim Samsung Ait KRSeon-Tae Kim ETRI KRSo Young Kim Samsung Electronics Co. KRTaehee Kim Samsung Electronics KRWon Ha Kim Kyung Hee University KRWoo-Shik Kim Samsung Ait KRYou Sun Kim Korea University KRHideaki Kimata NTT Advanced Technology JPTakahiro Kimoto NEC Corporation JPMasaki Kitahara NTT JPMasatsugu Kitamura For More Convenient Av Life JPKristofer Kjörling Coding Technologies Ab SETakuyo Kogure University Of Tokyo JPMayumi Koike U-Tokyo JPStefan Kraegeloh Fraunhofer Iis DEMike Ksar Microsoft USThomas Kummer-Hardt Chtv 4 Aio Spain ESChih-Hui Kuo Mediatek Inc. CNJean Kypreos Envivio FRGauthier Lafruit IMEC BEJean Le Feuvre ENST FRDaniel Lecomte Medialive FRBae-Keun Lee Samsung Electronics KRKyohyuk Lee Lee Samsung Electronics KRSang Hwa Lee Seoul National University KRSunyoung Lee Hanyang University KRYung-Gi Lee Sejong University KRYung-Lyul Lee Sejong University KRChakjoo Lee Panasonic Singapore Labs Pte Ltd SGMen Huang Lee Panasonic Singapore Labs Pte Ltd SGGwo Giun Lee National Cheng Kung University USShawmin Lei Sharp Labs Of America USRiccardo Leonardi University Of Brescia/Dea ITVladimir Levantovsky Monotype Imaging USZhengguo Li Institute For Infocomm Research SGTilman Liebchen Technical University Of Berlin DE

14

Young-Kwon Lim Net&Tv Inc. KRChong Soon Lim Panasonic Singapore Labs Pte Ltd SGPeter List T-Systems DEZhongkang Lu Institute For Infocomm Research SGAjay Luthra Motorola USSiwei Ma University Of Southern California USDetlev Marpe Fraunhofer Hhi DEEmin Martinian Mitsubishi Electric Research Labs USMarco Mattavelli EPFL CHXinjian Meng Huawei Technologies Co Ltd CNHahn Minsoo Information & Communications Univ. KRYoshihiro Miyamoto NEC JPIol Moccagatta IMEC BEHan-Gil Moon Samsung Electronics KRFrancisco Morán Burgos Universidad Politécnica De Madrid ESDouglas Morton University Of Miami USMarta Mrak Queen Mary University Of London UKMarian Muczko C.W.T. Polska PLKarsten Müller Fraunhofer Hhi DETokumichi Murakami Mitsubishi Electric JPTomokazu Murakami Hitachi JPJohan Muskens Philips Research NLTakayuki Nakachi NTT JPHiroya Nakamura Victor Company Of Japan, Ltd JPMandayam Narasimhan Motorola USSua Hong Neo Panasonic Singapore Labs Pte Ltd SGPaolo Nesi Disit, Univ. Florence ITMike Nilsson BT Exact UKTakashi Nishi Oki Electric Industry Co., Ltd. JPHirofumi Nishikawa Mitsubishi Electric JPTakeshi Norimatsu Matsushita Electric/Panasonic JPRobert O'callaghan Mitsubishi Electric UKTobias Oelbaum Munich University Of Technology DEYukiko Ogura Ipsj/Itscj JPEunmi Oh Samsung Ait KRHyen-O Oh Lg Electronics KRSeoung-Jun Oh Kwangwoon University KRWeon Geun Oh ETRI KRJens-Rainer Ohm RWTH Aachen DEPatrice Onno Canon Crf FRWerner Oonen Philips NLJoern Ostermann University Of Hannover DEPurvin Pandit Thomson Inc. USHee-Suk Pang LG Electronics KRChangseob Park Korean Broadcasting System KRChoon Seo Park ETRI KRGwang-Hoon Park Kyung Hee University KRHochong Park Kwangwoon University KRJi Ho Park LG Electronics KRKeunsoo Park Korean Broadcasting System KRSeung-Wook Park LG Electronics KR

15

Soo-Jun Park ETRI KRSunghee Park Pixtree KRMadhu Parthasarathy Wipro INStephane Pateux France Telecom Division R&D FRFlorelle Pauchet Irisa FRBenoit Pellan Enst FRWen-Hsiao Peng National Chiao-Tung University USFernando Pereira IST-IT PTFlorian Pestoni Microsoft USPierrick Philippe France Telecom R&D FRPawel Piotrowski C.W.T. Polska Sp. Z O.O. PLMarius Preda INT FRFrancoise Preteux INT FRHeiko Purnhagen Coding Technologies Ab SESchuyler Quackenbush Audio Research Labs USMajid Rabbani Eastman Kodak USSusanto Rahardja Institute For Infocomm Research SGMichael Ransburg Klagenfurt University ATThomas Rathgen Technical University Ilmenau DEPatrick Rault Fastvdo CATaylor Ray Nds Ltd. UKJulien Reichel Visiowave (Ge Security) CHNikolaus Rettelbach Fraunhofer Iis DEYuriy Reznik Qualcomm Incorporated USJustin Ridge Nokia FIYong Man Ro ICU KRDavide Rogai Univ. Of Florence - Dsi Disit ITJérôme Royan France Telecom R&D FRNiels Rump Rightscom Limited UKMartin Russ BT Group UKPhoom Sagetong Qualcomm Incorporated USSatoru Sakazume Victor Company Of Japan, Ltd JPAlexandru Salomie Vrije Universiteit Brussels BEDiego Santa Cruz Visiowave (Ge Security) CHThomas Schierl Fraunhofer Hhi DEPeter Schirling IBM USAndreas Schneider Coding Technologies Gmbh DEHeiko Schwarz Fraunhofer Hhi DEAndrew Segall Sharp Labs Of America USTakanori Senoh The University Of Tokyo JPJeongil Seo ETRI KRJungdong Seo School Of Ee, Yonsei University KRYang Seungji Information & Communications Univ. KRBeack Seungkwon ETRI KROfer Shapiro Layered Media USShengmei Shen Panasonic Singapore Labs Pte Ltd SGMasato Shima Texas Instruments Japan JPOsamu Shimada Nec Corporation JPYoshihide Shimpuku Sony Corporation JPIl Hong Shin KAIST KRSungchol Shin Samsung Electronics KR

16

Donggyu Sim Kwangwoon University KRDavid Singer Apple USThomas Rorvik Skjolberg Adactus NOAljoscha Smolic Fraunhofer Hhi DEKwanghoon Sohn School Of Ee, Yonsei University KRHan Sae Song Seoul National University KRSuk-Kyu Song ETRI KRWonseon Song Soongsil University KRYoung Joo Song Samsung KRRalph Sperschneider Fraunhofer IIS DEYeping Su Thomson Inc. USYoshinori Sugihara JEITA JPHiroaki Sugiura Mitsubishi Electric Corp. JPDoug Young Suh Kyung Hee University KRGary Sullivan Microsoft USHuifang Sun Mitsubishi Electric USShijun Sun Sharp Labs Of America USViswanathan Swaminathan Sun Microsystems Inc. USKatsumi Tahara Sony Corp. JPYoshiaki Takagi Matsushita Electric JPAnisse Taleb Ericsson SEMikko Tammi Nokia FIThiow Keng Tan NTT Docomo, Inc. JPMasayuki Tanimoto Nagoya University JPSuzuki Teruhiko Sony Corp. JPAndrew Tescher Microsoft USHerbert Thoma Fraunhofer IIS DEJoseph Alfred Thomas-Kerr University Of Wollongong AUChristophe Tillier Get Enst FRChristian Timmerer Klagenfurt University ATJani Toiminen Nokia FIAndrew Alexander

Tokmakoff Telematica Instituut NL

Pankaj Topiwala Fastvdo USCong Thang Truong Information & Communications Univ. KRChun-Jen Tsai NCTU/ITRI USStefano Tubaro Politecnico Di Milano ITYi-Shin Tung Setabox Corporation USTakafumi Ueno Matsushita Electric JPMauri Vaananen Nokia FIJames Van Loo Microsoft USFrederic Vexo Epfl-Vrlab CHJérôme Vieron Thomson FRMark Vinton Dolby Laboratories USDavid Virette France Telecom FRWade Wan Broadcom Corporation USXianglin Wang Nokia FIYe-Kui Wang Nokia FIXin Wang Contentguard, Inc. USSimon Watt Universal Music Group International UKThomas Wedi Panasonic DE

17

Thomas Wiegand Frannhofer HHI DEMathias Wien Rwth Aachen University DESteffen Wittmann Panasonic R&D Center Germany DEIngo Wolf Deutsche Telekom DEPing Wu Tandberg Television UKLianhuan Xiong Huawei Technologies Co., Ltd. CNLijing Xu Huawei Technologies Co., Ltd CNAkio Yamada NEC JPYoshihisa Yamada Mitsubishi Electric JPTomoyuki Yamamoto Sharp JPChanseok Yang Information & Communications University KRJeonghyu Yang LG Electronics KRYoshiyuki Yashima NTT JPKyoungro Yoon Konkuk University KRSeung-Uk Yoon Gwangju Inst. Of Science & Techn. (Gist) KRLu Yu Zhejiang University CNSangjun Yu Via-Multimedia Center KRRongshan Yu Institute For Infocomm Research SGHaoping Yu Thomson USQing Zhang Huawei Technologies Co., Ltd CNSheng Zhong Broadcom USFrancesco Ziliani Visiowave Ge Security CHGiorgio Zoia Epfl - Its CH

18

Annex 2Agenda

Agenda item1. Opening 2. Roll call of participants 3. Approval of agenda 4. Allocation of contributions

5. Communications from Convenor 6. Report of previous meeting 7. Processing of NB Position Papers8. Work plan 1 Media coding 1.1. Generic inverse DCT specification

1.2. Fixed point implementation of DCT/IDCT

1.3. Colour spaces

1.4. Scalable Video Coding

1.5. 3D AV Coding

1.6. Low delay AAC profile

1.7. Audio Lossless Coding 1.8. Parametric Coding for High Quality Audio Conformance

1.9. MPEG Surround

1.10. AFX extensions

1.11. Open Font Format

1.12. Video Coding Tool Repository

1.13. Exploration on wavelet video coding

1.14 Scalable audio and speech coding

2. Composition coding

2.1. Lightweight Scene Representation

2.2. Symbolic Music Representation

3. Media Description

19

3.1. Visual Descriptor Extensions

3.2. Audio Descriptor Extensions

3.3. Extraction and use of descriptors and description schemes

4. Systems support

4.1. 3D Compression Profile Descriptor

4.2. MPEG-7 Random Access in BiM

4.3. XML Binarisation

5. IPMP

5.1. DII Related Identifiers

5.2. MPEG-21 IPMP Components

5.3. REL Profiles

5.4. Rights Data Dictionary

6. Digital Item

6.1. DIA Conversions and Permission Extensions

6.2. Event Reporting

6.3. Fragment Identification of MPEG Resources

6.4. XML Fragment Requests 6.5. MPEG-21 Conformance

7. Transport and File Format

7.1. Transport of Streaming Text over MPEG-2

7.2. AVC File Format extensions for FRExt

7.3. AVC File Format extensions for SVC 7.4. Digital Item Streaming

8. Multimedia architecture

8.1. MPEG-J GFX

8.2. MPEG Multimedia Middleware

20

8.3. Digital Item Processing 8.4 Content Based Search Framework 8.5 MPEG Dictionary

9. Reference implementation

9.1. Parametric Coding for High Quality Audio Reference Software

9.2. Reference Hardware Description

9.3. MPEG-7 Systems Reference Software

9.4. MPEG-21 Reference Software

10. Application formats

10.1. Application Format Framework

10.2. PhotoPlayer Application Format

11. Maintenance

11.1 Systems coding standards

11.2 Video coding standards

11.3 Audio coding standards

11.4 Visual description coding standards

11.5 Audio description coding standards

11.6 MDS standards

9. Liaison matters 10. Organisation of this meeting Tasks for subgroups

Joint meetings

Room allocation

11. Administrative matters Schedule of future MPEG meetings

Promotional activities 12. Planning of future activities13. Resolutions of this meeting 14. A.O.B 15 Closing

21

22

Annex 3List of input documents

No. Authors Title 12420 Wo Chang Document Register for SC29/WG11 Meeting Nice, France

12421 Robert TurneyMarco Mattavelli

AHG on MPEG-4 Part 9 Reference Hardware Description Phase 1 and 2

12422 Mike Rubinfeld AHG on MPEG Dictionary

12423Klaus DiepoldWo ChangHarald Fuchs

AHG on MAFs

12424Wo ChangRiccardo LeonardiMatthias Gruhne

AHG on CBSearch Framework

12425 Joseph Thomas-Kerr AHG on XML Fragment Requests

12426 Teruhiko Suzuki AHG on Colour Spaces

12427 G. SullivanLuthra AHG on Video IDCT Specification

12428 Yi-Shin TungWang

AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

12429

L. CieplinskiA. YamadaSang-Kyun KimRobert O'Callaghan

AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software

12430 Miroslaw BoberSang-Kyun Kim AHG on Description Tools for MPEG-7 New Visual Extensions

12431 Aljoscha SmolicKimata AHG on 3D Video Coding

12432 Euee S. JangAsai AHG on Video Coding Tools Repository

12433

Riccardo LeonardiJizheng XuStefano TubaroBéatrice Pesquet-Popescu

AHG on Exploration in Wavelet Video Coding

12434 Touradj EbrahimiOstermann

AHG on Organization of Workshop on Future Directions in Video Compression

12435

M. BoberA. YamadaS. K. KimWo Chang

AHG on Photo Player MAF

12436 R. Sperschneider AHG on Audio Standards Maintenance

12437 M. Gruhne AHG on MPEG-7 Audio

12438 S. Quackenbush AHG on MPEG Surround

12439 Tilman Liebchen AHG on MPEG-4 Lossless Audio Coding

12440 Paolo Nesi AHG on Symbolic Music Representation

23

Giorgio Zoia

12441 S. Quackenbush AHG On Exploration of Scalable Audio and Speech Coding

12442Marius PredaJeong-Hwan AhnFrancisco Morán Burgos

AHG on AFX documents, CEs, and software

12443Mikaël Bourges-SévenierVishy SwaminathanItaru Kaneko

AHG on MPEG-J Graphics Framework eXtensions

12444 Gerrard DruryDe Keukaleare AHG on MPEG-21 DIP

12445 Christian Timmerer AHG on MPEG-21 DIA

12446 FX NuttallTokmakoff AHG on MPEG-21 Event Reporting

12447 Simon Watt AHG on MPEG-21 IPMP Components

12448Sylvain DevillersJoseph Thomas-KerrIngo Wolf

AHG on Digital Item Streaming

12449Claude SeyratAndreas HutterItaru Kaneko

AHG on XML Structure Binarization and Streaming

12450Alexandre Cotarmanac.hYoung-Kwon LimCyril Concolato

AHG on Scene Representation

12451 David SingerMohammed AHG on MPEG File Formats

12452

Jean GelissenHendryMartin RussDavide Rogai

AHG on MPEG Multimedia Middleware

12453 SC 37 via SC 29 Secretariat Liaison Statement from JTC 1/SC 37 [SC 29 N 6877]

12454 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-2:2004/FDAM 2 [SC 29 N 6885]

12455 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 21000-2 2nd Edition [SC 29 N 6887]

12456 CEN/ISSS via SC 29 Secretariat Liaison Statement from CEN/ISSS [SC 29 N 6892]

12457 ITU-T SG 16 via SC 29 Secretariat Liaison Statement from ITU-T SG 16 [SC 29 N 6893]

12458 ITU-T SG 16 via SC 29 Secretariat Liaison Statement from ITU-T SG 16 [SC 29 N 6894]

12459 SC 24 via SC 29 Secretariat ISO/IEC 19775-1/FPDAM 1 [SC 29 N 6914]

12460 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3:200X/DCOR 1 [SC 29 N 6918]

12461 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-3:2002/FPDAM 2 [SC 29 N 6919]

12462 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:2004/FPDAM 11 [SC 29 N 6920]

24

12463 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-15:2004/FPDAM 1 [SC 29 N 6921]

12464 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 23001-1 [SC 29 N 6922]

12465 TVA via SC 29 Secretariat Liaison Statement from TVA [SC 29 N 6930]

12466 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-1:2004/FDAM 1 [SC 29 N 6942]

12467 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-1:2002/FPDAM 2 [SC 29 N 6935]

12468 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 21000-16 [SC 29 N 6939]

12469 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 14496-11 [SC 29 N 6941]

12470 Schuyler Quackenbush Audio Codec Behavior

12471 Schuyler Quackenbush 73rd MPEG Audio Report

12472Robin Berjon Philippe de CuetosCedric Thienot

Extensibility in LASeR BiM-Compatible Simple Encoding

12473Robin BerjonPhilippe de CuetosCedric Thienot

Carriage of private data in LASeR BiM-Compatible Simple Encoding

12474Robin BerjonPhilippe de CuetosCedric Thienot

Report on generality in LASeR BiM-Compatible Simple Encoding

12475

Robin BerjonPhilippe de CuetosGregoire PauCedric Thienot

Implementation of the BiM-Compatible LASeR reference software

12476 IEC TC 100 via SC 29 Secretariat IEC CDV 61937-8 [SC 29 N 6946]

12477A.CotarmanachR. CazoulatM. Cormier

StreamSource

12478CotarmanachCazoulatFisher

Updated 2-Pager for BIFS

12479 Jean-Claude Dufourd Extensibility of the Custom SDL (for the Cupertino Meeting)

12480 Jean-Claude Dufourd Genericity of the Custom SDL (for the Cupertino Meeting)

12481 Jean-Claude Dufourd Custom SDL and mapping (for the Cupertino Meeting)

12482 3GPP via SC 29 Secretariat Liaison Statement from 3GPP [SC 29 N 6949]

12483 SC 29 Secretariat Summary of Voting on ISO/IEC PDTR 14496-9 [SC 29 N 6953]

12484 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 21000-4 [SC 29 N 6954]

12485

Yo-Sung HoSeung-Uk YoonEun-Kyung LeeSung-Yeol KimKugjin YunDaehee KimNamho Hur

Generation and Coding of Layered Depth Images for Multi-view Video

12486 Gerrard Drury Preliminary comments on ISO/IEC 21000-10 PDAM/1

25

Ian S. Burnett

12487Ulrich FeckerMarcus BarkowskyAndré Kaup

Luminance and Chrominance Compensation for Multi-View Sequences Using Histogram Matching

12488

Pierfrancesco BelliniMaurizio CampanaiGiorgio ZoiaPaolo Nesi

Proposed Amendment to 14496-11 for SMR support

12489

Jorn Janneck Marco Mattavelli Dave Parlour Robert Turney

Proposal for a VCTR formalism description and simulation framework.

12490

David SingerThomas RathgenPeter AmonAndreas Hutter

On the SVC File Format VM

12491 David Singer Amendment 1 to AVC FF, proposed output text

12492 DVB via SC 29 Secretariat Liaison Statement from DVB [SC 29 N 6955]

12493

12494 Melanie Dulong de Rosnay Contribution to AhG on MPEG-21 RDD

12495Roberto GarcíaJaime DelgadoEva Rodríguez

Ontological Analysis of the MPEG-21 Rights Data Dictionary (RDD)

12496

Marco Mattavelli Ihab Amer Wael Badawy Andrew Kinane

Overview of MPEG-4 Part-9 reference HW description

12497 Marco Mattavelli Overview of MPEG-7 Part-6 reference SW: Experimentation Model (XM)

12498Jeong Taek HwangYongju ChoJae-Gon Kim

Analysis of extracting SVC streams in the non-sequential order (informative)

12499 Christian Timmerer Editor's input on ISO/IEC 21000-7 FPDAM/1

12500 Octavian Folea Content protection extension for MPEG-21 REL

12501D.IchimuraY.HondaM.H.Lee

A Tool for Interactive ROI Scalability

12502D.IchimuraY.HondaM.H.Lee

Stream Structure and CABAC improvement for Multiple Interactive ROI Scalability

12503 Jean-Claude Dufourd LASeR and SAF editor's study

12504Jean-Claude DufourdYe Sun JoungYoung Kwon Lim

Proposal to add JSR 226 / MicroDOM to LASeR

12505 Jean-Claude Dufourd Final version of custom SDL, validated by implementation

12506 Jean-Claude Dufourd Fixes to the LASeR study, with explanations

12507 Jean-Claude Dufourd Clarifications proposals for LASeR and SAF

26

12508 D. Tran Lijie Liu and Pankaj N. Topiwala

Fast Fixed-Point Multiplier-less DCT/IDCT Approximation Based on the Lifting Scheme

12509 D. Tran Lijie Liu and Pankaj N. Topiwala

Fast Fixed-Point Multiplier-less DCT/IDCT Approximation Based on Loeffler Structure

12510 D. Tran Lijie Liu and Pankaj N. Topiwala

Fast Fixed-Point Multiplier-less DCT/IDCT Approximation Based on Loeffler Structure II

12511

Marc GauvinJaime Delgado Eva RodriguezRoberto García González

Preliminary Results of RDD CE for Expressing “Work”

12512

Tae-Hyeun HaJae-Phil KooDae-Hyun KimSo-Young Kim

Spatial vector prediction by Camera Parameter

12513

Kazuo SugimotoYoshihisa YamadaKohtaro AsaiTokumichi Murakami

Proposed update of TD 4.0

12514

Kazuo SugimotoYoshihisa YamadaKohtaro AsaiTokumichi Murakami

Update of VCTR Reference Software - Intra Only Decoder for AVC High Profile

12515 ATSC via SC 29 Secretariat Liaison Statement from ATSC [SC 29 N 6960]

12516 CEA via SC 29 Secretariat Liaison Statement from CEA [SC 29 N 6961]

12517 Gwang Hoon Park Proposal for high level syntax with super slice

12518 Hideaki KimataMasaki Kitahara

Anchor bitstreams for Call for Proposal on multi-view video coding

12519 Jean Stride UKNB comment on Liaisons

12520 CJ Lee SGNB Comment on AVC new 4:4:4 profiles

12521 Jean-Claude Dufourd About the usage of codec_rare results in the custom encoding

12522 Eva RodriguezJaime Delgado Comments on ISO/IEC FCD 21000-4

12523Jaime DelgadoJose PradosEva Rodriguez

Preliminary comments on REL profiles

12524Jaime DelgadoEva RodriguezJose Prados

Comments on MPEG-21 REL Base Profile

12525 Eva RodriguezJaime Delgado Integrity and authenticity of Event Reporting information

12526 Jean Gelissen for DNB DNB comment on request to maintain fastest possible schedule for MPEG Surround

12527 A. G. Tescher for USNB USNB Contribution: Regarding “MAFs under Consideration”

12528 A. G. Tescher for USNB USNB Contribution: New Profiles for AVC

12529 A. G. Tescher for USNB USNB Contribution: ISO/IEC 23003 Issues

12530 A. G. Tescher for USNB USNB Contribution: Performance measure for SLS

27

12531 Sheng ZhongSandy MacInnis High Fidelity Fixed point 8x8 IDCT and DCT algorithms

12532 Wo Chang CBSearch Query Interface Definition

12533 Ye-Kui WangMiska M. Hannuksela Signaling of low-to-high layer switching points in SVC file format

12534 Tae Hyeon KimH. Jean Cha

Proposal of new scenarios and requirements for an Accompaniment Music Player MAF

12535 IEC TC 100 via SC 29 Secretariat Liaison Statement from IEC TC 100 [SC 29 N 6962]

12536 NISO via SC 29 Secretariat Liaison Statement from NISO [SC 29 N 6963]

12537Noboru HaradaYutaka KamamotoTakehiro Moriya

Performance evaluation of ALS on a PC platform

12538 Kyunghee JiJungwon Kang Preliminary comments on 21000-15 FCD

12539 Jeong-Hwan Ahn Updates on Study document of ISO/IEC 14496-4:2005/ AMD12 (Morphing & Textures)

12540

Sang-ki KimSangyoun LeeSun-jeong KimJung-Ho Choi

CE Report for VCE-5

12541

Donggyu SimSeoung-Jun OhChang Beom AhnYung Lyul LeeKyuheon KimKyeongok Kang

Comments on View Scalability of Multi-View Video Coding

12542

Yo-Sung HoKwan-Jung OhHan OhByeong-ho ChoiJe-Woo Kim

Multi-view Video Coding based on Lattice-like Pyramid GOP Structure

12543

Jeongil SeoSeungkwon BeackSang Bae JeonInseon JangKyeongok KangJinwoo HongMinsoo Hahn

Core Experiment on Efficient Quantization Method for CLD

12544 Myriam AmielhErnest Wan Preliminary comments on ISO/IEC 21000-17 FCD (FID)

12545 Soo-Jun ParkMyung Gil Jang Cross verification report of CE for photo categorization (VCE-2)

12546

Kwanghoon SohnYongtae KimChangseob ParkJaeho Lee

Validation of carmera parameters in terms of epipolar geometry

12547 Hee-Suk PangDong Soo KimJaehyun LimHyen-O Oh

Report on Non-Guided MPEG Surround Verification Test

28

Yang-Won Jung

12548

Dong Soo KimHee-Suk PangJaehyun LimHyen-O OhYang-Won Jung

High Frequency Energy Compensation for MPEG Surround

12549

Hyen-O OhYang-Won JungHee-Suk PangDong Soo KimJaehyun Lim

Proposed core experiment on pilot-based coding of spatial parameters for MPEG Surround

12550

Hee-Suk PangDong Soo KimJaehyun LimHyen-O OhYang-Won Jung

Proposed Syntax Revision for Redundancy Reduction in MPEG Surround

12551

Hee-Suk PangDong Soo KimJaehyun LimHyen-O OhYang-Won Jung

Comments on the Bitstream Syntax for Residual Coding in MPEG Surround

12552

Yang-Won JungHyen-O OhHee-Suk PangDong Soo KimJaehyun Lim

Proposed syntax revision for extended signaling in MPEG Surround

12553

Eun-Young ChangDaiyong KimByeongwook MinSunyoung LeeNamho HurSoo In LeeEuee S. Jang

CE Results on 3DMC Revision for AFX amd. 2

12554

Eun-Young ChangDaiyong KimSunyoung LeeNamho HurSoo In LeeEuee S. Jang

3DMC white paper V2.0

12555Sunyoung LeeChungku YieEuee S.jang

Proposal of VCTR requirements

12556

Sinwook LeeSunyoung LeeChungku YieEuee S.Jang

Status report of VCTR Ref. SW

12557 Hyunsoo AhnSunyoung LeeYongho choByeongwook MinHyungyu KimSinwook LeeChungku Yie

VCTR demo scenario on bitstream reconfigurable coding and profile free coding

29

Euee S.Jang

12558

Chong Kok SengYoshiaki TakagiShuji MiyasakaKojiro OnoTakeshi NorimatsuNeo Sua Hong

Core experiment on an even lower complexity mode for MPEG Surround

12559 Jeroen BreebaartChristof Faller MPEG Surround Non-guided modifications WD

12560Marius PredaFranck Le Pouliquen Francoise Preteux

Conformance streams for Morphing and Animation

12561 Marius Preda Editorial corrections on AFX 2nd Release

12562David Crombie Roger Lenoir Neil McKenzie

SMR CE Report on Braille and Spoken Music

12563

Philippe de Cuetos Robin Berjon Gregoire Pau Cedric Thienot

Specification of ISO_15938_1_Encoding in LASeR

12564

Philippe de Cuetos Robin BerjonGregoire PauCedric Thienot

Integration of LASeR specific codecs in the BiM reference software

12565 Philippe de CuetosClaude Seyrat Editor's Study of ISO/IEC 23001-1 FCD

12566

Gerard HothoLars VillemoesJeroen breebaartHeiko PurnhagenJonas Roden

Verification of MPEG-Surround Artistic Downmix and next steps

12567 Niels Rump Review of CE on DI Mapping to Delivery Channels

12568

Michael ZuffereyEric DelfosseChristian TimmererHarald Kosch

Report on CE Proposed DIA extensions: Multiple input/output values for AdaptationQoS IOPins and MPEG-7 as BSDLink steering description

12569 Werner OomenFrans de Bont Proposed corrigenda DCOR1 to AMD6, (lossless 1-bit)

12570

Chong KokSengZhou HuanKazuhiro IidaGempo ItoYoshiaki Takagi

Core Experiment on adding 3D Stereo support to MPEG Surround

12571

Chong KokSengZhou HuanKazuhiro IidaGempo ItoYoshiaki Takagi

Core Experiment on adding 3D stereo support to MPEG surround

12572 Ralf Geiger Markus Schmidt

Evaluation of MPEG-4 SLS in Near-Lossless Range

30

Jürgen Herre

12573 Stephen DavisIan Burnett Improved and clarified FRU text

12574

Davide RogaiPaolo NesiTommaso MartiniAndrea Vallotti

MPEG-21 Multimedia Middleware: Remote Capabilities

12575 JungHoe KimMiyoung Kim Proposed Audio Conformance Bitstreams for BSAC

12576 JungHoe Kim Proposed Corrigendum to 14496-3 2001 FDAM 4 (BSAC)

12577 JungHoe KimEunmi Oh Proposed Syntax Revision on Integration of BSAC and SBR

12578 Chris Barlas Reviewer's Comment on CE on RDD Abstraction and Resource

12579 Christian Timmereron behalf of the Austrian NB Austrian NB comments on 21000-7 FPDAM/1

12580

Jeroen BreebaartHeiko PurnhagenKarsten LinzmeierChristof Faller

MPEG Surround: Evidence of the Matrix Compatibility configuration

12581

Pierfrancesco BelliniPaolo NesiDavide RogaiAndrea Vallotti

DSI preliminary comments on ISO/IEC FCD 21000-4

12582 Kristofer Kjörling Heiko Purnhagen Verification of the Non-Guided MPEG Surround CE

12583Christian TimmererBenoit PellanTruong Cong Thang

MPEG-21 DIA AMD/1 reference software status

12584 Kristofer Kjörling Maintenance of WD2 on MPEG Surround

12585

Purnhagen Kristofer Kjörling Ralph Sperschneider Werner Oomen

Update on Transport of MPEG Surround in MPEG-1/2/4

12586

Purnhagen Kristofer Kjörling Claus-Christian Spenger Werner Oomen

Analysis of proposed CE on CLD quantization

12587 Kristofer Kjörling Proposed additions to the DCOR 2 on MPEG-4 Audio third edition

12588HendryMunchurl KimFlorian Pestoni

A Flexible and Extensible Protection of Music Player MAF using Lightweight MPEG-21 IPMP

12589Chansuk YangJeongyeon LimMunchurl Kim

Extensions to Music MAF Player Format for Multiple JPEG images and Text data with Synchronizations to MP3 data

12590HendryMunchurl KimYoungjoo Song

Modeling M3W Logical Service using XML Schema

31

12591

CHOI Yong-SooKIM Hyoung-JoongCHO Yong-JuKIM Jae-Gon

The CE Report for Symbolic Music Representation(SMR) on Korean Traditional Music Notations.

12592Gun BangHyon-Gon ChooJeho Nam

Investigation of IPMP tool update functionality mapped on the M3W service

12593 Tilman Liebchen Proposed Draft Text of ALS Verification Report

12594

M. Kautzner K. Mueller A. Smolic T. Wiegand

Results on EE1 for D3DMC

12595

jan van der meerfons brulschris varekamparnoud bourgealjoscha smolicthomas wiegandshijun sun

Proposal to define depth map coding for stereoscopic applications

12596

jan van der meerfons brulschris varekamparnoud bourgealjoscha smolicthomas wiegandshijun sun

Requirements for stereoscopic applications using depth maps

12597Saar De ZutterFrederik De KeukelaereRik Van de Walle

Editors input on 21000-10 PDAM1

12598Hyon-Gon ChooGun BangJeho Nam

Refined IPMP Interfaces of Multimedia API on M3W service

12599 Matthias Gruhne Proposed editorial changes on 15938-4:2002/ FPDAM

12600

jan van der meerfons brulschris varekamparnoud bourgealjoscha smolicthomas wiegand

Draft depth map stream format

12601Frederik De KeukelaereSaar De ZutterRik Van de Walle

Contribution to DIP reference software - update to FDIS status

12602

jan van der meerfons brulschris varekamparnoud bourgealjoscha smolicthomas wiegand

Proposal for MPEG-2 System amendment for carriage of depth map streams over MPEG-2 Systems.

12603 jan van der meerfons brulschris varekamparnoud bourge

Background information on the use of Depth Maps for stereoscopic applications

32

aljoscha smolicthomas wiegandshijun sun

12604Hyon-Gon ChooGun BangJeho Nam

Investigation of MPEG-21 IPMP on M3W IPMP API

12605 Yuri VatisJörn Ostermann

Comparison of Complexity between two-dimensional non-separable Adaptive Interpolation Filter and Standard Wiener Filter

12606Pierfrancesco BelliniMaurizio CampanaiPaolo Nesi

Proposed revised text of WD on Symbolic Music Representation

12607Reznik Hari Garudadri Hyukjune Chung Phoom Sagetong Naveen Srinivasamurthy

Fixed Point Multiplication-Free 8x8 DCT/IDCT Approximation

12608 David Virette Cross-check of the Core Experiment on non-guided MPEG Surround

12609 David Virette Cross-check of the low rate and high quality MPEG Surround bitstreams

12610Gregoire PauPhilippe de CuetosClaude Seyrat

BiM reference software update

12611Davy De SchrijverRobbie De SutterRik Van de Walle

Report on Core Experiment on BSDL extensions

12612

D. CerneaA. MarkovaA. SalomieA. AlecuP. SchelkensA. MunteanuR. Deklerck

Updates to the AFXEncoder related to MeshGrid

12613 van der Meer Werner Oomen Study on ISO/IEC 13818-1:2000/PDAM 6: Transport of streaming text over MPEG-2 systems

12614 Christian Timmereron behalf the editors Editor's input on DIA AMD/2: DIA Extensions WD v1.0

12615

A. SalomieD. CerneaA. MarkovaR. DeklerckA. MunteanuP. Schelkens

Updates to IM1 related to MeshGrid

12616 Gregoire Pau Beatrice Pesquet-Popescu Proposal of Vidwav OBMC bug fix

12617

Ci-Xun ZhangJing WangXin-Hao ChenQian HuXing LiLu Yu

Fixed-Point 8x8 IDCT, further result

33

12618

Chung-Yi WengWei-Kai Steve SuYi-Shin TungJa-Ling Wu

Contribution to VCTR Reference Software - Provision and Correction of Syntax Parsing and VLD functional units for MPEG-1 and Intra-Only MPEG-4 Decoder

12619Wei-Kai Steve SuYi-Shin TungJa-Ling Wu

New Codec Generation and Coding Tool Evaluation using VCTR Framework: An Example to Use Different Intra Prediction Tools

12620 Miska HannukselaJani Toiminen ID3v2 tag in ISO base media file format

12621

Miska HannukselaJani ToiminenDaidi ZhongRamakrishna Vedantham

FLUTE hint track in ISO base media file format

12622 Johannes HilpertKarsten Linzmeier

FhG listening test results for CE on non-guided mode of MPEG Surround

12623 Andreas Hutter on behalf of the GNB GNB Comments on Study Text of ISO/IEC FCD 14496-20

12624 Per Fröjdh Grouping of tracks in the SVC file format

12625 Jerome RoyanPatrick Gioia Proposal for Roof coding

12626

Johannes HilpertAndreas HoelzerSascha DischWerner OomenKristofer KjoerlingChristof Faller

Evidence for the Low Complexity Mode of MPEG Surround

12627 Marcos AvilésFrancisco Morán

Results for AFX's EE2 on spatial- and SNR-scalable 3D surface coding

12628Marcos AvilésFrancisco MoránMarius Preda

IndexedWedgeSet: Efficient Representation of Attributed Meshes

12629Francisco Morán Sebastián AmengualMarcos Avilés

Updates to 'Material Related to MPEG Reference Software'

12630Francisco MoránSebastián AmengualMarcos Avilés

Updates to WD of 'ISO/IEC 14496-4/Amd12'

12631

Sascha DischKarsten LinzmeierMatthias NeusingerGerard HothoJuergen HerreJohannes Hilpert

Proposed Quality Enhancements for MPEG Surround

12632

Christian TimmererHermann HellwagnerAndreas HutterJörg Heuer

Buffer Configuration Information for Digital Item Streaming: State of the Art and Examples

12633 Nikola SprljanMarta MrakNaeem Ramzan

Motion Driven Adaptation of Spatial Wavelet Transform

34

Ebroul Izquierdo

12634

Michael RansburgSylvain DevillersChristian TimmererHermann HellwagnerAlexandre Cotarmanac'h

Demonstration of gBSD-based Adaptation in Streaming Scenarios

12635

Truong Cong ThangTae Meon BaeYong Man RoJung Won KangJae-Gon Kim

Improvements of Scalability Information SEI message

12636

Truong Cong ThangTae Meon BaeJung Won KangYong Man RoJae-Gon Kim

Boundary handing for ROI scalability

12637

Truong Cong ThangDuckyeon KimTae Meon BaeJung Won KangYong Man RoJae-Gon Kim

Show case of ROI extraction using scalability information SEI message

12638

Truong Cong ThangJung Won KangYoungsuk KimYong Man RoJae-Gon Kim

SVC Video Adaptation with MPEG-21 DIA AdaptationQoS

12639Nicola AdamiMichele Brescianini Riccardo Leonardi

Edited version of the document SC 29 N 7334

12640 Markus BeermannMathias Wien

Wavelet Video Coding EE4: Joint Reduction of Ringing and Blocking

12641 Young-Kwon LIM (on behalf of KNB) KNB comment on ISO/IEC 14496-20 concerning StreamSource

12642

Nicola AdamiMichele Brescianini Riccardo LeonardiAlberto Signoroni

New prediction schemes for scalable wavelet video coding

12643

Nicola AdamiMichele Brescianini Riccardo LeonardiAlberto Signoroni

Performance evaluation of the current Wavelet Video Coding Reference Software

12644Peder DregeThomas SkjølbergRunar Solberg

Comments on Digital Item Streaming

12645Harald FuchsHerbert ThomaStefan Kraegeloh

Proposed Portable Video Player MAF

12646Harald FuchsStefan KraegelohThe TIRAMISU Project

Proposed Bundled License MAF

35

12647 Harald FuchsHerbert Thoma Proposed Slideshow MAF

12648 Anisse TalebPhilippe Pierrick Suggested Requirements for Scalable Speech and Audio Coding

12649 Simon Watt Review comments on CE on RDD Abstraction and Resource

12650

Sylvain Devillers Michael Ransburg Christian Timmerer Hermann Hellwagner Alexandre Cotarmanac'h

Updates on Media and XML Streaming Instructions

12651 Le Feuvre JeanCyril Concolato MPEG-4 Terminal Architecture White Paper

12652 Akio Yamada Proposed update on Photo Player WD

12653 Jean Le Feuvre MPEG-4 Objects extended synchronization

12654 Akio YamadaSang-Kyun Kim Editors' Study of ISO/IEC 15938-3:2002/FPDAM2

12655 Akio YamadaSang-Kyun Kim Editors' Study of ISO/IEC TR 15938-8/PDAM2

12656 Akio YamadaSang-Kyun Kim MPEG-7 Visual eXperimental Model version 25.1

12657

Sang-Kyun KimSeungji YangKyong Sok SeoSi Hyoung LeeYong Man RoJi-Yeon Kim

CE Report for Photo Categorization (VCE-2)

12658

Rongshan YuJungHoe KimTi-Eu ChanEunmi Oh

Report on combine SLS with Scalable AAC and BSAC

12659

Sang-Kyun KimSeungji YangJun Ho ChoYong Man RoJi-Yeon Kim

Application Scenarios and Derived Requirements for Photo Album MAF

12660Rongshan YuHaibin HuangLi Te

Updates of compression performance of MPEG-4 lossless audio coding architectures

12661

Philippe de CuetosRobin BerjonGregoire Pau Cedric Thienot

Performances of BiM encoding in LASeR

12662 Harald FuchsStefan Kraegeloh

Proposed Corrigenda Items for ISO/IEC 23000-2 Music Player MAF

12663 Wo Chang Proposed Profile Schema for Photo Player MAF

12664 Xin Wang Reviewer comments on CE on RDD Abstraction and Resource

12665 Gary J. SullivanJian Lou

Response to N7335 CfP on Fixed-Point 8x8 IDCT and DCT Standard

36

12666 Jean Le Feuvre Storage of MPEG-4 user streams in MP4

12667Ralph Sperschneider on behalf of the German National Body

GNB comment regarding the standardization time line for MPEG Surround

12668 Ralph Sperschneider Clarification on Definition of ExtensionProfileLevelDescriptor

12669 Ralph Sperschneider Proposal on profileAndLevelIndication Signaling in LATM

12670Peder DregeThomas SkjølbergRunar Solberg

Request for clarification regarding DIAC and adaptation decision process

12671 Mohammed SayedWael Badawy

An IP Block for Variable Block Size Motion Estimation in H.264/MPEG-4 AVC

12672Stefan Kraegelohon behalf of German National Body

GNB comments on MAF

12673 Stefan KraegelohHarald Fuchs

proposed revised text on 'Protected Music Player' MAF described in MAFs under Consideration

12674 Stefan KraegelohHarald Fuchs MAF Interoperability: Mandatory Tools vs. Default Signalling

12675 Antonio Silva Fast Fixed-point 8x8 IDCT

12676 Xin Wang Editors' Input on Study of ISO/IEC 21000-5/PDAM1

12677

Joseph Thomas-KerrIan Burnett Gabriel FernàndezAlejandro López González

Report of Core Experiment on DI mapping to delivery channels

12678 Joseph Thomas-KerrIan Burnett Technologies Required for Digital Item Streaming

12679 Gary J. SullivanRemarks on 23002-1 / 11172-6 Study of FCD on Accuracy requirements for implementation of integer-output 8x8 inverse discrete cosine transform

12680Teruhiko SuzukiNaoya KatohYoshihide Shimpuku

Proposal to support IEC 61966-2-4 in MPEG standards

12681

Teruhiko SuzukiNaoya KatohYoshihide SimpukuHiroaki Sugiura

Proposal to support new colour space in IEC TC100

12682

Hyungyu KimSunyoung LeeHyunsoo AhnChungku YieEuee S.Jang

Conceptual framework of reconfigurable bit-stream syntax management

12683

Jae-Gwi ChoiWeon-Geun OhA-Young ChoIk-Hwan ChoHyun-Mi KimDong-Seok JeongHae-Kwang Kim

Further feasibility test results of MPEG-7 visual descriptors as a Visual Identifier descriptor

12684 Diepold Considering a MAF for Surveillance Video

37

12685 - xxNx

12686 Honggang Qi Wen Gao Debin Zhao and Siwei Ma Fixed-point multiplier-less 8x8 IDCT

12687 Elion Chin Core Experiment on Perceptual Attributes

12688 Richard Gooch Lossless Compression – Applications & Requirements

12689 Arianne T. HindsDr. Joan L. Mitchell Fixed-Point Discrete Cosine Transform Proposal

12690 Patrick Rault VCTR: An example of multistandard video codec implementation

12691 ECMA via SC 29 Secretariat Liaison Statement from ECMA

12692

Weongeun OhYeonjeong JeongTaehyun KimHogab Kang

Comment on MPEG-21 base profile extension

12693 David Singer Mohammed Visharam proposed white paper on the MPEG file formats

38

Annex 4List of output documents

No. Title

7520 List of Documents from the Nice, France Meeting

7521 Resolutions of the Nice, France

7522 List of AHGs Established at the 74th Meeting in Nice, France

7523 Report of the 74th Meeting in Nice, France

7524 Guidelines for Electronic Distribution of MPEG and WG 11 Documents

7525 Press Release of the 74th Meeting in Nice, France

7526 Meeting Notice of the 75th Meeting in Bangkok Thailand

7527 Guide for WG 11 Meeting Hosts

7528 MPEG 101

7529 Request for Subdivision of IEC 23003

7530 Text of ISO/IEC 23003-1:200x MPEG Surround

7531 Liaison to DVB on IP Datacast over DVB-H

7532 ISO/IEC 15938-1/FDAM 2

7533 ISO/IEC 13818-1:2000/DCOR 5

7534 AHG on MPEG-7 Query Format

7535 AHG on MAFs

7536 Draft Requirements on MPEG-7 Query Format

7537 MPEG-21 Profiles under Consideration

7538 MAFs under Consideration

7539 Requirements on Multi-view Video Coding

7540 Draft Requirements on VCTR

7541 Status of HDL submissions and commitments for MPEG-4 Part-9

7542 “Study of Part ISO/IEC PDTR 14496-9:2005 2nd Edition Reference Hardware Description”

7543 Overview of MPEG-4 Part-9 reference HW description

7544 Overview of MPEG-7 Part-6 reference SW: Experimentation Model (XM)

7545 AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.

7546 Study of ISO/IEC 11172-6 FCD

7547 Request for 13818-2:2000 Amd.2

7548 Text of ISO/IEC 13818-2:2000 PDAM2 Support for Colour Spaces

7549 Request for 14496-2:2004 Amd.3

7550 Text of ISO/IEC 14496-2:2004 PDAM3 Support for Colour Spaces

7551 Request for 14496-10:200x Amd.1

7552 Text of ISO/IEC 14496-10:200x PDAM1 Support for Colour Spaces and Aspect Ratio Definitions

7553 Text of ISO/IEC 14496-10:200x DCOR2

39

7554 Working Draft 1 of ISO/IEC 14496-10:200x Amd.2 Advanced 4:4:4 Profiles

7555 Working Draft 4 of ISO/IEC 14496-10:200x Amd.3 Scalable Video Coding

7556 Joint Scalable Video Model (JSVM) 4

7557 JSVM 4 Software

7558 Introducing MPEG-7 DDL – an Overview

7559 Disposition of Comments on ISO/IEC 15938-3:2002/FPDAM2

7560 Text of ISO/IEC 15938-3:2002/FDAM2 Perceptual Shape Descriptor

7561 MPEG-7 Visual XM Document version 26.0

7562 Description of Core Experiments for MPEG-7 New Visual Extensions

7563 Study Text of ISO/IEC 15938-8/PDAM2

7564 Text of ISO/IEC 23000-3 CD Photo Player Multimedia Application Format

7565 Analysis and Summary of fixed-point DCT/IDCT Proposals

7566 SW Integration and Verification of Performance of fixed-point DCT/IDCT Proposals

7567 Updated Call for Proposals on Multi-View Video Coding

7568 Study of Video Coding Tools Repository V6.0

7569 VCTR Textual Description V5.0

7570 VCTR Software V4.0

7571 Draft Status Report on Wavelet Video Coding Exploration

7572 Description of Exploration Experiments in Wavelet Video Coding

7573 Wavelet Codec Reference Document and Software Manual V2.0

7574 Results of Second Workshop on Future Directions in Video Compression

7575 Study text of ISO/IEC 14496-15/DCOR 1

7576 Study Text of ISO/IEC 13818-1:2000/PDAM 6

7577 Study Text of ISO/IEC 14496-1:2004/PDAM2 3D Compression Profile Descriptor

7578Text of ISO/IEC 14496-1:2005/DCOR1 (Clarification of Audio Codec Behavior and of Profile & Level management in MPEG-4 Systems)

7579 Request for Amendment of ISO/IEC 14496-11

7580 Text of ISO/IEC 14496-11/PDAM1 (SMR)

7581 Request for Amendment of ISO/IEC 14496-12

7582 Text of ISO/IEC 14496-12/PDAM2 (Description of timed metadata)

7583 VM of ISO/IEC 14496-12/Amd.3 (Flute Hint Track)

7584 Text of ISO/IEC 14496-14/COR1 (Clarification of Audio Codec Behavior and of Profile & Level management in MPEG-4 Systems)

7585 Text of ISO/IEC 14496-15/FDAM1 (Support for FREXT)

7586 WD x.0 of ISO/IEC 14496-15/PDAM2 (SVC File Format)

7587 DoC on ISO/IEC 14496-20/FCD

7588 Text of ISO/IEC 14496-20/FDIS

40

7589 Request for Amendment on ISO/IEC 14496-20

7590 Text of ISO/IEC 14496-20/PDAM1 (SVGT1.2 Support)

7591 TuC for ISO/IEC 14496-20/Amd1

7592 DoC on ISO/IEC 15938-1/FPDAM2 (Fast Access Extension)

7593 MPEG-7 Systems reference software workplan

7594 TuC for ISO/IEC 15938-1/Amd.3 (Fragment Request Unit)

7595 Liaison to W3C

7596 DoC on ISO/IEC 23001-1/FCD

7597 Text on ISO/IEC 23001-1/FDIS

7598 WD1.0 of ISO/IEC 23001-1/Amd.1 (Reference Software & Conformance)

7599 WD3.0 of ISO/IEC 23004-2 Multimedia API

7600 Terms of Reference

7601 MPEG Standards

7602 Table of unpublished standards at FDIS level

7603 Work plan and time line

7604 Work item assignment

7605 List of patent statements received

7606 WD3.0 of ISO/IEC 23004-3 Component Model

7607 M3W Tutorial

7608 White Paper on MPEG-4 BIFS (Revision 1)

7609 White Paper on MPEG File Formats

7610 White Paper on MPEG-4 Terminal Architecture

7611 AHG on XML Structure Binarization and Streaming

7612 AHG on Scene Representation

7613 AHG on MPEG File Formats

7614 AHG on MPEG Multimedia Middleware

7615 AHG on Video IDCT Specification

7616 AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

7617 AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software

7618 AHG on Description Tools for MPEG-7 New Visual Extensions

7619 AHG on 3D Video Coding

7620 AHG on Video Coding Tools Repository

7621 AHG on Exploration in Wavelet Video Coding

7622 AHG on Photo Player MAF

7623 AHG on Depth/Disparity Representation

41

7624 WD 3.0 of 14496-16 2nd edition

7625 WD 3.0 of 14496-16/AMD2 (Geometry & Shadow)

7626 3D Graphics Core Experiments Description

7627 MPEG-4 Animation Framework eXtension (AFX) VM 19.0

7628 3D Graphics Compression FAQ 15.0

7629 Referencing Explanatory Report to JSR-135 Mobile Multimedia API

7630 Overview of 3DMC

7631 Overview of AFX

7632 AHG on AFX documents, CEs, and software

7633 AHG on MPEG-J Graphics Framework eXtensions

7634 DoC on ISO/IEC 14496-4/FPDAM11 Parametric Stereo Conformance

7635 Text of ISO/IEC 14496-4/FDAM11 Parametric Stereo Conformance

7636 Text of ISO/IEC 14496-4:2004/ DCOR3 (WSS & MG conformance updates)

7637 Request for ISO/IEC 14496-4:2004/ AMD12 (Morphing & Textures)

7638 Text of ISO/IEC 14496-4/PDAM12 (Morphing & Textures)

7639 Request for ISO/IEC 14496-5:2001/AMD9 (Morphing & Textures)

7640 Text of ISO/IEC 14496-5/PDAM9 (Morphing & Textures)

7641 WD1.0 of ISO/IEC 14496-4/AMDx (LASeR Conformance)

7642 Request for Amendment on ISO/IEC 15938-7 (Fast Access Extension Conf.)

7643 Text of ISO/IEC 15938-7/PDAM2 (Fast Access Extension Conformance)

7644 Material related to MPEG Reference Software

7645 Description of MPEG-1 Conformance

7646 Description of MPEG-1 Reference Software

7647 Description of MPEG-2 Conformance

7648 Description of MPEG-2 Reference Software

7649 Description of MPEG-4 Conformance

7650 Description of MPEG-4 Reference Software

7651 Description of MPEG-7 Conformance

7652 Description of MPEG-7 Reference Software

7653 Joint 4:4:4 Video Model (J4VM) 1

7654 J4VM 1 Software

7655 Responses to National Body Comments

7656 Statement of benefits from establishing a class C liaison with the CEA

7657 Statement of benefits from establishing a class C liaison with the ATIS

7658 List of Organisations with which MPEG entertains liaisons

7659 Liaison to WG1

7660 Disposition of Comments on ISO/IEC 21000-4 IPMP Components FCD

7661 Supporting Text to Disposition of Comments on ISO/IEC 21000-4 IPMP Components FCD

7662 Liaison to DVB on LASeR

42

7663 Liaison to TC 100

7664 Liaison to ATSC

7665 Liaison to DMP

7666 Liaison to IFPI

7667 Liaison to CES/ISSS

7668 Liaison to CEA

7669 Liaison to NISO

7670 Liaison to CISAC

7671 Liaison to 3GPP

7672 Liaison to ATIS

7673 Liaison to ECMA

7674 Liaison to OMA

7675 MPEG-1 White Paper - Multiplex Format

7676 MPEG-1 White Paper – Terminal Architecture

7677 MPEG-1 White Paper – Multiplexing and Synchronization

7678 MPEG-2 White Paper - Multiplex Format

7679 MPEG-2 White Paper – Terminal Architecture

7680 MPEG-2 White Paper – Multiplexing and Synchronization

7681 DoC on 14496-3:2005/DCOR 1 BSAC and LATM

7682 Text of 14496-3:2005/COR 1 BSAC and LATM

7683 14496-3:2005/DCOR 3 DST

7684 14496-3:2005/DCOR 4 Timestamps and SBR

7685 14496-3 2005/AMD 2:2005/DCOR 1 BSAC

7686 Verification Report on MPEG-4 ALS

7687 Verification Report on MPEG-4 SLS

7688 WD2 on Integration of BSAC and SBR

7689 Workplan on Integration of BSAC and SBR

7690 WD on Symbolic Music Representation

7691 Proposed Corrections to LATM V1

7692 Proposed Technical Report: Audio and Systems Interface

7693 Working Draft of BSAC Conformance

7694 Proposed correction to Audio part of 14496-4:2004

7695 Status of MPEG-4 Audio Conformance

7696 Study on ALS and SLS Reference Software

7697 Study on Text of 15938-4:2002/ FPDAM

7698 Workplan on Perceptual Attributes

7699 Proposed Corrigendum to MPEG-A Music Player

7700 Workplan for MPEG Surround

7701 Performance of MPEG Surround Technology

43

7702 Audio Exploration

7703 MPEG Technologies: MPEG-1/2 Layer 3

7704 MPEG Technologies: Advanced Audio Coding

7705 MPEG Technologies: Structured Audio

7706 MPEG Technologies: ALS

7707 MPEG Technologies: SLS

7708 MPEG Technologies: MPEG-7 Low-level audio descriptors

7709 MPEG Technologies: MPEG-7 High-level audio descriptors

7710 MPEG Technologies: Music Player

7711 AHG on Audio Standards Maintenance

7712 AHG on MPEG-7 Audio

7713 AHG on MPEG Surround

7714 AHG on MPEG-4 Lossless Audio Coding

7715 AHG on Symbolic Music Representation

7716 AHG On Exploration of Scalable Audio and Speech Coding

7717 Text of ISO/IEC 21000-4 IPMP Components FDIS

7718 Study of PDAM/1 MPEG-21 REL Profiles

7719 REL AMD/1 Reference Software Plan

7720 Working Draft of COR/2 of ISO/IEC 21000-6

7721 Preliminary Disposition of Comments on ISO/IEC 21000-14 CD

7722 DoC on ISO/IEC 21000-7 FPDAM/1 Conversions and Permissions

7723 Text of ISO/IEC 21000-7 FDAM/1 Conversions and Permissions

7724 Request for Amendment 2 of ISO/IEC 21000-7 DIA

7725 TuC for DIA AMD/2

7726 ISO/IEC 21000-7 PDAM/2 Dynamic and Distributed Adaptation

7727 DIA Reference Software Status and Workplan

7728 Workplan for CE on DIA Extensions for BSD based Adaptation

7729 Workplan for CE on SVC and AdaptationQoS

7730 Workplan for CE on BSDL Extensions

7731 Working Draft of Amendment for 21000-8

7732 Preliminary disposition of preliminary comments for ISO/IEC 21000-10 PDAM/1

7733 Study of PDAM/1 of ISO/IEC21000-10 DIP: Additional C++ Bindings

7734 Preliminary DoC of preliminary comments on ISO/IEC 21000-15 FCD

7735 Study of FCD of ISO/IEC 21000-15 MPEG-21 ER

7736 Preliminary DoC of Preliminary Comments on ISO/IEC 21000-17 FCD MPEG-21 Fragment Identification of MPEG Resources

7737 Study of ISO/IEC 21000-17 FCD MPEG-21 Fragment Identification of MPEG Resources

7738 Request for subdivision of ISO/IEC 21000-18 MPEG-21 DI Streaming

7739 ISO/IEC 21000-18 CD MPEG-21 DI Streaming

44

7740 TuC for ISO/IEC 21000-18 MPEG-21 DI Streaming

7741 Reference Software Workplan for DI Streaming

7742 AHG on DII amendment

7743 AHG on Development of RDD Corrigendum/2

7744 15.1.1 AHG on MPEG-21 DIP

7745 15.1.2 AHG on MPEG-21 DIA

7746 15.1.3 AHG on MPEG-21 Event Reporting

7747 15.1.4 AHG on MPEG-21 Fragment Identifiers

7748 AHG on Digital Item Streaming

7749 Study of CD of ISO/IEC 21000-14

7750 WinCVS Installation Instruction??

7751 DOCR on ISO/IEC 14496-15/FPDAM1

7752 Draft DOCR on ISO/IEC 14496-15/DCOR 1

7753 Rules of operation of MPEG ad-hoc groups and guidance notes to Chairs

45

Annex 5Report of Requirements

By Fernando Pereira (Instituto Superior Técnico, Lisboa-Portugal)

1 MPEG GENERAL

1.1 MPEG Dictionary12422, Mike Rubinfeld, AHG on MPEG DictionaryThis AHG report was not uploaded, and the AHG chair was not present at the MPEG meeting. Also there was no activity in this AHG since the last MPEG meeting. The AHG tasks were to 1. Determine a set of normative terms & acronyms for MPEG-212. Collect terms with their associated definitions3. Point out inconsistencies in terminology used across MPEG-21 Standards4. Define the best clustering for the termsSince no activity happened to achieve the objectives, it was decided to discontinue the AHG. If at one of the next MPEG meetings, some relevant material is brought, the AHG may be created again.

2 MPEG-4

2.1 AVC Profiles12520, CJ Lee, SGNB Comment on AVC new 4:4:4 profiles12528, A. G. Tescher for USNB, USNB Contribution: New Profiles for AVC12698, Edouard François on behalf of FNB, FNB comment on new High profile in AVCFollowing the NB positions regarding the Advanced 4:4:4 and the Advanced 4:4:4 Intra-Only Profile, it was agreed that these profiles correspond to relevant applications scenarios (as the existing High 4:4:4 profile) for which there is significant industry support. JVT will analyze the technical evidence regarding these 2 profiles. If JVT decides that technical evidence supports their definition, than these 2 new profiles will be created. In the case JVT decides to create these new profiles (using an amendment), there was no opposition to remove the existing High 4:4:4 profile using a corrigenda (ideally as soon as possible).

3 MPEG-7

3.1 Fragment Request Units12425, Joseph Thomas-Kerr, AHG on XML Fragment Requests12573, Stephen Davis, Ian Burnett, Improved and clarified FRU textThe activity addresses a client side messaging mechanism to request fragments in XML documents. There was a preliminary agreement to address this topic in the context of MPEG-7 Systems although the technology involved regards XML documents in general. There is also a need to fit the additional technology in the current MPEG-7 Systems architecture. The technology proposed will go into a ‘MPEG-7 Systems Technology under Consideration’ document to be issued by Systems. This document will be studied until the next meeting when a decision on the starting of a MPEG-7 Systems amendment should be made.

46

3.2 Content-based Search Framework12424, Wo Chang, Riccardo Leonardi, Matthias Gruhne, AHG on CBSearch Framework12532, Wo Chang, CBSearch Query Interface DefinitionFollowing the discussions at this meeting, there is a much better understanding of the scope of the CBSearch activity, notably in terms of objective, what needs to be normative, and requirements.Going back to the initial MPEG-7 vision, the meaning of MPEG-7 interoperability was associated, for example, to the scenario of one retrieval engine being able to ‘speak’ with as many as possible data bases, and a corresponding scenario for push scenarios. For this to happen, the MPEG-7 framework has to include not only standard content descriptions but also the means for the bidirectional ‘conversation’ to happen in a standard way. In this context, the objective of this activity is the specification of a format for the querying and feedback messages between MPEG-7 enabled terminals, e.g. searching engines and databases. This would be an important step to increase the interoperability in the MPEG-7 framework. To address this objective, an AHG has been created with the tasks to:

1. Review and improve the current draft requirements for query format (N7534) 2. Identify relevant typical queries for images library 3. Define a simple query format to support these typical query 4. Explore and review existing technology in this area 5. Develop supporting tools for this query format (as demo) 6. To collaborate between WG1 and WG11 on the content-based search framework

While it is recognized the objective is useful, there seems to be currently not enough critical mass to address it. For that reason, it is essential to gather industry support to proceed, notably in terms of technical work.

4 MPEG-21

MPEG-21 DIA12670, Peder Drege, Thomas Skjølberg, Runar Solberg, Request for clarification regarding DIAC and adaptation decision processThis contribution requested a clarification on the DIA configuration tools, specifically regarding the use of the DIA Configuration tool to decide which descriptors are to be considered by which side in the adaptation, in addition to decide the location of the adaptation process itself. After discussing the problem, it was agreed that the clarifications would be provided by the MDS subgroup.

DI Streaming Requirements12644, Peder Drege, Thomas Skjølberg, Runar Solberg, Comments on Digital Item StreamingThis document was withdrawn.12677, Joseph Thomas-Kerr, Ian Burnett, Gabriel Fernàndez, Alejandro López González, Report of Core Experiment on DI mapping to delivery channelsThis document reported the results of the core experiment (CE) evaluating the capability of the Bitstream Binding Language (BBL) Tools to fulfill the use case provided by the DMP project, which is a subset of DIS use case 4.2. This CE has shown that BBL is able to fulfill the DI Streaming use case 4.2. It has been demonstrated that BBL provides an efficient framework for communicating and executing streaming instructions for MPEG-21 Digital Items in multiple scenarios – in this case MPEG-2 Transport Streams and RTP. It has also been demonstrated the modular nature of BBL descriptions, which maximizes the reusability of streaming instructions. During the course of the CE, several enhancements to BBL have been identified. Following these

47

conclusions, a preliminary agreement on promoting the available technology to CD on MPEG-21 Part 16 (DI Streaming) was reached.12678, Joseph Thomas-Kerr, Ian Burnett, Technologies Required for Digital Item StreamingThis document analyses the way the BBL fulfils the major DI Streaming requirements. The need to review the DI Streaming Requirements document until the next meeting has been stressed.12632, Christian Timmerer, Hermann Hellwagner, Andreas Hutter, Jörg Heuer, Buffer Configuration Information for Digital Item Streaming: State of the Art and ExamplesThis document reviews the state of the art about buffering information and list examples where such information is required. No specific action was needed.

REL Profiling (joint with MDS)12523, Jaime Delgado, Jose Prados, Eva Rodriguez, Preliminary comments on REL profilesThis document was withdrawn.12524, Jaime Delgado, Eva Rodriguez, Jose Prados, Comments on MPEG-21 REL Base Profile12692, Weongeun Oh, Yeonjeong Jeong, Taehyun Kim, Hogab Kang, Comment on MPEG-21 base profile extension12500, Octavian Folea, Content protection extension for MPEG-21 REL The last 3 documents propose additions/changes to the BASE REL profile under ballot. To address these proposals, a Break-out Group (BoG) with the task to recommend a decision on the proposed additions/changes. The consensual additions/changes have been included on the Study of REL Profiles PDAM under ballot. The other proposals may still be proposed through the NB comments.Following the interest expressed during the week, some experts gathered together to work on the ‘Broadcast’ REL profile proposed at the last MPEG meeting and refine a proposal for a new REL profile under consideration. This proposal was approved and has been included in the MPEG-21 Profiles under Consideration document (N7537).

5 MPEG-A

General12423, Klaus Diepold, Wo Chang, Harald Fuchs, AHG on MAFs

This contribution just reports the MAF related activities between the Poznan and Nice meetings.

Directly addressing protection issues 12672, Stefan Kraegeloh, on behalf of German National Body, GNB comments on MAF12527, A. G. Tescher for USNB, USNB Contribution: Regarding “MAFs under Consideration”

The issues addressed by these 2 NBs have been satisfactorily considered; please see precise feedback in the MPEG output document with answers to NBs.

12588, Hendry, Munchurl Kim, Florian Pestoni, A Flexible and Extensible Protection of Music Player MAF using Lightweight MPEG-21 IPMP12674, Stefan Kraegeloh, Harald Fuchs, MAF Interoperability: Mandatory Tools vs. Default Signalling12673, Stefan Kraegeloh, Harald Fuchs, Proposed revised text on 'Protected Music Player' MAF described in MAFs under Consideration

The first and the last contributions above address the addition of two types of protection capabilities to the (non-protected) existing Music Player MAF. Following lengthy and detailed discussions, the Requirements subgroup decided to include 2 new MAFs under Consideration providing 2 different types of protection capabilities on the top of the Music Player MAF, notably following:

a Fixed Encryption Approach a IPMP/REL Approach (may lead to new REL/IPMP profiles)

48

These 2 MAFs under Consideration represent two different approaches to protection of the Protected Music Player MAF based on different understandings of interoperability. A good list of supporting companies and organizations exists for both proposals.

12646, Harald Fuchs, Stefan Kraegeloh, The TIRAMISU Project, Proposed Bundled License MAFThis contribution addresses licensing issues in the context of the super-distribution MAF. It has been recognized that the proposals made are more related to possible REL/IPMP profiles than a MAF. Although the proposals made have been used to update the existing super-distribution MAF, it is expected that the authors will propose the relevant REL and/or IPMP profiles at the next meeting. In this context, the super-distribution may be deleted since no real industry need seems to be driving it.

12659, Sang-Kyun Kim, Seungji Yang, Jun Ho Cho, Yong Man Ro, Ji-Yeon Kim, Application Scenarios and Derived Requirements for Photo Album MAF

This contribution regards a MAF built on the top of the Photo Player MAF including additional metadata, as well as very likely also audio and some protection capabilities. The authors were asked to bring a more precise proposal at the next meeting, already taking into account the new Music Side Show MAF under consideration.

Less (or not) directly addressing protection issues12662, Harald Fuchs, Stefan Kraegeloh, Proposed Corrigenda Items for ISO/IEC 23000-2 Music Player MAF

This contribution reports issues regarding the Music Player MAF which may deserve correction by means of a corrigenda. These issues have been addressed in detail by the Audio subgroup.

12589, Chansuk Yang, Jeongyeon Lim, Munchurl Kim, Extensions to Music MAF Player Format for Multiple JPEG images and Text data with Synchronizations to MP3 data12534, Tae Hyeon Kim, H. Jean Cha, Proposal of new scenarios and requirements for an Accompaniment Music Player MAF12647, Harald Fuchs, Herbert Thoma, Proposed Slideshow MAF

The 3 contributions above address application scenarios related to slide shows, karaoke, story telling, photo-music albums, etc. Considering the significant overlapping between the 3 proposals, the authors involved managed to propose a common MAF, called for now Music Slide Show MAF, which includes images, music, and text with some synchronization (without protection); maybe also some animation in the future by means of a Laser profiles. This common MAF is required to be hierarchical both to the Music Player MAF and the Photo Player MAF which is a very interesting and powerful feature. The common proposal has been accepted for inclusion in the MAFs under Consideration document.

12684, Klaus Diepold, Considering a MAF for Surveillance VideoThis contribution proposes a Surveillance Video MAF, in fact also including audio and some protection capabilities. This proposal has been accepted for inclusion in the MAFs under Consideration document. This MAF under consideration needs further work to make it more precise.

12645, Harald Fuchs, Herbert Thoma, Stefan Kraegeloh, Proposed Portable Video Player MAFThis contribution precises the already existing Video Player MAF. The additional details have been accepted for inclusion in the MAFs under Consideration document.

49

5.1 Summary on MAFsThe global MAF situation after the Nice MPEG meeting can be summarized as follows:

1. MAFs Specified (Final)a. Music Player MAF

2. MAFs Under Developmenta. Photo Player MAF

3. MAFs Under Considerationa. 2 flavours of Protected Music Player MAF (hierarchical to the existing Music Player

MAF)b. Music Slide-Show MAF (hierarchical to the Music Player and Photo Player MAFs)c. Video Player MAFd. Surveilance MAFe. Super-Distribution MAF f. Open Release MAF

6 Explorations

6.1 Multi-view Video Coding12541, Donggyu Sim, Seoung-Jun Oh, Chang Beom Ahn, Yung Lyul Lee, Kyuheon Kim, Kyeongok Kang, Comments on View Scalability of Multi-View Video CodingFollowing the contribution above, the Multiview Coding Requirements document has been revised and a new version released (N7539). The revision regards a small clarification in the requirement on View Scalability stating that view scalability shall be supported with minimum decoding effort.

6.2 Stereoscopic Applications (joint with Video and Systems)12596, Jan van der Meer, Fons Bruls, Chris Varekamp, Arnoud Bourge, Aljoscha Smolic, Thomas Wiegand, Shijun Sun, Requirements for stereoscopic applications using depth mapsThis contribution has been reviewed with special reference to the requirements on backward compatibility with 2D, timely availability of the standard, simple solution, display independency, and re-use of existing standards as much as possible. Because the application scenarios addressed seem to have some relation with the scenarios considered in the Multiview Video Coding (MVC) Call for Proposals (CfP), it was decided to defer any final decision on this technology until the next meeting when all the information related to the answers to the MVC CfP will be available. However, in order to avoid loosing time, and AHG has been created with the following mandates: To study the relevance of applications requiring encoding of depth/disparity maps and

corresponding requirements. To study and improve proposed and alternative solutions for representation of depth/disparity

maps (including study of critical cases such as occlusion, limitations of 2D+z formats) in the context of MPEG Video and Systems standards, and their feasibility for standardization, and produce a document as input to 75th meeting.

To identify the relationship of depth/disparity based applications with the applications and technology considered in the context of the "CfP on Multi-view Video Coding".

50

6.3 New Colour Spaces in MPEG Standards (joint with Video)12426, Teruhiko Suzuki, AHG on Colour Spaces12680, Teruhiko Suzuki, Naoya Katoh, Yoshihide Shimpuku, Proposal to support IEC 61966-2-4 in MPEG standards12681, Teruhiko Suzuki, Naoya Katoh, Yoshihide Simpuku, Hiroaki Sugiura, Proposal to support new colour space in IEC TC100Although MPEG does not define colour spaces, this activity follows the request to consider in MPEG specifications wide-gamut colour spaces for new types of displays, notably IEC 61966-2-4 and ITU-R BT.1361; the status quo is already summarized in N7283. To consider these new colour spaces, the MPEG-2 Video and MPEG-4 parts 2 and 10 standards will be amended, notably updating the tables related to the colour spaces specification.

6.4 VCTR12555, Sunyoung Lee, Chungku Yie, Euee S.Jang, Proposal of VCTR RequirementsWith the target to build on the document submitted with proposed VCTR Requirements, the Requirements subgroup met 4 times with the VCTR break out group. These meetings had as target to define the motivation, objectives, benefits for industry, architecture, terminology, normative elements, and requirements for VTCR. Another issue discussed has been the name of the activity since it was recognized that the name VCTR has to be used for the toolbox itself and the activity itself regards more than the toolbox alone. As a result of the work during the week, a more complete version of the VCTR Requirements has been produced (N7540). This document has to be improved in the context of the VCTR AHG.

51

Annex 6Report of Systems

Source: Systems Chair and Break-out group ChairsEditor: Olivier Avaro (Streamezzo)Contributors: David Singer (Apple), Andreas Hutter (Siemens), Alexandre Cotarmanac’h (France Telecom R&D), Jean Gelissen (Philips), Jean-Claude Dufourd (Streamezzo).

1 OverviewThe main outputs of the meeting from the Systems Sub-group perspective are:

No. Title TBP AvailableX 13818-1:2000 MPEG-2 Systems7533 Text of ISO/IEC 13818-1/DCOR57576 Study Text of ISO/IEC 13818-1:2000/PDAM 6 No 05/10/21X 14496-1 :2004/MPEG-4 Systems7577 Study Text of ISO/IEC 14496-1:2004/PDAM2 3D Compression Profile

DescriptorNo 05/10/21

7578 Text of ISO/IEC 14496-1:2005/DCOR1 (Audio Codec Behavior and of Profile & Level management in MPEG-4 Systems)

No 05/10/21

X 14496-11 Scene Description7579 Request for Amendment of ISO/IEC 14496-11 No 05/10/217580 Text of ISO/IEC 14496-11/PDAM5 (SMR) No 05/10/21X 14496-12 ISO File Format7581 Request for Amendment of ISO/IEC 14496-12 No 05/10/217582 Text of ISO/IEC 14496-12/PDAM1 (Description of timed metadata) No 05/10/217583 VM of ISO/IEC 14496-12/Amd.2 (Flute Hint Track) No 05/10/21X 14496-14 MPEG-4 File Format7584 Text of ISO/IEC 14496-14/DCOR1 (Audio Codec Behavior and of Profile &

Level management in MPEG-4 Systems)No 05/10/21

X 14496-15 AVC File Format7751 DoCR on ISO/IEC 14496-15/FPDAM1 No 05/10/217585 Text of ISO/IEC 14496-15/FDAM1 (Support for FREXT) No 05/10/217752 Draft DOCR on ISO/IEC 14496-15/DCOR 1 No 05/10/217575 Study text of ISO/IEC 14496-15/DCOR 1 No 05/10/217586 WD x.0 of ISO/IEC 14496-15/PDAM2 (SVC File Format) No 05/11/04X 14496-20 LASeR7587 DoC on ISO/IEC 14496-20/FCD No 05/10/217588 Text of ISO/IEC 14496-20/FDIS No 06/01/207589 Request for Amendment on ISO/IEC 14496-20 No 05/10/217590 Text of ISO/IEC 14496-20/PDAM1 (SVGT1.2 Support) No 05/11/047591 TuC for ISO/IEC 14496-20/Amd1 No 05/10/21X 15938-1 Systems7592 DoC on ISO/IEC 15938-1/FPDAM2 (Fast Access Extension) No 05/10/217532 Text on ISO/IEC 15938-1/FDAM2 (Fast Access Extension) No 05/10/217593 MPEG-7 Systems reference software workplan No 05/10/217594 TuC for ISO/IEC 15938-1/Amd.3 (Fragment Request Unit) No 05/10/21X 23001-1 BinXML7596 DoC on ISO/IEC 23001-1/FCD No 05/10/217597 Text on ISO/IEC 23001-1/FDIS No 05/10/287598 WD1.0 of ISO/IEC 23001-1/Amd.1 (Reference Software & Conformance) No 05/10/28X 23004 MPEG MultiMedia Middleware7599 WD3.0 of ISO/IEC 23004-2 Multimedia API No 05/10/217606 WD3.0 of ISO/IEC 23004-3 Component Model No 05/10/217607 M3W Tutorial No 05/10/21

52

X Promotion ,Exploration and Maintenance7608 MPEG-4 White Paper - MPEG-4 BIFS (Revision 1) No 05/10/217609 MPEG File Formats White Paper No 05/10/217610 MPEG-4 White Paper – Terminal Architecture No 05/10/217675 MPEG-1 White Paper - Multiplex Format No 05/10/217676 MPEG-1 White Paper – Terminal Architecture No 05/10/217677 MPEG-1 White Paper – Multiplexing and Synchronization No 05/10/217678 MPEG-2 White Paper - Multiplex Format No 05/10/217679 MPEG-2 White Paper – Terminal Architecture No 05/10/217680 MPEG-2 White Paper – Multiplexing and Synchronization No 05/10/21

53

2 General issues

2.1 GeneralThe meeting report from Poznan has been approved.

M12651: MPEG-4 Terminal Architecture White Paper. Taken as the basis for output document.M12478: Updated 2-Pager for BIFS. Taken as the basis for output document.M12693: Proposed white paper on the MPEG file formats. Taken as the basis for output document.

The following demonstrations have been made: M12634: Demonstration of gBSD-based Adaptation in Streaming Scenarios. Demonstration of StreamSource.

2.2 List of standards under development

Pr Pt Edit. Project Description CfP WD CD FCD FDIS2 1 2005 Cor.5 Corrections while editing 3rd

Ed.05/10 06/01

2 1 2000 Amd.6 Transport of Streaming Text 05/07 06/01 06/074 1 200x Amd.2 3D Profile Descriptor

Extensions05/07 06/01 06/07

4 1 2005 Cor.1 Clarif. On audio codec behavior

05/10 06/04

4 11 2005 Amd.1 Symbolic Music Representation

05/07 05/10 06/04 06/10

4 12 2005 Cor.2 Miscellanea 05/04 05/07 06/014 12 2005 Amd.1 Description of timed

metadata05/07 05/10 06/01 06/07

4 12 2005 Amd.2 Flute Hint Track 05/10 06/04 06/10 07/014 14 2005 Cor.1 Audio P&L Indication 05/10 06/044 15 2004 Cor.1 AVC File Format 05/04 05/07 06/014 15 2005 Amd.2 SCV File Format Extensions 05/10 06/04 06/07 07/014 20 2004 Amd.1 SVGT1.2 Support 05/10 06/04 06/104 22 2005 1st Ed. Open Font Format 05/07 06/01 06/077 1 2004 Amd.3 Fragment Request Unit 05/10 06/04 06/10 07/01B 1 200x Amd.1 Reference Soft. & Conf. 05/10 06/01 06/07 06/10E 1 200x 1st Ed. Architecture 05/01 05/07 06/04 06/07 07/01E 2 200x 1st Ed. Multimedia API 05/01 05/07 06/04 06/07 07/01E 3 200x 1st Ed. Component Model 05/01 05/07 06/04 06/07 07/01E 4 200x 1st Ed. Ressource & Quality

Management05/01 05/07 06/04 06/07 07/01

E 5 200x 1st Ed. Component Download 05/01 05/07 06/04 06/07 07/01E 6 200x 1st Ed. Fault Management 05/01 05/07 06/04 06/07 07/01E 7 200x 1st Ed. System Integrity

Management05/01 05/07 06/04 06/07 07/01

54

2.3 Standing Documents

Pr Pt Documents No. Meeting1 1 MPEG-1 White Paper – Multiplex Format N7675 05/07 Nice1 1 MPEG-1 White Paper – Terminal Architecture N7676 05/07 Nice1 1 MPEG-1 White Paper – Multiplexing and

SynchronizationN7677 05/07 Nice

2 1 MPEG-2 White Paper – Multiplex Format N7678 05/07 Nice2 1 MPEG-2 White Paper – Terminal Architecture N7679 05/07 Nice2 1 MPEG-2 White Paper – Multiplexing and

SynchronizationN7680 05/07 Nice

2 11 White Paper on MPEG-2 IPMP N7503 05/07 Poznan4 1 White Paper on MPEG-4 Systems N7504 05/07 Poznan4 11 MPEG-4 White Paper – Terminal Achitecture N7610 05/10 Nice4 11 MPEG-4 White Paper – BIFS N7608 05/10 Nice4 xx White Paper on File Formats N7609 05/10 Nice4 13 White Paper on MPEG-4 IPMP N7505 05/07 Poznan4 13 MPEG IPMP Extensions Overview N6338 04/03 München4 17 White Paper on Streaming Text N7515 05/07 Poznan4 18 White Paper on Font Compression and Streaming N7508 05/07 Poznan4 20 Presentation Material on LASER N6969 05/01 Hong-

Kong4 20 White Paper on LASeR N7507 05/07 Poznan4 22 White Paper on Open Font Format N7519 05/07 Poznan7 1 White Paper on MPEG-7 Systems N7509 05/07 PoznanE X MPEG Multimedia Middleware Context and

ObjectivesN6335 04/03 München

E X White paper on Multimedia Middleware N7510 05/07 PoznanE X Tutorial on M3W N7607 05/10 Nice

55

2.4 Mailing Lists Reminder

Topic Information Kindly Managed by

General Systems

List

Liste Reflector : gen-sys@lists.uni-klu.ac.atList-Subscribe:

http://lists.uni-klu.ac.at/mailman/listinfo/gen-sysmailto:gen-sys-request@lists.uni-klu.ac.at?subject=subscribe

List-Archive: http://lists.uni-klu.ac.at/pipermail/gen-sysList-Help: mailto:gen-sys-request@lists.uni-klu.ac.at?subject=help

University of Klagenfurt

BinXML

Liste Reflector : mpeg7-sys@lists.uni-klu.ac.atList-Subscribe:

http://lists.uni-klu.ac.at/mailman/listinfo/mpeg7-sysmailto:mpeg7-sys-request@lists.uni-klu.ac.at?subject=subscribe

List-Archive: http://lists.uni-klu.ac.at/pipermail/mpeg7-sysList-Help: mailto:mpeg7-sys-request@lists.uni-klu.ac.at?subject=help

University of Klagenfurt

File Format

Liste Reflector : mp4-sys@lists.uni-klu.ac.atList-Subscribe:

http://lists.uni-klu.ac.at/mailman/listinfo/mp4-sysmailto:mp4-sys-request@lists.uni-klu.ac.at?subject=subscribe

List-Archive: http://lists.uni-klu.ac.at/pipermail/mp4-sysList-Help: mailto:mp4-sys-request@lists.uni-klu.ac.at?subject=help

University of Klagenfurt

LASeR

Liste Reflector : mpeg-laser@lists.uni-klu.ac.atList-Subscribe:

http://lists.uni-klu.ac.at/mailman/listinfo/mpeg-lasermailto:mpeg-laser-request@lists.uni-klu.ac.at?subject=subscribe

List-Archive: http://lists.uni-klu.ac.at/pipermail/mpeg-laserList-Help: mailto:mpeg-laser-request@lists.uni-klu.ac.at?subject=help

University of Klagenfurt

2.5 FAQThe FAQ were updated as needed.

2.6 AOBNone.

56

3 MPEG-2 Systems (13818-1)

3.1 13818-1:2005 Amd.6 Transport of Streaming TextM12613: Study on ISO/IEC 13818-1:2000/PDAM 6: Transport of streaming text over MPEG-2 systems. Taken as the basis for the output document.

Technical Work in Progress.

4 MPEG-4 Systems (14496-1)

4.1 14496-1:2005 Amd.2

4.1.1 Topics1. 3D Profile Descriptor Descriptor

4.1.2 ContributionsNone.

Technical Work in Progress.

4.2 ExplorationM12653: MPEG-4 Objects extended synchronization. The use cases are assessed as valid. To be further studied.M12669: Proposal on profileAndLevelIndication Signaling in LATM. To be further studied (possibly a clarifying annex).

Technical Work in Progress.

5 MPEG-4 Scene Description (14496-11)

5.1 14496-11:2005 Amd.1 (Numbering 5 for 2nd Edition)5.1.1 Topics

1. Symbolic Music Notation

5.1.2 Contributions

M12440, M12488, M12606, M12591: Input document M12488 "Proposed Amendment to 14496-11 for SMR support" has been reviewed and discussed jointly between Audio and Systems experts. The document presented a revised proposal following the first discussion and comments at the 73rd meeting in Poznan. Instead of a simple texture-like node, two separate nodes are proposed to provide interface to the decoder control and graphical rendering respectively. This allows in particular the double possibility of a decoder generating scores as raster or vector graphics. This was considered a good improvement for generality. Furthermore, many details have been discussed concerning the several fields of the two nodes, to make them compatible with other BIFS definitions and more interoperable with other nodes. Following this discussion, a purely editorial activity (G.Zoia and P. Bellini) generated document N7580: "Text of ISO/IEC 14496-11:PDAM1 (SMR support)", which has been approved in the final systems plenary.

57

Technical Work in Progress.

6 ISO File Format (14496-12)

6.1 GeneralM12451: AHG Report. Note and accepted.

M12693: White paper. Taken as the basis on the White Paper on File Format.

M12620: ID3v2 tags in part 12. ID3 version goes into the box, box version is the box format version; no length field (implied by box length, i.e. data to end of box), and use ‘meta’ container rather than user-data. ‘Political’ questions remain, however (can we reference ID3). We’d like this in the meta box, not the user-data box. If acceptable, this goes into amendment 2 of part 12. Cf. requirements report.

M12621: Flute hint tracks in part 12. lots of questions here, but also lots of interest. Can you deliver media tracks over the flute session? If so, what is the ‘file type’ of the raw media track? Or does one send a ‘reduced MP4 file’? The timing of the hint track is suggested pacing? What are the pros and cons of sending (a) the entire file over the FLUTE session vs. (b) sending the individual pieces? (One is that there might not be a defined use of these files in a 3GPP container; another might be differential protection?) We take this as Part 12 amendment 3, VM for now, to allow other company comment. We’ll add this to the 3G liaison and ask if there are timing constraints, but also other companies can comment on the desired time schedule.

M12666: MPEG-4 User Streams. Noted, thank you.

6.2 14496-12/Cor.2

6.2.1 Topics1. Miscellanea

6.2.2 ContributionsNone.

Technical Work in Progress.

6.3 14496-12/Amd.1

6.3.1 Topics1. Description of Timed Metadata

6.3.2 ContributionsNone.

Technical Work in Progress.

58

7 MPEG-4 File Format (14496-14)

7.1 14496-14/Cor.1

7.1.1 Topics2. Handling timestamps in audio

7.1.2 ContributionsHandling timestamps in audio (edit lists and pre-roll groups), new annex as Cor. (Cf. section on joint meetings below).

Technical Work in Progress.

8 MPEG-4 AVC File Format (14496-15)

8.1 14496-15:2004/Cor.1

8.1.1 Topics1. Miscellanea

8.1.2 ContributionsNone.

Technical Work in Progress.

8.2 14496-15:2004/Amd.2

8.2.1 Topics1. SVC File Format Extensions

8.2.2 ContributionsM12463: Summary of Voting on ISO/IEC 14496-15:2004/FPDAM 1 [SC 29 N 6921. Accepted US comment, add “If the two sequences differ in color space indications in their VUI information, then two different configuration records are also required.” Editor to prepare DoC and outputs.

M12491: Proposed output text. Noted

M12490: SVC File format. Accepted into the SVC ff and the part 12 amendment with corrections.

M12533: Signaling of low-to-high layer switching points in SVC file format. Great to see ideas on these lines. concerns: EIDR isn’t yet in the SVC -- but we need to solve this problem in FF anyway. Also this technique has sample counts in the group descriptions, which seems like not such a good idea. Not accepted as is, because of the sample counts in the group descriptions. But we do agree to mark the EIDR as being members of a second group of the same layer. The author to work with the editors on a group design to satisfy this concept. Great to see this problem addressed. Also we relay to the JVT that we need to be able to find ‘entry points’ in layers. Note that only when there is multi-loop decoding would we need to know about ‘climbing the ramp’; however, in all cases (single loop decoding) it is worth knowing where the ‘entry points’ (I layer-pictures) are.

M12624: Track grouping for SVC. Accepted, with details as noted by author (and the questions remain: where does the tagging go?).

59

VM2 of SVC FF -- need one week editing period. Add new map groups, groups to describe EIDR, switch groups and labeling etc.

Technical Work in Progress.

9 LASeR (14496-20)

9.1 14496-20:2005 First Edition

9.1.1 Topics1. Lightweight Application Scene Representation

9.1.2 ContributionsMost of the activity has been focused towards achieving the validation (through the validation experiment as per N7482). The validation experiment was reviewed during the Cupertino meeting held from September 22nd to September 23rd and concluded on the validation of the Custom SDL. During the 74th MPEG meeting in Nice, the group also validated the BC SDL binarization solution and concluded to the usage of BC SDL as the binary solution for LASeR. This has lead to the decision to reach the FDIS stage with a long editing period up to the Bangkok meeting.(cf output docs section). Additionally, a first amendment was issued containing the following technologies ( Stream Source, Active, Scroller (but not scrollbar), Local/GlobalID. (cf output docs section). Finally the TuC document has been updated and issued during the meeting (informative annex on Scene API) (cf output docs section). A workplan for the next period has been set up.

M12450: AHG on Scene Representation. Noted and approved.

M12503: LASeR and SAF editor's study. Taken as the basis for the edition of the FDIS.

The group wants to propose a future-proof alternative to the scene access signalling providing dependencies for inline/scalable scenes.

The text proposes to add dependsOnStreamId to the SimpleDecoderConfigIf "0"(actually the same value as the Id of the stream and not 0 which can be already a stream id), this means that the stream does not depend on any other stream and can be used to access the stream directly. What happens in the case of Animation (Inline). In this case the stream has no dependency to any other stream. You can play such scene without any dependency. An "inline" depends on the "main scene". It is proposed to write this dependency as followsBit(1) hasDependencyIf (hasDependency){

bit(12) dependsOnStreamID;bit(4) reserved;

} What happens if 2 streams with no dependence on ? alternate Is CDF a Work Item for Version 2 ?

60

Could it be possible to have an explicit signalling of the structure of the session?[ One possibility : in the case of CDF, it is perhaps needed to define other alternatives should be proposed as descriptors : ]

Agreement: for V1 we do not need to consider this use case. So we do not expect any change to the spec except a reserved bit.

Propose modification of the SDL and SPEC with a "reserved byte" in the SimpleConfigDescriptor and RemoteStreamHeader.

Impact of a descriptor signalling vs a "reserved" signalling(what would need to be changed in the spec).

M12472, M12473, M12474, M12475, M12479, M12480, M12481: Reviewed during the Cupertino AHG meeting. Cf. AHG report.

M12623: GNB Comments on Study Text of ISO/IEC FCD 14496-20- The contribution was reviewed- PrivateData Comment : " WG11 agrees that the naming was misleading and has updated the

specification using the privateDataIdentifier syntax. The specification currently does not detail how to achieve a the signalling of the couple (content-type, namespace) syntax in the privateDataIdentifier table nevertheless, it is the understanding of the group that the current syntax can accommodate for such couple (content-type, namespace) signalling in future versions of the specification. WG11 thanks GNB for the scrutiny and will put the semantics of the syntax in the body of text.

- Documentation of the anyXML (how do we use the privateDataIdentifier).

M12506: Fixes to the LASeR study, with explanations.a) typo agreedb) references agreedc) impact to SDL changes (resetEncodingContext) :it is agreed that only NewScene dissociates binary ID and scene ID.Question : how do you reset the colours and not the namespaces ?Answer : it is not possibleQuestion : why should the scene answer to error-resilience ?Question : resetting the namespaces can be heavy ?Question : is it worth it to reset one or the other independently ?Usage : if not sending all the coloursPhilippe : propose to reset the context by the user ? No Specific use case for independently resetting the different contexts, could be added in the future. The change is agreed.d) Inmutable elements rewording is needed."and the following attributes of the

animation elements : by, from, to, values and fill" agreed.e) Correction of Add command agreed. [put a provision for out of bounds], AP,

Jean-Claudef) Correction of Insert command agreed

61

g) Correction of Replace command agreed h) Inmutable Replace agreed (change the wording as per d.)i) Save/Restore agreedj) Definition of inheritance and possibility to animate the elements.We agree on the need for this clarification. Agreed. Update the software & SDL. This has an impact on the validation schema and on the SDL.AP: add a test sequence with animation of choice, Jean-Claudek) timeStampResolution fix agreedl) Viewport-fill : SVG renamed the attribute agreedm) Missing reference to ev.xsd agreed.AP : Encoding schemas by Philippe to be added, Philippen) list of events : to be discussed tomorrow. o) serviceID : to be removed agreedp) codec_ID agreed.

M12505: Final version of custom SDL, validated by implementation. Noted. sdl.txt in the CVS has been updated.

bugs reported by Expway (sequences to be corrected) propagate missing type in script, audio, video, image

M12507: Clarifications proposals for LASeR and SAF.a) SAF : we agree on Stream 0b) Behaviour of CTS in the script. Alternative solution agreed and documented in the

document.c) Clarification on the delay agreed.d) TransformBehavior for image Cf. profiles

M12563: Specification of ISO_15938_1_Encoding in LASeR. lsr Updates : the ordering of the updates is not the same as in Custom SDL. The number of bits for the updates is discussed. Why so many updates? to allow extension (6 bits) could be possible agreed Difference with customSDL : Element indexes not coded in VLC the usage of a predefined DecoderInit configuration has been.discussed Needs to update the codecs What needs to be documented in the spec :

how the decoders work (at least on what is the result of the codec) elements & attributes are well enough defined. global variables BiM decoding process section.(in a common section)

M12661: Performances of BiM encoding in LASeR. Using predefined DecoderInit, BIM results shows comparable compression efficiency to Custom SDL.

M12521: About the usage of codec_rare results in the custom encoding. Contribution shows the impact of using fill and stroke as generics or as codec-rare with VLC. The contribution concludes not to use them as generics. Agreed.

M12564: Integration of LASeR specific codecs in the BiM reference software. Noted.

62

M12695: FNB Position Paper on LASeR. Cf. DoC.

M12504: Proposal to add JSR 226 / MicroDOM to LASeRPresentation of the context in 3GPP & OMA in order to have an API similar to MPEG-J API . uDOM is requested by 3GPP. JSR 226 is a subset of uDOM. Proposes to use JSR 226 as a first step and extend to uDOM. Proposes to add in V1 extended semantics to the JSR226 function getElementById(in DOMString id) [if string ids]. Proposes for V2 to add new function Element getElementById(in in binId) in order to get the elements if no string ids.

Evaluation of the impact:May be code size will grow+ parseXML+ extra memory footprint (small total impact) [small cost compared to EcmaScript]

Questions: What is the impact in terms of the decoder model / architecture of the LASeR codec ? An information on how the interface is in the architecture. [Otherwise the architecture is not complete] What is the impact on the execution model ? Have a look to MPEG-J. Is there some text to explain the background? Is the sentence "can be ued to access…" sufficient ? What happens to LASeR extensions to SVG Tiny 1.2? Do we want to use all JSR 226? Binding with Java? What is informative & what is normative ? What is the interaction with MicroDOM ? MicroDOM is a superset. It is noted that when the initial implementation is a C implementation, JSR226 will be a cost. What is the assessment from a C implementation point of view ?

Objections from Siemens: Requires adding additional text to the spec. Gives a clear preference to Java implementations. In version 2, we would like to have MicroDOM. What is the impact of having JSR 226 now and MicroDOM afterwards? It is decided to take a decision based on a proposed informative annex building upon this contribution.

To be further discussed in the TuC.

M12710 : Cross-check of the BiM reference software.This validates: The tool allows for encoding / decoding Validates the compression resultsThe encoded and decoded files are compared structurally and are equal.Comments:The current multiple binarization solution is a bad situation.Options :

a) delay the specification (to check the BC SDL syntax : but already done twice)b) use CustomSDL, remove BiM generic (validated, workable, but does not reach consensus)c) use BC SDL syntax as updated by Expway (could reach consensus, needs further check of

the spec (editorial))Proposal:

a) V1 : BC SDL, in informative annex (configuration of BiM required for it to be compatible BC SDL+encoding schema) + extension points

reasonable confidence (low risk)

63

possible concern on the extension mechanism (maybe not ready for V1) could be a skippable hook (hook for) extension mechanism + informative annex explaining how to use it e.g. with

BiMDefining this extension mechanism requires an SDL.

LASeRHeader :Addition of extension descriptor. Extension and Private have been agreed (email from JCD and feedback from Andreas).

Discussion on 15938-1 and SimpleEncodinga) CustomSDLb) BiM Generic

a. Genericb. Pre-defined configuration :

i. Why do we have a predefined ?Two reasons : + no need to send again and again the decoder Init+ have in reference the configuration which allows to make the content in an interoperable. E.g. sending in the same session two pieces of content.Similar to a predefined SL config.Useful for a certain type of profile. [fear that the decoderInit has not sufficient profile, and that ]

ii. Is it possible to have a Profile & Level ? would require support from industry

iii. Encoding XML Schema : predefined encoding implies encoding schema.[concern by STZ is that it is not validated]

Summarya) SimpleEncoding SDLb) Generic Bim takes different schemas (decoderInit provided inline)c) Discussing whether should have BiM solution with a decoderInit which is provided in the spec.(compression efficiency)What is the advantage of the decoderInit in terms of compactness ?M12661 shows comparable compression results.

a) and b) are agreed.c) predefined decoderInit is questioned

Concern by JCD : Encoding Schema is to be validated (maturity of the Encoding Schema)Proposal by STZ : no assigned value. Complexity of the decoding process : Pre-condition of BiM is to have at least one configuration (it is to be decided whether this

configuration is to be standardized)

We agree that (Generic) BiM(LaserHeader part, Type Codecs, classification scheme) will not be removed from the spec if the functional cross-check is achieved.

encoding schema(Transformation), -- rare codecs / same :[definition agreed to be done] -- feasible

64

code size/ memory : to be doneintegration in the renderer.

The FDIS contains : Unique binary syntax compatible with ISO/IEC 23001-1. The scope section contains : "simple

yet efficient compression to improve delivery and parsing times, as well as storage size, one of the design goals being to allow both for a direct implementation of the SDL as documented, as well as for a decoder compliant with 23001-1 to decode the LASeR bitstream."

Informative annex explaining the configuration of an ISO/IEC 23001-1 decoder so as to be able to be compliant with LASeR V1 specification. This is referenced in Section 13 with the following sentence.

A decoder compliant with 23001-1 will decode the syntax as specified in this clause when the configuration according to Annex 1 is used.

The list of codecs as well as the classification schema privateElement to be checked

Technical Work Completed.

9.2 14496-20/Amd. 1

9.2.1 Topics1. Lightweight Application Scene Representation

9.2.2 Contributions

M12477: StreamSourceThe contribution reviews the status of StreamSource and the implementationComments: Three different cases changing from one channel to another 3 different models (operator, broadcaster, content provider) What is the SDM of LASeR ? Is it conceptual or has to be really implentable ? What is definiton session? Where do we signal the grouping ? What is the impact ? Conceptual model is conflicting with the SDM potentially Improve the SDM.New cases o be brought.

Concerns: see impact on SDM, to have NB comments support, voting process. Agreement that the propose usage of one decoder and a couple of buffers is useful. Concern by France Telecom that if the existing assumed SDM can be applied, there is no reason to prevent StreamSource from being included.

Bug report with MMAPI implementation – it takes 1 mn for video to come up.

M12641 : KNB comment on ISO/IEC 14496-20 concerning StreamSource.Technical comments:Complete session is independent from other session.

65

Channel switching is out of the scope of MPEG-4: implies tying different sessions ?Composition only controls "show"/"hide"

Questions: How do we signal such a grouping to decoding layer?"Multiple concurrent decoding chains are not aligned with LASeR requirements."Siemens recalls that the multiple decoding chains is a question of profile. You need to be compatible with the model. When creating content, you should assume that decoders behave as the content. Proposes to use as a normative behaviour for the terminal, the implementation decoder model from StreamSource. How do we signal the grouping to decoding layer ?A : StreamSource is doing this. What is the effect to the decoding layer? What is different from not showing some video nodes?Simpler than in Is this scenario realistic to LASeR?

Discussion on Tue 18/10a) review of TuC 7481 : If clipPath is added in V1, then we need to remove the clipping functionality in <g> element, which implies modifying the schema + SDL + software. clipPath would imply adding clip-path attribute + the url(xxx) syntax.AP : Do we need to add transformBehaviour to clipPath., JCDIs the functionality needed for other use cases? yes for clipping text.Question : is objectBoundingBox aligned with screen pixels.The two conditions are maybe redundant. the rect element shall be axis-aligned.

the value of clipPathUnits shall be objectBoundingBox

To be further discussed (agreement to put this in the PDAM + discussion to finalize the text)

streamSource :

agreement that the technology is needed

agreement through the validation process that the technology can be put in the PDAM

list of points to be clarified and improved. It is expected to ask for contributions: buffer model, events.

AP Add these lines to the mandate, Alexandre

The KNB comment is therefore accepted.

M12702 : Amendment v1.The object of the discussion was to refine what technology was to be included in the Amendment 1. The point discussed was specifically was the BC SDL and what were the tools needed. Cf previous to decision to include BC SDL in the spec.a) Generation of the SDLCurrently the produced SDL code is optimized in order to factor functions.This means however that changes to the spec, modify the SDL.It is agreed that the generation of SDL is modified so as not to be impacted by changes to the spec.AP: Provide the executable software to produce the SDL code, Expway, next AhG????

66

AP: Provide the executable to produce the decoder from the SDL code,Jean-Claude, ????AP: Re(de)fine API between decoder and renderer, Jean-Claude & Philippe,????

AP: Minimal code documentation for integration purposes, ,b) codec_anyElement et codec_anyAttribute have to be updatedc) extensibilityd) Trigger element to be deleted and addition of listenere) decoderInit configuration :

BiMDecoderInit has to be skippable Further use cases need to be checked further on. Current understanding is :

if (encoding == SimpleEncoding) { bit(1) hasPrivateData; bit(1) hasExtendedAttributes; } else if (encoding == SimpleEncodingV2 ) {

vluismbf5 sizeOfBDI;//a simplev2 decoder is not mandated to decode bdi bit(1) hasBiMDecoderInit; if (hasBiMDecoderInit) { BiMDecoderInit bdi; //DecoderInit() as specified in ISO/IEC 15938-1 } else if(encoding==ISO_15938_Encoding) {

bit(1) hasBiMDecoderInit; if (hasBiMDecoderInit) { BiMDecoderInit bdi; //DecoderInit() as specified in ISO/IEC 15938-1 else {

vluismbf5 sizeOfURN; byte(sizeOfURN) BiMDecoderInitURN; uint(8) SchemaIDLength; }

} M12707: Informative annex on Scene APIProvides the execution model for LASeR. An example of an application using the API is a game.Open items : asynchronous events launched by Java (to be further discussed) How the java app is launched (this not done yet) How classes carried? (this not done yet) Performances? TuC Request profile Implementation.A draft validation experiment has to be written (Young-Kwon).

Discussion on Profile and LevelProposal made on profile & level signalling in the LASeR Header

LaserHeader:uint(appropriate size) mpeg_profile;uint(appropriate size) mpeg_level;uint(8) conformance_point_count;

for (i=1; i<=conformance_point_count; i++){  string conformance_URL;}

Each optional conformance_URL is the name of a profile/level point to which the file also complies.  The URL need not be de-referencable; it is used solely as a name, in a similar way to

67

namespaces in XML. Use of a URL here implies that the organization named in the 'host' part of the URL has defined the conformance point with the URL.

Notes:1) It is recommended (a) that the URLs contain the date of the definition of the conformance point and that (b) that the main part of the URL be de-referencable.  The use of the date protects against the case when the ownership of a domain name changes.  An example might be "http://www.example.org/march2004/media_profiles.htm#profile3level2".

2) This mechanism permits setting of limits in ways that may refer to satisfying the needs of a particular industry segment, possibly by referencing specific equipment as the minimum requirement (e.g. "to conform to this profile/level, the content must render satisfactorily on an ACME 1.0 Media Player").

The LASERHeader can host this in the extension part. MPEG Style P&L To be added in the amendment

Amendment 1 to LASeRText of the amendment

a) BC SDL (Under discussion) a. to put the text insideb. have the validation running in parallel (re-issue the validation experiment)

i. Workplan ii. Contents of the validation experiment (Review what is needed)

a. Update Softwareb. integration with rendererc. Transformation step? : d.

Objection from Streamezzo: put in Amendment when validation

b) TuCa. StreamSource / Events (TUC+12477) [see review of contribution above]b. Local/Global ID (TuC)

Three proposals : localID/GlobalID for IDs, StreamsID How are the localIDs be destroyed ?You need to destroy the from the parent.How are the local streamIDs destroyed ?When the scene has no more reference to a stream, then the player can reclaim/delete the decoding chain What is the difference with Inline?It gives access to the globalID. What about Scripts ?Use scripts on globalIDs Do we need a concept of session? No, the current proposal does not require a session concept. Need to define the session definition.

useful functionality need to investigate possible impact when doing script. to be added to the PDAM. agreed

68

c. Text Scroller (TuC)i. Agreement : functionality is useful

ii. Need for some clarification :1. what is being scrolled ? (clipping region or the content of the group)2. update the text to refer to listener and accessKey

iii. Scrollbar is nevertheless questioned and if no revised and agreed solution, it is agreed to keep it in TuC. The other functionality is agreed for PDAM

AP : Update Scroller Text, Jean-Claude, ThursdayAP : Implementation of Scroller Text, Jean-Claude, DateToDefined (e.g. AhG

meeting)

d. Active (TuC)e. Scene API (JSR 226+uDOM)

c) SVG Tiny 1.2d) Scripting (ECMA-MP ?)

Still to be donea) Finalize the private data discussion.b) Clarify content access procedurec) Informative Scene Graph API [to be reviewed]d) Profiles & Levels (Table to be done, transformBehaviour on image, define what are the axis – what are the measurable parameters to limit, and the levels [memory(#objects), complexity(# streams, #animations), bandwidth]– (use 254 for level "full")e) Conformance WD (documentation of sequences done)

The Amendment contains : Informative annex on BiM: explaining possible extensions. It is understood that in any case

these extensions shall maintain the compatibility with v1 (or v2) fixed syntax. (including privateExtension feature)

StreamSource Scroller (without scrollbar still in TuC) Local/Global ID Active P&L signalling proposed during the meeting.

Technical Work in Progress.

10 Open Font Format Specification (14496-22) 10.1.1 Topics

1. Font Representation

10.1.2 ContributionsNo contributions.

Technical Work in Progress.

69

11 MPEG-7 Systems (15938-1)

11.1 15938-1/Amd.2

11.1.1 Topics1. BiM Extension

11.1.2 Contributions

M12449: AHG on XML Structure Binarization and Streaming (Claude Seyrat et al.). The report was presented in plenary. No comments were received.

M12467: Summary of Voting on ISO/IEC 15938-1:2002/FPDAM 2 [SC 29 N 6935] The proposed changes were implemented with minor modifications. The text of 15938-1:2002 FFDAM2 and the DoC to the comments were produced and approved by WG11. Congrats. to the Editor ! The text of ISO/IEC 15938-1:2002/FPDAM 2 was sent to DVB in a liaison letter as they want to reference the ContextPathTable in the DVB CBMS spec. A liaison to W3C informs about the FDAM.

Conformance for BiM Extension in Amd. 2The text of MPEG-7 Systems Amd2 Conformance WD1.0 was revised to shape it into ISO amendment style. It was issued as a new PDAM. Editor is Ray Taylor.

BiM Reference SW M12610: BiM reference software update (Gregoire Pau et al.). The contribution was reviewed reporting that one bug was solved and another felt not to be a bug. One new bug was reported. The MPEG-7 Systems reference software workplan was updated accordingly. The related mandate in the AHG on XML Structure Binarization and Streaming was re-newed.

2 nd Edition of 15938-1 / 21000 Following the creation of MPEG-B a new edition of 15938-1 will be started at the next meeting. Possible new edition of MPEG-21 Part 16. Following the creation of MPEG-B the references that currently point to 15938-1 need to be correct. Unlesss this correction can be still inserted into the current Amd 1, we will produce a new edition.

11.2 15938-1/Amd.3

11.2.1 Topics1. Fragment Request

11.2.2 ContributionsM12573: Improved and clarified FRU text Stephen Davis et al. The contribution was reviewed jointly with REQ and MDS. Questions were raised on the implications for the System/Terminal architecture as specified in clause 5 of 15938-1. An updated text was provided and reviewed during the Friday Systems plenary. It was decided to include this technology in a new TuC for a future Amd3 of 15938-1.

Technical Work in Progress.

70

12 MPEG-B

12.1 23000-1 Binary Format

12.1.1 Topics1. BiM

12.1.2 Contributions

M12464: Summary of Voting on ISO/IEC FCD 23001-1 [SC 29 N 6922] & M12565: Editor's Study of ISO/IEC 23001-1 FCD Philippe de Cuetos et al.The two contributions were reviewed jointly. The proposed changes were implemented with minor modifications. In response to the GNB comment was decided to include the ContextPath section of 15938-1 Amd2 in 23001-1. In addition it was decided not to include the sections on Reference SW and Conformance at this time because there was not yet a clear separation made between parts that will remain with 15938-6 and 15938-7, respectively, and those parts that will be part of 23001-1. Accordingly, it was decided to create a WD of Amd1 to 23001-1 that will include the Reference SW and Conformance specifications. The text of 23001-1 FDIS and the related DoC were produced. Liaisons to DVB and W3C inform about the finalization of MPEG-B.

Technical Work in Progress.

13 MPEG-E Multimedia Middleware (23004)

13.1 Multimedia Middleware

13.1.1 Topics1. MPEG Multimedia Middleware

13.1.2 ContributionsDuring its 74th meeting (Nice, France, October 17-21, 2005) MPEG has reviewed the contributions it received as a result of the Pozan meeting as well as the Amsterdam (September 13, 2005) M3W Ad-Hoc meeting. The contributions have been pre-discussed during the M3W Ad-Hoc meeting on Sunday before the MPEG Nice meeting (October 16, 2005). Based on the outcome of the Ad-Hoc meetings the following agenda has been agreed upon for the M3W BoG meeting of the Systems group during the MPEH meeting in Nice.

Nice Agenda (Based on AHG recommendations):

1. Integration of the remote capabilities into the M3W WD. (Contribution M12574 Remote Capabilities (DISIT-DSI: University of Florence, Italy))2. Integration of the IPMP capabilities into the M3W WD. (Contributions M12592 Investigation of IPMP tool update functionality mapped on the M3W service (ETRI, Broadcasting Media Research Group), M12598 Refined IPMP Interfaces of Multimedia API on M3W service (ETRI, Broadcasting Media Research Group) and M12604 Investigation of MPEG-21 IPMP on M3W IPMP API (ETRI, Broadcasting Media Research Group))

71

3. Integration of the Modelling M3W Logical Service using XMLSchema into the M3W WD. (Contribution M12590 Modelling M3W Logical Service using XMLSchema (ICU: Information and Communications University, Korea))Sub. 1. Integration of the remote capabilities into the WDRemote capabilities allows for client – server model operation to enable remote service invocation (e.g. to support security, outsourcing, load balancing and the like) Outcome:

Fully discussed, understood and accepted J Integrated into WD Part-3 (Component Model) clause 18 Might affect Part-1 (Architecture) t.b.d.

Sub. 2. Integration of the IPMP functionality into the WDReviewed with the MDS experts and accepted as fulfilling the security requirements as stated in M3W requirements V2Outcome:

Fully discussed, understood and accepted J Will utilize available M3W services for IPMP tool management Broadcast tool delivery use case will be documented in WD Part-5 No need to revisit the extra requirements (IPMP download and service managers) as the

proposal is in line with current requirements, and utilizes the already available M3W extra functionalities

Integrated into WD Part-2 (Multimedia API) clause 6 sub-clause 2 Might affect Part-1 (Architecture) t.b.d.

Sub. 3. Integration of the logical services using XMLSchema into the WDLogical services using XMLSchema allows, in a formalized manner, for the composition of logical services out of physical services. This means that an application is only concerned with the logical services and is relieved from implementation detailsOutcome:

Fully discussed, understood and accepted J Integrated into WD Part-3 (Component Model) clauses 16 & 17 Might affect Part-1 (Architecture) t.b.d.

Next to the aforementioned agenda points the M3W BoG received the request form a representative of Freescale Semiconductor, Inc. to allow for the presentation of the OpenMAX (Open Media Acceleration primitives) initiative to the M3W BoG.

Based on this presentation, information on the OpenMAX web site and e-mail communication with OpenMAX representatives the MPEG M3W BOG has concluded that:

The OpenMAX IL (integration layer) & DL(developer layer) could be utilized in an implementation of a M3W compliant system

The intended OpenMAX AL (application layer) has a lot of similarity with M3W

Based on the above a (not yet formal) relationship with OpenMAX has been established to investigate if OpenMAX could adopt M3W for its AL layer,

The M3W Nice BoG was pleased by the interest of a large number of delegates, representing the following institutes, academia and industry: DSI (DISIT-DSI: University of Florence, Italy), Telecom Italia, Samsung, British Telecom, Telematica Institute, Fraunhofer Institute, ETRI (Broadcasting Media Research Group), Philips Research, ICU (Information and Communications

72

University, Korea), France Telecom, Microsoft, Freescale Semiconductor, Inc., during the discussions in the BoG meeting.

During the week a lot of editing work on parts 2 and 3 of the M3W work (in the presence of all experts) during second part of week resulting in:

WD 3.0 of Part-2: Multimedia API (7599)o Clause 6: Added sub-clause 6.2 IPMP API.

WD 3.0 of Part-3: Component Model (7606)o Clause 11: Started on explanation of M3W concepts, this introduces duplication with

later clauses that still have to be removed.o Clause 16: (Merged 16 and 17) updated clause on Service Manager, contains meta

data description of logical services.o Clause 17: (Was 18) updated clause on Instantiation and binding of physical

services, contains meta data description of physical services.o Clause 18: (Was 19) updated clause on remote execution.

Note that all the other parts of the WD (1, 4, 5, 6 & 7) stay at WD level 2.0.

M3W Tutorial (Tutorial on M3W some 100+ slides) (7607)

The M3W BoG requested to establish a M3W AHG until the MPEG meeting in Bangkok with the following mandates:

1. Review and update 23004 Multimedia Middleware (M3W) WD Version 2/3 (Parts 1-7)

2. Update the seven WD parts according the (extended) action-points in the current text

3. Implement the alignment of current specification w.r.t.:4. Use of IDL, either translation towards one syntaxes or guidelines for mapping

between the different IDLs5. Modify the current contributions into the ISO template and style6. Document the usage of the Download framework for Broadcast reception of

components

A M3W AHG meeting will be held on the Sunday before the next MPEG meeting and a meeting between the Nice and Bangkok meeting (date and location t.b.d.), all other communication will be done using the M3W e-mail reflector.

Technical Work in Progress.

14 Joint Meetings and Exploration

14.1 RequirementsM12567: Review of CE on DI Mapping to Delivery Channels. Noted.M12678, M12677: C freq. report.

73

14.2 AudioM12470: Audio Codec Behavior. Decision to make three corrigenda to 14496 out of it : one of Part 1 (Systems), one for Part 3 (Audio), one for Part 14 and a technical report gathering (Lead by Audio).

M12668: Clarification on Definition of ExtensionProfileLevelDescriptor. Part of it will be integrated into the new Cor of Part 1. Editorial errors will be integrated in the 3rd Edition. As well as Part 14.

14.3 Streaming of DIM12632, M12650, M12644 : Cf. MDS report.

14.4 MAFM12534, M12589, M12645, M12647, M12659: Cf. Requirement report.

14.5 Carriage of Depth MapM12602, M12595, M12600, M12603 : Cf. Requirements report.

74

15 Latest References and Publication Status

Pr Pt Standard No. Issue Status Doc. with Purpose ISO Award

2 1 ISO/IEC 13818-1/Amd.7 Published 2000/12 Done2 1 ISO/IEC 13818-1:2000 (MPEG-2 Systems 2nd Edition) 00/12 Published 2000/12 Proposed2 1 ISO/IEC 13818-1:2000/COR1 (FlexMux Descr.) N3844 01/01 Pisa Published 2002/03 N/A2 1 ISO/IEC 13818-1:2000/COR2 (FlexMuxTiming_ descriptor) N4404 01/12 Pattaya Published 2002/12 N/A2 1 ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) & COR1 on Amd.1 N5867 03/07

TrondheimPublished 2003/12 Proposed

2 1 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2) N5604 03/03 Pattaya Published 2004/03 N/A2 1 ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-2) N5771 03/07

TrondheimPublished XXXX Proposed

2 1 ISO/IEC 13818-1:2000/Amd.4 (Metadata Application CP) N6847 04/10 Palma FDAM ITTF to be published N/A2 1 ISO/IEC 13818-1:2000/Amd.5 (New Audio P&L Sig.) N6585 04/07

RedmondFDAM ITTF to be published N/A

2 1 ISO/IEC 13818-1:2000/COR3 (Correction for Field Picture) N6845 04/10 Palma COR ITTF to be published N/A2 1 ISO/IEC 13818-1:2000/COR4 (M4MUX Code Point) N7469 05/07 Poznan COR ITTF to be published N/A2 1 ISO/IEC 13818-1:2006 (MPEG-2 Systems 3rd Edition) 06/xx Published ITTF TBD2 11 ISO/IEC 13818-1:2003 (IPMP on 2) N5607 03/03 Pattaya Published 2003/12 Proposed4 1 ISO/IEC 14496-1 (MPEG-4 Systems 1st Ed.) N2501 98/10 Atl. City Published 1999/12 Done4 1 ISO/IEC 14496-1/Amd.1 (MP4, MPEG-J) N3054 99/12 Hawaii Published 2001/11 Done4 1 ISO/IEC 14496-1/Cor.1 N3278 00/03

Noordwijk.Published 2001/11 N/A

4 1 ISO/IEC 14496-1:2001 (MPEG-4 Systems 2nd Ed.) N3850 01/01 Pisa Published 2001/11 N/A4 1 ISO/IEC 14496-1:2001/Amd.1 (Flextime) Published 2002/10 Done4 1 ISO/IEC 14496-1:2001/Cor.1 N4264 01/07 Sydney COR ITTF N/A4 1 ISO/IEC 14496-1:2001/Cor.2 N5275 02/10 Shangai COR ITTF N/A4 1 ISO/IEC 14496-1:2001/Cor.3 N6587 04/07 COR ITTF N/A

75

Redmond4 1 ISO/IEC 14496-1:2001/Amd.2 (Textual Format) N4698 02/03 Jeju

IslandAMD ITTF N/A

4 1 ISO/IEC 14496-1:2001/Amd.3 (IPMP Extensions) N5282 02/10 Shanghai

Published 2004-05 N/A

4 1 ISO/IEC 14496-1:2001/Amd.4 (SL Extension) N5471 02/12 Awaji Published 2003/12 N/A4 1 ISO/IEC 14496-1:2001/Amd.7 (AVC on 4) N5976 03/10

BrisbannePublished 2004-08 N/A

4 1 ISO/IEC 14496-1:2001/Amd.8 (ObjectType Code Points) N6202 03/12 Hawaii AMD ITTF to be published N/A4 1 ISO/IEC 14496-1:200x/Amd.1 (Text Profile Descriptors) N7229 05/04 Busan PDAM ITTF Final Text

EditingN/A

4 1 ISO/IEC 14496-1:200x/Cor4 (Node Coding Table) N7473 05/07 Poznan PDAM ITTF to be published N/A4 1 ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) N5277 02/10

ShanghaiIS ITTF to be published Proposed

4 1 ISO/IEC 14496-1:200x/Amd.1 (Text Profile Descriptors) N7229 05/04 Busan PDAM ITTF Final Text Editing

N/A

4 6 ISO/IEC 14496-6:2000 Published 2000/12 N/A4 8 ISO/IEC 14496-8 (MPEG-4 on IP Framework) N4712 02/03 Jeju Published 2004-05 Proposed4 11 ISO/IEC 14496-11 (MPEG-4 Scene Description) N5279 02/10

ShanghaiFDIS SC29 Final Text

EditingProposed

4 11 ISO/IEC 14496-11/Amd.1 (AFX) N5480 02/12 Awaji FDAM ITTF Integration in 1st

Ed.N/A

4 11 ISO/IEC 14496-11/Amd.2 (Advanced Text and Graphics) N6205 03/12 Hawaii FDAM ITTF Integration in 1st

Ed.N/A

4 11 ISO/IEC 14496-11/Cor.1 N6203 03/12 Hawaii COR SC29 N/A4 11 ISO/IEC 14496-11/Cor.3 Valuator/AFX related correction N6594 04/07

RedmondCOR ITTF Integration in 1st

Ed.N/A

4 11 ISO/IEC 14496-11/Amd.3 Audio BIFS Extensions N6591 04/07 Redmond

FDAM ITTF Integration in 1st

Ed.Proposed

4 11 ISO/IEC 14496-11/Amd.4 XMT and MPEG-J Extensions N6959 05/01 HongKong

FDAM ITTF Integration in 1st

Ed.N/A

4 11 ISO/IEC 14496-11/Cor.3 (Audio BIFS Integrated in 3rd Edition) N7230 05/04 Busan COR ITTF Final Text N/A

76

Editing4 12 ISO/IEC 14496-12 (ISO Base Media File Format) N5295 02/10

ShanghaiPublished 2004-02 Proposed

4 12 ISO/IEC 14496-12/Amd.1 ISO FF Extension N6596 04/07 Redmond

FDAM ITTF FDAM 04/11/30 N/A

4 12 ISO/IEC 14496-12/Cor.1 (Correction on File Type Box)

N7232 05/04 Busan COR ITTF Final Text Editing

N/A

4 13 ISO/IEC 14496-13 (IPMP-X) N5284 02/10 Shanghai

IS ITTF to be published Proposed

4 14 ISO/IEC 14496-14 (MP4 File Format) N5298 02/10 Shanghai

Published 2003-11 Proposed

4 15 ISO/IEC 14496-15 (AVC File Format) N5780 03/07 Trondheim

Published 2004-04 Proposed

4 15 ISO/IEC 14496-15/Amd.1 (Support for FREXT) N7585 05/10 Nice FDAM ITTF Final Text Editing

N/A

4 17 ISO/IEC 14496-17 (Streaming Text) N7479 05/07 Poznan FDAM ITTF TBP4 18 ISO/IEC 14496-18 (Font Compression and Streaming) N6215 03/12 Hawaii Published 2004-07 Proposed4 19 ISO/IEC 14496-19 (Synthesized Texture Stream) N6217 03/12 Hawaii Published 2004-07 Proposed4 20 ISO/IEC 14496-20 (LASeR) N7588 05/10 Nice FDAM Editor TBP7 1 ISO/IEC 15938-1 (MPEG-7 Systems) N4285 01/07 Sydney Published 2002/07 Done7 1 ISO/IEC 15938-1/Amd.1 (MPEG-7 Systems Extensions) N6326 04/03 Munich FDAM ITTF FDAM 04/11/28 N/A7 1 ISO/IEC 15938-1/Cor.1 (MPEG-7 Systems Corrigendum) N6328 04/03 Munich COR Editor N/A7 1 ISO/IEC 15938-1/Cor.2 (MPEG-7 Systems Corrigendum) N7490 05/07 Poznan COR ITTF N/A7 1 ISO/IEC 15938-1/Amd.2 (BiM extension) N7532 05/10 Nice FDAM ITTF N/A7 2 ISO/IEC 15938-2 (MPEG-7 DDL) N4288 01/07 Sydney Published 2002/02 Done21 9 ISO/IEC 21000-9 (MPEG-21 File Format) N6975 05/01

HongKongFDIS ITTF FDIS 05/01/21 Done

21 16 ISO/IEC 21000-16 (MPEG-21 Binary Format) N7247 05/04 Busan FDIS ITTF FDIS 05/04/22 TBPB 1 ISO/IEC 23001-1 (XML Binary Format) N7597 05/10 Nice FDIS ITTF TBP

77

16 Resolutions of Systems16.1.1 Cf. WG11 resolution.

17 List of Reviewed Contributions

N° Title Authors12440 AHG on Symbolic Music Representation Paolo Nesi et al.

12449 AHG on XML Structure Binarization and Streaming Claude Seyrat et al.12450 AHG on Scene Representation Alexandre Cotarmanac.h et al.12451 AHG on MPEG File Formats David Singer et al.12452 AHG on MPEG Multimedia Middleware Jean Gelissen et al.12463 Summary of Voting on ISO/IEC 14496-15:2004/FPDAM 1

[SC 29 N 6921]SC 29 Secretariat

12464 Summary of Voting on ISO/IEC FCD 23001-1 [SC 29 N 6922]

SC 29 Secretariat

12467 Summary of Voting on ISO/IEC 15938-1:2002/FPDAM 2 [SC 29 N 6935]

SC 29 Secretariat

12472 Extensibility in LASeR BiM-Compatible Simple Encoding Robin Berjon et al.12473 Carriage of private data in LASeR BiM-Compatible Simple

EncodingRobin BerjonPhilippe de Cuetos et al.

12474 Report on generality in LASeR BiM-Compatible Simple Encoding

Robin Berjon et al.

12475 Implementation of the BiM-Compatible LASeR reference software

Robin Berjon et al.

12477 StreamSource A.Cotarmanach et al.12478 Updated 2-Pager for BIFS Cotarmanach, Cazoulat, Fisher

12479 Extensibility of the Custom SDL (for the Cupertino Meeting)

Jean-Claude Dufourd

12480 Genericity of the Custom SDL (for the Cupertino Meeting) Jean-Claude Dufourd12481 Custom SDL and mapping (for the Cupertino Meeting) Jean-Claude Dufourd12482 Liaison Statement from 3GPP [SC 29 N 6949] 3GPP via SC 29 Secretariat12488 Proposed Amendment to 14496-11 for SMR support Pierfrancesco Bellini et al.12490 On the SVC File Format VM David Singer et al.12491 Amendment 1 to AVC FF, proposed output text David Singer12492 Liaison Statement from DVB [SC 29 N 6955] DVB via SC 29 Secretariat12503 LASeR and SAF editor's study Jean-Claude Dufourd12504 Proposal to add JSR 226 / MicroDOM to LASeR Jean-Claude Dufourd et al.12505 Final version of custom SDL, validated by implementation Jean-Claude Dufourd12506 Fixes to the LASeR study, with explanations Jean-Claude Dufourd12507 Clarifications proposals for LASeR and SAF Jean-Claude Dufourd12515 Liaison Statement from ATSC [SC 29 N 6960] ATSC via SC 29 Secretariat12516 Liaison Statement from CEA [SC 29 N 6961] CEA via SC 29 Secretariat12521 About the usage of codec_rare results in the custom

encodingJean-Claude Dufourd

12533 Signaling of low-to-high layer switching points in SVC file format

Ye-Kui Wang et al.

12534 Proposal of new scenarios and requirements for an Accompaniment Music Player MAF

Tae Hyeon Kim et al.

12563 Specification of ISO_15938_1_Encoding in LASeR Philippe de Cuetos et al.12564 Integration of LASeR specific codecs in the BiM reference

softwarePhilippe de Cuetos et al.

12565 Editor's Study of ISO/IEC 23001-1 FCD Philippe de Cuetos et al.

78

N° Title Authors12567 Review of CE on DI Mapping to Delivery Channels Niels Rump12573 Improved and clarified FRU text Stephen Davis et al.12574 MPEG-21 Multimedia Middleware: Remote Capabilities Davide Rogai et al.12589 Extensions to Music MAF Player Format for Multiple JPEG

images and Text data with Synchronizations to MP3 dataChansuk Yang et al.

12590 Modeling M3W Logical Service using XML Schema HendryMunchurl Kim et al.

12591 The CE Report for Symbolic Music Representation(SMR) on Korean Traditional Music Notations.

CHOI Yong-Sooand et al.

12592 Investigation of IPMP tool update functionality mapped on the M3W service

Gun Bang et al.

12595 Proposal to define depth map coding for stereoscopic applications

jan van der meer et al.

12598 Refined IPMP Interfaces of Multimedia API on M3W service

Hyon-Gon Choo et al.

12600 Draft depth map stream format jan van der meer et al.12602 Proposal for MPEG-2 System amendment for carriage of

depth map streams over MPEG-2 Systems.jan van der meer et al.

12603 Background information on the use of Depth Maps for stereoscopic applications

jan van der meer et al.

12604 Investigation of MPEG-21 IPMP on M3W IPMP API Hyon-Gon Choo et al.12606 Proposed revised text of WD on Symbolic Music

RepresentationPierfrancesco Bellini et al.

12610 BiM reference software update Gregoire Pau et al.12613 Study on ISO/IEC 13818-1:2000/PDAM 6: Transport of

streaming text over MPEG-2 systemsvan der Meer Werner Oomen

12620 ID3v2 tag in ISO base media file format Miska Hannuksela et al.12621 FLUTE hint track in ISO base media file format Miska Hannuksela et al12623 GNB Comments on Study Text of ISO/IEC FCD 14496-20 Andreas Hutter on behalf of

the GNB12624 Grouping of tracks in the SVC file format Per Fröjdh12632 Buffer Configuration Information for Digital Item

Streaming: State of the Art and ExamplesChristian Timmerer et al.

12634 Demonstration of gBSD-based Adaptation in Streaming Scenarios

Michael Ransburg et al.

12641 KNB comment on ISO/IEC 14496-20 concerning StreamSource

Young-Kwon LIM (on behalf of KNB)

12644 Comments on Digital Item Streaming Peder Drege et al.12645 Proposed Portable Video Player MAF Harald Fuchs et al.12647 Proposed Slideshow MAF Harald Fuchs et al.12650 Updates on Media and XML Streaming Instructions Sylvain Devillers et al.12651 MPEG-4 Terminal Architecture White Paper Le Feuvre Jean et al.12653 MPEG-4 Objects extended synchronization Jean Le Feuvre12659 Application Scenarios and Derived Requirements for Photo

Album MAFSang-Kyun Kim et al.

12661 Performances of BiM encoding in LASeR Philippe de Cuetos et al. 12666 Storage of MPEG-4 user streams in MP4 Jean Le Feuvre12668 Clarification on Definition of

ExtensionProfileLevelDescriptorRalph Sperschneider

12669 Proposal on profileAndLevelIndication Signaling in LATM Ralph Sperschneider12677 Report of Core Experiment on DI mapping to delivery

channelsJoseph Thomas-Kerr et al.

12678 Technologies Required for Digital Item Streaming Joseph Thomas-Kerr et al.12691 Liaison Statement from ECMA ECMA via SC 29 Secretariat12693 proposed white paper on the MPEG file formats David Singer et al.12693 proposed white paper on the MPEG file formats David Singer et al.

79

80

Annex 7Report of MDS

Ian S Burnett, PhD, Chair

1.0 Introduction

MDS commenced with an overview of the weeks planned activities:

• I BM logo must not be moved, added to, or altered inany way.

• Background shouldnot be modified.

• Title/ subtitle/ confidentiality line: 10pt Arial Regular, whiteMaximum length: 1 lineI nformation separated by vertical strokes,with two spaces on either side

•Slide heading:28pt Arial Regular, blue R120 | G137 | B251 Maximum length: 2 lines

•Slide body:18pt Arial Regular, blackSquare bullet color:teal R045 | G182 | B179Recommended maximum text length: 5 principal points

•Group name:14pt Arial Regular, whiteMaximum length: 1 line

• Copyright: 10pt ArialRegular, white

Template release: Oct 02For the latest, go to http:/ /w3.ibm.com/ ibm/presentations

MPEG Multimedia Descr iption Schemes (MDS) Sub-group

©2003 I BM Corporation

Optional slide number: 10pt Arial Bold, white

I ndications in green = Live content I ndications in white = Edit in masterI ndications in blue = Locked elementsI ndications in black = Optional elements

J uly 19—24, 2004 | 69th MPEG Meeting | Redmond, WA USA

Overview of MDS Activities

MPEG- 21:• REL (“Profiles”) – Study of PDAM & Reqts• RDD (Draf t of COR/2)• DI I (Liaison f rom NI SO)• DI A AMD/ 1 (FDAM), AMD/ 2 (PDAM)• DI P (C++ Resources) – Study of PDAM• Conf ormance (Study of CD)• Event Reporting (Study of FCD)• I PMP Components (FDI S)• FragmentI Ds (Study of FCD)• DI Streaming (CD) & DI A AMD/ 2 (PDAM)• MAF – joint meetings with Reqts• MPEG-21 Schema Doc (no update)

81

• I BM logo must not be moved, added to, or altered inany way.

• Background shouldnot be modified.

• Title/ subtitle/ confidentiality line: 10pt Arial Regular, whiteMaximum length: 1 lineI nformation separated by vertical strokes,with two spaces on either side

• Slide heading:28pt Arial Regular, blue R120 | G137 | B251

Maximum length: 2 lines

• Slide body:18pt Arial Regular, blackSquare bullet color:teal R045 | G182 | B179Recommended maximum text length: 5 principal points

• Group name:14pt Arial Regular, whiteMaximum length: 1 line

• Copyright: 10pt ArialRegular, white

Template release: Oct 02For the latest, go to http:/ /w3.ibm.com/ibm/presentations

MPEG Multimedia Description Schemes (MDS) Sub-group

©2003 I BM Corporation

Optional slide number: 10pt Arial Bold, white

I ndications in green = Live content I ndications in white = Edit in masterI ndications in blue = Locked elementsI ndications in black = Optional elements

J uly 19—24, 2004 | 69th MPEG Meeting | Redmond, WA USA

Overview of Activities

73rd MPEG meeting – Organization of work:• Main MDS track (MPEG-21) – Room Gallieni 3 • Break-out groups: Gallieni 4, Risso 6

– MPEG-21 DI P (brief ), RDD(?), DI A, ER, I PMPComponents, DI S, REL

• J oint meetings with other groups on MAF & MPEG-21• MDS plenary meetings (Mon, Thurs)• Single wrap-up meeting on Friday

• I BM logo must not be moved, added to, or altered inany way.

• Background shouldnot be modified.

• Title/ subtitle/ confidentiality line: 10pt Arial Regular, whiteMaximum length: 1 line

I nformation separated by vertical strokes,with two spaces on either side

• Slide heading:28pt Arial Regular, blue R120 | G137 | B251 Maximum length: 2 lines

• Slide body:18pt Arial Regular, black

Square bullet color:teal R045 | G182 | B179

Recommended maximum text length: 5 principal points

• Group name:14pt Arial Regular, whiteMaximum length: 1 line

• Copyright: 10pt ArialRegular, white

Template release: Oct 02For the latest, go to http:/ /w3.ibm.com/ibm/presentations

MPEG Multimedia Description Schemes (MDS) Sub-group

©2003 I BM Corporation

Optional slide number: 10pt Arial Bold, white

I ndications in green = Live content I ndications in white = Edit in masterI ndications in blue = Locked elementsI ndications in black = Optional elements

J uly 19—24, 2004 | 69th MPEG Meeting | Redmond, WA USA

Major MDS goals of the week MPEG- 21 DI Streaming

• gBS Adaptive streaming – DIA AMD/2• Part 18 – Digital I tem streaming

MPEG- 21 Schemas output document • Host on I TTF site• Working Document – output kept up to date

MPEG- 21 Event Reporting • Output: MPEG-21 ER Study of FCD

MPEG- 21 Fragment Identifiers • Output: MPEG-21 FI D Study of FCD

MPEG- 21 IPMP Components (Part 4):• Discussions & MAF discussions• Output: MPEG-21 I PMP Components FDI S

MPEG- 21 RDD (Part 5):• Discussions, reviewing of inputs• Output: Draf t of Corr igendum 2,

82

• I BM logo must not be moved, added to, or altered inany way.

• Background shouldnot be modified.

• Title/ subtitle/ confidentiality line: 10pt Arial Regular, whiteMaximum length: 1 lineI nformation separated by vertical strokes,with two spaces on either side

• Slide heading:28pt Arial Regular, blue R120 | G137 | B251

Maximum length: 2 lines

• Slide body:18pt Arial Regular, blackSquare bullet color:teal R045 | G182 | B179Recommended maximum text length: 5 principal points

• Group name:14pt Arial Regular, whiteMaximum length: 1 line

• Copyright: 10pt ArialRegular, white

Template release: Oct 02For the latest, go to http:/ /w3.ibm.com/ibm/presentations

MPEG Multimedia Description Schemes (MDS) Sub-group

©2003 I BM Corporation

Optional slide number: 10pt Arial Bold, white

I ndications in green = Live content I ndications in white = Edit in masterI ndications in blue = Locked elementsI ndications in black = Optional elements

J uly 19—24, 2004 | 69th MPEG Meeting | Redmond, WA USA

Major MPEG- 21 goals of the week (cont.) MPEG- 21 Digital I tem Adaptation (Part 7):• Review CE results, I nputs, Comments

• Output: MPEG-21 DI A AMD/ 1 FDAM, PDAM (incl. gBS streaming)

MPEG- 21 Digital I tem Processing (Part 10):• Discussions of C++ Resources• Output: Study of PDAM, Prelim Disposition

MPEG- 21 Conformance (Part 14):• Study of CD• Output: MPEG-21 Conformance Study of CD ???

MPEG- 21 DI I (Part 3):• Dispose of NI SO liaison• Output: AHG mandates

MPEG- 21 REL (Part 5):• Profi les• Output: Study of PDAM

• I BM logo must not be moved, added to, or altered inany way.

• Background shouldnot be modified.

• Title/ subtitle/ confidentiality line: 10pt Arial Regular, whiteMaximum length: 1 line

I nformation separated by vertical strokes,with two spaces on either side

• Slide heading:28pt Arial Regular, blue R120 | G137 | B251 Maximum length: 2 lines

• Slide body:18pt Arial Regular, black

Square bullet color:teal R045 | G182 | B179

Recommended maximum text length: 5 principal points

• Group name:14pt Arial Regular, whiteMaximum length: 1 line

• Copyright: 10pt ArialRegular, white

Template release: Oct 02For the latest, go to http:/ /w3.ibm.com/ibm/presentations

MPEG Multimedia Description Schemes (MDS) Sub-group

©2003 I BM Corporation

Optional slide number: 10pt Arial Bold, white

I ndications in green = Live content I ndications in white = Edit in masterI ndications in blue = Locked elementsI ndications in black = Optional elements

J uly 19—24, 2004 | 69th MPEG Meeting | Redmond, WA USA

J oint meetings schedule

J oint Meetings:

– M3W with I PMP Components (9am – 10am Tuesday) (in Systems)

– FRUs and DI AC (9am- 9.45am Tuesday)– MPEG- 21 Profile I ssues with Reqts (9.45am-10.45am

Tuesday)– DI S with Reqts/Systems(10.45am- 12pm Tuesday)– MAF with Reqts/Audio/Systems (2pm – 6pm Tuesday)– SVC & DI A & gBS with J VT (2pm- 2.30pm Wednesday)– MPEG- 7 issues with MPEG- 7 Video (5- 5.30pm Wednesday)

2.0 Notes on discussions on Input Documents

The MDS subgroup commenced with a discussion regarding potential goals and intended outcomes for the week. The group then reviewed the outcomes of the AHGs. BoGs on REL Profiles, IPMP Components, Event Reporting, DIA and DI Streaming were formed during the week. Their reports are included in the foregoing sections.

RDD Issues

12511

Marc Gauvin Jaime Delgado Eva Rodriguez Roberto García González Preliminary Results of RDD CE for Expressing “Work”

83

12578 Chris Barlas Reviewer's Comment on CE on RDD Abstraction and Resource

12649 Simon Watt Review comments on CE on RDD Abstraction and Resource

12664 Xin Wang Reviewer comments on CE on RDD Abstraction and Resource     

12495Roberto García Jaime Delgado Eva Rodríguez

Ontological Analysis of the MPEG-21 Rights Data Dictionary (RDD)

Input:

The first session considered the ‘orphan’ RDD CE setup in Poznan without an AHG mandate (by mistake). The session considered the CE, reviewers comments and then an extra input that examined the RDD Ontology using OWL.

Actions:

One issue raised was that the CE report m12511 had been updated in the document register since the original version sent to the reviewers. The new version has 5 reworded conclusions rather than the original four. The authors were requested to revise the m12511 in the document register to the original version supplied to reviewers (since this allows documents to be read in synchronism). The revised CE report may be uploaded under a new document number.

There was consensus that a corrigendum on the RDD should be created. This should be based on the inputs m12495 and m12578 which both provide ontological analyses of the RDD. These analyses utilize ontological and reasoning tools that were not available when the RDD was being written and standardized. The problems are minor terminology spelling errors, missing relationships etcThe CE participants were unable to proceed in their work due to the problems and thus this corrigenda will provide a first step.

Discussion on the issue of ‘Work’ was postponed until a later session (see 12.30pm Tuesday) at which use cases will be presented and a possible solution for representing work in MPEG-21 will be considered.

DI Streaming with Requirements

12644 Peder Drege Thomas Skjølberg Runar Solberg Comments on Digital Item Streaming

Input:

The authors chose to delete the document

Actions:

None required

12677Joseph Thomas-Kerr Ian Burnett Gabriel Fernàndez Alejandro López González

Report of Core Experiment on DI mapping to delivery channels

84

Input:

This CE explicitly looked at the use of tools proposed for the DI Streaming call to meet the use case of the Digital Media Project (DMP). Reported and demonstrated successful use of BBL to map DIs to MPEG-2 TS and RTP. In particular, it highlighted that more work on normative interfaces to lower delivery layers and normative MPEG handlers will be required. Also notes that inline function declaration in e.g. ECMA Script may be useful.

Actions:

Question on the formats – this proposal uses MPEG-2/MPEG-4 formats as they are with perhaps only a DI payload required for Metadata on MPEG-2. Discussion of clarity of requirements. The joint meeting feels that there is still some work to do on the Requirements but there is currently no new input.

12678 Joseph Thomas-Kerr Ian Burnett Technologies Required for Digital Item Streaming

Input:

Discusses the way in which BBL meets normative requirements for DI Streaming. Highlights the core requirements on DI Streaming. Discusses normative interfaces for handlers and encoders. Concludes that a complete interoperable framework is needed for DI Streaming instructions.

Actions:

There was some discussion on the relationship with NHNT tracks. It was also discussed whether TEM should be extended for carousel purposes.

12632Christian Timmerer Hermann Hellwagner Andreas Hutter Jörg Heuer

Buffer Configuration Information for Digital Item Streaming: State of the Art and Examples

Input:

Proposes that buffering must be specified in MPEG-21 as not all protocols support buffer configuration.

Actions:Further discussion in MDS

REL Profiling

12524 Jaime Delgado Eva Rodriguez Jose Prados Comments on MPEG-21 REL Base Profile

Input:

Requests three terms to be incorporated in the profile to allow verification and request of payment.

85

Actions:Further discussion in MDS breakout. It was noted that there should be NB comments on this as REL profile is already PDAM

12692Weongeun Oh Yeonjeong Jeong Taehyun Kim Hogab Kang

Comment on MPEG-21 base profile extension

Input:

Requests clarification of ‘store’, granularity of ‘governed copy’, and suggests some profile extensions.

Actions:Further discussion will take place. There were some concerns that the solutions did not offer enough power. Some changes proposed seem to go beyond the REL and impact on e.g. RDD.

12500 Octavian FoleaContent protection extension for MPEG-21 REL

Input:

Proposes an extension to REL profiles to support other protection mechanisms beyond encryption. Proposes a new element: ProtectionMethod.

Actions:There was a request for examples. This would require a change to the protection element in this REL extension. The conclusion is that REL BoG will analyse the proposal. It was also noted that IPMP Components may overlap this proposal.

Fragment Identifiers for MPEG Resources

12544 Myriam Amielh Ernest Wan Preliminary comments on ISO/IEC 21000-17 FCD (FID)

Input:

Proposed improvements to the FCD Actions:

There was consensus that these should be added to the Study of FCD.

12494 Melanie Dulong de Rosnay Contribution to AhG on MPEG-21 RDD

Input:

Inputs a detailed use case as mentioned on the reflector by reviewers of the RDD CE. Actions:

86

There is a relationship with the input from the previous meeting. One observation from a reviewer is that more detailed use cases were not the intention

A further input was accepted to be presented and will be uploaded as a late document to the document register. The input from Niels Rump:

Niels Rump Late Input

Input:

Looks at the use cases in the context of a complete MPEG framework. Proposes the use of DII to identify the various stages prior to the use of MPEG-21 RDD which is considered to be the last stage. Actions:

There is a concern that this is not an exclusively RDD solution.

Discussion:

Established that the requirements are 4.4.2.12, 4.4.3.2, 4.3.1.1. Formed a BoG which will establish exactly where the changes that would be needed in the RDD to make the RDD meet the requirements of the proponents of a clear way of expressing ‘Work’. The Protégé tool will be utilized and the RDD ontology generated by DMAG will be used as a basis.

12486 Gerrard Drury Ian S. Burnett Preliminary comments on ISO/IEC 21000-10 PDAM/1

12597Saar De Zutter Frederik De Keukelaere Rik Van de Walle Editors input on 21000-10 PDAM1

12601Frederik De Keukelaere Saar De Zutter Rik Van de Walle

Contribution to DIP reference software - update to FDIS status

Input:

12597/12486 were discussed during the BoG and the activities of the BoG were reported back during this meeting. There are a few minor amendments. The DIP Reference s/w is not in part 8 of MPEG-21. The contribution 12601 will provide the basis of AMD/1 of part 8 Reference Software. Actions:

Prelim DoC will be an outputStudy text on AMD/1 C++ Resources will be outputWD on AMD of Part 8AhG – any issues on preliminary comments, test streams for DIP conformance

DIA Session

DIA BoG reported. PDAM will be called “Dynamic and Distributed Adaptation”. Editors will be Christian Timmerer, Sylvain Devillers, Michael Ransburg.

87

12650Sylvain Devillers Michael Ransburg Christian Timmerer Hermann Hellwagner Alexandre Cotarmanac'h

Updates on Media and XML Streaming Instructions

Input:

Proposes technical updates to corresponding proposal input to Poznan. It proposes new attribute : auMode which allows for tree or sequential access to a document. auPart : tells where an Access Unit may be split. A clarification is made of the semantics of dtsDelta. There are new additions for XML Streaming instructions – these address the above issues. puMode can now be sequential or tree and is bounded by anchor elements. A new attribute indicating the depth of the subtree is sometimes used for XML. For the complex mode there are also proposals (may not be used if there is no use case in the scope of DIA). processUnitseq gives N output documents. parameterSeq and a tree structure make for more efficient processing.

Actions:

Straightforward matters to go to PDAM. Other matters to TUC of PDAM.

Event Reporting

12538 Kyunghee Ji Jungwon Kang Preliminary comments on 21000-15 FCD

The BoG reported on progress and included discussion of 12538. The progress on the Preliminary DoC was also then reported.

DIA/SVC – joint meeting with JVT

12638Truong Cong Thang Jung Won Kang Youngsuk Kim Yong Man Ro Jae-Gon Kim

SVC Video Adaptation with MPEG-21 DIA AdaptationQoS

Input:

Proposes extra QoS descriptors that will facilitate the adaptation of SVC streams. Spatial Layers, Temporal Levels & Quality Reduction.

Actions:

One concern was whether the SVC Priority ID should be used. Opinion was the AQoS should be aligned with the latest SVC standard. Do we need to generalize terms in AQoS?

Sylvain Devillers gave a presentation on the relationship between the gBSD work and SVC. A question was how efficient the generic solution would be – would it not be more efficient to work natively.

There will be a CE (as above) and demonstrations of SVC adaptation were promised for the next meeting. JVT & MDS will have a joint meeting again at the 75th meeting.

DIStreaming

Report of BoG on DI Streaming. DIS is growing and will also have a TuC.

88

Planned results this week for DIStreaming and DIA:

DIA related planning:• PDAM 2 for DIA • TuC for DIA• Module description and workplan for reference software/utility software (timeplan to be

confirmed by J.C.)

Part 18 related planning:• CD for DIS (part 18) including the stable technologies (subset of Poznan contribution +

straightforward additionsà XML syntax for handler parameters instead of Strings

• Module description and workplan for reference software/utility software • AhG on DIStreaming (mandate 6 of previous period; discuss further work items together)• TuC for

– Handler mechansim extension and Encoders– extension functions for XPATH– timeschemes

DIA

12499 Christian Timmerer Editor's input on ISO/IEC 21000-7 FPDAM/1

12579Christian Timmerer on behalf of the Austrian NB Austrian NB comments on 21000-7 FPDAM/1

12583Christian Timmerer Benoit Pellan Truong Cong Thang MPEG-21 DIA AMD/1 reference software status

12614Christian Timmerer on behalf the editors Editor's input on DIA AMD/2: DIA Extensions WD v1.0

12568Michael Zufferey Eric Delfosse Christian Timmerer Harald Kosch

Report on CE Proposed DIA extensions: Multiple input/output values for AdaptationQoS IOPins and MPEG-7 as BSDLink steering description

These inputs were considered in BoGs and were thus reported in MDS rather than represented.

m12499: Timmerer, Editor's input on ISO/IEC 21000-7 FPDAM/1— discussed during AhG meeting and updated according to the discussions— input from RDD experts considered— DoC produced and confirmed with NB— output:

o "DoC on ISO/IEC 21000-7 FPDAM/1"o "Text of ISO/IEC 21000-7 FDAM/1 Conversions and Permissions"

m12568: Zufferey et.al., Report on CE Proposed DIA extensions: Multiple input/output values for AdaptationQoS IOPins and MPEG-7 as BSDLink steering description

— CE presented during AhG meeting— proposal is to promote AQoS extensions to AMD/2— BSDLink extensions raises some issues which are not easy to solve— some minor open issues remains to be addressed— output:

o AQoS extensions to "Text of ISO/IEC PDAM/2 Dynamic and Distributed Adaptation"

89

o mandate to address open issues to "AhG on MPEG-21 DIA"

m12579: Timmerer (on behalf of the Austrian NB), Austrian NB comments on 21000-7 FPDAM/1

— only one comment  proposing to consider study documents and editors input when drafting FDAM/1

— comment accepted during BoG meeting

m12583: Timmerer et.al., MPEG-21 DIA AMD/1 reference software status— provides updates for DIA AMD/1— reference software is now available for AMD/1 tools— output: update "MPEG-21 DIA Reference Software Status and Work Plan"

m12670: Drege et.al., DIAC- clarifications on adaptation decision process— presented during joint meeting with Requirements— it's not yet clear what is the impact wrt MPEG-21 DIA requirements— proponents are asked to provide details regarding their use cases and discuss with DIA

experts later during the week— output: not out expected at the moment but might be updates to TuC + CE and/or AhG

mandate— will be discussed with BoG session Thursday morning

m12611: De Schrijver et.al., Report on Core Experiment on BSDL extensions— CE presented during AhG meeting— add'l BSDL attributes for low memory consumption successfully evaluated— promote to PDAM/2— output: add'l BSDL extensions to "Text of ISO/IEC PDAM/2 Dynamic and Distributed

Adaptation"

m12614: Timmerer et.al., Editor's input on DIA AMD/2: DIA Extensions WD v1.0— only ISO template applied and should be the basis for DIA PDAM/2— output: "Text of ISO/IEC PDAM/2 Dynamic and Distributed Adaptation"

m12638: Cong Thang et.al., SVC Video Adaptation with MPEG-21 DIA AdaptationQoS— add'l AdaptationQoS classification scheme terms covering the semantics required for

SVC-based adaptation— operations: spatial layers, temporal levels, and quality reduction— temporal levels vs. frame dropping:— spatial layers vs. spatial size reduction:— quality reduction vs. ???:— output:

o update the TuC with the proposed new AQoS termso CE to further investigate the usefulness of SVC adaptation operators

relationship with existing terms value range for 'quality reduction': percentage and priority ids

The reference software plan will be updated.

90

Editing of CD significantly progressedTuC – ECMAScript to define fn behaviour, simple fragmentation, timestamp formatsRequest for Part

IPMP Components

12525 Eva Rodriguez Jaime Delgado Integrity and authenticity of Event Reporting information

Input:

Looks at integrating IPMP into ERs such that integrity and authenticity of ERs can be maintained/ascertained.

Actions:

A CE/AHG Mandate for input to the next meeting. ER will remain ‘clear’ - an amendment will deal with ‘secure’ and protected ERs etc.

The Draft Disposition of Comments for IPMP Components based on National Body/ISO Comments were presented.

MDS received a presentation from Fillippo Chiariglione of the DMP on the usage made by DMP of the IPMP Components.

Joint meeting with MPEG-7 Video

Discussions on the complexity of the descriptors that need to be used in the PhotoPlayer MAF. The MDS group will ask two members to look at producing an appropriate schema for the MAF and will attend MPEG-7 video on Thursday at 2pm. This resulted in a successful outcome in terms of the ability to restrict the MDS schema to meet the requirements of MPEG7 video in their MAF.

NISO Liaison

Proposes using InfoURI for DI Identifiers. Resolution from MDS requesting DII RA to carefully review the solution and to act expeditiously to implement a scheme – the proposed solution appears to be the fastest route to success.

Thursday

RDD BoG report

► To represent “Work” the addition is suggested of “ConceptualWork” or some other Term as subclass of Concept or perhaps Abstraction

► This needs to be determined during the proposed AhG

► The following two suggested additions were both in the current PDAM.

► “SourceOfManifestation” as subclass of Source

91

► “IsManifestIn/IsSourceofManifestation” with “SourceOfManifestation” as domain and DerivedManifestation as range

► A new verb might be required, for instance a new subclass of Express called Manifest ► An AhG is recommended to progress this work before the 75th meeting

REL BoG report

92

3.0 MDS Output Documents and Resolutions – Nice 74th Meeting

The MDS subgroup notes that a number of suggestions are being made for the simplification and focusing of MDS MPEG-21 and MPEG-7 schemas. As such, MDS invites inputs from interested parties on technical issues and possible solutions regarding schema subsets. Parties are also referred to N6827 MPEG-7 Part 9 Profiles and Levels for existing information on subset derivation.

MPEG-21

The MDS subgroup notes that the MPEG-21 DID 2nd edition schema is freely available on the ITTF WWW site at http://standards.iso.org/ittf/PubliclyAvailableStandards/c041112_ISO_IEC_21000-2_2005(E).zip

The MDS subgroup notes that CISAC are the RA appointed for DII and that the RA is not fully operational at this point in time. The ‘info’ URI Scheme has been drawn to our attention and we would recommend strongly that CISAC investigate the options afforded by that scheme.

The MDS subgroup recommends approval of the following documents:

No. Title TBP Available21000-4 MPEG-21 IPMP Components

7660 Disposition of Comments on ISO/IEC 21000-4 IPMP Components FCD No 05/10/21

7661 Supporting Text to Disposition of Comments on ISO/IEC 21000-4 IPMP Components FCD

No 05/10/21

93

7717 Text of ISO/IEC 21000-4 IPMP Components FDIS No 05/11/25

The MDS subgroup thanks the National Bodies of Australia, France, and Japan for their comments on ISO/IEC 21000-4 FCD.

The MDS subgroup recommends approval of the following documents:

No. Title TBP Available21000-5 MPEG-21 Rights Expression Language

7718 Study of PDAM/1 MPEG-21 REL Profiles No 05/11/217719 REL AMD/1 Reference Software Plan No 05/10/21

The MDS subgroup recommends approval of the following documents:

No. Title TBP Available21000-6 MPEG-21 Rights Data Dictionary

7720 Working Draft of COR/2 of ISO/IEC 21000-6 No 05/10/21

The MDS sub-group invites proponents of MAFs which are intending to use tools from ISO/IEC 21000-5 REL and ISO/IEC 21000-6 RDD to present and discuss their requirements for these technologies with subject experts in MDS. MDS will endeavour to schedule such meetings within the subgroup agenda.

The MDS subgroup recommends approval of the following documents:

No. Title TBP Available21000-7 MPEG-21 Digital Item Adaptation

7722 DoC on ISO/IEC 21000-7 FPDAM/1 Conversions and Permissions No 05/10/217723 Text of ISO/IEC 21000-7 FDAM/1 Conversions and Permissions No 05/10/217724 Request for Amendment 2 of ISO/IEC 21000-7 DIA7725 TuC for DIA AMD/2 No 05/10/217726 ISO/IEC 21000-7 PDAM/2 Dynamic and Distributed Adaptation No 05/11/117727 DIA Reference Software Status and Workplan No 05/10/217728 Workplan for CE on DIA Extensions for BSD based Adaptation No 05/10/217729 Workplan for CE on SVC and AdaptationQoS No 05/10/217730 Workplan for CE on BSDL Extensions No 05/10/21

The MDS subgroup thanks the National Bodies of Austria and the USA for their NB comments on ISO/IEC 21000-7 FPDAM/1.

The MDS subgroup recommends approval of the following documents:

No. Title TBP Available21000-8 MPEG-21 Reference Software

7731 Working Draft of Amendment for 21000-8 05/10/21

94

The MDS subgroup recommends approval of the following documents:

No. Title TBP Available21000-10 MPEG-21 Digital Item Processing

7732 Preliminary disposition of preliminary comments for ISO/IEC 21000-10 PDAM/1

No 05/10/21

7733 Study of PDAM/1 of ISO/IEC21000-10 DIP: Additional C++ Bindings No 05/10/21

The MDS subgroup requests that if at all possible National Bodies take into consideration the Study of PDAM/1 of ISO/IEC 21000-10 (N7733) when making NB comments on the PDAM.

The MDS and Integration subgroups recommend approval of the following documents:

No. Title TBP Available21000-14 MPEG-21 Conformance Testing

7721 Preliminary Disposition of Comments on ISO/IEC 21000-14 CD No 05/10/217749 Study of CD of ISO/IEC 21000-14 No 05/11/21

The MDS subgroup recommends approval of the following documents:

No. Title TBP Available21000-15 MPEG-21 Event Reporting

7734 Preliminary DoC of preliminary comments on ISO/IEC 21000-15 FCD No 05/10/217735 Study of FCD of ISO/IEC 21000-15 MPEG-21 ER No 05/11/04

The MDS subgroup requests that if at all possible National Bodies take into consideration the Study of FCD of ISO/IEC 21000-15 (N7735) when making NB comments on the FCD.

The MDS subgroup reminds proponents of technology included in the ISO/IEC 21000-15 FCD of the need for Reference Software to be submitted at the 75th MPEG meeting.

The MDS subgroup recommends approval of the following documents:

No. Title TBP Available21000-17 MPEG-21 Fragment Identification of MPEG Resources

7736 Preliminary DoC of Preliminary Comments on ISO/IEC 21000-17 FCD MPEG-21 Fragment Identification of MPEG Resources

No 05/10/21

7737 Study of ISO/IEC 21000-17 FCD MPEG-21 Fragment Identification of MPEG Resources

Yes 05/11/11

95

The MDS subgroup requests that if at all possible National Bodies take into consideration the Study of FCD of ISO/IEC 21000-17 (N7737) when making NB comments on the FCD.

The MDS subgroup reminds proponents of technology included in the ISO/IEC 21000-17 FCD of the need for Reference Software to be submitted at the 75th MPEG meeting.

No. Title TBP Available21000-18 MPEG-21 Digital Item Streaming

7738 Request for subdivision of ISO/IEC 21000-18 MPEG-21 DI Streaming 05/10/217739 ISO/IEC 21000-18 CD MPEG-21 DI Streaming 05/11/187740 TuC for ISO/IEC 21000-18 MPEG-21 DI Streaming 05/10/217741 Reference Software Workplan for DI Streaming 05/10/21

7742 AhG on DII amendmentMandate: 1. Review comments received on ballot for DII PDAM 1

2. Review comments received on ballot for RDD PDAM 13. Make recommendations towards FPDAM texts

Chair: Niels Rump (niels (dot) rump (at) Rightscom (dot) com)Duration: Until 75th meeting Meetings No meeting. All business will be conducted by E-mail and/or telephone/web

conference Reflector: mpeg-21-list@imec.be message titles prefixed [DII] Subscribe: To subscribe, send an email to owner-mpeg-21-list@imec.be

7743 AhG on Development of RDD Corrigendum/2Mandate: 1. Determine semantics required to define “Work” and propose for inclusion

in RDD as necessary2. Develop and add semantics to improve consistency of RDD based on WD

of Corrigendum/23. Draft text for RDD Draft Corrigendum/24. Start development of OWL utility software

Chair: Chris Barlas [chris.barlas- at- rightscom.com]Duration: Until 75th meeting Meetings Business will be conducted using email

An AHG meeting may be held on the Sunday before the 75th meetingReflector: mpeg-21-at-listserv.imec.be messages to use the prefix [RDD]Subscribe: Apply at http://listserv.imec.be/mailman/listinfo/mpeg-21

7744 17.1.1 AHG on MPEG-21 DIPMandate: 1. Carry out further study of DIP PDAM 1. Specific issues to be considered are

a. Format for array parameters.b. Normative reference to only the W3C DOM API (not Xerces-C).

2. Develop test DIDs and text for DIP conformance.Chairs: Frederik De Keukaleare (Frederik.DeKeukelaere at ugent.be)

Gerrard Drury (gerrard at enikos.com)

96

Duration: Until the 75th MeetingMeetings: AhG Meeting to be held on the Sunday prior to 75th meeting.

Other business to be conducted by email or phone.Reflector: mpeg-21-dip at uow.edu.auSubscribe: Follow procedure at http://mailinglists.uow.edu.au/mailman/listinfo/mpeg-21-dip

7745 17.1.2 AHG on MPEG-21 DIAMandate: 1. Carry out Core Experiments on DIA and provide recommendations to

the MDS subgroup.2. Produce an editors' input on the text of ISO/IEC 21000-7 PDAM/2.3. Maintain the MPEG-21 DIA TuC document.4. Investigate the relationship between UCD and AQoS with regards to

multi-value IOPins.5. Produce conformance stream for ISO/IEC 21000-7 FDAM/1.6. Maintain the DIA reference software status and work plan.

Chair: Christian Timmerer (christian.timmerer_at_itec.uni-klu.ac.at)Duration: Until the 75th meeting.Meetings: AHG meeting will be held on the weekend prior to 75th meeting. Other

business will be conducted by e-mail or telephone conference.Reflector: mpeg21-uma_at_merl.comSubscribe: To subscribe send email to avetro_at_merl.com (Anthony Vetro).

7746 17.1.3 AHG on MPEG-21 Event ReportingMandate: 1. Validate the use of IPMP DI's for integrity and encryption of ER-R's and ER's.

Compare this with using Digital Signatures and explicit encryption.2. Continue to develop the Event Reporting reference software based upon the

Study of FCD.3. Further develop Study of FCD as necessary.

Chairs: Andrew Tokmakoff (tokmakoff at telin.nl)FX Nuttall (fx at nuttall.org)

Duration: Until the 75th MeetingMeetings: A pre-meeting will be held on the weekend before the 75th meeting.

Other business will be conducted by E-mail or telephone conference.Reflector: mpeg-21-event-reporting@lists.telin.nl Subscribe: See http://lists.telin.nl/mailman/listinfo/mpeg-21-event-reporting

7747 17.1.4 AHG on MPEG-21 Fragment IdentifiersMandates 1. Produce the Study of FCD for 21000-17

2. Investigate Logical Models for MP3 and SAF3. Investigate ways of constraining the types of sub-Logical Units

through the grammar.4. Refine the syntax for addressing travelling mattes5. Investigate existing solutions for addressing a bitstream within

an MPEG-2 TS6. Discuss terminology related to Logical Models

Chair Myriam Amielh (myriam.amielh@cisra.canon.com.au)Co Chairs Sylvain Devillers (sdevillers.ext@rd.francetelecom.com)Duration Until the 75th Meeting

97

Meetings Pre-meeting to be held in Bangkok prior to the 75th meetingReflector mpeg-21@listserv.imec.be

Please use the prefix [FID]Subscribe Send email to owner-mpeg-21-list@imec.be

7748 AHG on Digital Item StreamingMandates: 1. Revise the requirements and use cases for DIS

2. Investigate the relevance of existing technologies from MPEG and elsewhere for unfulfilled requirements

3. Clarify the relationship between DIStreaming and DIA and draft appropriate text

Chairs: Ingo Wolf (WolfI_at_t-systems.com)Joseph Thomas-Kerr (joetk_at_elec.uow.edu.au)Sylvain Devillers (sdevillers.ext_at_rd.francetelecom.com)

Duration: Until 75th meetingMeetings: Week-end before the 75th meeting.Reflector: mpeg-21@xlistserv.imec.be messages to use the prefix [DIS] – remove x

from email addressSubscribe: Apply at http://listserv.imec.be/mailman/listinfo/mpeg-21 

98

4.0 MDS Final Schedule – Nice 74th Meeting

MDS Sub-Group Schedule

  MPEG MDS Chair: Ian S Burnett    

  MPEG-7 and MPEG-21 v.11.0    

Number Source Title STD NOTES

         Monday Morning (9h00-13h00)        MPEG Plenary   Plenary room    

         Monday Afternoon (14h00-20h00)        

         Kick-off of MPEG MDS activities (14h00-14h30)   MDS Room Gallieni 3   ISB

 

Agenda, Goals and Issues for the Week for MDS Group Ian S Burnett    

         Review of AHG resolutions, CE results and action points (14h30-15h45)   MDS Room Gallieni 3 ALL ISB

12444Gerrard Drury De Keukaleare AHG on MPEG-21 DIP    

12445 Christian Timmerer AHG on MPEG-21 DIA    12446 FX Nuttall Tokmakoff AHG on MPEG-21 Event Reporting    12447 Simon Watt AHG on MPEG-21 IPMP Components    

12448

Sylvain Devillers Joseph Thomas-Kerr Ingo Wolf AHG on Digital Item Streaming    

                  

Define BoGs and Mandates (15h45-16h00)   MDS Room Gallieni 3 ALL ISB  IPMP Components Risso 6C    

 

DIA - FDAM/1 & DoC, Ref s/w update, DIA AMD/2 tools & name 4pm-6pm Risso 6C    

 DIP - 10-10.30 Tuesday Risso 6C    

 ER - Tuesday pm 2pm -5pm Risso 6C    

  RDD Risso 6C    

 DIS - prepare CD text, Tuesday pm onwards Gallieni 4    

 

REL - study of PDAM, Ref s/w plan, Tuesday pm 5pm-6pm, Wednesday 2pm-5pm Gallieni 4, Risso 6C    

         MPEG-21 IPMP Components (16h00 - 16h30)   MDS Room Gallieni 3 MPEG-21  

            MPEG-21 RDD (16h30 - 18h00)   MDS Room Gallieni 3 MPEG-21  

         

12511

Marc Gauvin Jaime Delgado Eva Rodriguez Roberto García González

Preliminary Results of RDD CE for Expressing “Work”    

12578 Chris BarlasReviewer's Comment on CE on RDD Abstraction and Resource    

12649 Simon Watt Review comments on CE on RDD Abstraction and Resource    

12664 Xin Wang Reviewer comments on CE on RDD Abstraction and Resource    

         

12495Roberto García Jaime Delgado Eva Rodríguez

Ontological Analysis of the MPEG-21 Rights Data Dictionary (RDD)    

                  

Tuesday Morning (9h00-13h00)                 M3W with IPMP Components (09h00 - 10h00)   SYSTEMS MPEG-21           MPEG-21 FRUs + DIAC (09h00 - 09h45)   REQTS Gallieni 6 MPEG-21  

12425 Joseph Thomas-Kerr AHG on XML Fragment Requests    

12670Peder Drege Thomas Skjølberg Runar Solberg

Request for clarification regarding DIAC and adaptation decision process    

   

100

MPEG-21 DI Streaming (09h45 - 10h45)   REQTS/SYSTEMS Gallieni 6 MPEG-21  

12644Peder Drege Thomas Skjølberg Runar Solberg Comments on Digital Item Streaming    

12677

Joseph Thomas-Kerr Ian Burnett Gabriel Fernàndez Alejandro López González

Report of Core Experiment on DI mapping to delivery channels    

12567 Niels Rump Review of CE on DI Mapping to Delivery Channels    

12678Joseph Thomas-Kerr Ian Burnett

Technologies Required for Digital Item Streaming    

12632

Christian Timmerer Hermann Hellwagner Andreas Hutter Jörg Heuer

Buffer Configuration Information for Digital Item Streaming: State of the Art and Examples    

         

12701

Michael Ransburg Sylvain Devillers Joe Thomas-Kerr Christian Timmerer

Report of Core Experiment on Fragmentation for DI Streaming    

      

MPEG-21 Profiles (10h45 - 12h00)   REQTS Gallieni 6 MPEG-21  

12523Jaime Delgado Jose Prados Eva Rodriguez Preliminary comments on REL profiles    

12524Jaime Delgado Eva Rodriguez Jose Prados

Comments on MPEG-21 REL Base Profile    

12692

Weongeun Oh Yeonjeong Jeong Taehyun Kim Hogab Kang

Comment on MPEG-21 base profile extension    

12500 Octavian FoleaContent protection extension for MPEG-21 REL    

12676 Xin Wang Editors' Input on Study of ISO/IEC 21000-5/PDAM1    

         MPEG-21 FID (12h00 - 12h30)   MDS Room Gallieni 3 MPEG-21  

12544 Myriam Amielh Ernest Wan Preliminary comments on ISO/IEC 21000-17 FCD (FID)    

MPEG-21 RDD Issues (12h30 - 13h00)   MDS Room Gallieni 3 MPEG-21  

12494Melanie Dulong de Rosnay

Contribution to AhG on MPEG-21 RDD    

101

         Tuesday Afternoon (14h00-20h00)        

         MAF The Big Session (14h00 - 18h00)   REQTS/SYSTEMS Gallieni 6 MPEG-21  

12423Klaus Diepold Wo Chang Harald Fuchs AHG on MAFs    

         MAF The Big Session (14h00 - 18h00)   REQTS/SYSTEMS Gallieni 6 MPEG-21  

12672

Stefan Kraegeloh on behalf of German National Body GNB comments on MAF    

12527A. G. Tescher for USNB

USNB Contribution: Regarding “MAFs under Consideration”    

                  

12674Stefan Kraegeloh Harald Fuchs

MAF Interoperability: Mandatory Tools vs. Default Signalling    

12673Stefan Kraegeloh Harald Fuchs

proposed revised text on 'Protected Music Player' MAF described in MAFs under Consideration    

12588Hendry Munchurl Kim Florian Pestoni

A Flexible and Extensible Protection of Music Player MAF using Lightweight MPEG-21 IPMP    

12646

Harald Fuchs Stefan Kraegeloh The TIRAMISU Project Proposed Bundled License MAF    

                  MAF The Big Session (14h00 - 18h00)   REQTS/SYSTEMS Gallieni 6 MPEG-21  

12662Harald Fuchs Stefan Kraegeloh

Proposed Corrigenda Items for ISO/IEC 23000-2 Music Player MAF    

12589Chansuk Yang Jeongyeon Lim Munchurl Kim

Extensions to Music MAF Player Format for Multiple JPEG images and Text data with Synchronizations to MP3 data    

12534 Tae Hyeon Kim H. Jean Cha Proposal of new scenarios and requirements for an Accompaniment    

102

Music Player MAF

12645Harald Fuchs Herbert Thoma Stefan Kraegeloh Proposed Portable Video Player MAF    

12647 Harald Fuchs Herbert Thoma Proposed Slideshow MAF    

12684 Diepold Considering a MAF for Surveillance Video    

                  Wednesday Morning (09h00-13h00)                 

MPEG Plenary (9h00-11h00)   Plenary roomMPEG Plenary  

         MPEG-21 DIP (11h30 - 12h00)   MDS Room Gallieni 3 MPEG-21  

12486 Gerrard Drury Ian S. Burnett Preliminary comments on ISO/IEC 21000-10 PDAM/1    

12597Saar De Zutter Frederik De Keukelaere Rik Van de Walle Editors input on 21000-10 PDAM1    

12601Frederik De Keukelaere Saar De Zutter Rik Van de Walle

Contribution to DIP reference software - update to FDIS status    

   MPEG-21 DIA (12h00 - 12h30)   MDS Room Gallieni 3 MPEG-21  

12650

Sylvain Devillers Michael Ransburg Christian Timmerer Hermann Hellwagner Alexandre Cotarmanac'h

Updates on Media and XML Streaming Instructions    

         MPEG-21 ER (12h30 - 13h00)   MDS Room Gallieni 3 MPEG-21           

12538 Kyunghee Ji Jungwon Kang Preliminary comments on 21000-15 FCD    

         Wednesday Afternoon (14h00-17h45)        

   Joint with JVT (14h00 - 14h30)   MDS Room Gallieni 3 MPEG-21  

12638

Truong Cong Thang Jung Won Kang Youngsuk Kim Yong Man Ro Jae-Gon Kim

SVC Video Adaptation with MPEG-21 DIA AdaptationQoS    

103

         MPEG-21 DIA (14h30 - 16h00)   MDS Room Gallieni 3 MPEG-21  

12499 Christian Timmerer Editor's input on ISO/IEC 21000-7 FPDAM/1    

12579

Christian Timmerer on behalf of the Austrian NB

Austrian NB comments on 21000-7 FPDAM/1    

12583

Christian Timmerer Benoit Pellan Truong Cong Thang

MPEG-21 DIA AMD/1 reference software status    

12614Christian Timmerer on behalf the editors

Editor's input on DIA AMD/2: DIA Extensions WD v1.0    

                  

12568

Michael Zufferey Eric Delfosse Christian Timmerer Harald Kosch

Report on CE Proposed DIA extensions: Multiple input/output values for AdaptationQoS IOPins and MPEG-7 as BSDLink steering description    

12611Davy De Schrijver Robbie De Sutter Rik Van de Walle

Report on Core Experiment on BSDL extensions    

   MPEG-21 IPMP Components (16h00 - 17h00)   MDS Room Gallieni 3 MPEG-21  

12525Eva Rodriguez Jaime Delgado

Integrity and authenticity of Event Reporting information    

MPEG-7 Issues with complexity of Ds DSs for Photo Player MAF (17h00 - 17h30)   MDS Room Gallieni 3             MPEG-21 DII NISO Liaison (17h30 - 18h00)   MDS Room Gallieni 3 MPEG-21  MPEG Social Event (17h45 - midnight)                 Thursday Morning (09h00-12h30)                          

MAFBreak out on MAFs Report (12h00-13h00) REQTS    

Thursday Afternoon (14h00-19h00)        MPEG-21 RDD/REL Issues MDS Room Gallieni 3 MDS  

104

(14h00 - 15h00) Plenary

MPEG-21 DIS Issues (15h00 - 16h00) MDS Room Gallieni 3

MDS Plenary  

MPEG-21 FID/DII Issues (16h00 - 16h30) MDS Room Gallieni 3

MDS Plenary  

MPEG-21 DID Comments (09h00 - 10h00)ER/DIA Issues (16h30 - 17h00) MDS Room Gallieni 3

MDS Plenary  

Plenary MDS and Reports of BoG (16h00 - 17h00)   MDS Room Gallieni 3MDS Plenary  

Review of Output documents, AHGs, CEs, DoC, Std (17h00- 18h00+++)   MDS Room Gallieni 3             Friday Morning (09h00-13h00)        

Wrapping up (09h00 - 13h00)   MDS Room Gallieni 3MDS Plenary  

 

Approval of resolutions, AHGs and Output documents      

         Friday Afternoon (14h00-21h00)        

MPEG Plenary   Plenary roomMPEG Plenary  

Contact: Ian S Burnett        x        

105

Annex 8Report of Video and JVT

Source: Jens-Rainer Ohm, Gary Sullivan (Video), Miroslaw Bober (MPEG-7 Visual)

1 IDCT in MPEG Standards

Several refinements of the text of the 11172-6 FCD and the study text N7292 were proposed in M12679 and were reviewed. The contribution requests some minor clarifications as compared to the previous study document. All of these points are planned to be integrated in the ISO/IEC 23002-1 FDIS by the time of the January 2006 meeting, and a new study text was issued.

The editing process of 11172-4 DCOR1, 13818-4:2004 DCOR1, 14496-2:2004 DCOR2 and 14496-4:2004 DCOR2 has incurred some delays. Therefore, it will only be possible to issue the COR texts by the April 2006 meeting (delay by one meeting).

Document reviewed:

12679 Gary J. SullivanRemarks on 23002-1 / 11172-6 Study of FCD on Accuracy requirements for implementation of integer-output 8x8 inverse discrete cosine transform

Output documents:No. Title TBP Available

11172-6 MPEG-1 Implementation of IDCT 7546 Study of ISO/IEC 11172-6 FCD Yes 05/10/28

2 Support for Colour Spaces in 13818-2 and 14496-2

It was identified in the study work of an AHG and through contributions and discussions of this meeting and previous meetings that wide-gamut colour space are important for new types of displays. Such colour spaces are existing in ITU-R BT.1361, and now appear as well in draft IEC 61966 which is just about in the final phase of the IEC approval process, to be published soon as an approved standard. Therefore, amendments were started to support such colour spaces by the colour table definitions in 13818-2, 14496-2 and 14496-10. In the same context, small alignments will be made to define fully identical colour tables in all of the three standards. Different from the strategy eventually foreseen by the 73rd MPEG meeting report, providing this common definition within a new part of 23002 (MPEG-C), it was decided to keep separate colour tables within all three of the standards. This conclusion was made because the AVC standard until now was by purpose designed without normative external references, and it appeared not to be adequate breaking this rule for such a minor issue.

Documents reviewed (Jointly with Requirements):12680 Teruhiko Suzuki Proposal to support IEC 61966-2-4 in MPEG standards

12681

Teruhiko SuzukiNaoya KatohYoshihide SimpukuHiroaki Sugiura

Proposal to support new colour space in IEC TC100

Output documents:No. Title TBP Available

13818-2 MPEG-2 Video7547 Request for 13818-2:2000 Amd.2 No 05/10/217548 Text of ISO/IEC 13818-2:2000 PDAM2 Support for Colour Spaces No 05/11/037549 Request for 14496-2:2004 Amd.3 No 05/10/217550 Text of ISO/IEC 14496-2:2004 PDAM3 Support for Colour Spaces No 05/11/03

3 JVT Report

The Joint Video Team (JVT) of ITU-T Q.6/16 and ISO/IEC JTC 1/SC 29/WG 11 held its 17th meeting during 14-21 October 2005 in Nice, France. The JVT meeting was held under the chairmanship of Dr. Gary Sullivan (Microsoft/USA) and Dr Jens-Rainer Ohm (RWTH Aachen/Germany), and under the associate chairmanship of Dr. Thomas Wiegand (Fraunhofer HHI/Germany) and Dr. Ajay Luthra (Motorola/USA). The JVT meetings opened at approximately 9:30 on Friday October 14 2005 and closed at 13:35 on Friday 21 October 2005. Approximately 148 people attended the JVT meetings (as recorded on a sign-in sheet passed at the meeting) and approximately 93 input documents were discussed. The meetings took place in a co-located fashion with a meeting of ISO/IEC JTC 1/SC 29/WG 11 (MPEG). The subject matter of these activities consisted of work on video coding.

3.1 JVT Input documentsJVT-Q000 List of documents of Nice meetingJVT-Q001 [G.J. Sullivan, J.-R. Ohm, A. Luthra, T. Wiegand] AHG Report: Proj mgmt and errataJVT-Q002 [T. Wiegand, K. Suehring, A. Tourapis, K.P. Lim] AHG Report: JM text and ref softJVT-Q003 [T. Suzuki, L. Winger] AHG Report: Bitstreams & conformanceJVT-Q004 [Withdrawn] WithdrawnJVT-Q005 [G. Cook] AHG Report: JSVM s/W and new func. integ.JVT-Q006 [J. Reichel, H. Schwarz, M. Wien] AHG Report: JSVM & WD textJVT-Q007 [G. Sullivan] AHG Report: Spatial scalability resamplingJVT-Q008 [Y.-K. Wang] AHG Report: Err resil test cond's & appsJVT-Q009 [M. Wien, H. Schwarz] AHG Report: Coding eff & JSVM perf test condJVT-Q010 [T. Suzuki] AHG Report: Study of 4:4:4 functionalityJVT-Q011 [L. Xiong] AHG Report: Enh. slice complexity reductionJVT-Q012 [G.J. Sullivan, J.-R. Ohm, A. Luthra, T. Wiegand] Meeting report of Poznan meetingJVT-Q013 [E. Francois, J. Vieron, V. Bottreau] Additional results on SVC ESS evaluationJVT-Q014 [J. Vieron, E. Francois, V. Bottreau] Additional test conds for SVC ESS JSVM Perf

EvalJVT-Q015 [E. Francois, J. Vieron, V. Bottreau] General. SVC ESS for inter-layer ratios >2JVT-Q016 [Withdrawn] WithdrawnJVT-Q017 [Z. Lu, Z. Li, S. Rahardja, X. Lin, K.P. Lim, W. Lin, J. Zheng, W. Yao] High-level

syntax for SVC ROIJVT-Q018-L [Z. Lu, Z. Li, S. Rahardja, X. Lin, K.P. Lim, W. Lin, J. Zheng, W. Yao] Progress

report SVC CE4: ROIJVT-Q019 [P. Bordes, E. Francois] SEI for logo insertionJVT-Q020 [D. Ichimura, Y. Honda, M.H. Lee] Slice group map for mult. interactive ROI scal.JVT-Q021 [D. Ichimura, Y. Honda, M.H. Lee] Stream struct and CABAC for mult. inter. ROI

scal. JVT-Q022 [J. Reichel, X. Ziliani, P. Amon, X. Boltz, U. Benzler] Surveillance profile for SVC JVT-Q023 [T. Suzuki] Some COR issues JVT-Q024 [T. Suzuki] Verif. of new 4:4:4 tools JVT-Q025-L [E. Setton, B. Girod] R-D analysis and streaming of SP and SI frames JVT-Q026 [M. Visharam] Study of effect of MCTF update step

107

JVT-Q027 [J. Xin, A. Vetro, H. Sun] Verif. of 4:4:4 in JVT-P017 JVT-Q028 [P. Yin, J. Boyce, P. Pandit] High-level SVC Syntax JVT-Q029 [P. Yin, J. Boyce, P. Pandit] FMO and ROI scalability JVT-Q030 [H. Schwarz, D. Marpe, T. Wiegand] Closed loop coding with quality layers JVT-Q031 [M. Winken, H. Schwarz, D. Marpe, T. Wiegand] Adapt. motion refinement for FGS

slices JVT-Q032 [S. Sekiguchi, Y. Isu, Y. Yamada, K. Asai, T. Murakami] Improved entropy coding

for intra pred. modesJVT-Q033 [Y. Isu, S. Sekiguchi, Y. Yamada, K. Asai, T. Murakami] Verif. on existing Adv.

4:4:4 proposalsJVT-Q034 [I.H. Shin and H.W. Park] CE3: Adapt. upsampling JVT-Q035 [Y.L. Lee] Complexity of prop. lossless intra for 4:4:4 JVT-Q036 [D. Hench, P. Topiwala] Joint source-channel encoding JVT-Q037 [P. Topiwala] Prop. 14-b sample support in Adv. 4:4:4 Pr JVT-Q038 [S. Sun] New results on direct interp. for upsamp. in ESS JVT-Q039-L [Y. Bao, M. Karczewicz] CE7: FGS for low delay JVT-Q040-L [J. Ridge, M. Karczewicz] CE8: VLCs for SVC JVT-Q041 [Withdrawn] WithdrawnJVT-Q042-L [A. Tourapis] Updates to reference software manualJVT-Q043 [K.H. Lee] CE2: Revision of interlayer mot pred & TDMJVT-Q044 [Withdrawn] WithdrawnJVT-Q045 [K.H. Lee] CE3: Verif. of NEC JVT-Q048-LJVT-Q046 [Y. Chen, J. Boyce, K. Xie] SVC frame loss concealmentJVT-Q047-L [T. Kimoto] CE2: Verif.JVT-Q048-L [T. Kimoto, Y. Miyamoto] CE3: Unrestricted temporal decomposition in SVCJVT-Q049 [L. Xiong] Enh. layer intra pred using lower layerJVT-Q050 [L. Xiong] Enh. layer intra pred modesJVT-Q051 [L. Xiong] Spatial upsampling filterJVT-Q052-L [L. Xiong] Adaptive intra slice codingJVT-Q053 [J. Jia, H.K. Kim, H.C. Choi, J.G. Kim] CE3: Polyphase downsample bef DCT for

SVC FGSJVT-Q054 [J. Jia, H.K. Kim, H.C. Choi, J.G. Kim] Implementation of redundant pictures in

JSVMJVT-Q055 [J. Jia, H.K. Kim, H.C. Choi, J.G. Kim] Polyphase downsample-based redundant picsJVT-Q056 [J. Jia, H.K. Kim, H.C. Choi, J.G. Kim] CE5: Verif of Tool5 resultsJVT-Q057 [B.K. Lee] VLC for 8x8 transform FGSJVT-Q058-L [W.-S. Kim, D. Cho, D. Birinov, H.M. Kim] Verif and analysis of JVT-P017 on

4:4:4 profileJVT-Q059-L [W.-S. Kim, D. Cho, D. Birinov, H.M. Kim] Advanced residual color transformJVT-Q060 [I.H. Shin, H.W. Park] CE3: Verif of Sejong/JVT-Q053JVT-Q061-N [I.H. Shin, H.W. Park] CE3: Verif of Samsung/JVT-Q062 JVT-Q062 [S.-Y. Kim] CE3: Smoothed reference prediction JVT-Q063 [W.-J. Han] CE5: Distribution-based dequant for SVC JVT-Q064 [Y.-K. Wang, M.M. Hannuksela, S. Wenger] SVC DPB management JVT-Q065 [Y.-K. Wang, M.M. Hannuksela] Enhancement-layer IDR picture ("EIDR") JVT-Q066 [Q. Shen, H. Li, Y.-K. Wang] Showcase of non-required picture SEI messageJVT-Q067 [H. Liu, H. Li, Y.-K. Wang] Showcase of scalability information SEI messageJVT-Q068 [Withdrawn] WithdrawnJVT-Q069 [Y. Guo, H. Li, Y.-K. Wang] SVC/AVC loss simulator donationJVT-Q070 [Y.-K. Wang, S. Wenger] SVC RTP payload format internet draftJVT-Q071-L [J.-H. Park, S.-W. Park, B.-M. Jeon] Context modeling of residual prediction flagJVT-Q072-L [J.-H. Park, S.-W. Park, B.-M. Jeon] Inter-layer pred for temporally enh picturesJVT-Q073-L [J.-H. Park, S.-W. Park, B.-M. Jeon] Modified temporal direct mode for SVC

108

JVT-Q074 [Withdrawn] WithdrawnJVT-Q075 [T.C. Thang, T.M. Bae, J.W. Kang, Y.M. Ro, J.-G. Kim] Improved scalability info

SEI messageJVT-Q076 [T.C. Thang, T.M. Bae, J.W. Kang, Y.M. Ro, J.-G. Kim] Boundary handling for ROI

scalabilityJVT-Q077 [T.C. Thang, T.M. Bae, J.W. Kang, Y.M. Ro, J.-G. Kim] Showcase of ROI extraction

using scal info SEIJVT-Q078 [C.-X. Zhang, L. Yu, L. Xiong] Simplification of upsampling for IntraBL mode JVT-Q079-L [A. Tourapis, P. Topiwala] Sub-pel ME for enh. predictive zonal searchJVT-Q080 [Z. Heng] R-D function of H.264/AVC transf. coeffs.JVT-Q081-L [I. Amonou, N. Cammas, S. Kervadec, S. Pateux] Layered quality opt. of JSVM-3 &

closed-loopJVT-Q082 [Withdrawn] WithdrawnJVT-Q083 [A. Segall ] Up-/Down-sampling for Spatial SVCJVT-Q084 [Y. Libo, C. Ying, Z. Jiefu, Z. Feng] Low complexity intra pred for enh layerJVT-Q085-N [J.-Z. Xu] CE7: Core experiment 7 proposalJVT-Q086 [T. Wedi] Intra-only 4:4:4 profileJVT-Q087-L [F. Pauchet] Prop SVC bit error resilience test condsJVT-Q088-L [X. Xu, Y. He] Dynamic search range for ME in JMJVT-Q089-L [X. Xu, Y. He] Comments on ME in current JM softwareJVT-Q090 [P. Topiwala, H. Yu] New Viper HD test sequencesJVT-Q091 [S. Jeong, M. Park, G. Park, K Kim, J. Hong] Numbering of Key picturesJVT-Q092-N [Z. Wu, Y. He] Verif Adv 4:4:4 profileJVT-Q093-N [W. Choi, J. Yang, B. Jeon] CE5: Verif Samsung/JVT-Q063JVT-Q094-N / M12498 [J.T. Hwang, Y. Cho, J.-G. Kim] Extracting SVC streams in non-

sequential order (registered and provided but not requested for presentation)JVT-Q095-N / M12517 [D.Y. Suh, G.H. Park] High level syntax and "super slices" (registered

and provided as MPEG document but not provided as JVT document and not requested for presentation)

JVT-Q096-N [D. Singer, Y.K. Wang] File format

MPEG documents reviewed (jointly with MPEG Requirements Subgroup):12520 C.J. Lee SGNB Comment on AVC new 4:4:4 profiles 12528 A. G. Tescher for USNB USNB Contribution: New Profiles for AVC

12698 Edouard FRANCOIS on behalf of FNB FNB comment on new High profile in AVC

3.2 Major JVT output documentsBelow are listed the JVT output documents related to AVC as provided to the WG 11 parent bodyNo. Title TBP Available

14496-10 MPEG-4 Advanced Video Coding 7551(WG11 only)

Request for 14496-10:200x Amd.1 No 05/10/21

7552JVT-Q204

Text of ISO/IEC 14496-10:200x PDAM1 Support for Colour Spaces and Aspect Ratios

No 05/11/03

7553JVT-Q208

Text of ISO/IEC 14496-10:200x DCOR2 (Removal of High 4:4:4 profile)

No 05/11/03

7554JVT-Q209

Working Draft 1 of ISO/IEC 14496-10:200x Amd.2 Advanced 4:4:4 Profiles

No 05/11/03

7653JVT-Q206

Joint 4:4:4 Video Model (JFVM) 1 Algorithm Description No 05/11/03

7654 JFVM 1 Software No 05/11/03109

JVT-Q2077555JVT-Q201

Working Draft 4 of ISO/IEC 14496-10:200x Amd.3 Scalable Video Coding

No 05/10/28

7556JVT-Q202

Joint Scalable Video Model (JSVM) 4 No 05/11/18

7557JVT-Q203

JSVM 4 Software No 05/12/19

3.3 JVT internal output documentsBelow are listed the JVT internal output documents other than SVC core experiment descriptions.JVT-Q200 Meeting report of the JVT meeting of 14-21 October 2005 in Nice, France

(this document)JVT-Q205 Testing conditions for SVC coding efficiency proposals and JSVM performance

evaluation [05/11/04](Testing conditions for SVC loss resilience remains as in JVT-P206.)JVT-Q210 Errata list for AVC standard [05/11/11]JVT-Q211 Errata list for AVC conformance [05/10/28]

3.4 SVC core experiment output documents

Below are listed the JVT SVC core experiment description documents.JVT-Q301 [B.-K. Lee (baekeun@gmail.com), et. al] CE1: CAVLC [based on JVT-Q057] (Participants: Samsung, Nokia, Mitsubishi, GE, TI, HHI, Huawei, Zhejiang U., LG, Panasonic, INRIA, SKKU, Siemens) [05/10/21]CE document has been presented.JVT-Q302 [K.-H. Lee (kyohyuk.lee@gmail.com), et al.] CE2: inter-layer motion prediction [based on JVT-Q043, JVT-Q072-L, JVT-Q073-L] (Participants: FT, Nokia, NEC, Huawei, Zhejiang U., HHI, LM) [05/10/21]CE document has been presented.JVT-Q303 [T. Kimoto (t-kimoto@az.jp.nec.com), et. al] CE3: inter-layer texture prediction [based on JVT-Q034, JVT-Q048-L] (Participants: NEC, KAIST, Mitsubishi, RWTH, Nokia, FT, INRIA, Huawei, Zhejiang U., HHI, Microsoft) [05/10/21]CE document has been presented.JVT-Q304 [Z. Lu, et. al] CE4: ROI [based on JVT-Q018-L, JVT-Q020, JVT-Q021, JVT-Q076] (Participants: I2R, Panasonic, ICU, ETRI, Nokia, SKKU, HHI, GE, Bosch) [05/10/21]From meeting notes: Agreement that the functionality necessary for 64-100 ROIs can be achieved using FMO. The efficiency of ROI coding can be discussed and investigated in CE. Behavior at slice boundaries needs to be clarified. Have SEI messages to support ROI functionality realized through FMO.CE document has been presented.JVT-Q305 [W.-J. Han (hurumi@gmail.com), et. al] CE5: quantization [based on JVT-Q063] (Participants: Samsung, FT, Siemens, ETRI, SKKU, Nokia, Panasonic, HHI, RWTH, Microsoft) [05/10/21]CE document has been presented. Availability of test sequences needs to be clarified.JVT-Q306 [Y.-K. Wang (ye-kui.wang@nokia.com), et. al] CE6: high-level syntax [based on JVT-Q064, JVT-Q065] (Participants: Nokia, FT, HHI, Microsoft, Siemens, NEC, LM, GE, Samsung) [05/10/21]CE document has been presented.JVT-Q307 [X. Wang (@nokia.com), et. al] CE7: improved and low-delay FGS [based on JVT-P046, JVT-Q085-N, JVT-Q030] (Participants: HHI, IIR, Microsoft, Nokia, Siemens, NCTU, Freescale, Huawei, RWTH Aachen, LM, Panasonic, NEC, FT, NTT, Apple) [05/10/21]CE document has been presented.

110

3.5 4:4:4 core experiment output documents

Below are listed the JVT 4:4:4 core experiment description documents.JVT-Q308 [W.-S. Kim (hyunmun27.kim@samsung.com), et. al] CE8: RCT [based on JVT-Q059-L] (Participants: Samsung, Sharp, Thomson, Microsoft, HHI) [05/10/21]CE document has been presented.JVT-Q309 [T. Wedi (thomas.wedi@eu.panasonic.com), et. al] CE9: Separate prediction modes for 4:4:4 coding [based on JVT-Q086, JVT-Q032, JVT-Q033] (Participants: Panasonic, Mitsubishi, Thomson, Sony, HHI, Sejong U., Microsoft) [05/10/21]CE document has been presented.

3.6 JVT Administrative topics

3.6.1 Administrative documentsJVT-Q001 [G.J. Sullivan, J.-R. Ohm, A. Luthra, T. Wiegand] AHG Report: Proj mgmt and errataNoted.JVT-Q002 [T. Wiegand, K. Suehring, A. Tourapis, K.P. Lim] AHG Report: JM text and ref softNoted.JVT-Q003 [T. Suzuki, L. Winger] AHG Report: Bitstreams & conformanceProblems reported in some conformance bitstreams. Plan to track of such issues for eventual COR. Reports of new problems discovered since last meeting:Violations of Annex B use of zero_byte.Chroma motion vectors for 4:2:2 (should not have reconstructed picture in specification – rely on software instead)Create an output document to capture full current status of errata on bitstreams.JVT-Q005 [G. Cook] AHG Report: JSVM s/W and new func. integ.AHG report has been noted. SW integration not finished. 4 weeks estimated to be left for the work. Short test set for SW integration. JVT-Q006 [J. Reichel, H. Schwarz, M. Wien] AHG Report: JSVM & WD textAHG report has been noted. JSVM 3 and WD 3 text versions have been apporved.JVT-Q007 [G. Sullivan] AHG Report: Spatial scalability resamplingContinue AHG with mandate to be drafted by Julien and S. Sun.JVT-Q008 [Y.-K. Wang] AHG Report: Err resil test cond's & appsNoted.JVT-Q009 [M. Wien, H. Schwarz] AHG Report: Coding eff & JSVM perf test condAHG report has been noted. Work will continue including scope of providing anchors for CE experiments. Post bit streams on ftp site in compressed form.JVT-Q010 [T. Suzuki] AHG Report: Study of 4:4:4 functionalityAHG report has been noted. SW of JVT-P017 has been distributed. Various proposals submitted.JVT-Q011 [L. Xiong] AHG Report: Enh. slice complexity reductionNoted.JVT-Q012 [G.J. Sullivan, J.-R. Ohm, A. Luthra, T. Wiegand] Meeting report of Poznan meetingNoted.

3.6.2 IPR policy reminderParticipants were reminded of the IPR policies established by the parent organizations of the JVT and were referred to the parent body web sites for further information.

Participants were particularly reminded of the need to supply a completed JVT IPR status reporting form in all technical proposals for normative standardization.

3.6.3 Late contribution documentsNo objections were voiced to the consideration of the late contribution documents. Contribution documents listed in this report in italics and with a "-L" suffix to their document numbers were classified

111

as late. Contribution documents listed in this report in italics and with a "-N" suffix to their document numbers were still not available on the first meeting day, and were agreed only to be considered as information documents at the end of the meeting as time permitted. (Administrative documents, e.g., ad-hoc group reports, are not tracked in this fashion.) The late contribution documents are listed as follows:JVT-Q018-L [Z. Lu, Z. Li, S. Rahardja, X. Lin, K.P. Lim, W. Lin, J. Zheng, W. Yao] Progress report of SVC CE4: ROIJVT-Q025-L [E. Setton, B. Girod] R-D analysis and streaming of SP and SI frames JVT-Q039-L [Y. Bao, M. Karczewicz] CE7: FGS for low delayJVT-Q040-L [J. Ridge, M. Karczewicz] CE8: VLCs for SVC JVT-Q042-L [A. Tourapis] Updates to reference software manualJVT-Q047-L [T. Kimoto] CE2: Verif. JVT-Q048-L [T. Kimoto, Y. Miyamoto] CE3: Unrestricted temporal decomposition in SVCJVT-Q052-L [L. Xiong] Adaptive intra slice codingJVT-Q058-L [W.-S. Kim, D. Cho, D. Birinov, H.M. Kim] Verif and analysis of JVT-P017 on 4:4:4 profileJVT-Q059-L [W.-S. Kim, D. Cho, D. Birinov, H.M. Kim] Advanced residual color transformJVT-Q061-N [I.H. Shin, H.W. Park] CE3: Verif of Samsung/JVT-Q062JVT-Q071-L [J.-H. Park, S.-W. Park, B.-M. Jeon] Context modeling of residual prediction flagJVT-Q072-L [J.-H. Park, S.-W. Park, B.-M. Jeon] Inter-layer pred for temporally enh picturesJVT-Q073-L [J.-H. Park, S.-W. Park, B.-M. Jeon] Modified temporal direct mode for SVCJVT-Q079-L [A. Tourapis, P. Topiwala] Sub-pel ME for enh. predictive zonal searchJVT-Q081-L [I. Amonou, N. Cammas, S. Kervadec, S. Pateux] Layered quality opt. of JSVM-3 &

closed-loopJVT-Q085-N [J.-Z. Xu] CE7: Core experiment 7 proposalJVT-Q087-L [F. Pauchet] Prop SVC bit error resilience test condsJVT-Q088-L [X. Xu, Y. He] Dynamic search range for ME in JMJVT-Q089-L [X. Xu, Y. He] Comments on ME in current JM softwareJVT-Q092-N [Z. Wu, Y. He] Verif Adv 4:4:4 profileJVT-Q093-N [W. Choi, J. Yang, B. Jeon] CE5: Verif Samsung/JVT-Q063

3.7 JVT Scalable video coding work

3.7.1 CE1 & related docs: Update step

JVT-Q026 [M. Visharam] Study of effect of MCTF update step In this contribution a summary of a study about the role and effects of the update stage within the MCTF process in the JSVM encoding/decoding framework is provided. The studies indicates that disabling the update step at the decoder does not degrade the visual quality and PSNR performance of the decoded video, when compared to the case of “update on”. Also a few tests to study the effect of update step at very high qualities are performed as well. At very high qualities (QP ~ 0) a difference in PSNR between update On vs. Off at the decoder is noticed. No difference in terms of subjective visual quality are observed.

Update stepPros:– Sometimes provides coding efficiency gains– Reduces fluctuations when omitting update step in open-loop coding (not the case in closed-

loop coding)– Pre-processor provides these gains for PSNR from 30-45 dB

Cons:– Bit-depth issues affects memory bandwidth

112

– Reference picture buffering– Delay issues– Complexity increase– Interlaced

Agreements:– Remove the update step from the JD starting with JD4.– Make update step a non-normative tool in JSVM 4 not necessarily being compatible with all

features of the standard (e.g. interlaced).

Prior CE 1 is stopped.

3.7.2 CE2 & related docs: Inter-layer motion prediction

JVT-Q043 [K.H. Lee] CE2: Revision of interlayer mot pred & TDMRevision of inter layer motion prediction and AVC TDM (Temporal Direct Mode) relative to JVT-O058 and JVT-P075. This contribution is based on closed loop analysis encoding and has two kind of new technical proposals. One is revision of inter layer motion prediction and the other is revision of AVC TDM.

JVT-Q043's temporal direct mode modification aspect

See notes below. Does not appear especially promising considering the small gain in compression performance versus the necessary re-design of existing tools and added complexity.

JVT-Q043's inter-layer motion prediction aspect

See notes below. Adds another motion prediction mode. No indication of significant gain. Does not appear especially promising.

JVT-Q047-L [T. Kimoto] CE2: Verif.Verification of JVT-Q043. As a verification task, implementation inspection and coding performance check were carried out.

Not sufficient support for adoption.

JVT-Q072-L [J.-H. Park, S.-W. Park, B.-M. Jeon] Inter-layer pred for temporally enh picturesThis document presents the experimental results of CE2 which aims to improve coding efficiency for temporally enhanced pictures. In this document, the performance of the proposed method is compared with that of temporal/spatial direct mode which is selected by RD-optimization at slice layer. Experimental result shows a gain up to 0.2 dB (in case of CIF sequence) against the RD-optimized temporal/spatial direct mode.

Something for temporal enhancement pictures (when no corresponding base layer picture).

Compares to "JSVM 3.0" – but JSVM 3.0 doesn't exist yet – perhaps this point of comparison is the current CVS code – ver 2.2.

JVT-Q043 tested a different proposed method for a similar issue. JVT-Q043 compared against JSVM 2.1. Up to 3.7% bit rate savings was shown in JVT-Q043 (including both revision of inter-layer motion prediction and revision of temporal direct mode – the latter having max 1.5% gain). Most tested sequences showed some improvement. Average not reported (but appears very small).

113

JVT-Q047-L is a verification of JVT-Q043.

Some gain (up to 0.2 dB on CIF, up to 0.3 dB on 4CIF) shown in some cases.

JVT-Q073-L [J.-H. Park, S.-W. Park, B.-M. Jeon] Modified temporal direct mode for SVCTemporal direct mode is allowed to be used at every high pass picture in SVC structure. Problem that mvCol points to the picture located at temporally long distance from the current picture. Proposal to extend temporal direct mode with slight modification to solve this issue.

Differs from what is tested/proposed in JVT-Q043, JVT-Q047-L, and JVT-Q072-L.

Modifies process to reference a closer picture in time rather than the picture referenced by the co-located MB.

Basically adds a third direct mode that can be chosen in addition to the temporal and spatial direct modes.

Tested in JSVM 2.2.

Compared to temporal direct always. Remark: What if spatial direct would be better?

No R-D improvement shown. The proponent indicates that further study may show benefits. Further contributions encouraged provided that these benefits can be proven (no CE).

Continue CE 2.

3.7.3 CE3 & related docs: Inter-layer texture prediction

JVT-Q062 [S.-Y. Kim] CE3: Smoothed reference predictionSingle-loop decoding is a very useful technique to reduce the decoding complexity in the multi-layer structure, however, the restrictions of the intra-base prediction sometimes degrades the performance especially for the fast-motion sequences. The earlier proposed smoothed reference technique that based on the residual prediction process to simulate the intra-base prediction by adding the smoothing function to the prediction signal with consideration of the residual prediction process. In this proposal, a new prediction mode is presented, which utilizes the actual downsampling function to generate the smoothed prediction signal. It downsamples the prediction signal composed of the inter-mode prediction of the current layer and the intra-mode prediction of the base-layer to simulate the decoded base-layer signal. The proposed method is reported to reduce blocking artifacts from residual predicted macroblocks. PSNR improvements in fast-motion sequences such as Football and Soccer sequences are reported within the context of the low-complexity decoding mode.

Method does smoothing of the prediction signal prior to motion compensating it requiring processing of the reference picture.

JVT-Q061-N [I.H. Shin, H.W. Park] CE3: Verif of Samsung/JVT-Q062Results have been verified.

Does address the problem of having no Intra MB in base-layer.Can smoothed reference prediction be a replacement MB type for I_Bl in case there is no Intra MB co-located in the base-layer?

114

What is the relative selection frequency of smoothed reference prediction over residual prediction?What are the choices of complexity we have associated with this idea?What is the relationship with the re-sampling AHG?The technique looks very promising. Seems to complete the design for single-loop decoding.Create AHG on smoothed reference prediction to finalize the design and provide answers to the above questions. Chairs: W. Han, H. Schwarz

JVT-Q034 [I.H. Shin and H.W. Park] CE3: Adapt. upsamplingThis document presents the technical description and experimental results for the adaptive up-sampling considered in CE3 with details in the JVT-P045. In the current JSVM, the I_BL macroblock mode uses an up-sampling process for providing the prediction signal of the current spatial layer. Current up-sampling filter for JSVM uses six-tap interpolation, which has good performance. An adaptive filtering method for the luma component in the type-1 DCT up-sampling is proposed, which applies different weighting parameters to DCT coefficients. Since the decoder requires the weighting parameters of up-sampling matrix, the weighting parameters of horizontal and vertical up-sampling are transmitted.

Very small bit rate savings for Inter frame coding cases. Larger gains for Intra frame coding cases.

Continue in CE 3.

JVT-Q049 [L. Xiong] Enh. layer intra pred using lower layerThe enhancement layer intra directional prediction is claimed to be improved by using lower layer information when some samples are not available.

No gain. Contribution noted.

JVT-Q050 [L. Xiong] Enh. layer intra pred modesJVT-P041 proposes that only 3 intra directional prediction modes which are DC, Horizontal and Vertical be used in the enhancement layer. This proposal gives the further experimental results for GOP=1 and GOP=16.

Proposal to use only 3 spatial prediction modes instead of 9 in I_BL mode: Reports PSNR loss of 0.1 dB at very high rates (PSNR > 50 dB), typically no differences observed below 45 dB. Could be useful to reduce encoder complexity, not much impact on decoder.

JVT-Q051 [L. Xiong] Spatial upsampling filterSince the human visual system is less sensitive to chroma than to luma, a different upsampling filter can be used on luma and chroma for the I_BL mode. The proposal uses a simple upsample filter [-1 5 5 -1]/8 to replace the original 6 tap filter on chroma. And for residual prediction, the proposal uses the filter [-1 5 5 -1]/8 as the residual upsampling filter on both luma and chroma, or uses the filter [-1 5 5 -1]/8 as the residual upsampling filter on luma and the filter [1 1]/2 on chroma. Very small differences in the results have been reported. No separate testing on Intra vs. Inter frame coding.

For case of I_BL upsampling JVT-Q078 gives more generic results. For case of residual prediction upsampling, usage of 4-tap filter does not give any significant advantage. Contribution noted.

JVT-Q052-L [L. Xiong] Adaptive intra slice coding

115

Every slice of intra frame is encoded twice. First, the slice is encoded as usual. Second, the original slice is rotated 180 degree then the rotated result is encoded.

Results only given for Football and Bus. Irrelevant improvement in PSNR (<<0.1 dB at high rates).

JVT-Q056 [J. Jia, H.K. Kim, H.C. Choi, J.G. Kim] CE3: Verif of Tool5 resultsThis document reports the cross-check results for the proposal for CE3 Tool5 as described in JVT-Q034. The verification has been performed by decoding the coded bitstreams which are provided by KAIST. Both of the PSNR against the original sequence and the bit rate according to the file size have been verified. It is shown that the RD results obtained by decoding the provided bitstreams match the experimental results presented in JVT-Q034 quiet well. Verification results are shown in verification_CE3_T5.xls.

JVT-Q078 [C.-X. Zhang, L. Yu, L. Xiong] Simplification of upsampling for IntraBL modeIn the current JSVM, a 6-tap interpolation filter (1, -5, 20, 20, -5, 1)/32 is used in the up-sampling process of IntraBL mode coding both for luma and chroma components and the complexity of this interpolation is even higher than the half-pel interpolation of reference frames in AVC. (Remark: that last remark seems doubtful – aren’t they the same?) Considering that the spatial correlation may be different from the temporal correlation, experiments are carried out and it is reported that the complexity can be reduced without obvious penalty by using more simple interpolation filters.

Intra_BL upsample uses [1, -5, 20, 20, -5, 1] filter for upsampling both luma and chromaReports that bilinear is not good enough for lumaBut advocates simplifying luma to [-1, 5, 5, -1] and simplifying chroma to [-1, 5, 5, -1] or bilinear [1, 1].Remark: Should analyze chroma impact.Remark: Test conditions say "FRExt mode: No". Why? Off in common conditions. All-intra coding, since this is testing Intra_BL upsampling impact.Remark: We must have better generation of test sequences before drawing any firm conclusions on such issues. Sequences that were downsampled using the JSVM method do not use any appropriate alignment of chroma to luma, and sequences that were downsampled using the MPEG-4 VM method (or perhaps it was the MPEG-2 TM method) do not have appropriate alignment with the upsampling of chroma in our current JSVM decoder design (except perhaps in "ESS" mode).Remark: Based on results in AHG report, perhaps OK to interpret results according to this experiment for the sequences that were generated using the JSVM downsampling approach. Look at whether the chroma resampling impact is different on those sequences in the tests versus the other sequences.Remark: Look at ESS case and its interaction with "non-ESS" case. That needs to be fixed.Verification? Not yet.

Shijun Sun coordinated side activity to work on these issues during the meeting. Results of that to be provided as updated JVT-Q078.Add further work on the topic to AHG on re-sampling.

JVT-Q083 [A. Segall ] Up-/Down-sampling for Spatial SVCThis contribution investigates the upsampling and down-sampling operation utilized for spatial scalability. The problem of upsampling/down-sampling is posed as an optimization problem, and two “optimal” designs for the upsampling filter are derived. The investigation begins by considering the down-sampling process currently utilized for SVC testing. It then identifies application specific weaknesses of this down-sampler and explores an alternative down-sampling

116

approach. Results motivate a modification to the current upsampler. Specifically, the contribution advocates that the upsampler should filter the pixels co-located in the high- and low-resolution frames. This extends the current method that interpolates missing pixels.

Considers the upsampler as an estimation problem, dependent on the downsampler. Analyzes using Wiener filter design concept, uses RLS optimization for separable design optimization. Tests with different fidelities. Concludes that current 6-tap filter is good (relative to other hypothetical 6-tap filter) for upsampling video that was downsampled using the current JSVM downsampling filter.

The current upsampler is an "interpolator" – every other sample horizontally and vertically is simply copied rather than filtered. (One out of 4 in the 2-d grid are copied.)

Reports that the current upsampler is not optimal in that sense. RLS optimal upsampler design seems to depend on the fidelity of the video. RLS upsampler differs from one-tap design now used in JSVM.

Investigates current (13-tap) downsampler. Reports that current downsampler introduces some ringing and is rather long.

Suggests considering alternatively a shorter downsampling filter, perhaps with less ringing. e.g., a Gaussian filter design may be an interesting choice to consider.

Actually the best downsampling method to use may be an application-dependent issue.

If there is a desire to use an "interpolating" upsampler, the current upsampler design is reportedly fine (ignoring luma/chroma alignment issues).

Suggests creating a parameterized upsampler design.

Remark: How much does the parameterization help? Not really quantified, but proponent says significant.

Max average gain of 1.8% by parameterized non-interpolating upsampler relative to current interpolating upsampler when using current downsampler.

However, with a Gaussian downsampler, up to 10% average improvement, overall average across different fidelities roughly 6% average improvement.

Perceptual?

Add to AHG on re-sampling.

JVT-Q084 [Y. Libo, C. Ying, Z. Jiefu, Z. Feng] Low complexity intra pred for enh layerThis document presents a low complexity intra prediction method for spatial enhancement layer. In current JSVM, intra prediction is implemented by using three intra modes Intra4x4, Intra8x8, Intra16x16, together with I_BL in enhancement layer. Based on the claim that Intra8x8 and Intra16x16 have almost no impact on the coding efficiency in enhancement layer, it is proposed to remove these two modes to reduce the complexity of intra coding. At the same time, the corresponding syntax bits can be saved. Simulation results reportedly show that compared with the current JSVM, this low complexity approach keeps the same performance.

Comment: What is the complexity reduction when these modes exist in the base layer anyway?

117

Comment: Intra_16x16 and Intra_8x8 are existing and proven to work.

Justification on Intra_16x16 was given when proposed in D.360 in the ITU-T SG16 meeting in Geneva October 2000. It has been shown that Intra_16x16 works especially well for gradual intensity changes.

Contribution was noted.

JVT-Q053 [J. Jia, H.K. Kim, H.C. Choi, J.G. Kim] CE3: Polyphase downsample bef DCT for SVC FGSIn this proposal, a method for improving SVC coding efficiency on the basis of polyphase downsampling (PD) is described. The presented method proposes to implement PD on FGS residual signal before integer transformation in SVC enhancement layer coding process. Experiments based on JSVM3.0 were performed using the JVT common testing conditions. Experimental results are reported to show that the presented method gives 0 – 0.1 dB PSNR improvement on luma component and 0.35 – 0.96 dB improvement on chroma components compared to the current JSVM.

Comment: Gains for chroma but losses for luma. Similar results can be achieved by different bit allocation. Most at the time losses for luma.No support for this proposal.

JVT-Q060 [I.H. Shin, H.W. Park] CE3: Verif of Sejong/JVT-Q053Verifies the results of JVT-Q053.

JVT-Q048-L [T. Kimoto, Y. Miyamoto] CE3: Unrestricted temporal decomposition in SVCThis contribution presents the proposal for SVC CE3 on “Inter-layer texture prediction”. In Unrestricted Temporal Decomposition (UTD), MC structure is decoupled between a base and enhancement layers. The pictures of a GOP in a base layer are encoded first, preceded by the corresponding pictures in enhancement layers. UTD is asserted to achieve low computational complexity and small memory at a base layer while keeping comparable coding performance at higher layers. In the experimental results, when the base layer has IPPP structure, UTD is reported to outperform a short GOP in all layers by up to 3.0 dB at higher layers.

Remark: How does this compare to low-delay FGS tools.

Continue CE 3 with this subject. Compare results to low-delay FGS coding results.

3.7.4 CE4 & related docs: ROI

JVT-Q017 [Z. Lu, Z. Li, S. Rahardja, X. Lin, K.P. Lim, W. Lin, J. Zheng, W. Yao] On high-level syntax for SVC ROIThis contribution consists of two parts. One is on the geometrical relationship between two successive spatial resolutions, which is based on JVT-O008. The other is on the prediction between syntaxes in picture parameter set and slice header that are related to ROI in JVT-O056.

Proposal advocates to modify ROI parameters in high-level (picture parameter set) syntax. For position, four parameters are still needed to cover all possible applications (incl. different aspect ratio). Bit saving would be a maximum of 3 bits / picture. The proposal on combining PPS and slice header would save 2 bits/slice, but also make conditional parsing necessary. Advantage of both proposals seems questionable.

118

JVT-Q018-L [Z. Lu, Z. Li, S. Rahardja, X. Lin, K.P. Lim, W. Lin, J. Zheng, W. Yao] Progress report of SVC CE4: ROIExperiment with "subjective ROI": Eye-tracker to investigate location of ROI. Very fast changes in position are observed. Experiment with fixed ROI based on FMO implementation, and Delta-QP. Proposal for syntax change in PPS to support ROI update (would require different PPS implementation for SVC NAL unit types). For the first experiment, a rough estimate is given that 200 bits/frame would be necessary to support dynamic ROI, which could reportedly be reduced by roughly 30 bits by the new syntax proposal. No experiments performed yet to prove this. Another proposal to change slice header syntax for further bit savings (no results yet).

Plan: Need to come back with more evidence about actual bit savings.

Continue in CE 4.

JVT-Q020 [D. Ichimura, Y. Honda, M.H. Lee] Slice group map for mult. interactive ROI scal.Interactive region of interest (IROI) scalability is distinguished from predefined ROI fixed at encoder side, where current FMO (e.g. FMO map type 2) is known to be capable of achieving. The applications of IROI are discussed. The solution to support interactive ROI scalability by coding rectangular grid of MBs as independent slices is proposed. Coding of grid slices can be specified by a new FMO map type 7 for grid slice groups to reduce overhead bits. From the experimental results, the coding efficiency penalty to support IROI scalability is 15% bit rate increase for the overall bitstream but IROI coding is reported to show a 3 dB gain in PSNR for the user-selected ROI region. Subjective quality of ROI region is also reported to be enhanced with more details. Moreover, for IROI decoding an additional benefit of lower decoder complexity according to experimental results is reported. Lastly, a bug fix in JSVM software is also reported in this contribution.

The bug fix reportedly gives 53-68 kbps bit rate reduction at 4CIF resolution. Coordinate implementation of bug fix with software coordinator. No exact numbers given yet about the number of bits that can be saved. New type 7 allows post-encoding ROI selection, most probably with relevant bit savings compared to types 2 and 7. Needs more study in CE, under consistent conditions for fixed and dynamic ROI (e.g. derived from eye movements of JVT-Q018-L).

JVT-Q021 [D. Ichimura, Y. Honda, M.H. Lee] Stream struct and CABAC for mult. inter. ROI scal.In this contribution, the proposal to improve the coding efficiency of Interactive Region of Interest (IROI) scalability is presented. In IROI coding, a picture is divided into many rectangular grid slices. One problem with dividing into many slices is the amount of overhead associated with coding many NAL unit headers and slice headers using JSVM stream structure because each quality layer is coded in a separate slice. A new stream structure is proposed to reduce the header overhead, where several quality layers are coded in one slice. Another problem with dividing into many slices is the reduced coding efficiency of CABAC due to more initialization and less updating of CABAC contexts. Inter quality layer context continuation is proposed to improve the coding efficiency of CABAC. In inter quality layer context continuation, the context states are used continuously through all quality layers in a slice without initialization. From the experimental results, an analysis of the overheads comparison between JSVM stream structure and proposed IROI stream structure with 3 quality layers shows an overhead bit rate reduction by 75%. A 5% overall bit rate reduction and a PSNR gain of 0.3 dB is reported for the ROI region when using inter quality layer context continuation.

Plan: Further study under unified condition for fixed and dynamic ROI.

Continue in CE 4.

119

JVT-Q076 [T.C. Thang, T.M. Bae, J.W. Kang, Y.M. Ro, J.-G. Kim] Boundary handling for ROI scalabilityAt the last meeting, an FMO-based method to enable encoding and extraction of ROIs from SVC bitstream was presented. It was claimed that ROI boundaries should be treated as picture boundaries. In this contribution, the importance of ROI boundary handling in SVC is studied. When ROI boundaries are not handled, two different kinds of errors are shown related to upsampling and fractional sample prediction. Also, some related work with MPEG-4 part 2 and H.263 is reviewed.

For the case of ROI without surrounding background, artifacts are obviously visible when no padding is performed. Normative handling of ROI boundaries would also be needed when surrounding background is available (and SS) to avoid encoder/decoder mismatch. Further study is needed to identify whether the ROI flag is necessary, or if it can be derived from the SEI message, and whether the filtering proposal is consistent with ESS (also non-dyadic case).

Continue in CE 4.

Need to have FMO in JSVM software.Agreement that the functionality necessary for 64-100 ROIs can be achieved using FMO.The efficiency of ROI coding can be discussed.Have SEI messages to support ROI functionality realized through FMO.

Comment: Need to have boundary extension for upsampling at slice boundaries.

3.7.5 CE5 & related docs: Quantization

JVT-Q063 [W.-J. Han] CE5: Distribution-based dequant for SVCThis contribution is a response to CE5, “Improved quantization for SVC”. It demonstrates that an optimal decoding offset can be approximated using a histogram distribution of the quantized transform coefficients. (Thus it is not required to send this offset in the bitstream).

Average histogram is used for all coefficients. Gain is mainly found at high bit rates. Only CGS case is considered. Results reported are based on floating-point implementation. Questionable whether similar performance gains could be achieved by encoder-side optimization, transmitting side information would not be such relevant at high bit rates. Further study encouraged, also investigating more precise statistics.

Continue in CE 5.

3.7.6 CE6 & related docs: Extended spatial scalability

JVT-Q015 [E. Francois, J. Vieron, V. Bottreau] General. SVC ESS for inter-layer ratios >2This document addresses two issues. The first issue is a bug fixing in ESS that has been revealed in specific cropping configurations. The second issue aims at generalizing ESS for inter-layer spatial ratios greater than 2. In JSVM3, [JVT-P202], Extended Spatial Scalability (ESS) is limited to inter-layer spatial ratios from 1 to 2. A straightforward generalization of ESS, enabling to use any ratio greater than 1, is proposed. Corresponding JSVM modifications are described.Adopt bug fix and generalization to JSVM. In the context of profile/level definitions it should be re-considered which maximum ratios would make sense.

Establish AHG on interlaced-scan video, to proceed with software implementation, and investigate implications of interlace on spatial scalability.

120

JVT-Q038 [S. Sun] New results on direct interp. for upsamp. in ESS In Poznan meeting, the direct interpolation method (JVT-P012) for upsampling in extended spatial scalability was adopted into the JSVM software as an option to be further tested. This contribution shows new test results of the technique based on the latest JSVM software. In the resampling experiments, this upsampling option is reported to be up to 4.11 dB (and on average 1.96 dB) better than the default option based on the quarter-pixel interpolation. In the ESS experiments (with IntraPeriod equal to 32), the direct interpolation option is reported to show a performance gain of 0.21 dB on average comparing to the default option. It is therefore proposed to formally adopt this method into the SVC Extension.

Improves performance while reducing complexity. Sufficiently tested. Adopt to JSVM.

JVT-Q013 [E. Francois, J. Vieron, V. Bottreau] Additional results on SVC ESS evaluationJVT-P018 provided evaluation results of ESS, in comparison with single layer and simulcast-like configurations. This document provides additional results, using different test conditions than JVT-P018. In previous tests, comparisons were achieved for equivalent bit rates. These new tests have been performed by targeting a same quality (PSNR) for the different compared solutions, and by comparing the required bit rates.

Report > 20% performance decrease of ESS compared to single layer, and > 40% increase compared to simulcast.

JVT-Q014 [J. Vieron, E. Francois, V. Bottreau] Additional test conds for SVC ESS JSVM Perf Eval The aim of this contribution is to set-up test conditions for JSVM performance evaluation for the Extended Spatial Scalability (ESS) tools. It is recommended that the proposed test sets are included in the testing conditions superset already provided by the AhG on Testing Conditions for Coding Efficiency and JSVM Performance Evaluation in document [JVT-P205].

Further optimization of ESS encoder settings to be performed in AHG, with contribution from the original proponents.

3.7.7 CE7 & related docs: Low-delay FGS

JVT-Q039-L [Y. Bao, M. Karczewicz] CE7: FGS for low delayAdopt into JSVM with all 3 interpolation methods and the highest performance interpolation method being the main reference for comparisons.

JVT-Q085-N [J.-Z. Xu] CE7: Core experiment 7 proposal

Continue in CE on improved and low delay FGS coding.

3.7.8 CE8 & related docs: CAVLC

JVT-Q040-L [J. Ridge, M. Karczewicz] CE8: VLCs for SVCAt the previous JVT meeting, software enabling entropy coding using VLCs in progressive refinement (FGS) layers was presented. A core experiment was created to enable further consideration of that feature prior to acceptance into the JSVM. This contribution reviews the VLC for FGS feature, notes some minor improvements made during the course of the CE, and presents results indicating that the overhead associated with VLC for FGS is in line with the single-layer case.

121

Report about status of CE. Mainly confirms previous (Poznan) results. Average overhead compared to CABAC under 10%, 5-16% depending on sequence. Only tested for QCIF and CIF and partial results for 4CIF.Adopt to JSVM and continue software integration.

JVT-Q057 [B.K. Lee] VLC for 8x8 transform FGSJVT-P056 proposed CAVLC for FGS. In JVT-P056 flag coding for significance pass in 8x8 transform is done. This is reported to be improved for 8x8 transform. The VLC technique of 4x4 transform is extended for significant pass in 8x8 transform. The modification is asserted to be small. The experimental results report a bit rate saving up to 12%.

Continue in CE 8.

3.7.9 Improved FGS coding

JVT-Q031 [M. Winken, H. Schwarz, D. Marpe, T. Wiegand] Adapt. motion refinement for FGS slicesIn this contribution, the adaptive coding of motion refinements as part of progressive refinement slices is investigated. The impact of using a constant set of motion data for all progressive refinement slices of a pictures is analyzed. Based on this analysis a first approach for adaptively refining motion data in progressive refinement slices has been investigated. First experimental results are reported with estimated coding efficiency gains of more than 1 dB, when motion data refinements are coded in progressive refinement slices in addition to the refinements of texture information. It is proposed to set up a new Core Experiment on that issue with the goal to significantly improve the coding efficiency of fine-granular SNR scalable coding, especially for large rate intervals.

Add to CE on improved and low delay FGS coding.

3.7.10 Improved CABAC coding

JVT-Q071-L [J.-H. Park, S.-W. Park, B.-M. Jeon] Context modeling of residual prediction flagThis document presents information about context modeling for coding the residual prediction flag. In the case that the CBP value of a base MB is zero and the residual prediction flag of the base MB is equal to 1, the current model is reported to not fully utilize base layer residual information. Since originally the base MB has access to the residual signal, although CBP value of base MB is zero, it is asserted that ctxIdxInc should have non-zero value in that case. A modified condition for context modeling of residual prediction flag is introduced.

Comment: Problem does not exist as it is currently already solved.

No action need by JVT.

3.7.11 High-level syntax

JVT-Q028 [P. Yin, J. Boyce, P. Pandit] High-level SVC Syntax The concept of FGS fragment NAL units was adopted in Poznan. So the concatenated [quality_level, fragment_order] is used to support MGS/FGS. But in the current design, the quality level is indicated in NAL unit header or SPS, but fragment_order is indicated in slice header. For consistency, it is proposed to add fragment_order information in NAL unit header or SPS, without changing the existing number of bytes in the NAL unit header (e.g. either 1 or 2). The 6 bits allocated but unused for simple_priority_id in the two-byte mode, are proposed to be

122

used for fragment order and a short_priority_id field which the proposal advocates to be used as determined by the application.

Comment: Different priority_id values can be assigned to fragments and this way the proposed functionality is already provided. The proposal then only provides a different way of signaling with shifted trade-offs that have not been viewed by the group to be beneficial over the existing one.

No action by JVT.

JVT-Q091 [S. Jeong, M. Park, G. Park, K Kim, J. Hong] Numbering of Key pictures In the current JSVM the interval of key pictures, i.e. GOP size, can be fixed or can be variable. When temporal scalability is used, this interval is variable. JSVM uses the numbering scheme for all pictures by its displaying order. Therefore, it is difficult to detect the dropping of key pictures. When the proposed numbering scheme for key pictures is used, it is asserted to be easy to detect the drop or lost error of key pictures. Furthermore it is asserted to be possible to conceal the error resulting from a dropped key picture at the decoder.

Comment: Concept seems to be incomplete. Needs further discussion. Maybe add as SEI message for error detection.

When reference picture list reordering (RPLR) is used to create the reference picture list for coding pictures of a particular layer (including key pictures in a variable GOP size structure) any missing pictures that are needed for reference can be detected. This is also the method for standard conforming temporal scalability including gaps_in_frame_num_allowed_flag being equal to 1.

JVT-Q029 [P. Yin, J. Boyce, P. Pandit] FMO and ROI scalability FMO has been discussed to implement the feature of ROI scalability. The base specification does not allow any missing slice groups, which means even for slice groups which contain non-ROIs still need to be coded and send them into the network. In this contribution, it is proposed to relax this requirement and allow missing slice groups in enhancement layers, and define a normative behavior for intentionally missing slices. The base layer remains compatible.

Further discussion needed. A better understanding on how FMO and ROI are implemented. Further work encouraged.

Comment: Alternative to the proposed approach of signaling missing slice groups in the PPS, we could specify that the enhancement layer picture must be completely covered by the coded video picture representing the enhancement layer picture. For efficiency reasons, this would imply the specification of a "skip" slice group coding. Such a "skip" slice group coding would in the header of a slice utilize 1 bit to signal that the contents of the slice is either I_Bl MB type or its corresponding 0-bit version when the base-layer MB is not coded in intra. This 0-bit version could be a smoothed reference prediction without motion vector refinement.

JVT-Q064 [Y.-K. Wang, M.M. Hannuksela, S. Wenger] SVC DPB management This contribution proposes some changes to the DPB management syntax and process for handling of decoded pictures used for inter-layer prediction referencing in SVC. The goal of the proposal is to significantly save the required DPB buffer size, which is demonstrated by the example in the end of the contribution.

Comment: No implementation available. Need to see implementation and showcase for the use of the feature that tests the concept when interacting with all the other components.

123

Comment: Interaction with extractor? Unknown because of lack of implementation.Create CE on high-level syntax. Add this to that CE.

JVT-Q065 [Y.-K. Wang, M.M. Hannuksela] Enhancement-layer IDR picture ("EIDR") This contribution proposes the coding of enhancement-layer IDR (EIDR) picture to enable efficient low-to-high layer switching, which is important in scalable stream adaptation.

Comment: No new NAL unit type needed. Suggestion to make scalable version of recovery point SEI message.Proposal is to actually re-define IDR NAL unit for SVC NAL units. Seems like good idea at first sight.Comment: No implementation available. Need to see implementation and showcase for the use of the feature that tests the concept when interacting with all the other components.

Add to CE on high-level syntax.

JVT-Q066 [Q. Shen, H. Li, Y.-K. Wang] Showcase of non-required picture SEI message This contribution describes the showcase of non-required picture SEI message, which was adopted in the Poznan meeting, to demonstrate the usefulness of the SEI message. The demonstration tool set is attached such that anyone interested can perform the demo independently. The source code for creation of the demonstration tool set is also attached.

The showcase verifies that the SEI message in JSVM 3 works and can therefore now be transferred to JD 4.

JVT-Q067 [H. Liu, H. Li, Y.-K. Wang] Showcase of scalability information SEI messageThis contribution describes the showcase of the scalability information SEI message, which was adopted in the Poznan meeting, to demonstrate the usefulness of the SEI message. The showcase of the part for support of sub-picture coding based ROI scalability is described in JVT-Q077. The demonstration tool set is attached such that anyone interested can perform the demo independently. The source code for creation of the demonstration tool set is also attached.

The showcase verifies that the SEI message in JSVM 3 works and can therefore now be transferred to JD 4, with the possible exception of ROI ID as discussed in notes elsewhere.

JVT-Q070 [Y.-K. Wang, S. Wenger] SVC RTP payload format internet draft This is an informative contribution to announce that the work towards an RTP payload format for SVC coded video has started. The first Internet Draft is available at http://www.ietf.org/internet-drafts/draft-wenger-avt-rtp-svc-00.txt. As for all Internet Drafts, comments are encouraged in the appropriate forum, which is the IETF AVT WG's mailing list. Please see http://www.ietf.org/html.charters/avt-charter.html.

Information document. Experts are encouraged to read and provide feedback.

Remark – Why does this rule out single nal unit packetization? Response – that is not the current industry preference for how to operate.

JVT-Q075 [T.C. Thang, T.M. Bae, J.W. Kang, Y.M. Ro, J.-G. Kim] Improved scalability info SEI message In the last (Poznań) JVT meeting, a new syntax structure for a scalability information SEI message was proposed. This proposed syntax describes information relating to all the possible layers of an SVC bitstream, namely the base layer and all temporal/spatial/SNR enhancement layers.

124

From the implementation of the ROI extraction show case, it is reported in the contribution that, when there exist ROIs in a SVC bitstream, the current syntax of scalability information SEI message is still inconvenient to describe the layers of different ROIs. For this purpose, some changes to the current syntax are proposed in the contribution.

Comment: Having all ROI related SEI in one message is desirable. A breakout group was formed to discuss a new design during the meeting. Further work is encouraged.

JVT-Q077 [T.C. Thang, T.M. Bae, J.W. Kang, Y.M. Ro, J.-G. Kim] Showcase of ROI extraction using scal info SEIAt the last (Poznań) meeting, a method to enable ROI extraction from an SVC bitstream was proposed in JVT-P042. To help the extractor in extracting ROI bitstreams, information about ROIs inside an SVC bitstream was included in a scalability information SEI message. In this contribution, a showcase of ROI extraction is presented using the scalability information SEI message. Here, the focus is on the application where ROI is extracted according to an ROI ID. In addition, one change to the current syntax of scalability information SEI message is proposed, so as to support overlapped regions between ROIs.

The original contribution file was corrupted, and an update was provided to fix that.

Listing of multiple ROIs not adopted due to questioning of whether it is necessary given the available dependency information – further study may clarify. Single ROI syntax is also to be studied further, based on software just promised to be provided, etc.

Adopt original SEI design.

3.7.12 Error resiliency

JVT-Q054 [J. Jia, H.K. Kim, H.C. Choi, J.G. Kim] Impl. of redundant pictures in JSVMIn order to enhance robustness to packet loss, the redundant picture feature is one of the error resilience tools in the current standard, which allows an encoder to send redundant coded pictures (or a subset of the macroblocks in the primary coded picture). As current JSVM software doesn’t use the redundant pictures feature, in this contribution, some redundant pictures feature capability was implemented into the current JSVM software. Also, a description of the usage of this tool was provided in the contribution.

The JVT agreed to add implementation of this feature into the SW integration schedule.

JVT-Q055 [J. Jia, H.K. Kim, H.C. Choi, J.G. Kim] Polyphase downsample-based redundant picsIn order to enhance error resilience of SVC, a concept of Polyphase Downsampling (PD) based redundant picture coding in JSVM is described in this proposal. The presented method implements PD on residual signals before DCT in the redundant picture coding process, which enables the redundant coded picture to be sent flexibly with some degradation of the picture quality corresponding to the quantity of DCT coefficients that have been sent. When part of the DCT coefficients in one redundant picture have been sent, a reconstruction utilizing the spatial redundancy inherent in natural pictures between neighboring pixels can reportedly be performed to improve the reconstruction quality.

For further study. Needs more actual results provided, and study within a more well-understood framework is needed.

JVT-Q069 [Y. Guo, H. Li, Y.-K. Wang] SVC/AVC loss simulator donation

125

This is an informative contribution to announce that a loss simulator is donated to the JVT for use in SVC/AVC error resilience simulations. The simulator is intended for free and public use. Both the source code and the executable files are contained in the attachment of this contribution document.

Source code was provided. It takes a bitstream as input and puts out an output bitstream based on an input packet loss rate. Or with 4 arguments, can apply different packet loss rates to different layers. Remark: Looks useful.

Adopt as loss simulating software.

Remark: Need to develop a full framework in order to do effective error resilience work.

Remark: Suggest to create anchor bitstreams. Response: Not sure such bitstreams would fit well into the current framework of software capability.

Remark: In error resilience tests, would like to see comparisons with an anchor that includes loss optimization of mode selection, etc.

It was suggested to set up AHG to work out an agreed framework for error resilience proposal evaluations including the generation of anchors. It was remarked (and generally agreed) that we should seek to compare proposals against the best that can be done without adoption of proposed normative changes.

Need to get multiple slices per picture support in JSVM, etc. Should test things proposed for SVC use in the JSVM context.

Should we look for someone to do the work to implement multiple slices per picture in the JSVM? Response: In fact we have this already scheduled for integration in the reference software.

(If we have FMO, we will presumably have slice-structured coding support.)

AHG should work on these issues, as evaluation of new proposed features should be done in the context of a good model for what can be done without adoption of the proposed changes.

JVT-Q087-L [F. Pauchet] Prop SVC bit error resilience test condsThis document proposes common conditions for SVC error resilience testing – taking into account bit errors.

The contribution states that some network environments allow packets to be passed through the channel to the decoder even when they contain errors (sometimes along with an indication that there are errors).

Advocates tests against frame error concealment (per Boyce et al) implemented in the JSVM and using some VCEG error patterns.

The JVT operational philosophy has been to focus on "packet loss" phenomena in resilience/robustness work, assuming that bit errors within bitstreams need not be considered. This contribution appears to ask us to reconsider that approach. The consensus of the group is not to do so, until/unless the group becomes convinced that the work area is likely to be a fruitful one.

126

3.7.13 Profiles

JVT-Q022 [J. Reichel, X. Ziliani, P. Amon, X. Boltz, U. Benzler] Surveillance profile for SVCThis proposal is to define a Surveillance Profile for scalable video coding with the aim of creating a subset of tools for applications requiring low-delay, low-complexity encoder and decoder solutions and defining those in one specific profile.

A definition of scalable profile would include constraints on, e.g., total rate and distortion, and constraints on each particular layer. Levels are proposed to be strictly non-decreasing with increasing layer. So are profile capabilities.

If we allow multi-loop decoding, we would also possibly modify/increase DPB capacities.

Remark: Perhaps a simpler way of specifying the requirements would be possible.

Proposal seems to have a number of good elements of thought that merit study.

Remark: Perhaps define "twinnings" of current profiles – e.g., create a Scalable Baseline profile and a Scalable High Profile.

Remark: Weighted prediction off? Yes. Why? Maybe complexity?

Remark: Maybe not B slices.

Contribution noted. Profiling suggestions may become more relevant around the April 2006 time frame.

3.8 JVT SVC non-normative modifications

JVT-Q081-L [I. Amonou, N. Cammas, S. Kervadec, S. Pateux] Layered quality opt. of JSVM-3 & closed-loopThis document presents an change to the Joint Scalable Video Software 3 (JSVM 3.0). It proposes to extend the notion of priority levels introduced in JVT-O202 to the context of closed-loop coding. In closed-loop coding, the impact of the distortion between frames is no longer uncorrelated as it was the case of open-loop coding. This document discusses an approach for computing quality layers. The priority levels are then introduced in the bitstream using the SVC extended NAL unit header (priority_id). Results reportedly show improvement of up to 0.66 dB when compared to JSVM 3.0. It is proposed that the improved algorithm for the determination of quality layers is adopted as non-normative tool for the Joint Scalable Video Model (JSVM) 4.

The JVT agreed to adopt this into the JSVM.

JVT-Q030 [H. Schwarz, D. Marpe, T. Wiegand] Closed loop coding with quality layersIn this contribution, the usage of "quality layers" in connection with closed-loop coding is investigated. Furthermore, a modified algorithm for the determination of quality layers has been developed. The developed algorithm has been tested for closed-loop coding with hierarchical B pictures, where coding efficiency gains are reported to be up to 0.28 dB compared to the algorithm proposed in JVT-P029. In comparison to closed-loop coding without the usage of quality layers, coding efficiency gains of up to 0.63 dB have been reported. It is proposed that the improved algorithm for the determination of quality layers is adopted as non-normative tool for the Joint Scalable Video Model (JSVM) 4.

127

Conclusion from quality layers (QL) work: Clear advantage of QL shown for closed-loop coding by both proposals. The two proposals may target different rate points, but JVT-Q081-L seems to be the better starting point. Proponents were asked to study whether elements of JVT-Q030 can be added or be made switchable as an option. Except for City, closed loop performs clearly better than open-loop MCTF.

The JVT agreed to adopt this, conditioned on achieved improvement after merging.

JVT-Q046 [Y. Chen, J. Boyce, K. Xie] SVC frame loss concealmentThe current JSVM3.0 software has no error concealment support. The software crashes with any loss. Four error concealment algorithms are proposed to be added to the JSVM to handle frame loss – frame copy and temporal direct mode motion generation, BlSkip mode and reconstruction base layer upsampling. The proposed error concealment algorithms were tested using the packet loss model of VCEG Q15-I16r1, and the testing conditions are referred to JVT-P026. The described scenario focuses on the two spatial layer cases.

Remark: The same team recently contributed loss concealment functionality in the JM software. The JSVM (up until now) does not behave gracefully in the case of packet losses (i.e., it crashes).

Several concealment methods were implemented by the contributing team and are offered to the JVT for incorporation into the reference software.

(Relies on an SEI message for ability to detect some problems in bitstream.)

If scheduling issues work out, we would like to have resilience functionality in the software.

The JVT agreed to adopt this into the JSVM.

3.9 JVT Non-SVC normative modifications

3.9.1 Improved 4:4:4 coding

JVT-Q024 [T. Suzuki] Verif. of new 4:4:4 toolsIt was reported in the last two meetings that the current 4:4:4 profile is not optimal and that the coding efficiency can be improved significantly with (at least conceptual) simplification of codec design. The activity toward new 4:4:4 profile was summarized in JVT-P204 of the Poznan meeting. In this new contribution document, the results of a cross verification of JVT-O013 and JVT-P017 are reported.

Results were provided just for one sequence for now. For that sequence, the approximate benefit of the new profile would be 0.7 dB AvPSNR across all three of RG&B color components at 45 dB for all-Intra coding, and 0.3 dB benefit for IBrBP.

Software provided by Thomson was used.

Remark: This used some older software – better software available since then.

New software was then used later and new results were reported – for one sequence "DT = Dining Table", there was reported to be 1.0 dB improvement in the all-intra case, and slightly less but about the same amount for IBrBP case (GOP length = 13).

JVT-Q027 [J. Xin, A. Vetro, H. Sun] Verif. of 4:4:4 in JVT-P017

128

The “Advanced 4:4:4 Profile” as proposed in JVT-O013 and JVT-P017 has been implemented by the authors of the above two contributions. In this contribution, the performance of the encoding schemes proposed in JVT-P017 is verified.

This contribution reports substantial agreement with the JVT-P017 (Thomson) results. See summary discussion below.

JVT-Q032 [S. Sekiguchi, Y. Isu, Y. Yamada, K. Asai, T. Murakami] Imp. ent coding for intra pred modesIntroduction of improved entropy coding of intra prediction modes is proposed in this contribution. In some proposals, independent intra prediction for each color component is used, which can improve prediction efficiency but leads increase of overhead bits to code additional intra prediction modes. The efficiency of entropy coding for intra prediction modes is investigated for the case that independent intra prediction per each color component is employed. Two types of entropy coding modifications are presented to achieve further coding gain. The first one is a modification to the process of predictor determination for coding intra NxN pred modes. The other is a direct CABAC application to the intra NxN pred mode syntax. A set of preliminary experimental results is provided.

Given the adoption of approach #2 below, this document is treated as an informational contribution.

The contribution describes the increase in overhead bit percentage for the separate mode selection intra coding operation method. Methods of trying to mitigate this issue in the entropy coding process are described in the contribution. Total bit rate savings of up to 4% (much larger when viewed as a percentage of the bits spend on intra pred modes) were reported.

JVT-Q033 [Y. Isu, S. Sekiguchi, Y. Yamada, K. Asai, T. Murakami] Verif. on existing Adv. 4:4:4 proposalsThis document provides verification results on the existing advanced 4:4:4 coding proposals that were characterized by the proponent as short-term approaches (i.e., with minimum modifications to the current AVC coding tools). Both the intra-only coding case and inter coding case were discussed. The main purpose of this verification was reportedly to evaluate the efficiency of independent spatio-temporal prediction for each color component. The common set of HDTV materials discussed in the 4:4:4 AHG were used as test sequences. The existing AVC High 4:4:4 profile (“ref”) was used as a reference for comparison. For intra-only coding, independent 4:0:0 coding for each color component (“400x3”) and the proposed implementation of the “new3” method proposed in JVT-P017 (“new3_melco”) were evaluated. As for the inter coding case, a comparison between ref and 400x3 for IPPP… picture type configuration was conducted.

This was reportedly an independent implementation from that used by other proponents. Some questions were raised – seeking to clarify algorithm aspects for testing. Roughly the same average PSNR difference, measured in the RGB domain, was reported as whas reported by Thomson (e.g., average 1.0 dB).

Some (up to 0.5 dB) benefit was shown (more than appeared to be shown in other reports) for separate-prediction-mode intra coding (for their own implementation – a common MB type, but separate pred modes were used). But the proponent reports that they think there should be some way to reduce overhead bits.

In IPPP… coding, the proponent reportedly found that sometimes many macroblocks were coded as Intra. (And therefore the performance is dominated by Intra.) It was reportedly thought that

129

perhaps different R-D optimization could avoid this phenomenon. Less gain was reported when transform coefficients were a higher percentage of the total data.

It was noted that the Thomson proposed changes affect only the chroma coding aspects.

JVT-Q035 [Y.L. Lee] Complexity of prop. lossless intra for 4:4:4The new 4:4:4 profile will use a multi-directional spatial prediction method to reduce the spatial redundancy by using block boundary samples. A new lossless Intra residual DPCM coding method was proposed at the JVT meeting for the Advanced 4:4:4 Profile. At the previous meeting, the proposed lossless Intra coding method based on residual DPCM showed a bit rate reduction approximately 12.53% in comparison to the lossless Intra coding method included in FRExt. The purpose of this document is to analyze the complexity of the residual DPCM when the proposed one is used. In the experiments, the decoding complexity is reportedly reduced when the proposed method is applied to the Advanced 4:4:4 Profile.

Bit rate reduction (approx 12.5%) previously shown see JVT-P016. Poznan report quote "Generally favorably disposed, but needs further study and depends on other 4:4:4 plans." Now the other 4:4:4 plans are becoming more concrete.

Complexity analyzed. Concludes that proposed method always improved coding efficiency and reduced decoder complexity. Proposal has been stable for about a year (first showed up at the Redmond meeting) and has been verified.

The JVT agreed to include this as a replacement of the current qpprime_y_zero_transform_bypass_flag operation in the new 4:4:4 profiles.

JVT-Q037 [P. Topiwala] Prop. 14-b sample support in Adv. 4:4:4 ProfileThis contribution proposes support of 14-bit per sample video sample data in the upcoming Advanced 4:4:4 Profile. Applications using existing 14-bit video sensors ranging from military surveillance to emerging commercial television and film industry reportedly require 14-bit support.

The contribution notes a reported low impact on the specification and notes that the reference software decoder apparently needs no change and that changes needed in the reference software encoder are minor.

Assesses the incremental complexity (esp in software implementations) of 14 bit video, relative to 12 bit video, to be minor.

JVT-Q058-L [W.-S. Kim, D. Cho, D. Birinov, H.M. Kim] Verif and analysis of JVT-P017 on 4:4:4 profileReports a problem with current reference software relating to RCT. After some bugs were fixed (listed as follows), the RCT performance reportedly improved up to 1 dB.– Adaptive rounding control had not been implemented for RCT case– R-D optimized mode selection problem relating to skip mode– Modified Lambda use to adjust for RCT use (measure transformed error)

Adaptive rounding control was turned off in the final experiment.

Results with adaptive rounding control turned on for both luma and chroma are reportedly worse than with luma alone and are not significantly better than with adaptive rounding control turned off altogether. Luma rounding control reportedly helps when chroma adaptive rounding control is not used, but luma adaptive rounding control was turned off.

130

Remark: Does this produce an unfair comparison – crippling the reference for comparison? Response: Adaptive rounding control seems to affect both the RCT off and RCT on cases in roughly the same way (when used properly).

Remark: Encourage investigation of the above problem report. Tourapis (by email) confirms that there may be a problem for chroma adaptive rounding control for non-4:2:0 operation. However, Haoping Yu did not notice any such problem in his experiments. Adaptive rounding control has also (according to Tourapis) not been implemented properly for luma 16x16 and chroma DC values. Additionally, Tourapis reports a serious bug in the Lagrangian computation for negative values of QP and has contributed a fix for this bug in contribution JVT-Q037. (Negative values of QP are not used in most experiments.)

Remark: Consider the effect of all three color components.

At roughly 45 dB, the proponent reported (on typical sequences) roughly only an average benefit of 0.2 dB (measured in Y component) for the Thomson single-model-selection design (with adaptive rounding control off and no support for RCT) relative to current High 4:4:4 profile (which does support RCT).

Remark: The reported results, when plotted relative to results reported and verified from other contributions, do not appear consistent with the performance of the Thomson scheme as measured in other contributions.

Contribution JVT-Q058-L does not provide Intra-only result reports. Such results were requested for work on this topic.

Remark: What happens when the RCT and Thomson modifications are used together? Response: It improves the RCT performance case – in fact the Thomson modifications are good for RCT because (with single mode selection variant of Thomson proposal) it produces consistent behavior between luma and chroma components.

Contribution also reports results for a modified RCT / inter-plane prediction, used together with the Thomson single-mode proposed modifications, reporting an overall 0.6 dB improvement relative to Thomson proposal.

RCT / inter-plane prediction topic requires further study.

JVT-Q059-L [W.-S. Kim, D. Cho, D. Birinov, H.M. Kim] Advanced residual color transformThis contribution proposes a residual color transform (RCT) method known as "inter-plane prediction" (IPP). The basic concepts have been presented previously (reportedly since May 2003).

Remark: What PSNR or bit rate range are we trying to evaluate performance for?

Note report of recent bug fix activity for RCT.

New results were reported since the original document submission. Trying to match chroma PSNR and measure Y PSNR.

Reports 0.7 dB average on top of Thomson proposal performance (JVT-P017) – maximum 1.3 dB in terms of Y PSNR with equal chroma PSNR.

131

Needs further study.

JVT-Q086 [T. Wedi] Intra-only 4:4:4 profileFor professional applications, Intra-only coding is a common coding method. Furthermore, several experiments and demonstrations have shown that intra AVC coding has excellent performance, even compared to state of the art still image coding schemes.

The proposal advocates an intra-only 4:4:4 profile with the same set of modes available for every color component and with separate mode selection for each color component (with interleaving of the data for the three color arrays at the macroblock level rather than picture level).

The proponent advocates selection, e.g., at sequence level, between "common mode selection" and "separate mode selection" operation.

Draft syntax was provided. Remark: Suspect it may look much simpler in "proposal-quality" draft syntax versus true properly-edited actual impact on the complete specification.

Software was provided.

Remark: Any comparison between separate mode selection vs. common mode selection? No.

NOTE: Thomson's separate prediction-mode selection variant is not as separate as this proposed method is. Here, even the macroblock mode selection between Intra_4x4 and Intra_8x8 and Intra_16x16 is separate.

Remark: The parallelism advantage here has an architectural structure dependency – helps with one type of parallelism but not others.

The coding efficiency seems about the same for both schemes (common mode selection and separate mode selection).

Remark: Perceptual impact? Response: We don't see one.

Remark: From purely a point of view of the quantity of (encoder) processing power is lower for common mode selection than for separate mode selection (although the separate mode selection case may be "friendlier" to encoder implementation with a particular parallelism structure). From a decoder perspective, the complexity is likely lower with common mode selection.

After discussion and expression of opinions, what we now seem to have before us is a choice between:– Common partitioning with separate mode selection only, or– Common partitioning with common mode selection only, or agreed.– Support of at least one of the two cases above and also possibly separate partitioning and

separate mode selection.

The JVT thus agrees to use common partitioning with common mode selection in the new Advanced 4:4:4 profile working draft.

JVT-Q090 [P. Topiwala, H. Yu] New Viper HD test sequencesThree new test sequences are introduced in addition to the existing VIPER 10-bit HD data. These replace two previously selected sequences that have been found to be inappropriate for 4:4:4 coding.

132

Some prior Viper test data had data corruption (streaks in chroma components and periodic phenomena) – as reported at the Poznań meeting. This contribution proposes replacing two sequences – with a net result being 6 encouraged test sequences. The JVT agreed to this suggestion.

4:4:4 Summary DiscussionGroup Estimate: The gain from the Thomson-proposed changes in JVT-P017 estimated in various contributions (with RCT off in both cases) is roughly 1.0 dB on average (across R, G, and B) for RGB Intra coding at about 45 dB. Intra performance dominates the measured behavior at such bit rates (so that a similar although somewhat lower benefit is also found in use cases that include Inter prediction). The benefit from changes to the inter prediction process is significantly less than the benefit from changes to intra prediction, and is primarily at lower bit rates.

A side-activity was conducted to study the benefit measurement including all reported sequences, and reported as follows: 0.85 dB for Intra-only coding. One sequence, "Treasure Planet", not part of the common conditions and not particularly easy to encode, had an improvement of 2.7 dB. Removing that sequence from the average would make the average drop to 0.63 dB.

The candidate sequences left out of Thomson's tests are those characterized as bad/corrupted in our input documents, and are those advocated for being replaced in other contributions (see section discussing contribution JVT-Q090).

Conclusions of the JVT on this topic:– Do we create one or more new 4:4:4 profiles? Yes. (no objections, substantial support)– Should we make such a profile that supports Inter coding? Yes. (no objections, substantial

support)– Should we make such a profile that supports only Intra coding? Yes. (no objections,

substantial support)– Should we keep the current High 4:4:4 profile, or remove it as a corrigendum action?

Remove it. (no objections, substantial support, US & France WG11 NB positions noted).– Should the new profiles include 14 b video capability? (seems rather simple in text and

software, and hopefully in implementations) Keep the topic open for now – leaning towards including this unless it appears to cause some significant implementation problem. Request input opinions at next meeting. US WG 11 NB position supporting it noted.

JVT agreed JD 1 design on 4:4:4 codingJVT-P017 (Poznan: uses luma tools for intra and inter prediction as common mode solution)JVT-Q035 (new lossless Intra 4:4:4 coding)

(Software was provided as an attached to the Poznan input as JVT-P017.)

The RCT / IPP topic requires further study. Whether to include such a feature in the new profile or not, and the details of any such design if included, remain yet to-be-determined (TBD).

3.9.2 Logo insertion

JVT-Q019 [P. Bordes, E. Francois] SEI for logo insertionThe problem of the logo insertion in video is addressed. It is proposed to transmit the encoded logo in a standardized SEI message. The proponent says that this will greatly facilitate the logo insertion, removing and replacing logos in a video byte-stream without modifying the quality of the video (VCL).

133

The proposal has been welcomed and the goal it advocates to achieve has been found of interest to the group. Further investigations are encouraged towards enabling more generic insertion/overlay capabilities including animated logos, subtitles, stock tickers, etc. The use of the aux. picture feature was suggested.

3.10 JVT Non-SVC non-normative aspects

3.10.1 Encoder optimization techniques

JVT-Q080 [Z. Heng] R-D function of H.264/AVC transf. coeffs.In recent literature on rate control, a quadratic model has been widely used. This model was reportedly first introduced in assuming the source to be continuous. It is claimed that the transform coefficients are actually discrete random variables, thus the conclusions of continuous source may not hold. This contribution derives the R-D function of transform coefficients by first obtaining the R-D function of simple discrete sources with a unique alphabet step, and then composing these simple cases to a product source. Results reported are that the continuous and discrete source has different R-D function form and the latter can approximate to a logarithmic form more than that of the former one.

Information document. Document noted for study by JVT members.

3.10.2 Improved error resilience

JVT-Q036 [D. Hench, P. Topiwala] Joint source-channel encodingA “Joint Source-Channel friendly” real-time implementation of normative AVC is discussed. The motivation is both to support basic research and to be an early adopter by performing a technology demonstration.

Information document – provided to generate interest and to provide an illustration of an ability to adapt rate to channel characteristics.

Reference software

JVT-Q025-L [E. Setton, B. Girod] R-D analysis and streaming of SP and SI framesAdopt into reference software.

JVT-Q088-L [X. Xu, Y. He] Dynamic search range for ME in JMAdd to FME technique that was originally proposed by Tsinghua University (only).

Adopted for use within UMHexS operation (only).

JVT-Q089-L [X. Xu, Y. He] Comments on ME in current JM softwareReports irregular performance from Santa Clara University's Simplified UMHexS relative to ordinary UMHexS – example PSNR loss 0.2 dB on Foreman QCIF. Advocates comparison to full search or fast full search in quality, to ensure never dropping far from that benchmark.

Relative to EPZS integer search part, reports UMHexS has similar quality and lower complexity (esp. for hardware).

No action taken on this contribution.

JVT-Q079-L [A. Tourapis, P. Topiwala] Sub-pel ME for enh. predictive zonal search

134

Most of the complexity of the MV search process is reportedly in the integer position search. However, the fractional search part also has some complexity, so a fast search has been offered in this contribution for the EPZS technique.

Shows example of Foreman QCIF (see above remark on this case in context of JVT-Q089-L) comparison of USC's Simplified UMHexS, with some improvement in R-D performance relative to that.

Adopted into reference software and JM text for use with EPZS technique (only).

3.11 Withdrawn JVT documents

The following JVT document registrations were withdrawn: JVT-Q004, JVT-Q016, JVT-Q041, JVT-Q044, JVT-Q068, JVT-Q074, JVT-Q082, JVT-Q094, and JVT-Q095.

3.12 Updating of JVT group documents

JVT-Q023 [T. Suzuki] Some COR issuesThis contribution consists of a report of problems in current AVC specification.A.3.3 slice rate constraint for first pictureLack of slice rate constraint for some profiles & levels (we think that was intentional – no action likely needed)D.2.2 CPB removal delay of first picture in the whole bitstream required to be 0. Does not enable simplest editing – requires changing the CPB removal delay when chopping bitstream at an IDR location If that's the only thing that would be required for chopping a bitstream at an IDR picture, then that constraint should probably not be there.

The JVT agreed to create an output document to track all such issues. Additional issues are noted in JVT-Q001.

JVT-Q042-L [A. Tourapis] Updates to reference software manualThis contribution provides good input to keep our reference software manual up-to-date. The JVT agreed to adopt this as a group-maintained document update.

3.13 JVT internal operating rules

The following clarifications/adjustments of JVT operating rules have been approved.

All submissions must be made in JVT-Rxxx.zip format with the word docs, excel sheets and other information being in the zip container. A revision of the doc shall be made by adding the revised doc to the zip container. (The document must also contain an abstract and be accompanied with an e-mail notification containing title, authors and abstract (identical to the one in the doc) which is no longer than 200 words and is written in 3rd person in a manner that does not express endorsement of the content of the document.)

Independent verification (necessary for adoption of a proposal) is provided either througha) independent implementation by 1 or more company different than the proponent, based

on the textual description (after adoption, both decoder source code versions must be made publicly available and one encoder version)

b) providing source code to all CE participants prior to the meeting (CEs can only be joined at the meeting, when the CE is created. CEs are created at each meeting and last until the next meeting.)

135

For every SEI message and every syntax element that are currently in the SVC draft, a showcase has to be provided in order to retain it in the JSVM/WD. If such a showcase is not provided at the next meeting for an SEI message or parts of it, the SEI message or the respective parts will be removed from the JSVM/WD. The source code and executables for the showcase must be made available.

A first CE description must be available at the last day of the meeting. Changes of the CE description are only allowed until 1 month prior to the next meeting. These changes must be of evolutionary characteristic relative to the input documents on which the CE is based and must be agreed by those who contributed the respective input document(s) or be added as an option.

3.14 List of Adoptions

The person listed in brackets in this section is responsible for providing text and for software integration.

3.14.1 Normative SVC adoptions

[H. Schwarz] Remove the update step from the JD starting with JD4. JVT-Q015 [E. Francois] General. SVC ESS for inter-layer ratios >2: bug fix and

generalization to JSVM JVT-Q038 [S. Sun] New results on direct interp. for upsamp. in ESS JVT-Q039 -L [Y. Bao] CE7: FGS for low delay: with all 3 interpolation methods and the

highest performance interpolation method being the main reference for comparisons JVT-Q040 -L [J. Ridge] CE8: VLCs for SVC

3.14.2 Non-Normative SVC adoptions

JVT-Q081 -L [N. Cammas] Layered quality opt. of JSVM-3 & closed-loop JVT-Q030 [H. Schwarz] Closed loop coding with quality layers: conditioned on achieved

improvement after merging. JVT-Q046 [Y. Chen] SVC frame loss concealment

3.14.3 Normative non-SVC related adoptions

JVT-P017 [H. Yu] (Poznan: Uses luma tools for intra and inter prediction as common mode solution)

JVT-Q035 [Y.L. Lee] (new lossless Intra 4:4:4 coding)

3.14.4 JM reference software adoptions

JVT-Q025 -L [E. Setton] R-D analysis and streaming of SP and SI frames JVT-Q088 -L [Y. He] Dynamic search range for ME in JM JVT-Q079 -L [A. Tourapis] Sub-pel ME for enh. predictive zonal search

3.15 List of JVT AHGs established

AHG on Project management and errata [Chairs: G. J. Sullivan, J.-R. Ohm, A. Luthra, T. Wiegand]

AHG on JM text and reference software [Chairs: T. Wiegand, K. Suehring, A. Tourapis, K. P. Lim]

AHG on Bitstreams & conformance [Chairs: T. Suzuki, L. Winger]AHG on JSVM S/W and new functionality integration [Chair: G. Cook]

136

AHG on JSVM & JD text [Chairs: J. Reichel, H. Schwarz, M. Wien]AHG on Spatial scalability resampling [Chair: S. Sun, J. Reichel]AHG on Error/Loss resilience test conditions & applications [Chair: Y.-K. Wang, H. C. Choi]AHG on Coding eff & JSVM coding efficiency testing conditions [Chairs: M. Wien, H. Schwarz]AHG on Study of 4:4:4 functionality [Chair: T. Suzuki]AHG on enhancement-layer complexity reduction [Chair: L. Xiong]AHG on SVC interlaced coding [Chair: E. Francois, H. Schwarz]AHG on smoothed reference prediction [Chair: W.-J. Han, H. Schwarz]

3.16 Key JVT resolutions of the meetingThe JVT nominates the following persons as editors of ISO/IEC 14496-10:200x Amd.1: Gary

Sullivan, Teruhiko Suzuki, Thomas Wiegand.The JVT nominates the following persons as editors of ISO/IEC 14496-10:200x Cor.2: Gary

Sullivan, Thomas Wiegand.

3.17 JVT SVC SW integration plan

Latest SW: version 2.2 – Poznan SW with some missing partsOctober 25th [H. Schwarz] Remove the update step from the JD starting with JD4. (parallel with VLC) [J. Ridge] JVT-P056-L Variable length codes for SVC: CAVLC for base layer.

Implementation of existing tools. Adopt into JSVM software, New tools for scalable coding. [J. Ridge] JVT-Q040-L CE8: VLCs for SVC [Y. Bao] JVT-Q039-L CE7: FGS for low delay: with all 3 interpolation methods and the

highest performance interpolation method being the main reference for comparisons [Y.-K. Wang] JVT-P061 Signaling of scalab. info. / JVT-P042 CE08: Spatial scalability of

multiple ROIs. Adopt as described in JVT-P113. [Y.-K. Wang] JVT-P062 Indication of non-required pics.: Adopt adjusted SEI message as

decribed in JVT-P062r1.-> v 3.1November 8th [S. Kervadec] JVT-P031 (M12306) Syntax for FGS pass fractioning / JVT-P100 High-level

syntax for SVC : Adopt as described in JVT-P112, Introduction of FGS fragment NAL units. Adopt. , Decision: keep switchable version of NALU ext header with different meaning of P and Q. Removal of "dead substream" SEI message.

[N. Cammas] JVT-P029 (M12304) CE05: CE report on quality layers: Non-normative part adopted.

[N. Cammas] JVT-Q081-L Layered quality opt. of JSVM-3 & closed-loop-> v 3.2November 10th [H. Schwarz] JVT-Q030 Closed loop coding with quality layers: conditioned on achieved

improvement after merging.-> v 3.3November 12th [T. M. Bae] FMO addition-> v 3.4November 18th [E. Francois] JVT-Q015 General. SVC ESS for inter-layer ratios >2: bug fix and

generalization to JSVM [S. Sun] JVT-Q038 New results on direct interp. for upsamp. in ESS [Y. Chen] JVT-Q046 SVC frame loss concealment [J. Jia] JVT-Q054 Implementation of redundant pictures in JSVM

137

[J. Boyce] JVT-P064 Weighted prediction for SVC / JVT-P076 Multi-layer weighted prediction: 2 parts: a) Weighted prediction for the base layer. Adopt into JSVM software, b) New tools for scalable coding. Adopt.

[J. Boyce] JVT-P065 Weighted prediction for SVC MCTF update step: Do not apply the weights for the update step. Adopted.

3.18 JVT Attendance

JVT attendees (per sign-in sheet at the meeting) included the following persons (148 in total):Gary Sullivan (Microsoft), Jens-Rainer Ohm (RWTH Aachen), Thomas Wiegand (Fraunhofer HHI), Greg Cook (Thomson), Peter Amon (Siemens AG), Ulrich Benzler (Robert Bosch GmbH), Mathias Wien (RWTH Aachen), Heiko Schwarz (Fraunhofer HHI), Tobias Oelbaum (TUM), Peter List (Deutsche Telekom T-Systems), Shawmin Lei (Sharp Labs), Ye-Kui Wang (Nokia), Justin Ridge (Nokia), Lulin Chen (Mobilygen), Zhongli (Jones) He (Freescale), Xianglin (Shawn) Wang (Nokia), Yiliang Bao (Nokia), Nam Hyeong Kim (Korea Univ.), Jae-Gon Kim (ETRI), Lu Yu (Zejiang Univ.), So-Young Kim (Samsung Electronics), Bae-Keun Kim (Samsung Electronics), Kyo-Hyuk Lee (Samsung Electronics), Woo-Jin Han (Samsung Electronics), Tukihiro Bandoh (NTT), Mike Nilsson (BT), Masato Shima (Texas Instruments Japan), Lazar Bivolarski (Connex Technology), Shijun Sun (Sharp), Lee Men Huang (Panasonic), Andrew Segall (Sharp), Diego Santa Cruz (VisioWave / GE Security), Ji Ho Park (LG Electronics), Seung-Wook Park (LG Electronics), Byeong-Moon Jeon (LG Electronics), Takeshi Chujoh (Toshiba), Takahiro Kimoto (NEC), Satoru Sakazume (Victor Company of Japan), Yeping Su (Thomson), Purvin Pandit (Thomson), Jungyoup Yang (Sungkyunkwan Univ.), Nathalie Cammas (France Telecom), Stéphane Pateux (France Telecom), Teruhiko Suzuki (Sony), Hae Kwang Kim (Sejong Univ.), Tomoyuki Yamamoto (Sharp), Patrick Rault (FastVDO), Jung Wong Kong (ETRI), Rich Hall (Polycom), Xinjian Meng (Huawei), Lianhuan Xiong (Huawei), Thomas Wedi (Panasonic), Steffen Wittmann (Panasonic), Seyoon Jeong (ETRI), Haechul Choi (ETRI), Jie Jia (Sejong Univ.), Jizheng Xu (Microsoft Research Asia), Alex Eleftheriadis (Layered Media), Haoping Yu (Thomson), Ilhong Shin (KAIST), Woo-Shik Kim (Samsung AIT), Edouard Francois (Thomson), Jerôme Vieron (Thomson), Yoshihiro Miyamoto (NEC), Per Fröjdh (Ericsson), Francesco Ziliani (VisioWave GE), Lieszek Cieplinski (Mitsubishi), Marta Karczewicz (Nokia), Dae-Sung Cho (Samsung AIT), Hyun Mun Kim (Samsung AIT), Shen Sheng Mei (Panasonic), Chong Soon Lim (Panasonic), Barry Haskell (Apple), Xiaozhong Xu (Tsinghua Univ.), Yoshiyuki Yashima (NTT), Isabelle Amoneu (FT), Tokumichi Yashima (NTT), Kohtaro Asai (Mitsubishi), Yoshihisa Yamada (Mitsubishi), Sam Narasimhan (Motorola), Kihun Han (Sejong Univ.), Yung-Lyul Lee (Sejong Univ.), So Yong Kim (Samsung), Jani Toiminen (Nokia), Tomokazu Murakami (Hitachi), Gwang Moon Park (KyungHee University), Daijiroh Ichimura (Panasonic), Jong Ki Han (Sejong Univ.), Zhungkang Lu (I2R), Huifang Sun (Mitsubishi Electric), Ulrich Fecker (Univ. Erlangen-Nuremberg), Takashi Itoh (Fujitsu Labs), Wonseon Song (Soongsil Univ.), Jie Jia (Sejong Univ.), Christine Guillemot (INRIA), Xavier Henocq (Canon Research France), Patrice Onno (Canon Research France), Florelle Pauchet (INRIA), SongJun Yu (Kwangwoon Univ.), Chang Beon Ahn (Kwangwoon Univ.), Seoung-Jun Oh (Kwangwoon Univ.), Yi-Jen Chiu (Intel), Truong Cong Thang (ICU), Tae Meon Bae (ICU), Arild Fuldseth (Tandberg), Jung Won Kang (ETRI), Taehee Kim (Samsung Electronics), Detlev Marpe (Fraunhofer HHI), Thomas Schierl (Fraunhofer HHI), Arnaud Bourge (Philips), Seon Tae Kim (ETRI), Phoom Sagetong (Qualcom), Suk Kyu Sung (ETRI), Ofer Shapiro (Layered Media), Thomas Radhgen (Ilmenau Tech. Univ.), Takashi Nishi (Oki), Katsumi Tahara (Sony), Frank Bossen, Onur G. Guleryuz (DoCoMo Labs), Vincent Bottreau (Thomson), Shih-Ta Hsiang (Motorola), Jean Kypreos (Envivio), Cheh Ying (Thomson), Wenguo Li (I2R), Thiow Keng Tan (NTT DoCoMo), Yun He (Tsinghua Univ.), Siwei Ma (USC), Chi-Cheng Chu (MediaTek), Chih-Hui Kuo (MediaTek), Yung-Ki Lee (Sejong Univ.), Dae Yeon Kim (Sejong Univ.), Takayuki Nakachi (NTT), Choon Seo Park (ETRI), Jim-Hwan Jeong (ETRI), You-Sun Kim (Korea Univ.), Marian Muozko (Telekomunikacjia Polska),

138

Pawel Piotrowski (Telekomunikacjia Polska), Lazar Bivolarski (Commex Technology), Emin Martinian (MERL), Faisal Ishtiaq (Motorola), Han-Sae Song (Seoul Natl. Univ.), Yuriy Reznik (Qualcomm), Iole Moccagatta (IMEC), Seung-Uk Yoon (GIST), Doug Y. Suh (KHU), C.J. Lee (Panasonic), Marina Bosi (MPEG LA, LLC), Wade Wan (Broadcom)

4 MPEG-7

4.1 MPEG-7 related work in Nice The MPEG-7 breakout group was active during the whole week. Input documents as reviewed are listed in the table below.

12461 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-3:2002/FPDAM 2 [SC 29 N 6919]

12540

Sang-ki KimSangyoun LeeSun-jeong KimJung-Ho Choi

CE Report for VCE-5

12545 Soo-Jun ParkMyung Gil Jang

Cross verification report of CE for photo categorization (VCE-2)

12652 Akio Yamada Proposed update on Photo Player WD

12654 Akio YamadaSang-Kyun Kim Editors' Study of ISO/IEC 15938-3:2002/FPDAM2

12655 Akio YamadaSang-Kyun Kim Editors' Study of ISO/IEC TR 15938-8/PDAM2

12656 Akio YamadaSang-Kyun Kim MPEG-7 Visual eXperimental Model version 25.1

12657

Sang-Kyun KimSeungji YangKyong Sok SeoSi Hyoung LeeYong Man RoJi-Yeon Kim

CE Report for Photo Categorization (VCE-2)

12663 Wo Chang Proposed Profile Schema for Photo Player MAF

12683

Jae-Gwi ChoiWeon-Geun OhA-Young ChoIk-Hwan ChoHyun-Mi KimDong-Seok JeongHae-Kwang Kim

Further feasibility test results of MPEG-7 visual descriptors as a Visual Identifier descriptor

A new non-normative tool called “Image Categorisation Tool” was approved for the XM (M12312). This tool supports automatic (unsupervised) categorisation of photographs and images based on 5 visual descriptors. Categorise currently supported include: Architecture, Indoor, Terrain, Sunset, Snowscape, Water-side, Nightscene.

A significant progress was made in development of the Photo Player MAF specification. The PP MAF supports multiple collections of the images in the archive, but it can also work with a single image. Metadata information can also be provided on the collection level. In order to simplify PP applications, a small (restricted) MAF-PP schema was generated based on the MPEG-7 schema. Joint meetings on Photo Player MAF were held with the Requirements and the MDS groups to ensure consistency between different MAF’s under development. A Committee Draft (CD) of the Image Player MAF was completed.

139

Work continued on Visual tools and Description Schemes for image or photo- libraries. The main focus remains on the development of new visual Description Schemes, Descriptors and other algorithms for applications related to digital image libraries, such as personal collections of photos from digital cameras. Tools supporting “situation-based image clustering” and “image categorisation” have been completed and now work focuses Identity-based image clustering, and Robust Face Recognition technology. A new CE on Visual Identifier was defined. The following Core Experiments are running:

VCE-2 - Image CategorisationVCE-3 – Identity-based clustering, indexing and retrieval of imagesVCE-4 – Robust Face Recognition technologyVCE-5 – Evaluation of MPEG-7 Face Recognition Technology on IR ImagesVCE-6 – Visual identifier descriptor

Joint meetings:1. With MDS: developing a simplified PP MAF schema (task completed)2. With ISG: MPEG-7 Visual XM software maintenance and addition of new elements3. With Requirements: CBsearch – Standardised Query and Response language4. With Systems: To signal potential interoperability problems when a restricted schema is

used with BiM

4.2 Output documents related to MPEG-7 Visual

No. Title TBP Available15938-3 MPEG-7 Visual

7559 Disposition of Comments on ISO/IEC 15938-3:2002/FPDAM2 No 05/10/217560 Text of ISO/IEC 15938-3:2002/FDAM2 Perceptual Shape Descriptor No 05/10/217561 MPEG-7 Visual XM Document version 26.0 No 05/11/037562 Description of Core Experiments for MPEG-7 New Visual Extensions No 05/10/21

4.3 Output documents related to MPEG-7 Part 8

No. Title TBP Available15938-8 MPEG-7 TR (ext. and use of MPEG-7 descriptions)

7563 Study Text of ISO/IEC 15938-8/PDAM2 No 05/10/21

4.4 Output documents related to MPEG-A Photo Player MAF

No. Title TBP Available23000-3 Photo Player Multimedia Application Format

7564 Text of ISO/IEC 23000-3 CD Photo Player Multimedia Application Format

Yes 05/12/15

5 23002 MPEG-C Video Technologies

5.1 Fixed-point DCT/IDCT

Following the issuance, at the 73rd WG 11 meeting, of a Call for Proposals toward development of a fixed-point IDCT and DCT standard, 9 proposal contributions were received from 7 organizations. In some proposals, more than one particular algorithm was discussed. In the initial phase of discussion, a rough grouping of the proposal algorithms into three categories was made as follows

140

Techniques based on or conceptually similar to [Y. Arai, T.Agui and M. Nakajima, "A Fast DCT-SQ Scheme for Images", Transactions of the IEICE E71(11): 1095, November 1988] (esp. in regard to the inclusion of a non-power-of-2 pre-scaling stage): 12509 , 12510, 12607, 12686 (method I), 12689

Techniques based on or conceptually similar to [C. Loeffler, A. Ligtenberg, and G. S. Moschytz, "Practical fast 1-D DCT algorithms with 11 multiplications", Proc. IEEE Intl. Conf on Acoust., Speech, and Signal Proc. (ICASSP), vol. 2, pp. 988-991, Feb. 1989]: (esp. in regard to a lack of a non-power-of-2 pre-scaling stage) 12531, 12617, 12665, 12686 (method II)

Techniques based on a “lifting” structure: 12508

Some of the proposal contributions were registered or uploaded somewhat late, or were originally uploaded without software or were otherwise modified after their initial upload. The group discussed details of various proposals toward identifying any missing information and obtaining improved test results, software, and documentation. The latest versions of each proposal were included in the discussion.

In response to some of the issues in the discussion, and additional late document providing comments on scaling issues was provided as contribution 12711. This contribution was considered by the group as information to be studied in the future work.

An output document N7565 was created to provide a summary of the algorithms of the various proposals and to provide very-high-level (non-verified) summary information regarding their complexity. It appeared, however, difficult to reach a unification within such groups at this stage, and more investigation of implementation issues appeared necessary. To achieve this, it was agreed to establish a common software testbed N7566 that will allow an evaluation of the different proposals under unified conditions until the next MPEG meeting. Pankaj Topiwala was designated as the coordinator for the editing of both the summary document and the software testbed.

Some contributors deviated somewhat in the content of their software copyright disclaimer text format relative to MPEG’s template. It was agreed that the group software would use the current MPEG template format. Individual proponents are to provide an implementation of their IDCT as a subroutine that would fit into the structure of the group software. Some proponents indicated that at this stage of work, as MPEG has not yet decided on an adopted basis for a working-draft design, they may use somewhat different copyright text in the subroutine(s) specific to their proposal at this time.

A key aspect of the selection of a design for a fixed-point IDCT/DCT standard is the need to agree on the degree of necessary accuracy, i.e., the degree to which accuracy beyond the requirements specified in well-defined tests such as those of FCD 11172-6 is (or is not) necessary. It was particularly asserted in one proposal contribution (12531) that significant accuracy beyond the degree specified in FCD 11172-6 is needed in order to prevent visual artifacts to a degree acceptable to industry requirements.

The software testbed coordination activity is an effort to test specific algorithms, which is a separate activity from any discussion of what would be required to claim conformance to the new standard. Another issue raised in contribution 12531 is whether an alternative conformance criteria different than what was envisioned in the Call for Proposals is desirable. This issue can be summarized as follows:– Hypothetical conformance requirement anticipated in CfP material: Take any input

spatial-domain samples in the range of –X to +Y, process it with an ideal integer-output

141

forward DCT, then process it with the specified fixed-point IDCT and with the IDCT under test. An exact match would then be required in all cases.

– Hypothetical alternative proposed conformance requirement proposed by Broadcom (contribution 12531): Run some specified set of tests to measure whether performance falls within specified accuracy tolerances. (Which presumably would be much more stringent than what is already specified in other standards.)

The consideration of whether to use an alternative conformance criteria formulation as proposed in contribution 12531 was not agreed and was left as a topic for further study.

An Ad Hoc Group was created to further the work and study on this topic during the interim period between the 74th and 75th meetings of WG 11.

Documents reviewed:12508 D. Tran Lijie Liu and Pankaj N.

TopiwalaFast Fixed-Point Multiplier-less DCT/IDCT Approximation Based on the Lifting Scheme

12509 D. Tran Lijie Liu and Pankaj N. Topiwala

Fast Fixed-Point Multiplier-less DCT/IDCT Approximation Based on Loeffler Structure

12510 D. Tran Lijie Liu and Pankaj N. Topiwala

Fast Fixed-Point Multiplier-less DCT/IDCT Approximation Based on Loeffler Structure II

12531 Sheng ZhongSandy MacInnis High Fidelity Fixed point 8x8 IDCT and DCT algorithms

12607 Yuriy Reznik Fixed Point Multiplication-Free 8x8 DCT/IDCT Approximation

12617Ci-Xun Zhang, Jing Wang,Xin-Hao Chen, Qian Hu, Xing Li, Lu Yu

Fixed-Point 8x8 IDCT, further result

12665 Gary J. SullivanJian Lou

Response to N7335 CfP on Fixed-Point 8x8 IDCT and DCT Standard

12686 Honggang Qi, Wen Gao, Debin Zhao and Siwei Ma Fixed-point multiplier-less 8x8 IDCT

12689 Arianne T. HindsDr. Joan L. Mitchell Fixed-Point Discrete Cosine Transform Proposal

12711 Wael BadawyIhab Amer

Comments on the sensitivity of the scaling factor for DCT/IDCT

Output documents:No. Title TBP Available

23002-2 MPEG-C Fixed point IDCT and DCT7565 Analysis and Summary of fixed-point DCT/IDCT Proposals No 05/10/287566 SW Testbed for fixed-point DCT/IDCT Proposals No 05/11/10

6 Explorations

6.1 Multiview Video Coding

Following the Call for Proposals on Multiview Video Coding, 13 pre-registrations were received (7 from industry, 4 from research institutes, 2 from universities). In further preparation of the CfP, AVC simulcast anchor encoding was performed, and it was decided to apply a minor change of rate points (new points lower) for one sequence, where it could otherwise be expected that it would become hard to see any differences. Further, the accuracy of camera parameters was tested. It was found that the new parameters provided by the providers of the sequences were accurate enough (feature points closely found on the epipolar lines), except for one sequence. A minor update of the Call was made according to these findings.

142

Technical input documents 12485, 12487, 12512 and 12542 were reviewed. These are considered as purely informative at this moment , but may be updated in the context of responses to the Call or later.

In 12595 and 12600, a proposal is made to use existing video codecs for encoding of depth maps. It is claimed that this would bee beneficial for simple stereoscopic application based on depth/disparity maps and view projection (2D+Z). The approach seems to be simple to implement. In general, it was regarded as useful to have a generic format for depth/disparity encoding (if justified by application cases), possibly with different complexities (bit depth, spatio/temporal subsampling etc.). Furthermore, it is important to identify the relationship with the ongoing CfP. A joint meeting with the Systems and Requirements subgroups was also held on this topic. It was decided to perform a study within an AHG to identify importance of application cases possible solutions in context of MPEG standards, and limitations of the approach relationship with technologies proposed in forthcoming CfP, and their applicationsDocuments reviewed:a) Related to the CfP and test sequences

12518 Hideaki KimataMasaki Kitahara

Anchor bitstreams for Call for Proposal on multi-view video codingFor RENA sequences, anchor results seem not suitable because they only cover high quality range.

12546

Kwanghoon SohnYongtae KimChangseob ParkJaeho Lee

Validation of carmera parameters in terms of epipolar geometry Deviation of up to 3 pixels found between epipolar line and matching point (in RACE sequence).

b) other technical input

12485

Yo-Sung HoSeung-Uk YoonEun-Kyung LeeSung-Yeol KimKugjin YunDaehee KimNamho Hur

Generation and Coding of Layered Depth Images for Multi-view VideoAn approach for using layered depth information (LDI) in multi-view- video coding is described. It is also mentioned that presently accurate estimation of depth from the available test sequences is not possible yet in some cases.

12487Ulrich FeckerMarcus BarkowskyAndré Kaup

Luminance and Chrominance Compensation for Multi-View Sequences Using Histogram MatchingThe usage of histogram matching for the compensation of luminance and chrominance variations in multi-view sequences is proposed. A description of the histogram matching algorithm is given and the effect on the histogram of a sample image is illustrated. Histogram matching is applied to multi-view sequences and the impact on the block matching step of a multi-view video coder is analysed.

12512 Tae-Hyeun HaJae-Phil Koo

Spatial vector prediction by Camera Parameter:Show that camera parameters are needed and improve compression efficiency, but no specific proposal for encoding – results announced for next meeting

12542

Yo-Sung HoKwan-Jung OhHan OhByeong-ho ChoiJe-Woo Kim

Multi-view Video Coding based on Lattice-like Pyramid GOP StructureThe lattice-like GOP structure is an arrangement of I frames that can have a big effect on the overall bit-rate and coding efficiency. The pyramid GOP structure is a hierarchical coding framework to improve coding efficiency within the GOP. A variable search range method for successful spatial referencing is proposed.

12595 jan van der meer Proposal to define depth map coding for stereoscopic

143

fons brulschris varekamparnoud bourgealjoscha smolicshijun sun

applications

12600

jan van der meerfons brulschris varekamparnoud bourgealjoscha smolic

Draft depth map stream formatProposal to encode depth maps by 8 bits using existing video standards. Spatial and temporal subsampling should be allowed. Non-normative annex proposes how rendering can be done, including proposal for linearized approach.

Output documents:

No. Title TBP Available3D AV

7567 Updated Call for Proposals on Multi-View Video Coding Yes 05/10/21

6.2 Video Coding Tools Repository

The VCTR activity was related to the setup of requirements, preparation of the demo that was planned for the 74th meeting and work on improvements of the Study and Textual Description documents, and the software. The Study document V6.0 (N7568) newly includes a method for universal parsing description and a formalism description as presented in M12682 and M12489. The Textual Description V5.0 (N7569) newly includes AVC High Profile-based FUs as presented in M12513. The VCTR Software V4.0 (N7570) is also updated by integrating these FUs, as well as further improvements collected in M12556.A demo on VCTR achievements was shown during the closing plenary. Implementations of the following capabilities were presented: Reconfigurable coding at bitstream level: Decoding of a bitstreams that are composed from

MPEG-2 Video and MPEG-4 AVC elementary streams Reconfigurable profiles: Usage of shape coding tools with MPEG-4 Visual simple profile Reconfigurable coding at macroblock level: Insertion of intra prediction tools from different

standards into MPEG-4 Visual simple profile encoder Reconfigurable coding at frame level: Decoding of a bitstreams that is composed from

interleaved MPEG-4 Visual and MPEG-4 AVC encoded frames Generation of new "advanced" 4:4:4 profile by inserting newly designed tools

Documents reviewed:

12489

Jorn Janneck Marco Mattavelli Dave Parlour Robert Turney

Proposal for a VCTR formalism description and simulation framework

12513

Kazuo SugimotoYoshihisa YamadaKohtaro AsaiTokumichi Murakami

Proposed update of TD 4.0

12514

Kazuo SugimotoYoshihisa YamadaKohtaro AsaiTokumichi Murakami

Update of VCTR Reference Software - Intra Only Decoder for AVC High Profile

12556

Sinwook LeeSunyoung LeeChungku YieEuee S.Jang

Status report of VCTR Ref. SW

12557 Hyunsoo AhnSunyoung Lee

VCTR demo scenario on bitstream reconfigurable coding and profile free coding

144

Yongho choByeongwook MinHyungyu KimSinwook LeeChungku YieEuee S.Jang

12618

Chung-Yi WengWei-Kai Steve SuYi-Shin TungJa-Ling Wu

Contribution to VCTR Reference Software - Provision and Correction of Syntax Parsing and VLD functional units for MPEG-1 and Intra-Only MPEG-4 Decoder

12619Wei-Kai Steve SuYi-Shin TungJa-Ling Wu

New Codec Generation and Coding Tool Evaluation using VCTR Framework: An Example to Use Different Intra Prediction Tools

12682

Hyungyu KimSunyoung LeeHyunsoo AhnChungku YieEuee S.Jang

Conceptual framework of reconfigurable bit-stream syntax management

12690 Patrick Rault

VCTR: An example of multistandard video codec implementationReports that amount of code sharing between M4P2 and AVC relatively low

Output Documents:

No. Title TBP AvailableVideo Coding Tools Repository

7568 Study of Video Coding Tools Repository V6.0 Yes 05/10/287569 VCTR Textual Description V5.0 No 05/10/217570 VCTR Software V4.0 Yes 05/11/12

6.3 Wavelet Video Coding

The breakout group on wavelet video coding has performed a first review of status (after one year of exploration). Results are mainly based on an extensive comparison between the best wavelet codec from the 70th (Palma) meeting against the present status of development, using the testing conditions of the core experiments previous to Palma, purely based on PSNR criteria. In general, the compression performance is clearly improved over the previous wavelet coding, in particular at lower spatial resolutions. However, compared to the present status of the SVC / JSVM development, results are still inferior for QCIF and CIF, while in case of single sequences, results are comparable at the 4CIF resolution. A "draft status report" (MPEG internal, N7571) was issued which summarizes the present development technically and w.r.t. results. A section about potential applications of wavelet technology is also included, however so far no functionalities were identified yet that not obviously could be fulfilled by SVC. It is planned to further improve this status report from discussions in the AHG and issue a new version by the next meeting. Other output documents are the description of exploration experiments (N7572) and the new version of the wavelet codec reference document and software manual (N7573). From the exploration experiments, further improvements are expected after bug fixing and integration of more tools proposed. One experiment is targeted to the preparation of subjective viewing assessment that is planned for the 75th meeting. The following tests are planned:(1) Performance at highest rate points(2) Visual comparison vs. one-year-old wavelet using “Palma” conditions (3) Visual comparison vs. JSVM

a) using common JSVM test conditions (may be delayed if found inappropriate to be fulfilled by the present wavelet codec)

145

b) further test cases e.g. more sequences or extending ranges of scalability(4) Visual test cases to be derived from prospective wavelet application scenarios (e.g. extremely high-resolution materials)The target of such tests is not a competition of wavelet technology against the SVC standard under development, but rather finding of advantages of such technology that point beyond the capabilities and application scope of SVC.

Documents reviewed:12616 Gregoire Pau

Beatrice Pesquet-Popescu Proposal of Vidwav OBMC bug fix

12633

Marta MrakNikola SprljanNaeem RamzanEbroul Izquierdo

Motion Driven Adaptation of Spatial Wavelet TransformAdaptation of spatial filters according to the motion information available at the decoder. Mainly done by observing discontinuities at block boundaries in the lifting structure. Cannot presently be combined with intra prediction. Reports marginal gain in PSNR, but some strange blocking artefacts disappear.

12639Nicola AdamiMichele Brescianini Riccardo Leonardi

Edited version of the document SC 29 N 7334Proposal for updated version of reference manual.

12640 Markus BeermannMathias Wien

Wavelet Video Coding EE4: Joint Reduction of Ringing and BlockingExtension of previous de-ringing filter method. Shows partial advantages of performing de-ringing not as post-processing, but after each level of MCTF synthesis, and takes into account constellations of motion vectors in the adaptation of the filters, which allows simultaneous operation for the purpose of de-blocking.

12642

Nicola AdamiMichele Brescianini Riccardo LeonardiAlberto Signoroni

New prediction schemes for scalable wavelet video codingUses low-to high resolution prediction of LL band at next-higher spatial resolution. Implemented AVC base layer compatibility, use adapted temporal decomposition and closed loop. Does not utilize motion prediction across layers. STOOL might also be combined on top with using JSVM for QCIF and CIF.

12643

Nicola AdamiMichele Brescianini Riccardo LeonardiAlberto Signoroni

Performance evaluation of the current Wavelet Video Coding Reference SoftwareShows some good improvement due to STOOL at the lower resolutions. JSVM typically still better by 1-2 dB. Different comparisons made, own reference, averaged reference etc. Remark: Strange that for STOOL own reference performs worse than common reference.

12699 Ruiqin Zhong Verification of Vidwav EE4 results of RWTHVerification of 12640.

Output Documents:

No. Title TBP AvailableWavelet Video Exploration

7571 Draft Status Report on Wavelet Video Coding Exploration No 05/10/217572 Description of Exploration Experiments in Wavelet Video Coding No 05/10/217573 Wavelet Codec Reference Document and Software Manual V2.0 No 05/11/03

6.4 Workshop on Future Directions of Video Compression

146

On Sunday prior to the MPEG meeting, the second workshop on Future Directions of Video Compression was held in which the presentations were given on the following topics:

a) Development of compression technology:- Distributed video coding- Methods for global optimization of encoder decisions- Texture synthesis- 3D object modeling- Warping motion modelsb) Development of tools applications:- Video coding tools repository- Digital cinema presentation environment- Wide-gamut colour spaces- Testing of high-quality video compression- Development of storage and display technology- Video surveillance application and the role of standards

The workshop was attended by approximately 150 participants. It clearly showed the potential in future technical development of video coding in the long term, as well as newly emerging applications and devices, all with potential implications on standards development. From the discussions, no need for immediate action in standardization was identified, but it will clearly remain an important task of the video group to watch the development of newly emerging compression technology and invite experts to perform a qualified assessment under prospective application perspectives.

Output documents:No. Title TBP Available

Workshop on Future Directions in Video Compression7574 Results of Second Workshop on Future Directions in Video

Compression Yes 05/10/29

7 Promotion

7.1 Introduction Documents

The Video subgroup approved an introduction document related to MPEG-7 DDL.

Output documents:

No. Title TBP AvailableIntroduction Documents

7558 Introducing MPEG-7 DDL – an Overview Yes 05/10/21

147

Annex 9Report of Audio

Source: Schuyler Quackenbush, Chair, Audio Subgroup

1 Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 74th meeting of WG11, October 17-21, 2005 in Nice, France. The list of participants is given in Annex A.

2 Administrative matters2.1 Approval of previous meeting reportThe 73rd Audio Subgroup meeting report had been previously distributed by e-mail and was approved.

2.2 Approval of agenda and allocation of contributionsThe agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in Annex B.

2.3 Task GroupsTask groups were convened for the duration of the MPEG meeting, as shown in Annex C. Results of task group activities are reported below.

2.4 Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.

2.5 Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.Groups What Where Day TimeAll MAF Req Tue 1400-1800Audio and Systems m12470,m12613,m12668,m12488,m12620 Systems Wed 1100-1300All Proposed Protected Music MAF Req Thur 1200-1300

2.6 Received National Body Comments and Liaison mattersThe NB Comments and Liaison documents for the meeting that require a response are as shown below.No. Title Response by

12530 USNB Contribution: Performance measure for SLS S. Quackenbush

12526 DNB comment on request to maintain fastest possible schedule for MPEG Surround J. Van der Meer

148

12667 GNB comment regarding the standardization time line for MPEG Surround

R. Sperschneider

12529 USNB Contribution: ISO/IEC 23003 Issues S. Quackenbush

12694 GNB comment on the MPEG Audio coding standards structure

R. Sperschneider

12527 USNB Contribution: Regarding “MAFs under Consideration”

Members of USNB

12672 GNB comments on MAF S. Kraegeloh

12458 Liaison Statement from ITU-T SG 16 [SC 29 N 6894] No response

12476 IEC CDV 61937-8 [SC 29 N 6946] No response12688 Lossless Compression – Applications & R P. Jessop

Ralph Sperschneider, FhG, presented additional details on

12694

Ralph Sperschneider on behalf of the German National Body

GNB comment on the MPEG Audio coding standards structure

This NB comment proposes a possible new structure of ISO/IEC 23003 which would look as listed below. 23003 - MPEG Audio coding=========================23003-1: MPEG Audio: Overview23003-2: MPEG Audio: Decoder Conformance23003-3: MPEG Audio: Reference software23003-4: MPEG-1 Audio: Layer 1/2/323003-5: MPEG-1 Audio: Bitstream Conformance23003-6: MPEG-2 Audio: Layer 1/2/323003-7: MPEG-2 Audio: AAC23003-8: MPEG-2 Audio: Bitstream Conformance23003-9: MPEG-4 Audio: Main23003-10: MPEG-4 Audio: Bitstream Conformance23003-11: MPEG-4 Audio: Speech coding - HVXC23003-12: MPEG-4 Audio: Speech coding - CELP23003-13: MPEG-4 Audio: General Audio coding (GA) - AAC, TwinVQ, BSAC23003-14: MPEG-4 Audio: Structured Audio (SA)23003-15: MPEG-4 Audio: Text To Speech Interface (TTSI)23003-16: MPEG-4 Audio: Parametric Audio Coding - HILN23003-17: MPEG-4 Audio: Parametric coding for high quality audio - SSC23003-18: MPEG-4 Audio: MPEG-1/2 Audio in MPEG-423003-19: MPEG-4 Audio: Lossless coding of oversampled audio - DST23003-20: MPEG-4 Audio: Audio Lossless coding (ALS)23003-21: MPEG-4 Audio: Scalable Lossless coding (SLS)23003-22: MPEG-4 Audio: MPEG Surround

Audio experts and personnel of ITTF made similar remarks, paraphrased here: “that these standards are well known in the market and that the current specification numbering has been heavily cross referenced, and any changes to that numbering could cause havoc in for implementers. Also each standard has its own scope and I doubt you could produce a scope so generic to cover all the standards.In a nut shell this could cause harm to MPEG and confusion to the user.”The Audio Subgroup decided to take no action on the GNB recommendation.

3 Record of AhG meetings149

In order to obtain a compete view of the business of this MPEG meeting, discussion of contributions in AhG meetings are recorded in this section of the Audio report.

3.1 Spatial Audio Coding (Sunday 0900 – 1330)David Virette, France Telecom, presented

12609 David Virette Cross-check of the low rate and high quality MPEG Surround bitstreams

The contribution agreed with previously presented data from FhG.David Virette, France Telecom, presented

12608 David Virette Cross-check of the Core Experiment on non-guided MPEG Surround

The listening tests presented in this contribution confirmed that the mean listening score for non-guided MPEG Surround is better than ProLogicII and Logic7 at the 95% level of significance.Hee-Suk Pang, LGE, presented

12547

Hee-Suk PangDong Soo KimJaehyun LimHyen-O OhYang-Won Jung

Report on Non-Guided MPEG Surround Verification Test

The listening tests presented in this contribution indicated that the mean listening score for non-guided MPEG Surround is better than ProLogicII at the 95% level of significance, but not different from Logic7 at the 95% level of significance. However the mean score for non-guided MPEG Surround is better than Logic7.Kristofer Kjörling, Coding Technologies, presented

12582Kristofer Kjörling Heiko Purnhagen

Verification of the Non-Guided MPEG Surround CE

The listening tests presented in this contribution confirmed that the mean listening score for non-guided MPEG Surround is better than ProLogicII and Logic7 at the 95% level of significance.Based on evidence of the previous three contributions, it was the consensus of the AhG that this CE is complete and to recommend that the non-guided MPEG Surround technology be added to the working draft.Werner Oomen, Philips, presented

12559 Jeroen BreebaartChristof Faller MPEG Surround Non-guided modifications WD

The AhG recommends that this text be incorporated into the MPEG Surround working draft.

Jeongil Seo, ETRI, presented

12543

Jeongil SeoSeungkwon BeackSang Bae JeonInseon JangKyeongok KangJinwoo HongMinsoo Hahn

Core Experiment on Efficient Quantization Method for CLD

The contribution proposes to quantize the channel level differences (CLD) in a new quantizer (VLSI) based on perceptual aspects of localization of sounds in space. It reviewed the timeline of the core experiment and the basis for comparison with RM0.

150

The following issues impacted the core experiment: Bug fixes in RM0 Change in random access point frequency Use of reference encoder vs. reference-quality encoder

Heiko Purnhagen, Coding Technologies, presented

12586

Purnhagen Kristofer Kjörling Claus-Christian Spenger Werner Oomen

Analysis of proposed CE on CLD quantization

This contribution made two points A coarser quantizer will give increased compression.

The MUSHRA test methodology has considerable uncertainty, as indicated by the 95% confidence intervals, such that one has to change the side information by a considerable amount (e.g. a factor of 2) in order to achieve a discernable difference at the 95% level of significance.

Its overall conclusion is that there already exists in RM0 many mechanisms to change the rate-distortion tradeoff. Discussion on CLD CE:Proponents did the experiment for ETRI, hence the proprietary encoder library was not released. However proprietary encoder technology was made available. The ETRI VSLI quantizer is based on the perceptual acuity of localizing sound in space. There was some discussion as to whether this was meaningful in the context of the RM0 tree structure of coding CLD.Target compression improvement is 5%, but that can be less that 5% if there is no appreciable increase in complexity or reduction in quality. There was considerable discussion as to whether MUSHRA was sufficiently accurate to conclude that the tool shows no significant distortion.The AhG accepts this proposal as a CE proposal and recommends that independent cross-check of the technology be brought to the next meeting.Dong-Soo Kim, LGE, presented

12548

Dong Soo KimHee-Suk PangJaehyun LimHyen-O OhYang-Won Jung

High Frequency Energy Compensation for MPEG Surround

This contribution noted that the ratio of energy in the MPEG Surround multi-channel reconstruction and the MPEG Surround downmix, as measured in low, mid and high bands is nearly 1 for the low band, higher for the mid band and significantly greater than 1 for the high band. It proposes syntax and semantics for high frequency energy compensation (HFEC) to normalize the multi-channel energy envelope.The contribution noted that HFEC could be done three ways:

As presented in contribution. Using RM0 arbitrary gain compensation parameters. In encoder, without the need for transmitted side information or decoder action.

There was considerable discussion on this contribution. It was noted that perhaps the most important case of the proposed technology is when artistic downmix is used, but that this was not tested.

151

The AhG recommends that additional evidence be brought on the performance of the technology when using artistic downmix, and also when used in conjunction with the arbitrary downmix parameters. Specifically, that a workplan be drafted to address:

The repeat of the contribution experiment, but using artistic downmix signals. Whether the experiment presented in the contribution can be done as an encoder-only

operation.

Werner Oomen, Philips, presented

12566

Gerard HothoLars VillemoesJeroen breebaartHeiko PurnhagenJonas Roden

Verification of MPEG-Surround Artistic Downmix and next steps

This contribution described the purpose of the ArbitraryDownmixGain parameters. In the case that the encoder is presented with a multi-channel signal and an artistic downmix signal, the ArbitraryDownmixGains permit the decoder to recreate an approximation of the downmix that the encoder would produce from the multi-channel signal, and to then apply the spatial cue parameters to that signal. The contribution shows that the ArbitraryDownmixGain parameters have dramatic effect if the artistic downmix is processed by an Orban-style dynamics processor. It was the consensus of the AhG that this contribution satisfies the requested verification of the RM0 technology.Werner Oomen, Philips, presented

12580

Jeroen BreebaartHeiko PurnhagenKarsten LinzmeierChristof Faller

MPEG Surround: Evidence of the Matrix Compatibility configuration

This contribution brings evidence of the compatibility of the MPEG Surround matrix encoding mode with other matrix decoders in the marketplace (i.e. ProLogicII and Logic7). It makes several conclusions:

Matrix compatible mode can be inverted in the decoder such that equivalent performance, when reconstructing a multi-channel signal based on side information, is achieved.

The performance of the ProLogicII decoder is better at the 95% level of significance when it decodes the matrix compatible signal as compared to the non-compatible signal.

It was the consensus of the AhG that this contribution satisfies the requested verification of the RM0 technology.Hee-Suk Pang, LGE, presented

12550

Hee-Suk PangDong Soo KimJaehyun LimHyen-O OhYang-Won Jung

Proposed Syntax Revision for Redundancy Reduction in MPEG Surround

This contribution shows a method to losslessly compress the per-frame side information. It presents a table for reduction in bit count, but only for the bits pertaining to the coding of these specific parameters. The AhG recommends that we take no action now, but instead ask for additional information on:

Bit reduction with respect to the entire side information. C-code that implements the parsing that permits evaluation of parsing complexity.

Hee-Suk Pang, LGE, presented12551 MPEG-D A Hee-Suk Pang Comments on the Bitstream Syntax for Residual

152

Dong Soo KimJaehyun LimHyen-O OhYang-Won Jung

Coding in MPEG Surround

This contribution shows a method to losslessly compress the per-frame side information. Audio experts felt that the compression advantage shown by the proposal came at the cost of reduced flexibility in the syntax (e.g. for possible future extensions), and therefore the AhG recommends that this CE not progress.Yang-Won Jung, LGE, presented

12552 MPEG-D A

Yang-Won JungHyen-O OhHee-Suk PangDong Soo KimJaehyun Lim

Proposed syntax revision for extended signaling in MPEG Surround

This contribution shows a method to losslessly compress the per-frame side information. It was noted that sometimes compression The AhG recommends that we take no action now, but instead ask for additional information on:

Bit reduction with respect to the entire side information. C-code that implements the parsing that permits evaluation of parsing complexity.

3.2 Lossless Audio Coding (Sunday 1400-1800)Werner Oomen, Philips, presented

12569 Werner OomenFrans de Bont

Proposed corrigenda DCOR1 to AMD6, (lossless 1-bit)

This contribution presented some issues that need to be corrected in this recent specification. The AhG recommends that these changes be incorporated into a DCOR to issue from this meeting.Schuyler Quackenbush, Audio Research Labs, presented

12688 Richard Gooch Lossless Compression – Applications & RThis contribution identifies several market needs for lossless audio compression. The Audio Subgroup will assist in drafting a response to this liaison later in the week.Ralf Geiger, FhG, presented

12572Ralf Geiger Markus Schmidt Jürgen Herre

Evaluation of MPEG-4 SLS in Near-Lossless Range

This contribution shows the performance of SLS under several operating conditions. One of them is at very low enhancement bit rates of, i.e. with a total SLS bitrate of from 128 kb/s to 320 kb/s, with a core lossy rate of 128 kb/s. For this case SLS performance was measured by both PEAQ ODG and Noise-to-Mask Ratio.The AhG recommends that this information be incorporated into the SLS performance document.Rongshan Yu, I2R, presented

12660 Rongshan YuHaibin Huang

Updates of compression performance of MPEG-4 lossless audio coding architectures

This contribution provides new information on the performance of both SLS and ALS architectures. The SLS performance is slightly different from previous reports due to both small syntax changes recently incorporated into the reference code and to additional encoder optimizations. ALS performance is reported using the backward The AhG recommends that this information be incorporated into the SLS performance document.Noboru Harada, NTT, presented

12537 Noboru Harada Performance evaluation of ALS on a PC platform153

Yutaka KamamotoTakehiro Moriya

This contribution presented performance of the latest ALS and SLS decoders and encoders. The AhG recommends we add at least the fast NNT ALS decoder performance results to the ALS performance document. Rongshan Yu, I2R, presented

12658

Rongshan YuJungHoe KimTi-Eu ChanEunmi Oh

Report on combine SLS with Scalable AAC and BSAC

This contribution reports compression performance when BSAC and Scalable AAC are used as core coders in the SLS architecture. The AhG recommends that this information be incorporated into the SLS performance document.Tilman Liebchen, TUB, presented

12593 Tilman Liebchen Proposed Draft Text of ALS Verification ReportThis contribution presents one view of what the ALS verification report could look like.

ConclusionsThe AhG recommends that there be two reports on ALS and SLS performance, and that these reports present tabular and graphical data in similar forms and graphical scales so as to permit direct comparison of the performance of the two architectures. The two reports should have the following common sections:

Introduction Architecture Performance criteria Performance results

o Tabular information as both compression ratio and compression size. There is no need to report byte counts of file sizes.

o Graphical compression size information

Where compressionRatio = originalSize/compressedSize and compressionSize = compressedSize /originalSize.The reports should reference only the ALS and SLS specifications and perhaps the original CfP. Published conference and journal papers can also be cited.

3.3 Symbolic Music Representation (Sunday 1900 – 1800)This activity is reported in Task Group section.

4 Audio plenary, joint meeting and task group activities4.1 Review of AHG reportsThere were no requests to review any of the AHG reports.

4.2 Received national body comments and liaison matters4.3 Audio plenary discussionsMPEG SurroundMPEG Surround will maintain the following standardization timeline:

CD at this week’s Wednesday MPEG plenary FCD at the 75th MPEG meeting in Jan, 2006 FDIS at the 77th MPEG meeting in July, 2006

154

Core experiments that propose new tools will be considered during this standardization process, with the understanding that all CEs must be completed at the 76th MPEG meeting in April, 2006. On a case-by-case basis, the Audio Subgroup can approve the integration of WD text and reference software as late as during the AHG period between the 76th and 77th meeting.Tue 6PMKristofer, Coding Technologies, presented the following two documentsN7529 Request for Subdivision of IEC 23003N7530 Text of ISO/IEC 23003-1:200x MPEG SurroundThe Chair spoke at length about his view of how each ongoing MPEG Surround CE might progress in the AHG period, and what CE proponents might bring as information to gain consensus on acceptance of their technology.The Chair asked (more than once) if any audio expert felt that they could not support promotion of this text to CD, and reminded experts that the Chair will take their support in Audio Plenary as indicating support of their National Bodies in Wednesday’s MPEG Plenary.Both of these documents were approved by unanimous consensus in the Audio Subgroup.

4.4 Joint Meetings 4.4.1 Joint with MDS, Req on Protected Music MAF1. Tuesday 1400-1800

Fernando Pereira noted that some of the discussion in the joint meeting may refer to N7280, MAFs under consideration.Stefan Kraegeloh presented

12672

Stefan Kraegelohon behalf of German National Body

GNB comments on MAF

The main points in this comment are that Interoperability is paramount. That “sub-formats” in MAF are appropriate.

It was noted that the sections in the Music Player MAF are simple enough so that there is no practical problem for all be mandatory tools. There will be a corrigendum to change the text so that is clear.Florian Pestoni presented

12527 A. G. Tescher for USNB

USNB Contribution: Regarding “MAFs under Consideration”

This contribution presented several points concerning tools and investigations relating to protected media MAFs.Hendry presented

12588HendryMunchurl KimFlorian Pestoni

A Flexible and Extensible Protection of Music Player MAF using Lightweight MPEG-21 IPMP

This contribution presented use cases for protected music content, and shows an example of using this structure which to address the case of a Protected Music MAF. It was noted that MPEG-21 IPMP Components offer interoperability at the level of description of the protection mechanism, but do not guarantee interoperability at the level of media presentation.Stefan Kraegeloh presented

12674 Stefan KraegelohHarald Fuchs

MAF Interoperability: Mandatory Tools vs. Default Signalling

155

This contribution reiterated the importance of interoperability as a goal of standardization. A specific choice of tools is a requirement for achieving interoperability. Fernando Pereira noted that making steps along an axis of “protection” is useful within MPEG. The current Music Player MAF offers “no protection.” For example: Protection Level Media

Music Image Etc. None Music Player MAFComponent 1 e.g. Stefan Kraegeloh

proposal.… (may be others)Component N e.g. Hendry proposal

Discussion and Consensus on proposed Protected Music MAFFernando Pereira proposed that there be two protected music MAFs in the MAF under consideration, one that achieves interoperability at the music presentation level and the other at the protection description level. It was the consensus of the experts present to expand N7280, MAFs under consideration, so that there are two MAFs that clearly describe the two protection mechanisms and protection goals. Stefan Kraegeloh presented

12673 Stefan KraegelohHarald Fuchs

proposed revised text on 'Protected Music Player' MAF described in MAFs under Consideration

It was pointed out that MPEG-21 IPMP Components could be useful in this application. This could be viewed as a “layer of protection” in table above.Harald Fuchs presented

12646

Harald FuchsStefan KraegelohThe TIRAMISU Project

Proposed Bundled License MAF

Harald Fuchs presented

12662 Harald FuchsStefan Kraegeloh

Proposed Corrigenda Items for ISO/IEC 23000-2 Music Player MAF

This contribution gives numerous changes that need to be made to this MAF. Additionally, it proposed to use the “sub-brands” in the MP4 file to indicate the particular MAF to which the file conforms. It also proposes to clarify that all sections are mandatory. It was agreed that this be a “proposed DCOR” to be approved by the Audio Subgroup, with the goal of further discussion during the AHG The following contributions were presented:

12589Chansuk YangJeongyeon LimMunchurl Kim

Extensions to Music MAF Player Format for Multiple JPEG images and Text data with Synchronizations to MP3 data

The proposal notes that there was an MPEG MAF Workshop in Korea where it was indicated that the MPEG Music Player MAF does not have sufficiently rich functionality to be interesting to industry.

12534 Tae Hyeon KimH. Jean Cha Proposal for Accompaniment Music Player MAF

This contribution shows an application running on a cellphone simulator that implements the Music Player MAF plus slide show and lyrics.These contributions were also presented

156

12647 Harald FuchsHerbert Thoma Proposed Slideshow MAF

12645Harald FuchsHerbert ThomaStefan Kraegeloh

Proposed Portable Video Player MAF

12684 Diepold Considering a MAF for Surveillance Video

2. Thursday 1200-1300

Stefan Kraegeloh, FhG, presented a revised version of the MAF under Consideration document, in which the previous Protected Music MAF section is split into MAF’s. These two MAF’s differ in that one focuses on media presentation interoperability, while the other focuses on protection description level interoperability. The media presentation interoperability MAF section states the objectives of such a MAF and an overview of how one might achieve those goals. A paragraph states that this proposal is supported by FhG, Thomson and Coding Technologies.The description interoperability MAF section states the objectives of such a MAF and an overview of how one might achieve those goals. A paragraph states that this proposal is supported by DRM Inside Inc., ICU, LG Electronics, Microsoft, Panasonic, Samsung Electronics, and Toshiba.There was considerable discussion on the two proposals and their respective features, strengths and weaknesses. The Requirements Chair reiterated that these two MAFs will be put into a revised version of the MAF under Consideration document.

4.4.2 Joint with Systems

Schuyler Quackenbush, Audio Research Labs, presented

12470 Schuyler Quackenbush Audio Codec Behavior

The contribution describes the desired behaviour of Systems and Audio with respect to two issues:

Maintaining synchronization of video and audio in the case that the audio decoder can operate in two modes, one with a greater throughput latency than the other.

Insuring that a waveform, encode, compressed representation, decode, waveform operation cycle produces an output waveform that is identical to the input waveform (with the exception of coding distortions), particularly that there is “nothing missing” at the beginning of the waveform and “nothing extra” at the end of the waveform.

This can be viewed as two separate problems, those being mandating 1) audio encoder/systems behaviour and 2) audio decoder/systems behaviour.It was the consensus of the group to:

Create a DCOR to MPEG-4 Systems Create a DCOR to MPEG-4 Audio Create a DCOR to MPEG-4 MP4FF (part 12) Create a Proposed Technical Report, which would become an amendment to MPEG-4

Audio.

Ralph Sperschneider, FhG, presented

12668 Ralph Sperschneider

Clarification on Definition of ExtensionProfileLevelDescriptor

This contribution raised a number of apparent inconsistencies in how Systems declares profile and level. There was considerable valuable discussion. It was noted that audio profile and level can be specified in an audio descriptor in the MPEG-2 Systems or Program transport streams.It was the consensus of the group to make

157

Editorial corrections (to 3rd edition) Correct errors in Systems via a DCOR to MPEG-4 Systems. AMD or COR to part 1 to add an informative annex. Consider an AMD part 14 to add informative annex.

Miska Hannuksela, Nokia, presented

12620Miska HannukselaJani Toiminen

ID3v2 tag in ISO base media file format

This contribution proposes to extend the udta box with a new box in the ISO base media file format that could contain ID3V2 meta data. Several experts noted that it may be a problem to reference the id3v2 metadata definitions in an ISO specification if they do not have the status of a recognized specification.Schuyler Quackenbush, Audio Research Labs, noted that the ID3V2 metadata set is very large and might not be appropriate for devices with limited resources (e.g. portable devices), and that ID3V1 could be a more realistic alternative.It was noted that the Music Player MAF already carries ID3V1 metadata as MPEG-7 descriptor values. Dave Singer, Apple, noted that “transcoding” or “importing” of one metadata format (e.g. ID3V2) into another metadata format (e.g. MPEG-7) can be undesirable if the exact values or character strings of the metadata cannot be preserved.

4.5 Task Group discussions4.5.1 MPEG Surround

Johannes Hilpert, FhG, presented

12626

Johannes HilpertAndreas HoelzerSascha DischWerner OomenKristofer KjoerlingChristof Faller

Evidence for the Low Complexity Mode of MPEG Surround

This contribution presents evidence for the performance of MPEG Surround RM0 when operating in Low Complexity mode. For all test cases T1, T2, T3), subjective tests show that there is no difference between the regular operating mode and low complexity mode, at the 95% level of significance. The subjective results suggests that the regular mode is better than the Low Complexity mode (but not significantly so at the 95% level) for the two applause items. The Chair noted that that this technology permits two decoding modes (normal and low complexity) of a single bitstream.It was the consensus of the Audio Subgroup that this contribution satisfies the requested verification of the RM0 technology, and to incorporate the “bug-fix” position of the TES module into the RM0 reference software V1.2 and the text of the MPEG Surround CD.Johannes Hilpert, FhG, presented

12631

Sascha DischKarsten LinzmeierMatthias NeusingerGerard HothoJuergen HerreJohannes Hilpert

Proposed Quality Enhancements for MPEG Surround

158

This contribution proposes a new tool, Guided Envelope Reshaping, for very fine adjustment of the time envelope for each output channel for both dry and diffuse components. The technology has been implemented and the contribution presents MUSHRA subjective test results. For the test items that contain significant isolated transient spatial events, the Guided Envelope Reshaping in combination with TES, provides significantly better mean subjective performance than TES alone provides at the 95% level of significance. The new tool provides significant improvements for the difficult “applause” items, and no quality degradation in quality for the remaining items.For T2 (reconstruction from mono downmix), the Reshaping tool has an ever greater positive impact on mean subjective quality.The Audio Subgroup accepts this CE and expects further information, including cross-check, at the next MPEG meeting. We note that order of CEs is important in determining the “baseline” against which this technology is compared.Chong Kok Seng, Panasonic, presented

12558

Chong Kok SengYoshiaki TakagiShuji MiyasakaKojiro OnoTakeshi NorimatsuNeo Sua Hong

Core experiment on an even lower complexity mode for MPEG Surround

The RM0 decoder is approximately 5 times the complexity of 2-channel AAC decoder. This contribution proposes a low complexity version of RM0 by using real-valued filterbanks. These filters are longer than those in RM0, which minimizes aliasing. An additional equalization tool further minimizes aliasing.New versions of existing tools:

QMF filterbank: use the real-valued filterbank from LP-SBR Nyqjuist splitting filters: only real modulating functions Decorrelation filters: no fractional delays New channel separation equations

New Tools: Equalizer to mitigate aliasing due to tonal signals components Subband Temporal Processing

Subjective performance data for STP tool Integrated matrixing

No degradation in sound quality Real filterbank Full Low Complexity decoder

No degradation in sound qualityIt is estimated that the full Low Complxity decoder will have a complexity that is 50% of that of an optimized RM0.Issues to consider in the workplan:

Possible re-use of STP tool in current RM0 Comparison of RM0 low-complexity mode and this proposal. Role of proposed new channel separation equations

The Audio Subgroup accepts this CE and expects further information, including cross-check, at the next MPEG meeting. Hyen-O Oh, LGE, presented12549 Hyen-O Oh

Yang-Won JungHee-Suk Pang

Proposed core experiment on pilot-based coding of spatial parameters for MPEG Surround

159

Dong Soo KimJaehyun Lim

This contribution proposes a new tool for coding the RM0 spatial parameters. The proposal is noiseless relative to the current RM0, and indicates that the side information can be reduced by as much as 2%. The Audio Subgroup accepts this CE and expects further information, including cross-check, at the next MPEG meeting. Heiko Purnhagen, Coding Technologies, presented

12585

Purnhagen Kristofer Kjörling Ralph Sperschneider Werner Oomen

Update on Transport of MPEG Surround in MPEG-1/2/4

It was the consensus of the Audio Subgroup to incorporate this into the RM0 WD.Heiko Purnhagen, Coding Technologies, presented

12584 Kristofer Kjörling Maintenance of WD2 on MPEG SurroundThis contribution presented editorial changes that correct “bug” or clarify text in the current WD. It was the consensus of the Audio Subgroup to incorporate Section 2 into the RM0 WD. The proposed changes in Section 3 will be treated as a light-weight core experiment, and requests that evidence of satisfactory performance of the proposed new modes be made available (since it is light-weight, no independent verification is required). Concluding DiscussionIt was the consensus of the Audio Subgroup to promote the MPEG Surround WD, revised as noted in this section, to CD at this meeting, to be approved at the Wednesday MPEG plenary session.

4.5.2 MPEG-4 Audio

JungHoe Kim, Samsung, presented

12575 JungHoe KimMiyoung Kim

Proposed Audio Conformance Bitstreams for BSAC

This contribution reported that the BSAC multi-channel source code has been successfully integrated into the MPEG-4 Audio reference software. Additionally, several conformance bitstreams have been defined and supplied, with cross-check proposed to occur during the next AhG period.JungHoe Kim, Samsung, presented

12577 JungHoe Kim Proposed Syntax Revision on Integration of BSAC and SBR

This contribution reviewed the performance of BSAC operating in combination with SBR. Performance at three rates was presented. The Chair noted that it would be very informative if more points on this rate-distortion curve were available, for example to the limit of scaling by individual SBR bands. JungHoe Kim, Samsung, presented

12576 JungHoe Kim Proposed Corrigendum to 14496-3 2001 FDAM 4 (BSAC)

This contribution proposed a change to the BSAC extension payload syntax that permits transport of both BSAC multi-channel information and also associated Decision

Issue DCOR at this meeting Integrate into VM during the AhG period Additional performance information brought to the next meeting

160

Expect to promote to CD at next meeting

Ralph Sperschneider, FhG, presented

12669 Ralph Sperschneider

Proposal on profileAndLevelIndication Signaling in LATM

The contribution proposes some corrections.Kristofer Kjörling, Coding Technologies, presented

12587 MPEG-4 A Kristofer Kjörling

Proposed additions to the DCOR 2 on MPEG-4 Audio third edition

This contribution proposed to make technical clarifications and adds a section that presents the theory of how phase can be shifted between analysis and synthesis filterbanks while maintaining near-perfect reconstruction.

4.5.3 MPEG-7

Elion Chin, Moodlogic, presented12687 Elion Chin Core Experiment on Perceptual Attributes

This contribution described a possible core experiment for audio Perceptual Attributes. Given a proposed set of audio Perceptual Attribute descriptors, the core experiments would evaluate

The interoperability of the descriptors The performance, in terms of “correct” recall, of the descriptors.

Interoperability. Subjects are presented with a song pair and asked “Is this pair similar or not similar with respect to the target attribute?” A descriptor that captures an attribute is determined to be interoperable if the distribution of responses is sufficiently compact. Conversely, a uniform distribution would indicate lack of common agreement amongst respondents.Performance. Subjects are presented with a song pair and asked “Is this pair similar or not similar with respect to the total of all possible attributes?” A descriptor that represents a perceptual attribute has sufficiently high performance if the distribution of responses is sufficiently compact. Conversely, a uniform distribution would indicate lack of discrimination within the song population.Evaluation procedure. Specific numerical targets for compactness of response distribution will be used to evaluate the responses.It was the consensus of the Audio Subgroup to proceed with this CE and to draft a workplan detailing the work timeline, cross-check participants, test procedure and evaluation procedure.

4.5.4 Lossless Coding

During the week the Verification Reports for ALS and SLS were prepared and discussed. Experts from the US National Body, the UK National Body and the IFPI expressed the view that it would be best if these reports contained performance and complexity information for MPEG or other technology that might be applicable to some of the use cases served by these new standards, and hence serve as meaningful points of reference. It was the consensus of the Audio Subgroup and experts from the US and UK NB and the IFPI to address this request for addition data in a mandate of the AHG on MPEG-4 Audio Technology Performance.

4.5.5 Music Player MAF

All discussions on this topic occurred in the joint meetings.

4.5.6 Symbolic Music Representation – Giorgio Zoia

12488

Pierfrancesco BelliniMaurizio CampanaiGiorgio ZoiaPaolo Nesi

Proposed Amendment to 14496-11 for SMR support

161

This document was briefly addressed during the AHG meeting on Sunday. This document has to be discussed in a join meeting with System, which will be done Wednesday after plenary.

12562David Crombie Roger Lenoir Neil McKenzie

SMR CE Report on Braille and Spoken Music

This document was briefly addressed during the AHG meeting on Sunday. We interacted with FNB people to reach an agreement about the changes to be performed in the RM0 and WD to address that part.

12591

CHOI Yong-SooKIM Hyoung-JoongCHO Yong-JuKIM Jae-Gon

The CE Report for Symbolic Music Representation(SMR) on Korean Traditional Music Notations.

This document was briefly addressed during the AHG meeting on Sunday. We need to meet the people to reach an agreement about the changes to be performed in the RM0 and WD to address that part.

12606Pierfrancesco BelliniMaurizio CampanaiPaolo Nesi

Proposed revised text of WD on Symbolic Music Representation

This document presented a revised version of the WD on SMR. It has been improved with respect to the last version presented at the previous meeting including the Bitstream syntax and access unit.. It is going to be edited during this meeting to include inside the XML version of the SMR Rendering Rules for formatting symbolic music representation. Next work will be also to add support and models for (i) addressing Beaming crossing barlines (single and multiple), (ii) Korean Music, (iii) Braille Music, (iv) Spoken Music.

4.5.7 Exploration

Anisse Taleb, Eriksson, presented

12648 MPEG-4 A Anisse TalebPhilippe Pierrick

Suggested R for Scalable Speech and Audio Coding

This contribution discuses numerous requirements that the authors felt should be addressed in the exploration. In summary, it proposed the following requirements:Primary level importance

Quality Consistent performance across items Functional scalability

Secondary level importance Low complexity Delay Backward compatibility

There was not sufficient time to thoroughly discuss this contribution such that the result could be certain to represent the consensus view of the Audio Subgroup. There will be an AhG mandate to progress this work.

4.6 Audio closing plenary discussionsThere were none, other than what occurred in the course of preparation of documents and AhG mandates.

5 Meeting deliverables

162

5.1 Recommendations for final plenaryThe Audio recommendations were presented and approved.

5.2 Establishment of Ad-hoc GroupsThe following ad-hoc groups were established by the Audio subgroup:

No. Title Mtg7711 AHG on Audio Standards Maintenance No7712 AHG on MPEG-7 Audio No7713 AHG on MPEG Surround Yes7714 AHG on MPEG-4 Audio Technology Performance No7715 AHG on Symbolic Music Representation Yes7716 AHG On Exploration of Scalable Audio and Speech Coding Yes

5.3 Approval of output documentsAll output documents, shown in Annex D, were presented in Audio plenary and were approved.

5.4 Responses to Liaison and NB commentsThe responses to the NB comments and Liaison were prepared and approved.

5.5 Press statementThe Audio part of the press statement was prepared, reviewed and approved via email in the closing MPEG plenary.

6 Future activities6.1 Schedule of future meetingsAd Hoc group meetings are indicated in Section 5.2. Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting.

6.2 Agenda for next meetingThe agenda for the next MPEG meeting is shown in Annex E. The Chair proposes that the following will be the

major topics for the week:

MPEG Surround Core Experiments Exploration

6.3 All other businessThere was none.

6.4 Closing of the meeting The 74th Audio Subgroup meeting was adjourned Friday at 13:00. The Chair thanked the Audio experts for their hard work during the week.

163

Annex A ParticipantsFirst Name Last Name Country Affiliation E-mail addressPierfrancesco Bellini IT DSI-UNIFI pbellini@dsi.unifi.itJohannes Boehm DE Thomson Johannes.Boehm@thomson.n

etMaurizio Campanai IT EXITECH mc@exitech.itElion Chin US MoodLogic elion@moodlogic.comKok Seng Chong SG Panasonic KokSeng.Chong@sg.panaso

nic.comBernhard Feiten DE Deutsche

Telekombernhard.feiten@t-systems.com

Ralf Geiger DE Fraunhofer IIS ralf.geiger@iis.fraunhofer.deBernhard Grill DE Fraunhofer IIS grl@iis.fraunhofer.deNoboru Harada JP NTT n-haraca@theory.brl.ntt.co.jpJohannes Hilpert DE Fraunhofer IIS Johannes.Hilpert@iis.fraunh

ofer.deYang-Won Jung KR LG

Electronicsywjung@lge.com

Dong Soo Kim KR LG Electronics

mahlerian@lge.com

Junghoe Kim KR Samsung AIT kjh94@samsung.comKristofer Kjörling SE Coding

Technologieskk@codingtechnologies.com

Tilman Liebchen DE TU Berlin liebchen@nue.tu-berlin.deDouglas Morton US University of

Miamid.morton@umiami.edu

Sua Hong Neo SG Panasonic suahong.neo@sg.panasonic.com

Paolo Nesi IT UNIFI DSI nesi@dsi.unifi.itTakeshi Norimatsu JP Panasonic Norimatsu.takeshi@jp.panas

onic.comEunmi Oh KR Samsung sait@samsung.comHyen-O Oh KR LG

Electronicsgenioho@lge.com

Werner Oomen NL Philips werner.oomen@philips.comSunghee Park KR Pixtree sunghee@pixtree.comPierrick Philippe FR France

Telecom R&Dpierrick.philippe@francetelecom.com

Heiko Purnhagen SE Coding Technologies

hp@codingtechnologies.com

Schuyler Quackenbush US ARL srq@audioresearchlabs.comSusanto Rahardja SG I2R rsusanto@i2r.a-star.edu.sgNikolaus Rettelbach DE Fraunhofer IIS Nikolaus.Rettelbach@iis.frau

nhofer.deYuriy Reznik US Qualcomm yreznik@qualcomm.comAndreas Schneider DE Coding

Technologiessnd@codingtechnologies.com

Jeongil Seo KR ETRI seoji@etri.re.krOsamu Shimada JP NEC o-shimada@bx.jp.nec.com

164

Ralph Sperschneider

DE Fraunhofer IIS ralph.sperschneider@iis.fraunhofer.de

Yoshiaki Takagi JP Panasonic takagi.yoshiaki@jp.panasonic.com

Anisse Taleb SE Ericsson AB anisse.taleb@ericsson.comMikko Tammi FI Nokia mikko.tammi@nokia.comAndy Tescher US Microsoft Andytescher@comcast.netMauri Vaananen FI Nokia Res.

Centermauri.vaananen@nokia.com

Mark Vinton US Dolby msv@dolby.comDavid Virette FR France

Telecom R&Ddavid.virette@francetelecom.com

Rongshan Yu SG I2R rsyu@i2r.a-star.edu.sgGiorgio Zoia CH EPFL giorgio.zoia@epfl.ch

165

Annex B Audio Contributions and ScheduleJoint MeetingsGroups What Where Day TimeAll MAF Req Tue 1400-1800Audio and Systems

m12470,m12613,m12668,m12488,m12620

Systems Wed 1100-1300

All Proposed Protected Music MAF Req Thur 1200-1300

Audio ScheduleX Time Number Group SG Authors Title / Topic

Sun0900-1300 MPEG Surround AHG

X 12609 MPEG-D A David Virette Cross-check of the low rate and high quality

MPEG Surround bitstreams

X

12547 MPEG-D A

Hee-Suk PangDong Soo KimJaehyun LimHyen-O OhYang-Won Jung

Report on Non-Guided MPEG Surround Verification Test

X

12582 MPEG-D A

Kristofer Kjörling Heiko Purnhagen

Verification of the Non-Guided MPEG Surround CE

X 12608 MPEG-D A David Virette Cross-check of the Core Experiment on

non-guided MPEG Surround

X

12622 MPEG-D A

Johannes HilpertKarsten Linzmeier

FhG listening test results for CE on non-guided mode of MPEG Surround

X12559 MPEG-

D AJeroen BreebaartChristof Faller

MPEG Surround Non-guided modifications WD

X

12543 MPEG-D A

Jeongil SeoSeungkwon BeackSang Bae JeonInseon JangKyeongok KangJinwoo HongMinsoo Hahn

Core Experiment on Efficient Quantization Method for CLD

X 12586 MPEG-D

A Purnhagen Kristofer Kjörling Claus-

Analysis of proposed CE on CLD quantization

166

Christian Spenger Werner Oomen

X

12548 MPEG-D A

Dong Soo KimHee-Suk PangJaehyun LimHyen-O OhYang-Won Jung

High Frequency Energy Compensation for MPEG Surround

X

12566 MPEG-D A

Gerard HothoLars VillemoesJeroen breebaartHeiko PurnhagenJonas Roden

Verification of MPEG-Surround Artistic Downmix and next steps

X

12580 MPEG-D A

Jeroen BreebaartHeiko PurnhagenKarsten LinzmeierChristof Faller

MPEG Surround: Evidence of the Matrix Compatibility configuration

X

12550 MPEG-D A

Hee-Suk PangDong Soo KimJaehyun LimHyen-O OhYang-Won Jung

Proposed Syntax Revision for Redundancy Reduction in MPEG Surround

X

12551 MPEG-D A

Hee-Suk PangDong Soo KimJaehyun LimHyen-O OhYang-Won Jung

Comments on the Bitstream Syntax for Residual Coding in MPEG Surround

X

12552 MPEG-D A

Yang-Won JungHyen-O OhHee-Suk PangDong Soo KimJaehyun Lim

Proposed syntax revision for extended signaling in MPEG Surround

Lunch

Sun1500-1800

Lossless Audio AHG

X 12569 MPEG-4

A Werner Oomen

Proposed corrigenda DCOR1 to AMD6, (lossless 1-bit)

167

Frans de Bont

X 12688 All L Richard Gooch Lossless Compression – Applications & R

X

12572 MPEG-4 A

Ralf Geiger Markus Schmidt Jürgen Herre

Evaluation of MPEG-4 SLS in Near-Lossless Range

X 12660 MPEG-4 A Rongshan Yu

Haibin HuangUpdates of compression performance of MPEG-4 lossless audio coding architectures

X

12537 MPEG-4 A

Noboru HaradaYutaka KamamotoTakehiro Moriya

Performance evaluation of ALS on a PC platform

X

12658 MPEG-4 A

Rongshan YuJungHoe KimTi-Eu ChanEunmi Oh

Report on combine SLS with Scalable AAC and BSAC

X 12593 MPEG-4 A Tilman

LiebchenProposed Draft Text of ALS Verification Report

Mon0900-1300

MPEG opening plenary

Lunch

Mon1400-1600

Audio Subgroup opening plenary

Approval of agenda

X Approval of 73nd MPEG meeting report

X 12471 All All Schuyler Quackenbush 73rd MPEG Audio Report

X Communications from the Chair- Review of Sun Chairs meeting- Outline of priorities for the week

X Allocation of contributions to schedule- Acceptance of late contributions

X Task groups and mandates

X Joint meetings

X Review of AHG Reports

X 12436 All G/A R. Sperschneider AHG on Audio Standards Maintenance

X 12437 All G/A M. Gruhne AHG on MPEG-7 Audio

X 12438 All G/A S. Quackenbush AHG on MPEG Surround

168

X 12439 All G/A Tilman Liebchen AHG on MPEG-4 Lossless Audio Coding

X 12440 All G/A Paolo NesiGiorgio Zoia AHG on Symbolic Music Representation

X 12441 All G/A S. Quackenbush

AHG On Exploration of Scalable Audio and Speech Coding

Ballots

X 12460 MPEG-4 G/A SC 29

SecretariatSummary of Voting on ISO/IEC 14496-3:200X/DCOR 1 [SC 29 N 6918]

X 12462 MPEG-4 G/A SC 29

SecretariatSummary of Voting on ISO/IEC 14496-4:2004/FPDAM 11 [SC 29 N 6920]

NB Comments

X SRQ 12530 All All A. G. Tescher for USNB

USNB Contribution: Performance measure for SLS

X12526 All

All Jean Gelissen for DNB

DNB comment on request to maintain fastest possible schedule for MPEG Surround

X SPS

12667 MPEG-D

All Ralph Sperschneider on behalf of the German National Body

GNB comment regarding the standardization time line for MPEG Surround

X 12529 All All A. G. Tescher for USNB USNB Contribution: ISO/IEC 23003 Issues

X

12694 All A

Ralph Sperschneider on behalf of the German National Body

GNB comment on the MPEG Audio coding standards structure

x SRQ 12527 MPEG-A R A. G. Tescher

for USNBUSNB Contribution: Regarding “MAFs under Consideration”

X SK

12672 MPEG-A R

Stefan Kraegelohon behalf of German National Body

GNB comments on MAF

Liaison

X- 12458 All L

ITU-T SG 16 via SC 29 Secretariat

Liaison Statement from ITU-T SG 16 [SC 29 N 6894]

X- 12476 All L

IEC TC 100 via SC 29 Secretariat

IEC CDV 61937-8 [SC 29 N 6946]

169

X P. Jessop 12688 All L Richard Gooch Lossless Compression – Applications & R

Plenary topics

MPEG Surround

X

12626 MPEG-D A

Johannes HilpertAndreas HoelzerSascha DischWerner OomenKristofer KjoerlingChristof Faller

Evidence for the Low Complexity Mode of MPEG Surround

X

12631 MPEG-D A

Sascha DischKarsten LinzmeierMatthias NeusingerGerard HothoJuergen HerreJohannes Hilpert

Proposed Quality Enhancements for MPEG Surround

Tue0900-1300 MPEG Surround

X

12558 MPEG-D A

Chong Kok SengYoshiaki TakagiShuji MiyasakaKojiro OnoTakeshi NorimatsuNeo Sua Hong

Core experiment on an even lower complexity mode for MPEG Surround

X

12549 MPEG-D A

Hyen-O OhYang-Won JungHee-Suk PangDong Soo KimJaehyun Lim

Proposed core experiment on pilot-based coding of spatial parameters for MPEG Surround

X 12585 MPEG-D

A Purnhagen Kristofer Kjörling Ralph Sperschneider Werner

Update on Transport of MPEG Surround in MPEG-1/2/4

170

Oomen

X 12584 MPEG-D A Kristofer

Kjörling Maintenance of WD2 on MPEG Surround

Lunch

Tue1400-1800 Joint with All on MAF

12527 MPEG-A R A. G. Tescher

for USNBUSNB Contribution: Regarding “MAFs under Consideration”

X

12672 MPEG-A R

Stefan Kraegelohon behalf of German National Body

GNB comments on MAF

X12588 MPEG-

A RHendryMunchurl KimFlorian Pestoni

A Flexible and Extensible Protection of Music Player MAF using Lightweight MPEG-21 IPMP

X12674 MPEG-

A RStefan KraegelohHarald Fuchs

MAF Interoperability: Mandatory Tools vs. Default Signalling

X12673 MPEG-

A RStefan KraegelohHarald Fuchs

proposed revised text on 'Protected Music Player' MAF described in MAFs under Consideration

X

12646 MPEG-A R

Harald FuchsStefan KraegelohThe TIRAMISU Project

Proposed Bundled License MAF

X

12659 MPEG-A R

Sang-Kyun KimSeungji YangJun Ho ChoYong Man RoJi-Yeon Kim

Application Scenarios and Derived R for Photo Album MAF

X12662 MPEG-

A RHarald FuchsStefan Kraegeloh

Proposed Corrigenda Items for ISO/IEC 23000-2 Music Player MAF

X

12589 MPEG-A R

Chansuk YangJeongyeon LimMunchurl Kim

Extensions to Music MAF Player Format for Multiple JPEG images and Text data with Synchronizations to MP3 data

12534 MPEG-A R

Tae Hyeon KimH. Jean Cha

Proposal for Accompaniment Music Player MAF

12647 MPEG- R Harald Fuchs Proposed Slideshow MAF

171

A Herbert Thoma

12645 MPEG-A R

Harald FuchsHerbert ThomaStefan Kraegeloh

Proposed Portable Video Player MAF

12684 MPEG-A R Diepold Considering a MAF for Surveillance Video

Tue1800-1830 Audio Subgroup plenary

N7529 Request for Subdivision: /IEC 23003-1:200x MPEG Surround

N7530 Text of ISO/IEC 23003-1:200x MPEG Surround

Tue1800-1900 Liaison

Tue1900- Chairs

Wed0900-1100 MPEG plenary

Wed1100-1300 Joint w/Systems

X 12470 MPEG-4 A Schuyler

Quackenbush Audio Codec Behavior

X 12668 MPEG-4 S Ralph

SperschneiderClarification on Definition of ExtensionProfileLevelDescriptor

X12620 MPEG-

4 SMiska HannukselaJani Toiminen

ID3v2 tag in ISO base media file format

X presented in Systems 12613 MPEG-

2 Svan der Meer Werner Oomen

Study on ISO/IEC 13818-1:2000/PDAM 6: Transport of streaming text over MPEG-2 systems

Wed 1400-1430 Joint w/Systems (cont’d)

X

12488 MPEG-4 S

Pierfrancesco BelliniMaurizio CampanaiGiorgio ZoiaPaolo Nesi

Proposed Amendment to 14496-11 for SMR support

Wed1400-1800 MPEG-4

X 12575 MPEG-4 A JungHoe Kim

Miyoung KimProposed Audio Conformance Bitstreams for BSAC

172

X 12577 MPEG-4 A JungHoe Kim Proposed Syntax Revision on Integration of

BSAC and SBR

X 12576 MPEG-4 A JungHoe Kim Proposed Corrigendum to 14496-3 2001

FDAM 4 (BSAC)

X 12669 MPEG-4 A Ralph

SperschneiderProposal on profileAndLevelIndication Signaling in LATM

Wed1600-1800 MPEG-7

X 12687 MPEG-7 A Elion Chin Core Experiment on Perceptual Attributes

Exploration

X12648 MPEG-

4 AAnisse TalebPhilippe Pierrick

Suggested R for Scalable Speech and Audio Coding

ParallelSession SMR

X

12606 MPEG-4 A

Pierfrancesco BelliniMaurizio CampanaiPaolo Nesi

Proposed revised text of WD on Symbolic Music Representation

X

12562 MPEG-4 A

David Crombie Roger Lenoir Neil McKenzie

SMR CE Report on Braille and Spoken Music

X

12591 MPEG-4 A

CHOI Yong-SooKIM Hyoung-JoongCHO Yong-JuKIM Jae-Gon

The CE Report for Symbolic Music Representation(SMR) on Korean Traditional Music Notations.

Social

Thu0900-1100

1100-1200 Review lossless performance reports

Thu1200-1300

Joint with All at ReqProposed Protected Music MAF

lunch

Thu1400-1800

MPEG-4 / MPEG-7

X 12587 MPEG-4 A Kristofer

KjörlingProposed additions to the DCOR 2 on MPEG-4 Audio third edition

173

X12599 MPEG-

7 AMatthias Gruhne Proposed editorial changes on 15938-

4:2002/ FPDAM

Exploration on Scalable Speech and Audio

Thu1800- Chairs

Fri0800-1300 Audio Subgroup closing plenary

X Approval of documents sponsored by other groups

X Recommendations for final plenary

X Establishment of new Ad-hoc groups

X AhG Mandates

Responses to NB comments

X Liaison statements

Press statement

X Dispositions of comments

X Approval of output documents

X Review of Audio presentation to MPEG plenary

Agenda for next meeting

X A.O.B.

X Closing of the Audio meeting

Lunch

Fri1400-

MPEG Plenary

174

Annex C Task Groups1. Spatial Audio Coding

Chair: Schuyler QuackenbushMandates:1.1. Review contributions1.2. Progress CEs1.3. Discuss standardization timeline

1.3.1. CD text for Wed plenary1.3.2. Request for Subdivision

2. Lossless CodingChair: Tilman LiebchenMandates:2.1. Review contributions2.2. Produce

2.2.1. Public Report on Performance and Complexity of ALS2.2.2. Public Report on Performance and Complexity of SLS2.2.3. Internal report comparing ALS and SLS2.2.4. Conformance

2.2.4.1.1. Public domain waveforms?

3. MPEG-4 and MPEG-4 ConformanceChair: Ralph SperschneiderMandates:3.1. Review contributions3.2. DoC on ISO/IEC 14496-3:2005/DCOR 1 3.3. Text of ISO/IEC 14496-3:2005/COR 13.4. DoC on ISO/IEC 14496-4:2001/ PDAM 11 3.5. Text of ISO/IEC 14496-4:2001/ FPDAM 113.6. Study on Low Delay Profile

4. MPEG-7Chair: Schuyler QuackenbushMandates:4.1. Review contributions4.2. Progress CEs

5. Symbolic Music RepresentationChair: P. Nesi, G. ZoiaMandates:5.1. Review contributions5.2. Progress CEs

6. Exploration of Scalable Speech and Audio CodingChair: Schuyler QuackenbushMandates:6.1. Next steps

175

Annex D Output DocumentsMPEG-4No. Title TBP Available

14496-3 MPEG-4 Audio7529 Request for Amendment: ISO/IEC 14496-3:2005/AMD 4 MPEG

SurroundNo 05/10/19

7530 Text of ISO/IEC 14496-3:2005/PDAM 4 MPEG Surround No 05/10/197681 DoC on 14496-3:2005/DCOR 1 BSAC and LATM No 05/10/217682 Text of 14496-3:2005/COR 1 BSAC and LATM No 05/10/217683 14496-3:2005/DCOR 3 DST No 05/10/217684 14496-3:2005/DCOR 4 Timestamps and SBR No 05/10/217685 14496-3 2005/AMD 2:2005/DCOR 1 BSAC No 05/10/217686 Verification Report on MPEG-4 ALS Yes 05/10/217687 Verification Report on MPEG-4 SLS Yes 05/10/217688 WD2 on Integration of BSAC and SBR No 05/10/217689 Workplan on Integration of BSAC and SBR No 05/10/217690 WD on Symbolic Music Representation No 05/10/217691 Proposed Corrections to LATM V1 No 05/10/217692 Proposed Technical Report: Audio and Systems Interface No 05/10/21

No. Title TBP Available14496-4 MPEG-4 Conformance

7693 Working Draft of BSAC Conformance No 05/10/217694 Proposed correction to Audio part of 14496-4:2004 No 05/10/217695 Status of MPEG-4 Audio Conformance No 05/10/21

No. Title TBP Available14496-5 MPEG-4 Reference Software

7696 Study on ALS and SLS Reference Software Yes 05/11/04

MPEG-7No. Title TBP Available

15938-4 MPEG-7 Audio7697 Study on Text of 15938-4:2002/ FPDAM No 05/10/217698 Workplan on Perceptual Attributes No 05/10/21

MPEG-ANo. Title TBP Available

23000-2 MPEG-A Music Player Application Format7699 Proposed Corrigendum to MPEG-A Music Player No 05/10/21

MPEG-DNo. Title TBP Available

23002-1 MPEG-D MPEG Surround 7700 Workplan for MPEG Surround No 05/10/217701 Performance of MPEG Surround Technology No 05/10/21

ExplorationsNo. Title TBP Available

176

Scalable audio and speech coding 7702 Audio Exploration No 05/10/21

PromotionNo. Title TBP Available

MPEG Promotion 7703 MPEG Technologies: MPEG-1/2 Layer 3 Yes 05/10/217704 MPEG Technologies: Advanced Audio Coding Yes 05/10/217705 MPEG Technologies: Structured Audio Yes 05/10/217706 MPEG Technologies: ALS Yes 05/10/217707 MPEG Technologies: SLS Yes 05/10/217708 MPEG Technologies: MPEG-7 Low-level audio descriptors Yes 05/10/217709 MPEG Technologies: MPEG-7 High-level audio descriptors Yes 05/10/217710 MPEG Technologies: Music Player Yes 05/10/21

177

Annex E Agenda for the 74th MPEG Audio Meeting

Agenda Item1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda2.2. Communications from the Chair2.3. Allocation of contributions2.4. Joint meetings2.5. Review of task groups and mandates2.6. Approval of previous meeting report2.7. Review of AhG reports 2.8. Received national body comments and liaison matters

3. Plenary issues4. Task group activities

4.1. Spatial Audio Coding4.2. Exploration4.3. Performance of MPEG Technologies4.4. MPEG-7 Audio4.5. MPEG-44.6. Symbolic Music Notation

5. Discussion of unallocated contributions6. Meeting deliverables

6.1. Recommendations for final plenary6.2. Establishment of new Ad-hoc groups6.3. Approval of output documents6.4. Responses to NB comments6.5. Responses to Liaison statements6.6. Press statement

7. Future activities8. Agenda for next meeting9. A.O.B10. Closing of the meeting

178

Annex 10Report of 3DG

1 Opening of the Meeting

1.1 Approval of the agenda

1.2 Goals for the weekThe goals of this week are:

Issue 14496-16/PDAM2 Review on-going AFX CE and explorations Issue PDAM on Conformance and Reference Software for Part 16 Amd. 1 Review the Universal 3D specification from ECMA

The output documents related to 3D Graphics Compression are:

No. Title Editor14496-4 MPEG-4 Conformance Text of ISO/IEC 14496-4:2004/ DCOR3 (WSS & MG conformance updates)

Francisco Morán

Request for ISO/IEC 14496-4:2004/ AMD12 (Morphing & Textures)

Jeong-Hwan Ahn

Text of ISO/IEC 14496-4:2004/ PDAM12 (Morphing & Textures) Jeong-Hwan Ahn

No. Title Editor14496-5 MPEG-4 Reference Software Request for ISO/IEC 14496-5:2001/AMD9 (Morphing & Textures)

Francisco Morán

Text of ISO/IEC 14496-5:2001/PDAM9 (Morphing & Textures) Francisco Morán

No. Title Editor14496-16 MPEG-4 Animation Framework eXtension (AFX)WD 3.0 of 14496-16 2nd edition Marius PredaWD 3.0 of 14496-16/AMD2 (Geometry & Shadow) Patrick Gioia3D Graphics Core Experiments Description Marius PredaMPEG-4 Animation Framework eXtension (AFX) VM 19.0 Marius PredaSNHC FAQ 15.0 Pierre Davy

No. Title Editor14496-21 MPEG-4 MPEG-J Graphics Framework eXtension (GFX)Referencing Explanatory Report to JSR-135 Mobile Multimedia API

Vishy

No. Title EditorPromotionOverview of 3DMC Eun-Young ChangOverview of AFX Francisco Morán

179

1.3 Standards from 3D Graphics CompressionIn red, status reached at this meeting. In yellow, status reached at next meeting. Projects that reached International Standard status have been removed.

Std Pt Edit. Project Description CfP WD CDPDAMDCOR

FCDFPDAM

FDISFDAMCOR

4 4 200x Amd.12 Conformance on Morphing and Textures

05/04 05/10 06/04 06/10

4 4 200x Cor.3 WSS & MG conformance updates

05/10 06/04

4 5 200x Amd.9 Reference software on Morphing and Textures

05/04 05/10 06/04 06/10

4 16 200x 2nd Ed. 2nd Ed. of AFX 05/04 06/014 16 200x Amd.2 Geometry and

Shadow05/04 06/01 06/07 07/01

4 16 200x Cor.3 (Meshgrid updates) 05/07 06/014 21 200x MPEG-J GFX 03/12 04/07 04/10 05/07 06/01

180

1.4 Allocation of joint meetingsSub-Groups Monday Tuesday Wednesday Thursday FridayIntegration 14:00~14:30 in 3DG

1.5 Room allocation3D Graphics Compression : Risso 7B

1.6 Allocation of contributions

N° Title Schedule ActivityD1 Monday D1

MPEG Plenary D1 09:00~13:30 MPEG Gen.

12442 Report of AhG on AFX documents, CEs and software

Marius PredaJeong-Hwan AhnFrancisco Morán Burgos

12443 Report of AhG on MPEG-J GFX

Mikaël Bourges-SévenierVishy SwaminathanItaru Kaneko

Lunch Break D1 13:30~14:30

3D Graphics Compression Plenary D1 14:30~17:00 3DGC Gen.

Roll call, Agenda, Goals, FAQ, etc. Mahnjin Han

12554 3DMC white paper V2.0

Eun-Young ChangDaiyong KimSunyoung LeeNamho HurSoo In LeeEuee S. Jang

General

12561 Editorial corrections on AFX 2nd Release Marius Preda 16:30 AFX

181

N° Title Schedule Activity

3D Graphics Compression D1 17:00~18:00 EEs

12594 Results on EE1 for D3DMC

M. Kautzner K. Mueller A. Smolic T. Wiegand

EE1

12627 Results for AFX's EE2 on spatial- and SNR-scalable 3D surface coding

Marcos AvilésFrancisco Morán EE2

D2 Tuesday D2

3D Graphics Compression D2 09:00~11:00 CEs

12625 Proposal for Roof coding Jerome RoyanPatrick Gioia CE1

12553 CE Results on 3DMC Revision for AFX amd. 2

Eun-Young ChangDaiyong KimByeongwook MinSunyoung LeeNamho HurSoo In LeeEuee S. Jang

CE2

3D Graphics Compression D2 11:00~12:30 RSW & Conf.

12539 Updates on Study document of ISO/IEC 14496-4:2005/ AMD12 (Morphing & Textures) Jeong-Hwan Ahn RSW & Conf.

12630 Updates to WD of 'ISO/IEC 14496-4/Amd12'Francisco Morán Sebastián AmengualMarcos Avilés

RSW & Conf.

12560 Conformance streams for Morphing and AnimationMarius PredaFranck Le Pouliquen Francoise Preteux

RSW & Conf.

12629 Updates to 'Material Related to MPEG Reference Software'Francisco Morán Sebastián AmengualMarcos Avilés

RSW & Conf.

182

N° Title Schedule Activity

12615 Updates to IM1 related to MeshGrid

A. SalomieD. CerneaA. MarkovaR. DeklerckA. MunteanuP. Schelkens

RSW

12612 Updates to the AFXEncoder related to MeshGrid

D. CerneaA. MarkovaA. SalomieA. AlecuP. SchelkensA. MunteanuR. Deklerck

RSW

Lunch Break D2 12:30~14:00

3D Graphics Compression +Integration in 3D Graphics Compression D2 14:00~14:30

SNHC Conformance & Ref S/W (12539, 12630, 12560, 12629) 14:00 RSW & Conf.

3D Graphics Compression D2 14:30~15:00

12628 IndexedWedgeSet: Efficient Representation of Attributed MeshesMarcos AvilésFrancisco MoránMarius Preda

AFX new

3D Graphics Compression D2 16:00~18:00 AFX

12691 Liaison Statement from ECMA ECMA via SC 29 Secretariat Liaison

D3 Wednesday D3

MPEG Plenary D3 09:00~11:30 MPEG Gen.

3D Graphics Compression Plenary D3 11:30~12:30 3DGC Gen

Status review, business plan presentation

183

N° Title Schedule Activity

Lunch Break D3 12:30~16:10

3D Graphics Compression D3 16:10~18:00

Discussion on U3DD4 Thursday D4

3D Graphics Compression D4 10:30~12:30 General

Discussion on 3DGC business plan

Lunch Break D4 12:30~14:00

3D Graphics Compression D4 14:00~18:00 3DGC Gen

Output documents reviewD5 Friday D5

3D Graphics Compression D5 09:00~12:00 3DGC Gen.

Document number attribution, AhGs and resolutions

Lunch Break D5 12:00~14:00

MPEG Plenary D5 14:00~22:00 MPEG Gen.

1.7 Attendance list .Name Country CompanyMahnjin Han Korea Samsung AITJean Le Feuvre France ENSTFrederic Vexo Switzerland EPFLEun-Young Chang

Korea ETRI

184

Patrick Gioia France France Telecom R&D

Jerome Royan France France Telecom R&D

Raphaele Balter France France Telecom R&D

Karsten Mueller Germany FHG-HHIEuee S. Jang Korea Hanyang Univ.Sunyoung Lee Korea Hanyang Univ.Marius Preda France INT/ArtemisFranck Le Poulizuen

France INT/Artemis

Thomas O’Rourke

Ecma Intel Corporation

Sanjay Deshmukh

Ecma Intel Corporation

Jeong-Hyu Sang Korea LGThomas Di Giacomo

Switzerland MIRALab, U. of Geneva

Pierre Davy Switzerland MIRALab, U. of Geneva

Jeong-Hwan Ahn Korea Samsung AITFrancisco Morán Spain UPMMarcos Avilés Spain UPMAlexandru Salomie

Belgium VUB

Dan Cernea Belgium VUB

185

2 General issues

2.1 3D Graphics Compression FAQThe first time attendant of 3D Graphics Compression subgroup was asked to review the current FAQ and give feedback. There were many editorial changes to the document in relation with the changing of the name SNHC to 3D Graphics Compression.

2.2 Liaison

2.2.1 M12691 – Liaison Statement from ECMATwo representatives of Ecma TC43 (Universal 3D) participated in 3DGC for explaining what U3D is and discussing about how we can harmonize it with MPEG tools. Universal 3D is an open, standard 3D file format for repurposing CAD & AEC data for downstream applications. It includes features such as continuous LoD, domain-specific compression, progressive streaming and key-frame/bone-based animation, which are also the features in MPEG. Also, mesh compression is in the top of the list for future feature enhancement of U3D.The 2nd edition was finalized last September and it was submitted to ISO/IEC JTC1 for fast-track process. Therefore, it is impossible for WG11 to update that specification to harmonize with MPEG-4 standard. However, it is agreed between Ecma TC43 and 3D Graphics Compression group of WG11 that we collaborate in the future harmonization.As a first step, it is recommended to have an exploration experiment on U3D.

ResolutionStart EE on U3D features and performances analysis.The goal of this exploration is to analyze technologies in U3D and compare with MPEG-4 technologies.The comparison will be made in terms of functionality and compression efficiency.

2.3 White Paper

2.3.1 M12554 – 3DMC white paper V2.0Following the comments received through the reflector, the white paper has been updated.Few more changes have been proposed during the review.

ResolutionThe result of the review is submitted as output document at the end of the week.

3 AFX (14496-16) activities

3.1 Specifications updatesThe list of modifications for existing specifications handled by SNHC is as follows.

186

3.1.1 M12561 – Editorial corrections on AFX 2nd ReleaseProposed the following

1. Remove annex F. XMT for BBA,2. Align the node definition with the node coding table

a. For NurbsCurve, NurbsCurve2D change the range of the knot to (-, ),3. Put the node tables outside the word file,4. Correct the equation format and numbering

During the discussion, there was a recommendation to add terminology and definitions in the document

ResolutionThe proposals are accepted and applied to the new draft of AFX 2nd Release.The text will be reviewed by the ad-hoc group and will be finalized at the next meeting in Bankok.The terminology and definitions shall be added to AFX Amd.2

3.2 Core experiments

3.2.1 CE1 – Multi-resolution Footprint-based Representation3. M12625 – Proposal for Roof codingBuilding representation can be based on footprint elevations. However, buildings need more features like roof and façade. The goal is to find a simple and generic representation for building. The roof node has been proposed previously and this contribution updates the node by changing SlopeAngle to array and addeing texture related fields. However, the implementation of rendering of roof textures is not ready and façade is not proposed yet. The definition of façade node and full implementation should be done by the next meeting.This representation is using procedural method for defining geometry, and therefore highly efficient. It also has an additional functionality, the level of detail, compared to IndexedFaceSet. However, the concern is that this method may be too specific in terms of supporting object types or applications. Therefore, an investigation for generic framework using procedural geometry is needed. If this investigation shows some possibility for generic framework, than it can be a good candidate for the future work item of 3D Graphics Compression.

ResolutionContinue CE to complete roof texture implementation and add façade representation. Test samples in Multi-resolution footprint and also in IndexedFaceSet shall be provided by France Telecom.The second mandate of the CE is to identify the procedural geometry framework. It includes the following activities:- Try to identify the kind of objects that can be identified by the procedural geometry.- Investigate similarity between objects- Design generic framework using procedural geometry.

187

3.2.2 CE2 – 3DMC Functionalities4. M12553 – CE results on 3DMC revision for AFX Amd. 2This contribution proposes an improvement to coding of vertex and face order which has an effect when there are multiple connected components in IFS. By encoding the vertex/face order map by the connected component instead of the whole model, small reduction of bit-rate has been shown. However, the test has been performed with only a couple of samples and so we need more test results by the next meeting. There was a discussion on moving 3DMC from 14496-2 to 14496-16. However, the group has discovered many difficulties in doing this. First of all, it is not only fixing part 2, but it also involves fixing part 11 and possibly part 1. Also, due to the backward incompatibility between the existing 3DMC and the revised 3DMC, they are considered different tool, which means we need to have both in the specification. Therefore, the plan for moving the existing 3DMC to part 16 has been cancelled.

ResolutionApply the revision to the WD. However, in order to be accepted to PDAM, more tests with more samples should be performed and be reported. It is recommended to use all test data for 3DMC.

3.3 Explorations

3.3.1 E1. 3D Mesh Compression Framework5. M12594 – Results on EE1 for D3DMCThis contribution shows an intermediate result of the D3DMC improvement with rate-distortion optimization of the motion modeling process to choose the best octree representation. This is done by finding the right λ in the equation J = D + λR. This provides the ability to adjust the overall quality by a universal Lagrangian parameter and not by a mesh dependent error threshold.The experiment has been performed only with the humanoid model and should continue with other test data.

ResolutionContinue the EE to get the complete result of the experiment.

3.3.2 E2. Spatial- and SNR-scalable 3D surface coding6. M12627 – Results for AFX’s EE2 on spatial- and SNR-scalable 3D surface codingThis contribution presents in-depth comparison of the PLTW algorithm vs. AFX’s WaveletSubdivisionSurface tool. The average gain compared to WSS is around 70%. This may be possible when having in mind that the existing WSS was not targeted for compression efficiency because of view dependent scalability. However, the result seems too good and we need to know the exact reason for it.Moreover, the experiment showed the possibility for view dependent support by progressive transmission of detail tree.However, there seems to be a bug in the remeshing tool they used because sometimes the PSNR decreases when increasing the LoD level.

Resolution

188

The exploration is satisfied. Promote this activity to core experiment and have a deeper study of the PLTW compared to WSS with more dedicated participants.- Fix the error in remeshing phase to have a correct evaluation.- What kind of functionality, compared to existing WSS, does it (or does it not) support?- Check the ability to handle the information attached to the PLTW data.- Check if PLTW can be implemented in a backward compatible way.- Test with various number of vertices for each model.

3.4 Reference Software & Conformance

3.4.1 M12539 – Updates on Study document of ISO/IEC 14496-4:2005/AMD12 (Morphing & Textures)The text in the contribution is complete except for X3D Graphics & Scene Graph Profiles, which has been provided during the week. Therefore, it is now ready for PDAM.

ResolutionPromote this document to PDAM together with the reference software of part 16 Amd. 1MovieTexture in the reference software remains to be fixed.

3.4.2 M12560 – Conformance streams for Morphing and AnimationThis contribution contains conformance document and bitstreams for Morphing and Animation.

ResolutionAdd it to the conformance document of part 16 Amd. 1

3.4.3 M12630 – Updates to WD of ISO/IEC 14496-4/Amd.12This contribution proposes to change the WSS conformance bitstreams that were found to be incomplete (does not cover all functionalities) and broken. The proposed bitstreams cover all functionalities of WSS and works on the current reference software with updated WSS implementation.

ResolutionThe changes are accepted. Since this is a correction of a broken specification, we will issue a corrigendum instead of adding it in the amendment. We also need to make a note in the DCOR to replace the existing bitstream files with the new ones and they will be attached as electronic attachment to the corrigendum.

3.4.4 M12629 – Updates to “Material Related to MPEG Reference Software”This contribution is under the scope of Integration group. Please see the Integration result for detail.

3.4.5 M12615 – Updates to IM1 related to MeshGridThis contribution presents changes to the reference software to be aligned with part 16 COR3. As a result, the conformance bitstreams have been regenerated.

189

ResolutionNeed to change the current conformance bitstream for Mesh Grid (no text change). This will be also noted in the new corrigendum for part 4 (conformance) and the bitstreams added as electronic attachment..

3.4.6 M12612 – Updates to the AFXEncoder related to MeshGridThis is an informative presentation for optimized encoding of MeshGrid

ResolutionThanks to VUB for informing us with the optimized encoding method for MeshGrid.

3.5 Additional AFX related issues

3.5.1 M12628 – IndexedWedgeSet: Efficient Representation of Attributed MeshesThis contribution presents another way to represent per corner attributes of IndexedFaceSet. It introduces an intermediate abstraction, called wedge, which is a set of vertex-adjacent corners whose attributes are the same. This method can show good results on models with discontinuities of materials.This is a new concept of representing an object and it may be a good framework to think about for the improvement of IFS.

ResolutionStart an exploration experiment to investigate the possible supporting functionality (e.g. multi-texturing) and perform comparison test with IFS on the uncompressed and BIFS compressed size. In order to do this, we need to collect many test samples.Investigate the possible extension of 3DMC to handle IndexedWedgeSet.

4 GFX (14496-21) activitiesSince the GFX specification has been promoted to FCD at the last meeting and the FDIS is to be submitted at the next meeting, there was no GFX related activity in Nice. However, the document on “referencing explanatory report to JSR-135 Mobile Multimedia API” has been reviewed on-line and approved by the group.The ad-hoc group activity continues for the implementation of the reference software and conformance investigation.

5 Resolutions of 3D Graphics Compression

5.1 Output documents

5.1.1 The SNHC subgroup recommends to approve the following documentsNo. Title TBP Available

14496-4 MPEG-4 Conformance 7636 Text of ISO/IEC 14496-4:2004/ DCOR3 (WSS & MG No 05/10/21

190

conformance updates)

7637 Request for ISO/IEC 14496-4:2004/ AMD12 (Morphing & Textures)

No 05/10/21

7638 Text of ISO/IEC 14496-4/PDAM12 (Morphing & Textures) No 05/10/2114496-5 MPEG-4 Reference Software

7639 Request for ISO/IEC 14496-5:2001/AMD9 (Morphing & Textures)

No 05/10/21

7640 Text of ISO/IEC 14496-5/PDAM9 (Morphing & Textures) No 05/10/2814496-16 MPEG-4 Animation Framework eXtension (AFX)

7624 WD 3.0 of 14496-16 2nd edition No 05/10/217625 WD 3.0 of 14496-16/AMD2 (Geometry & Shadow) No 05/11/047626 3D Graphics Core Experiments Description No 05/10/217627 MPEG-4 Animation Framework eXtension (AFX) VM 19.0 No 05/11/047628 3D Graphics Compression FAQ 15.0 Yes 05/11/04

14496-21 MPEG-4 MPEG-J Extension for rendering7629 Referencing Explanatory Report to JSR-135 Mobile Multimedia API Yes 05/10/21

Promotion7630 Overview of 3DMC Yes 05/10/217631 Overview of AFX Yes 05/11/04

5.2 Resolutions The SNHC subgroup recommends changing its name to “3D Graphics Compression” to

better reflect its activity. The SNHC subgroup announces that its reflector mpeg-snhc@gti.ssr.upm.es will be changed

to mpeg-3dgc@gti.ssr.upm.es shortly after the 74th WG11 meeting. To subscribe or unsubscribe, use http://www.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc. Any subscribers of the old reflector will automatically be subscribed to the new reflector.

The SNHC subgroup announces that its homepage http://www.mpeg-snhc.org will be changed to http://mpeg-3dgc.org shortly after the 74th WG11 meeting.

5.3 Establishment of SNHC Ad-Hoc Groups

N7632 Ad Hoc Group on AFX documents, CEs, and softwareMandate: 1. Maintain and edit 3D Graphics Compression documents.

2. Coordinate 3D Graphics Compression CE and EE activities.3. Coordinate conformance and reference software for AMD1 (Morphing and

Textures).4. Coordinate 3D Graphics Compression business plan activity

Chairman: Marius Preda (INT)

Co-chairs: Jeong-Hwan Ahn (Samsung AIT)Francisco Morán Burgos (UPM)

Duration: Until 75th Meeting Meetings Sunday before 75th MeetingReflector: mpeg-3dgc AT gti. ssr. upm. es

191

Subscribe: http://www.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc

N7633 AHG on MPEG-J Graphics Framework eXtensionsMandate: 1. Coordinate implementation of GFX reference software

2. Investigate GFX conformanceChairman: Mikaël Bourges-Sévenier (Mindego Inc.)

Co-chairs: Vishy Swaminathan (Sun Microsystems)Itaru Kaneko (Tokyo Polytechnic University)

Duration: Until 75th Meeting Meetings Sunday before 75th MeetingReflector: mpeg-j AT it-aru. ComSubscribe: Send an email to mpeg-j-request AT it-aru. com with the message “subscribe” as

the first line in the body.

6 Closing of the MeetingSee you in Bangkok.

192

Annex 11Report of Integration

1 Opening of the Meeting

1.1 Allocation of contributionsJoint meeting with 3DGC, Tuesday, 2pm to 2:30pm

12629 Francisco Moran Burgos Updates to material related to MPEG reference software

12539 Jeong-Hwan Ahn Updates on Study document of ISO/IEC 14496-4:2005/ AMD12 (Morphing & Textures)

12560Marius PredaFranck Le Pouliquen Francoise Preteux

Conformance streams for Morphing and Animation

12630Francisco MoránSebastián AmengualMarcos Avilés

Updates to WD of 'ISO/IEC 14496-4/Amd12'

Integration Plenary on Thursday, 2pm to 4pm12705 Jean-Claude Dufourd Proposed WD of LASeR Conformance

xxxx Alexandre Cotarmanac’h Schedule for the update of the LASeR Reference and Utility Software

1.2 List of standards under developmentStd Pt Edit. Project Description WD CD FCD FDIS

1 4 200x Cor 1 05/07 06/012 4 200x Cor 1 05/07 06/044 4 2004 Amd.11 Parametric Stereo Conformance 05/01 05/04 05/104 4 2004 Amd.12 Morphing and Textures conf 05/04 05/10

4 4 200x Amd.13 Parametric Coding 05/07 06/01 06/074 4 200x Cor 2 05/07 06/044 4 200x Cor 34 5 200x nth Ed. Reference Software 05/074 5 200x Amd.9 Morphing and Textures RS 05/04 05/10 06/04 06/104 5 200x Amd.10 Parametric Coding RS 05/07 06/01 06/077 7 200x Amd.2 Fast Access Ext. Conf. 05/10 06/04 06/10

21 8 200x Reference Software 06/0121 14 200x 1st Ed. Conformance 03/10 05/04 06/01 06/07

1.3 Latest references

Project P. Standard Issue No.MPEG-4 4 ISO/IEC 14496-4:2003 (MPEG-4 Conformance 2nd Ed.) 02/12 Awaji N5457MPEG-4 4 ISO/IEC 14496-4:2001/Amd.1 (FlexTime, Studio and Streaming

Video Profile)02/07 Klagenfurt N5083

MPEG-4 5 ISO/IEC 14496-5:2001 (Ref. Soft 2nd Ed.) 01/07 Sydney N4368MPEG-4 5 ISO/IEC 14496-5:2001/Amd.1 (FlexTime) 02/03 Jeju N4711MPEG-4 5 ISO/IEC 14496-5:2001/Amd.2 (XMT) 02/05 Fairfax N4865MPEG-7 6 ISO/IEC 15938-6:2002 (Reference Software) 01/12 Pattaya N4475MPEG-7 7 ISO/IEC 15938-7:2002 (Conformance) 02/07 Klagenfurt N4937MPEG-21 8 ISO/IEC 21000-8:2005 (Reference Software) 05/04 Busan

193

1.4 Request documentsProj P A Description Issue No

2 2 1 Request for New AMD: ISO/IEC 13818-2:2000/Amd 1 30614 4 1 Request for AMD 1 to ISO/IEC 14496-4 35044 4 2 Request for ISO/IEC 14496-4/Amd.2 35704 5 2 Request of ISO/IEC 14496-5/Amd.2 38644 4 3 Request for ISO/IEC 14496-4/Amd.3 38684 4 1 Request for AMD 1 of ISO/IEC 14496-4:2001 40884 5 1 Request for AMD 1 of ISO/IEC 14496-5:2001 40894 5 2 Request for AMD 2 of ISO/IEC 14496-5:2001 42794 4 3 Request for AMD 3 for ISO/IEC 14496-4 47074 5 3 Request for ISO/IEC 14496-5:2001/Amd.3 486521 8 Request for Subdivision to ISO/IEC 21000-8 49044 4 3 Request for ISO/IEC 14496-4:2002/AMD3 50854 4 4 Request for ISO/IEC 14496-4/AMD4 54424 5 4 Request for ISO/IEC 14496-5/AMD4 54444 4 5 Conformance Extensions for Error Resilience Scalable Profile 56694 5 5 Error Resilience Scalable Profile Reference Software 56702 4 1 IPMP Conformance Extensions 57992 5 1 IPMP Reference Software Extensions 58084 4 6 AVC Conformance 58154 5 6 AVC Ref Soft 58227 7 1 Conformance Extensions 58254 4 4 IPMP Conformance Extensions 58954 4 7 AFX Conformance Extensions 58964 5 4 IPMP Reference Software Extensions 58974 5 7 AFX Reference Software Extensions 589821 14 Request for Subdivision ISO/IEC 21000-14 MPEG-21 Conformance 60702 4 2 Request for Amd 2 of ISO/IEC 13818-4:200X 62334 4 8 Request for Amd 8 of ISO/IEC 14496-4:2003 62414 4 9 AVC Fidelity Range Extensions Conformance 63524 5 8 AVC Fidelity Range Extensions Reference Software 63554 4 10 Request for 14496-4:2004 Amd.10 64974 4 11 Parametric Stereo Conformance 05/01 4 4 13 Parametric Coding for High Quality Audio Conformance 05/077 7 2 Fast Access Extension Conformance 05/10 76424 5 9 Morphing & Textures Reference Software 05/10 76394 4 12 Morphing & Textures Conformance 05/10 7637

2 MPEG-4 Conformance (14496-4)12539 Jeong-Hwan Ahn Updates on Study document of ISO/IEC 14496-4:2005/ AMD12 (Morphing & Textures)

The document is presented. This is going into the PDAM12.

194

12560Marius PredaFranck Le Pouliquen Francoise Preteux

Conformance streams for Morphing and Animation

The document is presented. This is going into the PDAM12.

12630Francisco MoránSebastián AmengualMarcos Avilés

Updates to WD of 'ISO/IEC 14496-4/Amd12'

The document is presented. The requirement for a DCOR are discussed. This is going into a COR.

12705 Jean-Claude Dufourd Proposed WD of LASeR Conformance

The document is presented, discussed and improved on line. It will be used for the creation of the WD of LASeR Conformance output at this meeting.

3 MPEG-4 Reference Software (14496-5) 12629 Francisco Moran Burgos Updates to material related to MPEG reference software

This document is presented. It will be used as a basis for the creation of the output document

xxxx Alexandre Cotarmanac’h Schedule for the update of the LASeR Reference and Utility Software

Utility software:A tool to automatically produce the SDL from the encoding schema is discussed. Expway will provide an executable software for the next AhG meeting (December).

A J2SE decoder/encoder (A) for BCSDL by Stz, for next AhG.

An update of the BiM reference software (B) able to encode and decode the BC SDL, by Expway, for next AhG.

A tool to produce a J2SE decoder/encoder for BCSDL by Stz, for a date TBD (Bangkok).

A cross-check of the BC SDL by exchanging conformance bitstreams between A and B, by ENST, for next AhG.

A J2ME decoder integrated with the utility J2ME composer by Stz, for next AhG.

An implementation of StreamSource in the utility J2ME composer by FTRD with help from Stz on the renderer adaptation, for Bangkok.

An implementation of other v2 additions in the utility J2ME composer by Stz, for Bangkok.

An implementation of uDOM in the utility J2ME composer, tentative commitment by ETRI, for Bangkok.

195

4 MPEG-21 Reference SoftwareReference software for MPEG-21 file format: this is being worked upon by Apple and possibly ENST. The release is planned together with the SVC File Format

5 Resolutions of IntegrationMPEG-4

5.1.1The Integration and Audio subgroups recommend to approve the following documents

No. Title TBP Available14496-4 MPEG-4 Conformance

7634 DoC on ISO/IEC 14496-4/FPDAM11 Parametric Stereo Conformance No 05/10/217635 Text of ISO/IEC 14496-4/FDAM11 Parametric Stereo Conformance No 05/10/21

5.1.2The Integration and 3DGC subgroups recommend to approve the following documents

No. Title TBP Available14496-4 MPEG-4 Conformance

7636 Text of ISO/IEC 14496-4:2004/ DCOR3 (WSS & MG conformance updates)

No 05/10/21

7637 Request for ISO/IEC 14496-4:2004/ AMD12 (Morphing & Textures) No 05/10/217638 Text of ISO/IEC 14496-4/PDAM12 (Morphing & Textures) No 05/10/21

5.1.3The Integration and Systems subgroups recommend to approve the following document

No. Title TBP Available14496-4 MPEG-4 Conformance

7641 WD1.0 of ISO/IEC 14496-4/AMDx (LASeR Conformance) No 05/10/21

5.1.4The Integration and 3DGC subgroups recommend to approve the following documents

No. Title TBP Available14496-5 MPEG-4 Reference Software

7639 Request for ISO/IEC 14496-5:2001/AMD9 (Morphing & Textures) No 05/10/217640 Text of ISO/IEC 14496-5/PDAM9 (Morphing & Textures) No 05/10/28

MPEG-7

5.1.5The Integration and Systems subgroups recommend to approve the following documents

No. Title TBP Available15938-7 MPEG-7 Conformance

196

7642 Request for AMD on ISO/IEC 15938-7 (Fast Access Extension Conf.) No 05/10/21

7643 Text of ISO/IEC 15938-7/PDAM2 (Fast Access Extension Conformance)

No 05/10/21

MPEG-21

5.1.6The Integration and MDS subgroups recommend to approve the following documents

No. Title TBP Available21000-14 MPEG-21 Conformance

7721 DoC on ISO/IEC 21000-14/CD MPEG-21 Conformance No 05/10/217749 Study of ISO/IEC 21000-14/CD MPEG-21 Conformance No 05/10/21

General

5.1.7The Integration subgroup recommends to approve the following document

No. Title TBP Available7644 Material related to MPEG Reference Software No 05/10/21

Promotion

5.1.8The Integration subgroup recommends to approve the following documents

No. Title TBP Available7645 Description of MPEG-1 Conformance Yes 05/11/217646 Description of MPEG-1 Reference Software Yes 05/11/217647 Description of MPEG-2 Conformance Yes 05/11/217648 Description of MPEG-2 Reference Software Yes 05/11/217649 Description of MPEG-4 Conformance Yes 05/11/217650 Description of MPEG-4 Reference Software Yes 05/11/217651 Description of MPEG-7 Conformance Yes 05/11/217652 Description of MPEG-7 Reference Software Yes 05/11/21

6 LocationsThis section describes the location of all bitstreams and reference software for published MPEG standards.

Reference MPEG-1  11172-4:1995 Part 4: Compliance testing Bitstreams

 TR 11172-5:1998 Part 5: Software simulation Software                                                                                                      

Reference MPEG-2 

 13818-4:2004 Part 4: Conformance testing Bitstreams

 TR 13818-5:1997 Part 5: Software simulation Software

197

 TR 13818-5:1997/Amd.1:1999

Part 5: Software simulationAMD 1: Advanced Audio Coding (AAC) Software

 TR 13818-5:1997 /Amd.1:1999/Cor.1:2003

Part 5: Software simulation AMD 1: Advanced Audio Coding (AAC), TECHNICAL CORRIGENDUM 1 Software

 TR 13818-5:1997 /Amd.1:1999/Cor.2:2004

Part 5: Software simulation AMD 1: Advanced Audio Coding (AAC), TECHNICAL CORRIGENDUM 2 Software

 TR 13818-5:1997/Amd.2:2005

Part 5: Software simulationAMD 2: MPEG-2 IPMP reference software N6737 

 TR 13818-5:200X Part 5: Software simulation N6737                                                                                                       

Reference MPEG-4 

 14496-4:2004 Part 4: Conformance testing Bitstreams

 14496-4:2004/Cor.1 Part 4: Conformance testing TECHNICAL CORRIGENDUM 1

Bitstreams

 14496-4:2004 /Amd.1:2005

Part 4: Conformance testingAMD 1: Conformance testing for MPEG-4

Bitstreams

 14496-4:2004 /Amd.1:2005/Cor.1

Part 4: Conformance testing AMD 1: Conformance testing for MPEG-4 TECHNICAL CORRIGENDUM 1

Bitstreams

 14496-4:2004 /Amd.2:2005

Part 4: Conformance testingAMD 2: MPEG-4 conformance extensions for XMT and

media nodes

Bitstreams

 14496-4:2004 /Amd.3:2005

Part 4: Conformance testingAMD 3: Visual new levels and tools

Bitstreams

 14496-4:2004 /Amd.4:2005

Part 4: Conformance testingAMD 4: IPMPX conformance extensions

Bitstreams

 14496-4:2004 /Amd.5:2005

Part 4: Conformance testingAMD 5: Conformance extensions for error resilient simple

scalable profile

Bitstreams

 14496-4:2004/Amd.6 Part 4: Conformance testingAMD 6: Advanced Video Coding conformance

Bitstreams

 14496-4:2004 /Amd.7:2005

Part 4: Conformance testingAMD 7: AFX conformance extensions

Bitstreams

 14496-4:2004 /Amd.8:2005

Part 4: Conformance testingAMD 8 High Efficiency Advanced Audio Coding, audio

BIFS, and structured audio conformance

Bitstreams

 14496-5:2001 Part 5: Reference software Software 14496-5:2001 /Amd.1:2002

Part 5: Reference softwareAMD 1: Reference software for MPEG-4 Software

 14496-5:2001 /Amd.2:2003

Part 5: Reference softwareAMD 2: MPEG-4 Reference software extensions for XMT

and media nodesSoftware

 14496-5:2001 /Amd.3:2003

Part 5: Reference softwareAMD 3: Visual new level and tools Software

198

Reference MPEG-4 

 14496-5:2001 /Amd.4:2004

Part 5: Reference softwareAMD 4: IPMPX reference software extensions Software

 14496-5:2001 /Amd.5:2004

Part 5: Reference softwareAMD 5: Reference software extensions for error resilient

simple scalable profileSoftware

 14496-5:2001 /Amd.6:2005

Part 5: Reference software AMD 6: Advanced Video Coding (AVC) and Efficiency Advanced Audio Coding (HE AAC)

reference softwareSoftware

 14496-5:2001 /Amd.7:2005

Part 5: Reference softwareAMD 7: AFX reference software extensions Software

                                                                                                                                

Reference  MPEG-7

 15938-6:2003 Part 6: Reference software Software

 15938-7:2003 Part 7: Conformance testing Bitstreams

                                                           

Reference  MPEG-21

 FDIS 21000-8 Part 8: Reference Software N7206 CD 21000-14 Part 14: Conformance Testing N7213

                                                                                                                                                                                                                                                                                            

199

Annex 12Report of Test

Source: Tobias Oelbaum, Chair

Opening of the Meeting

Goals for the weekThe goals of this week are:

Confirm test conditions and time line for the CfP on Multi View Coding Prepare evaluation of the wavelet video coding activity

Joint MeetingsThe following joint meetings were scheduled

with Video – 3DAV CfP Multi View Coding with Video – Wavelet Video Coding

Test Activities

CfP on Multi View CodingBit rates for one sequence have been refined after reference encoding. The rest of the CfP remains untouched. Contributions to the CfP will be evaluated prior to the 75th MPEG meeting.Due to the high number of pre-registrations for the call (13) it may be necessary to perform the visual tests at two test sites in parallel. If this is the case test will be performed at FUB (Rome) in addition to the already fixed test site at TUM (Munich).To cover the costs of the visual evaluation each participant will have to pay a fee which will be between 1500€ and 2000€ (depending on the number of participants).

Wavelet video codingAn evaluation of the status of the wavelet video coding activity should be performed at the 75th MPEG meeting. It was proposed to switch to the current JSVM testing conditions which differ in some bit rates and extraction path compared to the test conditions used at the 70th MPEG meeting in Palma.As several target applications of the wavelet video coding activity require a very high image resolution, sequences with a resolution of 1408x1152 (16CIF) or higher should be added to the test set. As no such sequences are available at the current time rate points and extraction paths need to be fixed by the AhG. It has to be noted that selecting the right test sequences and the related test parameters for each sequence is a critical task and no test sequences should be introduced in an ad hoc manner.

200

Test Resolutions

Output Documents N7567 Updated Call for Proposals on Multi-View Video Coding

AdHoc GroupsNo AdHoc Groups have been set up at this meeting.

201

Annex 13Report of ISG

Source: Marco Mattavelli, Chair

1 OverviewThe main work items of the Implementation Studies Subgroup in Nice are:1. The advances in the development of the MPEG-4 “Part 9 Reference Hardware Description”

Phase 2 concerning the integration of the MPEG-4 Optimized Reference software Part 7 and the Reference Hardware Part 9 so as to constitute a “mixed” software hardware description of MPEG-4 video using the concept of the virtual socket.

2. The planning and extension of supported features and documentation for the integrated framework, putting together in a single application MPEG-4 Part 9 with MPEG-7 Part 7 and AVC (MPEG-4 Part-9) software.

3. The review of the new HDL module submitted for integration in Part 9.4. The review of the Overview document edited for MPEG-4 Part 9 and for MPEG-7 Part 6

(MPEG-7 XM)5. The contribution to the VCTR activity for requirements definition and for the proposition of an

appropriate description formalism and simulation framework.

Input contributions w.r.t. the above items are summarized according to the following table:

Contributions

M12421 “AHG on MPEG-4 Part 9 Reference Hardware Description Phase 1 and 2”

Robert Turney (Xilinx)Marco Mattavelli (EPFL)

M12496 “ Overview of MPEG-4 Part-9 reference HW description”

Marco Mattavelli (EPFL), Ihab Amer (University of Calgary, CAN), Wael Badawy (University of Calgary, CAN)Andrew Kinane (University of Dublin)

M12497 “Overview of MPEG-7 Part-6 reference SW: Experimentation Model (XM)”

Marco Mattavelli (EPFL)

M12671 “An IP Block for Variable Block Size Motion Estimation in H.264/MPEG-4 AVC”

Mohammed Sayed, Wael Badawy (University of Calgary, CAN)

2 Detailed Report

202

2.1 The progress in the development of the MPEG-4 “Part 9 Reference Hardware Description”

The ISG activity at the Nice meeting has mainly been devoted to:

the review of the contribution presenting a new HDL module submissions, the review of the documentation and user manual for the HW/SW API specification of the

“Virtual Socket”, the update of MPEG-4 Part 2 and Part 10 module submission status, the review of the documentation presenting the essential information about objectives and

technology provided by Part 9 to be posted on the web site.

Contribution M12671 “An IP Block for Variable Block Size Motion Estimation in H.264/MPEG-4 AVC” presents a new module motion estimation HDL block for variable size blocks. It presents an efficient real time variable block size motion estimation (VBSME) IP block. The architecture provides motion vectors for each 16x16 block and its 40 sub-blocks (i.e. 41 motion vectors). The architecture is an SIMD architecture integrated with embedded SRAMs on one chip. The developed IP block is prototyped and simulated using ModelSim 5.4®. It is synthesized using Xilinx ISE 6®. The proposed module processes 31 CIF frames /sec using 122 MHz clock frequency. This module utilizes 68% of the register bits, 16% of the Block RAMs, and 94% of the LUTs in Xilinx Virtex II FPGA XC2V3000-4. The module is documented according to the specifications and the content has been included into the study document for the second edition of Part 9 TR.

Part of the meeting has also been devoted to editorial corrections and integration of new elements for the user manual of the “virtual socket” implementation available in Part 9. All new editing has been approved and included in the study document for Part 9 TR.

The ad-hoc group on the development of MPEG-4 Part 9 (N7274) has been re-established with updated mandates, including a specific mandate for the specification and development of the demonstration platform and the mandate for continuing the investigating the hardware reference description for DCT/IDCT as answer to the Call issued by video and JVT.

The ad-hoc schedule includes 3 telephone conferences before next meeting. Phone conferences are planned on the 17th November, 15th January, 12th January 4 p.m. CET. Tel: (from US 1-877-582-3182, from outside US 1-770-970-4161, participant code 9202060193).

2.2 Contributions and synergies with the Video Coding Tool Repository activity

A relevant part of the ISG activity in Nice has been spent in joint meetings with Requirements and VCTR Video subgroup. The contribution for the further development of the requirement document is reported by the Requirements report. A contribution from active members of the ISG group has been provided to solve the still unresolved problem of defining formalism with associated language and tools to be used to pass from what is currently a textual description of the tools to a true functional description that enables

203

tool reconfigurability and simulations. A comprehensive proposal that include formalism description, simulation environment and the example of an MPEG-4 SP decoder using the described tools has been presented and discussed by VCTR Video subgroup. A full report of the work is documented by the Video report.

2.3 Contributions to the review of the proposals received as answer to the call for specification for finite precision IDCT

A part of ISG activity has also been devoted to the review of the contributions for the IDCT finite precision specification. A full report of such activity is reported by the video group report.

2.4 Revision of the MPEG-7 Part 6 XM overview document and discussions on the transfer of the CVS repository from University of Munich to another site

A joint meeting with MPEG-7 video group discussed was devoted to review the MPEG-7 XM overview paper to be posted on the web site.Another issued discussed was the transfer of the CVS repository and the relative SW maintenance for the MPEG-7 XM from Munich University to another site that will commit to take charge of the task after the departure of Stephan Herrmann.

3 ResolutionsThe above activities have led to the following resolutions and output document approval.

3.1 Part 9 Reference Hardware Description

3.1.1 The ISG subgroup recommends approval of the following documentsNo. Title TBP Available

14496-9 MPEG-4 Reference Hardware Description N7541 Status of HDL submissions and commitments for MPEG N 05/11/15N7542 “Study of ISO/IEC PDTR 14496-9:2005 2nd Edition Reference

Hardware Description”N 05/11/15

3.1.2 The ISG subgroup recommends approval of the following document(s) for posting on the MPEG web site

No. Title TBP Available15938-6 MPEG-7 Reference Software

N7544 Overview of MPEG-7 Part 6 reference SW: Experimentation Model (XM)

Y 05/10/21

N7543 Overview of MPEG-4 Part-9 Reference HW Description Y 05/10/21

204

Annex 14Report of Liaison

Source: Niels Rump

The Liaisons Group considered the following input documents:

Input Contribution Number

Title

M12453 Liaison Statement from JTC 1/SC 37 [SC 29 N 6877]M12456 Liaison Statement from CEN/ISSS [SC 29 N 6892]M12457 Liaison Statement from ITU-T SG 16 [SC 29 N 6893]M12458 Liaison Statement from ITU-T SG 16 [SC 29 N 6894]M12459 ISO/IEC 19775-1/FPDAM 1 [SC 29 N 6914]M12465 Liaison Statement from TVA [SC 29 N 6930]M12476 IEC CDV 61937-8 [SC 29 N 6946]M12482 Liaison Statement from 3GPP [SC 29 N 6949]M12492 Liaison Statement from DVB [SC 29 N 6955]M12515 Liaison Statement from ATSC [SC 29 N 6960]M12516 Liaison Statement from CEA [SC 29 N 6961]M12519 UKNB comment on LiaisonsM12535 Liaison Statement from IEC TC 100 [SC 29 N 6962]M12536 Liaison Statement from NISO [SC 29 N 6963]M12688 Lossless Compression – Applications & RequirementsM11269 Liaison Statement from ECMAM12697 Liaison Statement from DVD ForumM12703 Liaison Statement from DMP

M12708 IEC NP: Consumer audio/video equipment -- Digital interface -- Part 8: Transmission of ITU-R BT.601 style

During the Liaison meeting, the requests for a Liaison relationship from both ATIS and CEA were discussed and approved.

The Alliance for Telecommunications Industry Solutions (ATIS) is a technical planning and standards development organization that is committed to rapidly developing and promoting technical and operations standards for the communications and related information technologies industry worldwide using a pragmatic, flexible and open approach. Participants from more than 350 global communications companies are active in ATIS’ 23 industry committees and Incubator Solutions Program. ATIS has recently formed the IPTV Interoperability Forum (IIF) to bring focus and coordination to standardization efforts concerning IPTV.

The Consumer Electronics Association (CEA) is the pre-eminent trade association promoting industry growth and leading the consumer technology industry in technology policy, events, and fostering business and strategic relationships. CEA membership unites 2000 companies

205

within the U.S. consumer technology industry, providing exclusive information and unparalleled market research, networking opportunities with business advocates and leaders, up-to-date educational programs and technical training, extensive promotional programs, and representation from the voice of the industry, promoting and advancing member needs and interests. CEA is accredited by the American National Standards Institute (ANSI) and maintains an unmatched reputation as a credible and flexible standards making body, addressing the critical trends of technological innovation, marketplace globalization and regulatory reform.

In addition to replying, when appropriate, to the incoming Liaison Statements of this meeting, it was agreed to take the initiative to send outgoing Liaison Statements to: CISAC (on ANSI/NISO ‘info’ URI Scheme) W3C (on LASeR and BiM) WG 1 (on ISO/IEC 14496-12)

Finally, the responses for the non-technical National Body comments as well as the updated list of organisations with which MPEG entertains liaisons were completed.

The following recommendations were issued:

The Liaison subgroup recommends the approval of the following Liaison documents:

No. Title TBP AvailableGeneral

7656 Statement of benefits from establishing a class C liaison with the CEA

N 05/10/21

7657 Statement of benefits from establishing a class C liaison with the ATIS

N 05/10/21

7658 List of Organisations with which MPEG entertains liaisons N 05/10/21

The Liaison subgroup recommends the approval of the following Liaison Statements:

No. Title TBP AvailableGeneral

7531 Liaison to DVB on IP Datacast over DVB-H N 05/10/217659 Liaison to WG1 N 05/10/217662 Liaison to DVB on LASeR, MPEG-B and File Format N 05/10/217663 Liaison to TC 100 N 05/10/217664 Liaison to ATSC N 05/10/217665 Liaison to DMP N 05/10/217666 Liaison to IFPI N 05/10/217667 Liaison to CEN/ISSS N 05/10/217668 Liaison to CEA N 05/10/217669 Liaison to NISO N 05/10/217671 Liaison to 3GPP N 05/10/217672 Liaison to ATIS N 05/10/217673 Liaison to ECMA N 05/10/217674 Liaison to OMA N 05/10/21

206

7595 Liaison to W3C N 05/10/21

The Liaison subgroup appoints the following individuals as Liaison Representatives:

Dr Anthony Vetro (Liaison to the Consumer Electronics Association) Dr Takuyo Kogure (Liaison to the Digital Media Project) Dr Xin Wang (Liaison to the Alliance for Telecommunications Industry Solutions –

IPTV Interoperability Forum)

The Liaison subgroup recommends the approval of the following Liaison documents:

No. Title TBP AvailableGeneral

7655 Responses to National Body Comments N 05/10/21

207