INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N6301München, March 2004

Source Leonardo Chiariglione, Convenor

Title Report of the 68th meetingStatus

Report of the 68th meeting1 Opening The 68th WG11 meeting was held at the Technical University of Munich on 2004/03/15-19 at the kind invitation of the German National Body (DIN).

2 Roll call of participants Annex 1 gives the attendance list.

3 Approval of agenda Annex 2 gives the agenda approved.

4 Allocation of contributionsAnnex 3 gives the list of input contributions

5 Communications from Convenor The Convenor proposed that the management of the Monday Plenary should be changed with matters discussed depending on their belonging to identified categories of activities. This was accepted and N6403 documents the categories and work items belonging to them. This report will be organised accordingly.

6 Report of previous meetingThis was approved.

7 Processing of NB Position PapersNational Body papers were considered and answers provided where appropriate.

1

8 Work plan

8.1 Media coding

8.1.1 MPEG-2 AAC BW Extensions conformance

8.1.2 AVC Conformance

8.1.3 AVC Fidelity Range Extensions

8.1.4 AVC Fidelity Range Extensions ConformanceThe following document was approved6353 Working Draft 1 of Amendment 9 for ISO/IEC 14496-4: AVC Fidelity Range Extensions

Conformance

8.1.5 AFX ConformanceThe following documents were approved

6465 DoC on ISO/IEC 14496-4:200x/FPDAM7 AFX Conformance Ext.

6466 Text of ISO/IEC 14496-4:200x/FDAM7 AFX Conformance Ext.

8.1.6 AFX ExtensionsThe following document was approved6311 ISO/IEC 14496-16/AMD1 WD

4.0

8.1.7 Audio Lossless CodingThe following document was approved6435 WD3 of Audio Lossless

Coding

8.1.8 Audio Scalable Lossless CodingThe following document was approved6437 WD2 of Scalable Lossless Coding

8.1.9 1-bit Audio Lossless Coding The following document was approved6439 ISO/IEC 14496-3:2001/PDAM 6, Lossless Coding of Oversampled

Audio

8.1.10 HE-AAC ConformanceThe following documents were approved6461 DoC on ISO/IEC 13818-4:200X/PDAM2 Audio Conformance Ext.6462 Text of ISO/IEC 13818-4:200X/FPDAM2 Audio Conformance Ext.

6467 Doc on ISO/IEC 14496-4:2003/PDAM8 HE-AAC, ABIFS & SA Conf.

6468 Text of ISO/IEC 14496-4:2003/PDAM8 HE-AAC, ABIFS & SA Conf.

2

8.1.11 SA Conformance

8.1.12 Scalable Video Coding

8.1.13 Streaming Text Format

8.1.14 Spatial Audio Coding The following document was approved6455 Call for Proposals on Spatial Audio

Coding

8.1.15 Video Coding Tool Repository

8.1.16 3D AV CodingThe following document was approved

6393 Requirements for Omni-directional AV 0.1

8.2 Composition coding

8.2.1 Audio BIFS ExtensionsThe following documents were approvedN6319 DoC on ISO/IEC 14496-11/PDAM3N6320 Text of ISO/IEC

14496-11/FPDAM3

8.2.2 Audio BIFS Conformance

8.2.3 XMT extensions

8.2.4 Lightweight Scene RepresentationThe following document was approvedN6337 CfP on Lightweight Application Scene

Representation

8.2.5 Symbolic Music RepresentationThe following document was approved6457 Draft Call for Proposals for Symbolic Music

Representation

8.3 Description coding

8.3.1 Efficient representation of descriptionsThe following documents were approvedN6325 DoC on ISO/IEC

15938-1/FPDAM1N6326 Text of ISO/IEC 15938-1/FDAM1

3

8.3.2 Video DescriptorsThe following document was approved

N6367 WD 1.0 of MPEG-7 New Visual Extensions

8.3.3 Audio DescriptorsThe following document was approved6441 WD 1 of MPEG-7, High-level

Descriptors

8.3.4 MDS user preference extensionsThe following documents were approved6397 DoC on ISO/IEC 15938-5 PDAM/2

6398 ISO/IEC 15938-5 FPDAM/2 “MDS User Preference Extensions”

8.3.5 MPEG-7 Conformance Extensions

8.3.6 MPEG-7 ProfilesThe following documents were approved6385 DoC for ISO/IEC 15938-9 CD6386 Text of ISO/IEC 15938-9 FCD

8.3.7 Schema definitionThe following documents were approved6407 DoC on ISO/IEC 15938-10 CD

6408 ISO/IEC 15938-10 FCD “Schema Definition“

8.3.8 Extraction and use of MPEG-7 descriptions extensionsThe following documents were approved

N6370 Disposition of Comments on ISO/IEC TR 15938-8/PDAM1

N6371 Text of ISO/IEC TR 15938-8/DAM1

8.4 Systems support

8.4.1 Carriage of ISAN and V-ISAN metadata

8.4.2 New audio profile and level signalingThe following documents were approvedN6316 DoC on ISO/IEC 13818-1:2000/PDAM5N6317 Text of ISO/IEC

13818-1:2000/FPDAM5

8.4.3 MPEG-1 Audio access unitsThe following document was approved6433 Study on ISO/IEC 14496-3:2001/FPDAM 3, MP3 on

MP4

4

8.4.4 Streaming of MPEG-7 descriptions

8.4.5 Timestamps and Audio Codec Behavior

8.5 IPMP

8.5.1 MPEG-2 IPMP-X Conformance

8.5.2 MPEG-4 IPMP-X ConformanceThe following documents were approved

6463 DoC on ISO/IEC 14496-4:200x/FPDAM4 IPMP Conformance Ext.

6464 Text of ISO/IEC 14496-4:200x/FDAM4 IPMP Conformance Ext.

8.5.3 Evaluation Tools for Persistent AssociationThe following documents were approved

6391 DoC on PDTR of ISO/IEC 21000-11

6392 Text of DTR of ISO/IEC 21000-11

8.5.4 MPEG-21 IPMP FrameworkThe following documents were approved6389 Requirements for MPEG-21 IPMP6390 Updated Call for Proposals for MPEG-21 Intellectual Property Management and

Protection

8.6 Digital Item

8.6.1 Digital Item DeclarationThe following document was approved

6409 ISO/IEC 21000-2 DID 2nd Edition CD

8.6.2 Digital Item BinarisationThe following document was approvedN6333 WD1.0 of Text of ISO/IEC 21000-

16

8.6.3 DIA Conversions and PermissionThe following document was approved

6413 MPEG-21 DIA AMD/1 WD v.2 “Conversions and Permissions”

8.6.4 Event ReportingThe following document was approved

6419 ISO/IEC 21000-15 WD v.1 “Event Reporting”

5

8.6.5 MPEG-21 ConformanceThe following document was approved6472 WD3.0 of ISO/IEC 21000-14 MPEG-21

Conformance

8.6.6 Vision, technologies and strategyThe following documents were approved

6387 DoC on PDTR of ISO/IEC 21000-1 Second Edition

6388 Text of DTR of ISO/IEC 21000-1 Second Edition

8.7 Transport and File Format

8.7.1 ISO File Format extensionsThe following documents were approvedN6322 DoC on ISO/IEC 14496-12/PDAM1N6323 Text of ISO/IEC

14496-12/FPDAM1

8.7.2 MPEG-21 File FormatThe following document was approvedN6331 Text of ISO/IEC 21000-9

CD

8.8 Multimedia architecture

8.8.1 MPEG-J extension for scene control

8.8.2 MPEG-J extension for rendering

8.8.3 Digital Item Processing

8.8.4 MPEG Multimedia MiddlewareThe following document was approved6336 Requirements on the MPEG Multimedia

Middleware

8.9 Reference implementation

8.9.1 AVC Reference Software

8.9.2 HE-AAC Reference Software

8.9.3 AFX Reference Software

8.9.4 AVC Fidelity Range Extensions Reference SoftwareThe following document was approved6356 Working Draft 1 of Amendment 8 for ISO/IEC 14496-5: AVC Fidelity Range

Extensions Reference Software

6

8.9.5 MPEG-4 Visual Reference Hardware DescriptionThe following document was approvedN6307 ISO/IEC 14496-9/PDAM of AM 1: Information Technology – Coding of Audio

Visual Objects - Part 9: Reference Hardware Description.

8.9.6 MPEG-4 AVC Reference Hardware DescriptionThe following document was approvedN6308 Request for Reference Hardware Description

Extensions

8.9.7 MPEG-7 Reference Software Extensions

8.9.8 MPEG-21 Reference SoftwareThe following document was approved6470 Text of ISO/IEC 21000-8 CD MPEG-21 Reference

Software

8.9.9 Test Bed for MPEG-21 Resource Delivery

8.10 Application formats

8.10.1 Music player Application Format The following document was approved

6443 Text of MPEG-A, Music Player Application Format CD

8.10.2 Photo album Application Format

8.11 Maintenance

8.11.1 Video coding standards

8.11.2 Audio coding standards

8.11.3 Visual description coding standards

8.11.4 Audio description coding standards

8.11.5 MDS standards

9 Liaison matters The following liaisons were issuedN6340 Liaison Statement to the TV-Anytime Forum

N6341 Liaison Statement to SMPTE on V/ISAN and ISO 13818-1 DAM4

N6342 Liaison Statement to AVS ChinaN6343 Liaison Statement to ISO TC 46/SC 9N6344 Liaison Statement to IEEE-LTSCN6345 Liaison Statement to W3C

7

N6346 Liaison Statement to JPEGN6425 Information on MPEG-21 IPMP Call for Proposals

10 Organisation of this meeting

10.1 Tasks for subgroupsTasks were assigned to achieve the goals of the work plan.

10.2 Joint meetings The following joint meetings were held

Groups What Where Day TimeReq, MDS MPEG-21 Event Rep MDS Mon 16:00-17:00Req, Sys M3W Sys Mon 17:00-17:30

DMP 0938 Mon 18:00-19:00

HOD 0938 Mon 19:00-20:00MDS, Sys MPEG-21 binarisation MDS Tue 09:00-10:00Aud, Sys Various issues Aud Tue 10:00-12:00JVT, Sys AVC on MP2 Sys JVT Tue 11:30-12:00Req, Sys, Vid, Aud MAF Req Tue 12:00-13:00JVT, Tst Objective vid qual.

measureJVT Tue 12:00-12:30

Req, Sys M3W Req Tue 14:00-14:30Req, Sys Laser Req Tue 14:30-15:30Req, Sys, Snh MP4 Profiles Req Tue 15:30-16:30MDS, Int MPEG-21 Conform MDS Tue 15:30-16:00MDS, Int MPEG-21 Ref SW MDS Tue 16:00-18:00Req, Sys IPMP Prof. Req Tue 16:30-17:00Vid, ISG Video tools Vid Tue 17:00-17:30Vid, Tst Error Res. VT Vid Tue 17:30-18:00Liaisons 0938 Tue 18:00-19:00Req, MDS, Aud, Vid

MP7 Profiles, MAF Plen Wed 11:30-12:30

Req, Mds MPEG-21 US NB contrib Plen Wed 12:30-13:00Req, Aud Live Audio Broadcast etc. Aud Wed 14:00-14:30Vid, Sys Layered Video Coding Vid Wed 14:00-14:30Req, Sys IPMP profile N0115 Wed 15:00-16:00Snh, Req Compressed 3D Profile N0115 Wed 16:00-16:30Vid, Jvt SVC Vid Wed 17:00-18:30Sys, Mds MP21 FF Sys Wed 17:00-18:00Sys, ISG Laser evaluation Sys Thu 11:00-11:30Sys, Req Laser Sys Thu 12:00-12:30Req, JVT Fidelity Range Ext. JVT Thu 12:30-13:00Req, Vid 3D AV, SVC Vid Thu 14:00-15:00Mds, Int, Snh MPEG-21 ref SW Sys Thu 15:00-16:00

10.3 Administrative matters

10.3.1 Schedule of future MPEG meetings The following schedule was approved

8

Meeting City Country

Yr.

Mo. Days

68th München DE 04 03 15-19

69th Redmond, WA US 04 07 19-23

70th Palma de Mallorca

ES 04 10 18-22

71st Hong Kong CN 05 01 17-21

72nd Busan KR 05 04 18-22

73rd Poznań PL 05 07 25-29

74th ? FR 05 10 17-21

75th ? ? 06 01 24-28

10.3.2 Promotional activities An ad hoc group with this mandate was established.

11 Planning of future activities The following ad hoc groups were established:6475 Scene Representation6474 XML Structure Binarization and Streaming6380 3DAV Coding6350 AFX documents, CEs, and software6422 Core Experiments for MPEG-21 DID 2nd Edition6423 Core Experiments for MPEG-21 DIP6424 Core Experiments for MPEG-21 Event Reporting6379 Core Experiments in Scalable Video Coding6378 Description Tools for New Visual Extensions6376 Maintenance of MPEG-4 Visual related Documents, Reference Software and

Conformance6377 Maintenance of MPEG-7 Visual related Documents and Reference Software6476 MPEG Multimedia Middleware 6473 MPEG Reference Software6459 MPEG-4 Lossless Audio Coding6309 MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.6396 MPEG-7 Profiles6351 MPEG-J extensions for rendering6395 Multimedia Application Format (MAF)6458 Spatial Audio Coding6460 Symbolic Music Representation6478 Communicating MPEG to the business Community 6381 Video Coding Tools Repository6394 AHG to evaluate responses to the MPEG-21 IPMP CfP

9

12 Resolutions of this meetingThese were approved (N6299)

13 A.O.B There was no other business

14 Closing The meeting closed at 2004/03/19T21:40.

10

Annex 1Attendance list

Last name First name Affiliation Coun.Hellwagner Hermann University Klagenfurt ATKosch Harald University Klagenfurt ATTaschwer Mario University Klagenfurt ATTimmerer Christian University Klagenfurt ATWan Ernest Canon AUBecker Axel CISRA AUBurnett Ian Enikos/UoW AUTaubman David The University of New South Wales AUDrury Gerrard TITR / enikos AUDavis Stephen University Of Wollongong AUDe Keukelaere Frederik Ghent University BEDe Wolf Koen Ghent University BEVan de Walle Rik Ghent University BEBekaert Jeroen Ghent University - LANL BEBormans Jan IMEC BEDevillers Sylvain IMEC BERogge Boris Metanous BESalomie Alexandru V.U.B. BEMunteanu Adrian Vrije Universiteit Brussel BESchelkens Peter Vrije Universiteit Brussel BEWang Demin Communications Research Centre CAWinger Lowell LSI CAAlberti Claudio EPFL CHMattavelli Marco EPFL CHZoia Giorgio EPFL CHFaller Christof EPFL CHVexo Frederic EPFL-VRLab CHWuermlin Stephan ETH Zurich CHWaschbüsch Michael ETH Zürich CHDi Giacomo Thomas MIRALab, University of Geneva CHReichel Julien VisioWave CHZiliani Francesco VisioWave CHGao Wen Institute of Computing Technology (CAS) CNXu Jizheng Microsoft CNHe Yun Tsinghua Univ. CNRusert Thomas Aachen University DEWien Mathias Aachen University DECrysandt Holger Aachen University (RWTH) DESchneider Andreas Coding Technologies DEFeiten Bernhard Deutsche Telekom, T-Systems DEList Peter Deutsche Telekom, T-Systems DEStepping Michael FernUniversität Hagen DEWiegand Thomas Fraunhofer HHI DE

11

Suehring Karsten Fraunhofer HHI DEFehn Christoph Fraunhofer HHI DEMarpe Detlev Fraunhofer HHI DEMüller Karsten Fraunhofer HHI DESmolic Aljoscha Fraunhofer HHI DESchwarz Heiko Fraunhofer HHI DEBrandenburg Karlheinz Fraunhofer IDMT DEGeiger Ralf Fraunhofer IDMT DEGruhne Matthias Fraunhofer IDMT DEBaum Oliver Fraunhofer IIS DEFuchs Harald Fraunhofer IIS DEGrill Bernhard Fraunhofer IIS DEHerre Juergen Fraunhofer IIS DESperschneider Ralph Fraunhofer IIS DEThoma Herbert Fraunhofer IIS DELink Martin Institut für Rundfunktechnik GmbH DESteinmann Volker Institut für Rundfunktechnik GmbH DEStoll Gerhard Institut für Rundfunktechnik GmbH DEZiegler Gernot Max-Planck-Institut, Saarbrücken DEOelbaum Tobias Munich University of Technology DEWittmann Steffen Panasonic DEWedi Thomas Panasonic European Labs DEBenzler Ulrich Robert Bosch GmbH DEOhm Jens-Rainer RWTH Aachen DEHanke Konstantin RWTH Aachen University DEBäse Gero Siemens AG DEHutter Andreas Siemens AG DEAmon Peter Siemens AG DETaddei Herve Siemens AG DETimmerman Benoit Siemens AG DEKofler-Vogt Andrea Siemens AG DELiebchen Tilman Technical University of Berlin DEDrumm Helge Technische Universität Ilmenau DEBöhm Johannes Thomson DESchmidt Juergen Thomson DEHerpel Carsten Thomson DEGraffunder Andreas T-Systems DEWolf Ingo T-Systems DERittermann Marco TU Ilmenau DEDiepold Klaus TUM-LDV DEOelbaum Tobias TUM-LDV DEZwick Michael TUM-LDV DEObermeier Florian TUM-LDV DEHerrmann Stephan TUM-LIS DEKaup André University of Erlangen DEEdler Bernd University of Hannover DEOstermann Jörn University of Hannover DENarroschke Matthias University of Hannover DE

12

Nguyen Dieu Thanh University of Hannover DEKummer-Hardt Thomas AIO ESGauvin Marc Microgenesis ESVillegas Paulo Telefónica I+D ESMorán Burgos Francisco Univ. Politécnica Madrid ESDelgado Jaime Universitat Pompeu Fabra ESRodriguez Eva UPF ESLugmayr Artur   FIVäänänen Mauri Nokia FILainema Jani Nokia FIRidge Justin Nokia FINguyen Hang ALCATEL FRNuttal François-

XavierCISAC FR

Concolato Cyril ENST FRDufourd Jean-Claude ENST FRPesquet-Popescu Beatrice ENST FRSeyrat Claude EXPWAY FRCotarmanach Alexandre France Telecom FRAmonou Isabelle France Telecom FRDaniel Jerome France Telecom FRFournier Jérôme France Telecom FRGicquel Jean-Charles France Telecom FRGioia Patrick France Telecom FRLoras Frederic France telecom FRRoyan Jérôme France Telecom FRAvaro Olivier France Telecom R&D FRBenjelloun Touimi Abdellatif France Telecom R&D FRPateux Stéphane France Telecom R&D FRRault Jean-Bernard France Telecom R&D FRVirette David France Telecom R&D FRBalter Raphaèle France Telecom RD and IRISA FRGuillemot Christine INRIA FRPreda Marius INT FRMeudic Bernoit Ircam FRPuig Vincent Ircam FRBottreau Vincent IRISA-INRIA FRDulong de Rosnay Melanie Medialive FRJung Joel Philips FRMarc Guez Vucher SCPP FRFrancois Edouard Thomson FRVieron Jerome Thomson FRNilsson Mike BTexact Technologies GBRowe Simon Canon Research Centre Europe GBCasey Michael City University, London GBKudumakis Panos CRL GBJessop Paul IFPI GBLindsay Adam Lancaster University GB

13

Cieplinski Leszek Mitsubishi Electric ITE-VIL GBMiroslaw Bober Mitsubishi Electric ITE-VIL GBTeh Jonathan Motorola GBGrant Kate Nine Tiles GBHarwood Don Oxford Semiconductor Ltd GBAbhayaratne Charit Queen Mary, University of London GBPearmain Alan Queen Mary, University of London GBBarlas Chris Rightscom Limited GBRump Niels Rightscom Limited GBBarney Wragg Universal Music International GBWatt Simon Universal Music International GBAhik Achihuo

ManQuix Technologies IL

Birman Shlomo Vimatix inc. ILGill Aharon Zoran Microelectronics ILDesai Jwalant Wipro Technologies INChiariglione Leonardo CEDEO ITDavide Rogai DSI-DISIT-UNIFI ITPiefrancesco Bellini DSI-DISIT-UNIFI ITPaolo Nesi DSI-DSIT-UNIFI ITStefano Tubaro Politecnico di Milano ITCordara Giovanni Telecom Italia LAB ITLeonardi Riccardo University of Brescia ITKitamura Masatsugu For more convenient AV life JPKazui Kimihiko Fujitsu Laboratories Ltd. JPMurakami Tomokazu Hitachi JPSuzuki Yoshinori Hitachi, Ltd. JPOgura Yukiko IPSJ/ITSCJ JPSugihara Yoshinori Jeita JPKawada Ryoichi KDDI JPHitoshi Habe Kyoto University JPKogure Takuyo Matsushita JPSenoh Takanori Matsushita JPTakahashi Toshiya Matsushita JPTanaka Naoya Matsushita JPUeno Takafumi Matsushita JPAsai Kohtaro Mitsubishi Electric Corporation JPMurakami Tokumichi Mitsubishi Electric Corporation JPNishikawa Hirofumi Mitsubishi Electric Corporation JPYamada Yoshihisa Mitsubishi Electric Corporation JPSchultz Craig Multimedia Architectures JPFujii Toshiaki Nagoya University JPTanimoto Masayuki Nagoya University JPYamazawa Kazumasa Nara Institute of Science and Technology JPNomura Toshiyuki NEC JPYamada Akio NEC JPKimoto Takahiro NEC Corporation JPKimata Hideaki NTT JP

14

Moriya Takehiro NTT JPSugiura Koichi NTT Advanced Technology Corporation JPNakajima Junichi NTT Cyber Space Laboratories JPTan TK NTT DoCoMo, Inc. JPNishi Takashi Oki Electric Industry Co., Ltd. JPWu Zhixiong Oki Electric Industry Co., Ltd. JPNoguchi Yoji Sharp Corporation JPVisharam Zubair Sony JPSuzuki Teruhiko Sony JPAoki Terumasa The University of Tokyo JPKoike Mayumi The University of Tokyo JPKambayashi Toru Toshiba JPChujoh Takeshi Toshiba JPKaneko Itaru Waseda University JPOh Weon Geun ETRI KPKim Hyun Mun Samsung KPSung Woo Cheol Sejong University KPChae Jong Jin   KRDong Wook Kang   KRCho Yongju ETRI KRJeho Nam ETRI KRJeong Senator ETRI KRJeong Seyoon ETRI KRKim Kyuheon ETRI KRKim Wook-Joong ETRI KRSeo Jeongil ETRI KRSong Young Joo ETRI KRSoojun Park ETRI KRHendry   Information and Communications University KRKim Munchurl Information and Communications University KRJong-Tae Kim KAIST KRKim Hyoung

JoongKangwon National University KR

KiSeob Kim Kangwon National University KRPark Keunsoo KBS KRSang yong Sseo Korea Telecom KRKim Wonha Kyung Hee university KRSuh Doug Kyung Hee University KRJeon Byeong

MoonLG Electronics KR

Lim Young-Kwon

net&tv Inc. KR

Jong Jin Chae net&tv Inc. KRKim Joo Hee Samsung KRKim Sangwook Samsung KRKyun Kim Sang Samsung KROh Eunmi Samsung KRHan Mahnjin Samsung AIT KR

15

Ahn Jeong-Hwan Samsung AIT KRKim Sang Kyun Samsung AIT KRKim Woo-Shik Samsung AIT KRLee Jong Won Samsung Electronics KRWoo-Jin Han Samsung Electronics KRKim Hae Kwang Sejong University KRLee Yung Sejong University KRJi Kyunghee SIT KRByeungwoo Jeon SKKU KRWoong Il Choi Sung Kyun Kwan University KRRinchul Kim Univ. of Seoul KRKoenen Rob InterTrust NLBruls Wha Philips NLvan der Meer Jan Philips NLOomen A.W.J. Philips PDSL-E NLGelissen Jean H.A. Philips Research NLVanderschaar Mihaela Philips Research NLvan den Heuvel Bas Royal Philips Electronics NLTokmakoff Andrew Telematica Instituut NLPerkis Andrew NTNU NOBjontegaard Gisle Tandberg NOBlaszak Lukasz Poznan University of Technology PLDomañski Marek Poznañ University of Technology PLNavarro Antonio Aveiro University PTAscenso João EST-IT PTPereira Fernando Instituto Superior Técnico PTKjörling Kristofer Coding Technologies SEPurnhagen Heiko Coding Technologies SEFröjdh Per Ericsson SELin Xiao Institute for Infocomm Research SGOng Ee Ping Institute for Infocomm Research SGRahardja Susanto Institute for Infocomm Research SGYu Rongshan Institute for Infocomm Research SGZhengguo Li Institute for Infocomm Research SGLiu Jing Panasonic Singapore Laboratories SGChong Kok Seng Panasonic Singapore Laboratories SGChong Soon Lim Panasonic Singapore Laboratories SGHuang Lee Men Panasonic Singapore Laboratories SGHuang Zhongyang Panasonic Singapore Laboratories SGJi Ming Panasonic Singapore Laboratories SGNeo Sua Hong Panasonic Singapore Laboratories SGShen Shengmei Panasonic Singapore Laboratories SGChen Vincent   USHang Hsueh-Ming National Chiao Tung Univ. USTung Yi-Shin National Taiwan University USTsai Chun-Jen National Chiao Tung Univ. USChung-Neng Wang Allen National Chiao Tung Univ./ITRI USLevantovsky Vladimir Agfa Monotype Corp. US

16

Zatsman Alex Analog Devices, Inc USSinger David Apple USQuackenbush Schuyler Audio Research Labs USCornog Katie Avid Technology USMelby Alan Brigham Young University USZhong Sheng Broadcom Corp USFeng Chi Wang Conexant Systems, Inc. USGandee Bradford ContentGuard, Inc. USDeMartini Thomas ContentGuard, Inc. USWang Xin ContentGuard, Inc. USBossen Frank DoCoMo Communications Laboratories USA,

Inc.US

Husak Walter Dolby Labs USVinton Mark Dolby Labs USMcMahon Tom Dolby Labs USRabbani Majid Eastman Kodak USTopiwala Pankaj FastVDO USSwaminathan Kumar Hughes Electronics USSchirling Peter IBM Research USSmith John R. IBM T. J. Watson Research Center USNg Kia ICSRiM University of Leeds UK USHaque Munsi Intel Corporation USChen Fang-Chu ITRI USNalebuff Martha Microsoft USSullivan Gary Microsoft USTescher Andrew Microsoft USBourges-Sevenier Mikael Mindego Inc. USChiang Tihao Mitsubishi Electric USVetro Anthony Mitsubishi Electric USSun Huifang Mitsubishi Electric Research Labs USLuthra Ajay Motorola USNarasimhan Sam Motorola USRussel Chris MPA USChang Wo NIST USFenimore Charles NIST USChau Kwok NJR Corporation USPowell Ged NTT DoCoMo, Inc. USLu Jiuhuai Panasonic USTao Chen Panasonic Hollywood Lab USSagetong Phoom Qualcomm Incorporated USReznik Yuriy RealNetworks, Inc. USBlock Bruce Recording Industry Association of America USWoods John Rensselaer Polytech USGordon Stephen Sand Video USSun Shijun Sharp Labs of America USLei Shawmin Sharp Labs of America USSymes Peter SMPTE USVisharam Mohammed Sony US

17

ZubairTabatabai Ali Sony USChen George STMicroelectronics USSwaminathan Viswanathan Sun Microsystems Inc. USFernandes Felix Texas Instruments USBoyce Jill Thomson USTourapis Alexis

MichaelThomson US

Gomila Cristina Thomson USYu Haoping Thomson USChung Wilson Xilinx USSteyn Dr. Jacques Monash South Africa ZA

18

Annex 2Agenda

Agenda item1. Opening 2. Roll call of participants 3. Approval of agenda 4. Allocation of contributions 5. Communications from Convenor 6. Report of previous meeting 7. Processing of NB Position Papers8. Work plan

1. 8.1 Media coding1.1. MPEG-2 AAC BW Extensions conformance1.2. AVC Conformance1.3. AVC Fidelity Range Extensions 1.4. AVC Fidelity Range Extensions Conformance1.5. AFX Conformance1.6. AFX Extensions1.7. Audio Lossless Coding1.8. Audio Scalable Lossless Coding1.9. 1-bit Audio Lossless Coding 1.10. HE-AAC Conformance1.11. SA Conformance1.12. Scalable Video Coding1.13. Streaming Text Format1.14. Spatial Audio Coding 1.15. Video Coding Tool Repository1.16. 3D AV Coding

8.2 Composition coding2.1. Audio BIFS Extensions2.2. Audio BIFS Conformance2.3. XMT extensions2.4. Lightweight Scene Representation2.5. Symbolic Music Representation

8.3 Description coding3.1. Efficient representation of descriptions3.2. Video Descriptors3.3. Audio Descriptors3.4. MDS user preference extensions3.5. MPEG-7 Conformance Extensions3.6. MPEG-7 Profiles3.7. Schema definition3.8. Extraction and use of MPEG-7 descriptions

extensions8.4 Systems support

4.1. Carriage of ISAN and V-ISAN metadata4.2. New audio profile and level signaling

19

4.3. MPEG-1 Audio access units4.4. Streaming of MPEG-7 descriptions4.5. Timestamps and Audio Codec Behavior

8.5 IPMP5.1. MPEG-2 IPMP-X Conformance 5.2. MPEG-4 IPMP-X Conformance5.3. Evaluation Tools for Persistent Association5.4. MPEG-21 IPMP Framework

8.6 Digital Item6.1. Digital Item Declaration6.2. Digital Item Binarisation6.3. DIA Conversions and Permission6.4. Event Reporting6.5. MPEG-21 Conformance6.6. Vision, technologies and strategy

8.7 Transport and File Format7.1. ISO File Format extensions7.2. MPEG-21 File Format

8.8 Multimedia architecture8.1. MPEG-J extension for scene control8.2. MPEG-J extension for rendering8.2. Digital Item Processing8.3. MPEG Multimedia Middleware

8.9 Reference implementation9.1. AVC Reference Software9.2. HE-AAC Reference Software9.3. AFX Reference Software9.4. AVC Fidelity Range Extensions Reference Software9.5. MPEG-4 Visual Reference Hardware Description9.6. MPEG-4 AVC Reference Hardware Description9.7. MPEG-7 Reference Software Extensions9.8. MPEG-21 Reference Software9.9. Test Bed for MPEG-21 Resource Delivery

8.10

Application formats

10.1. Music player Application Format 10.2. Photo album Application Format

8.11

Maintenance

11.1 Video coding standards11.2 Audio coding standards11.1 Visual description coding standards11.2 Audio description coding standards11.3 MDS standards

9. Liaison matters 10.

Organisation of this meeting

10. Tasks for subgroups

20

1 10.2

Joint meetings

11.

Administrative matters

11.1

Schedule of future MPEG meetings

11.2

Promotional activities

12.

Planning of future activities

13.

Resolutions of this meeting

14.

A.O.B

15.

Closing

21

Annex 3Input document list

No. Authors Title

10456 Wo Chang Document Register for SC29/WG11 Meeting Munich, DE

10457 Robert TurneyMarco Mattavelli

AHG on MPEG-4 Part 9 Reference Hardware Description Phase 1 and 2

10458Marius PredaMahnjin HanMike Bourges-Sevenier

AHG on AFX documents editing and Core Experiments

10459 Mahnjin HanPatrick Gioia AHG on AFX Conformance

10460 Jens Spille AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4

10461Ralph Sperschneideron behalf of the AHG on MPEG-4 Audio Conformance

Report of the AHG on MPEG-4 Audio Conformance

10462

Ralph SperschneiderHeiko Purnhagenon behalf of the AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software

Report of the AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software

10463 W. Oomen AHG on MPEG-4 Audio Extensions 1 and 2

10464 Tilman Liebchen AHG on MPEG-4 Audio Lossless Coding

10465 Matthias Gruhne AHG on MPEG-7 Audio

10466 Paolo NesiGiorgio Zoia AHG on Music Notation Requirements

10467 Schuyler Quackenbush AHG on Timestamps and Audio Codec Behavior

10468 Schuyler Quackenbush AHG on Audio Explorations

10469

Myriam AmielhGerrard DrurySylvain DevillersYongju Cho Craig Brown

AHG on MPEG 21 Media Locators

10470Xin WangJaime Delgado Chris Barlas

AHG on MPEG-21 REL and RDD Reference Software

10471

Anthony VetroChristian Timmerer Sylvain DevillersThomas DeMartini

AHG on DIA Editing

10472

Jorg HeuerDebargha MukherjeeSylvain DevillersChristian Timmerer

AHG on Bit-stream Adaptation in Constrained and Streaming Environments

22

10473Christian TimmererGerrard Drury Frederik De Keukelaere

AHG on MPEG-21 DIA Reference Software

10474Gerrard DruryFrederik De KeukelaereMunchurl Kim

AHG on MPEG-21 DIP Reference Software

10475Gerrard DruryRik Van de WalleMunchurl Kim

AHG on Editing and Core Experiments for DIP

10476T. ChiangYi-Shin TungChung-Neng Wang

AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

10477 Miroslaw BoberSang-Kyun Kim

AHG on Visual Descriptors and Visual-only Description Schemes in MPEG-7

10478A. Yamada S. K. Kim L. Cieplinski

AHG on Editing MPEG-7 Visual related Documents

10479 Aljoscha SmolicHideaki Kimata AHG on 3DAV Coding

10480

Mihaela van der SchaarA. BeckerJ. RidgeC.J. TsaiVittorio Baroncini

AHG on Scalable Video Coding

10481Claude SeyratAli TabatabaiItaru Kaneko

AHG on MPEG-7 Systems

10482Jean-Claude DufourdYuval FisherJuergen Schmidt

AHG on MPEG-4 Scene Representation

10483 Dave Singer AHG on MPEG File format

10484 Mikael Bourges-SevenierVishy Swaminathan AHG on MPEG-J Extensions

10485 Jean-Claude Dufourd AHG on Reference Software

10486

Chun-Jen TsaiMihaela van der ShaarYoung-Kwon LimDoug Young Suh

AHG on MPEG Multimedia Test Bed

10487

Thomas DeMartiniSylvain DevillersFrederik De KeukelaereGerrard Drury

AHG on MPEG-21 Conformance

10488 Kohtaro Asai AHG on Intra-only Coding in MPEG

10489Simon WattBas van den HeuvelCraig Schultz

AHG to complete requirements for MPEG-21 IPMP

10490 Artur LugmayrAbdellatif Benjelloun Touimi

AHG on study of MPEG-21 and broadcasting

23

Jong-Nam KimItaru Kaneko

10491 Brad GandeeChris Barlas AHG on Profiles and Extensions for the MPEG-21 REL

10492 Wo ChangMasanori Sano AHG on MPEG-7 Interoperability and Profiling

10493 Wo ChangOlivier Avaro AHG on Multimedia Application Format (MAF)

10494 FX NuttallAndrew Tokmakoff AHG on MPEG-21 Event Reporting

10495 Craig Schultz Discussion on MPEG-21 IPMP Requirements

10496 SC 24 via SC 29 SecretariatISO/IEC FCD 19774: Information technology -- Computer graphics and image processing -- Humanoid animation (H-Anim) [SC 29 N 5756]

10497 TVA via SC 29 Secretariat Liaison Statement from the TV-Anytime Forum [SC 29 N 5757]

10498 Cieplinski UK NB comments on Text of ISO/IEC 15938-8/PDAM1

10499 Cieplinski UK NB comments on Text of ISO/IEC CD 15938-10

10500 Cieplinski UK NB comments on Text of ISO/IEC 15938-10 CD

10501 TVA via SC 29 Secretariat Liaison Statement from the TV-Anytime Forum [SC 29 N 5789]

10502

Bhavan GandhiPeter van BeekJohn R. Smith Alan K. Melby Elisha Berns

Terms and Definitions for MPEG-7 Profiles

10503 Alan K. MelbyJohn R Smith Proposal for logical media locator for MPEG 7&21

10504 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-1:2000/PDAM 4 [SC 29 N 5808]

10505 SC 29 Secretariat Summary of Voting on ISO/IEC TR 14496-7:2002/Amd.1/DCOR 1 [SC 29 N 5909]

10506 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-2:200X/DCOR 1 [SC 29 N 5910]

10507 SC 29 Secretariat Summary of Voting on ISO/IEC CD 15938-10 [SC 29 N 5911]

10508 ITU-T SG 16 via SC 29 Secretariat

Liaison Statement from ITU-T SG 16 on Audio Information [SC 29 N 5813]

10509 ITU-T SG 16 via SC 29 Secretariat Liaison Statement from ITU-T SG 16 [SC 29 N 5814]

10510 Ryoichi Kawada Comments to MPEG 3DAV activities

10511 George Chen ST dataset for 3DAV EE2

10512 George Chen Using inter-view prediction for multi-view video compression

10513 George Chen Response to 3DAV CfC

10514 SC 29 Secretariat Summary of Voting on ISO/IEC TR 15938-8/PDAM 1 [SC 29

24

N 5820]

10515 Ken-ichiro Yamamoto Comments to MPEG 3DAV activities

10516 Thomas DeMartini Suggested Edits for Digital Item Adaptation Amendment 1 Working Draft 1.0

10517

Yi-Shin TungChung-Neng WangTihao ChiangJens-Rainer Ohm

MPEG-4 Visual: List of Problems Reported, v.11.1

10518 IDF via SC 29 Secretariat IDF's Response to Evaluation Criteria for Appointing JTC 1 RA of ISO/IEC 21000-6 [SC 29 N 5825]

10519 Helge Drumm CE Shadow Algorithm

10520 Ali Tabatabai Comments to MPEG on 3DAV activities

10521

Xin WangVenugopal VenkatramanFrederik De KeukelaereRik Van de Walle

Simple Integration Reference Software for MPEG-21 REL and DID

10522 Hideyuki Kanayama Comments to MPEG 3DAV activities

10523 Paul SchumacherRobert Turney HDL Virtual Socket Platform Rev 1.0 for MPEG-4 Part 9

10524 Doug Young SuhSeung Ho Park Inter-block shuffling FGS

10525 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 21000-5 [SC 29 N 5832]

10526 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-2:200X/FDAM 1 [SC 29 N 5833]

10527 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-4:200X/FDAM 3 [SC 29 N 5834]

10528 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-5/PDAM 2 [SC 29 N 5835]

10529 Niels Rump for the UKNB UKNB Position on Document Deadlines

10530 Jean Gelissen MPEG Multimedia Middleware: Context and Objective (Update)

10531 Hui Zhang MPEG-7 Visual part of eXperimentation Model Version 19.0

10532Hui ZhangDuck Hoon KimIn Kyu Park

Release of Perceptual 3D Shape (P3DS) XM software

10533 Ryoichi Kawada KDDI multiview video sequences for MPEG 3DAV use

10534

VieronFrancoisBottreauGuillemotBoissonMarquant

Discussion on some CFP requirements and proposal for core experiments

10535Demin WangLiang ZhangAndre Vincent

Curved Wavelet Coding for Scalable Video Coding

25

10536 Wo Chang Multimedia Application Format (MAF) Overview Document

10537 Béatrice Pesquet-PopescuGrégoire Pau

Response to the CfP on Scalable Video Coding : Motion-compensated scalable subband video codec with optimized temporal prediction and update operators

10538 Béatrice Pesquet-PopescuChristophe Tillier

Response to the CfP on Scalable Video Coding : Motion-compensated triadic temporal scalable codec

10539 3GPP via SC 29 Secretariat Liaison Statement from 3GPP [SC 29 N 5842]

10540 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3:2001/Amd.1:2003/DCOR 1 [SC 29 N 5843]

10541 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-7:2003/DCOR 1 [SC 29 N 5844]

10542 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3:2001/DCOR 2 [SC 29 N 5845]

10543 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 7

10544 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-1:2000/PDAM 5

10545 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/PDAM 8

10546 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/PDAM 3

10547 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-12/PDAM 1 & ISO/IEC 15444-12/PDAM 1

10548 SC 29 Secretariat Summary of Voting on ISO/IEC PDTR 21000-1 [2nd Edition]

10549 SC 29 Secretariat Summary of Voting on ISO/IEC PDTR 21000-11

10550 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/PDAM 2

10551 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-10/DCOR 1

10552 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 14496-15

10553 Morimura Comments to MPEG 3DAV activities

10554 David Singer Handling Audio Pre-roll in MPEG-4

10555 A. G. Tescher for USNB USNB Contribution: ISO/IEC 14496-12 modifications

10556

Filippo ChiariglionePanos KudumakisYona SadigurshiRobert NoahKevin MurrayMarkus Berg

Comments on MPEG-21 IPMP Requirements

10557 A. G. Tescher for USNB USNB Contribution: ISO/IEC 14496-11 issues

10558 A. G. Tescher for USNB USNB Contribution: “Audio Type” Issues

10559 A. G. Tescher for USNB USNB Contribution: MPEG-7 profiles

10560 A. G. Tescher for USNB USNB Contribution: Demographic Information

10561 A. G. Tescher for USNB USNB Contribution: MPEG-21 Media Locators

10562 A. G. Tescher for USNB USNB Contribution: 14-bit sample depth support

10563 Artur Lugmayr MPEG-21 in Broadcasting Use-Case: Metadata Filtering (refinement 1)

10564 Artur Lugmayr MPEG-21 for the exchange of personal profiles between

26

Xiao Duan embedded devices

10565 Okui Comments to MPEG on 3DAV activities

10566

IST-SCHEMAVasileios MezarisYiannis KompatsiarisStephan HerrmannJosep Casas

Experimental results for a Search & Retrieval System using MPEG-7 still image descriptors

10567 Singapore National Body SgNB Comment on the Collaborative Phase of the Audio Scalable Lossless(SLS) Coding Work Item.

10568 Jerome BarthelemyBenoit Meudic Proposed MPEG 7 audio tools

10569 Jens-Rainer Ohm Registered Responses to the CfP on Scalable Video Coding

10570 Shinjun LeeMahnjin Han

Improvement of PointTexture Compression in Depth Image-Based Representation (DIBR)

10571

Gyeong Ja JangShinjun LeeJames D. K. KimMahnjin Han

Proposal of XMT-A specifications for PointTexture Compression

10572Thomas DeMartiniVishy Swaminathan Anthony Vetro

Preliminary Comments on DIP CD

10573Eva RodriguezJaime DelgadoSilvia Llorente

DMAG REL Interpretation Conformance

10574 Eva RodriguezJaime Delgado

DMAG REL License Interpretation using RDD term genealogy – Implementation using Web Services

10575Victor TorresJaime DelgadoEva Rodriguez

Contribution to DID/REL/RDD reference software: DMAG REL License Interpretation within DID using RDD term genealogy

10576 Systems Group MPEG IPMP Introduction

10577

Jaime DelgadoEva RodriguezSilvia LlorenteRoberto GarciaVictor Torres

Status of DMAG Reference Software for MPEG-21 REL/RDD/DID

10578 Takehiro Moriya Proposed draft for WD 3 of ISO/IEC 14496-3:2001/AMD 4, Audio Lossless Coding (ALS)

10579

Stephan WuermlinMatthias ZwickerMichael WaschbueschMarkus GrossHanspeter Pfister

Results on Core Experiment on Point based Rendering for MPEG-4 AFX

10580Stephan WuermlinMichael WaschbueschMarkus Gross

ETH-REAL: A real-world test data set for 3DAV EE2

10581 Michael WaschbueschStephan WuermlinEdouard Lamboray

Average Coding of Free-viewpoint Video in MPEG-4

27

Markus GrossHanspeter Pfister

10582James D. K. KimJeong-Hwan AhnSang Oak Woo

Proposal for Real-Time Water Simulation

10583Jeong-Hwan AhnJames D. K. KimSang Oak Woo

Proposal for Cloth Animation

10584Michael RansburgChristian TimmererHermann Hellwagner

Status Report and Improvements of the MPEG-21 DIA Reference Software

10585 Christian TimmererHermann Hellwagner Comments on MPEG-21 DIP CD

10586Christian TimmererHermann Hellwagneron behalf of the ANB

Austrian NB comments on PDTR 21000-1 2nd Edition

10587 Gregoire PauClaude Seyrat MPEG-7 BiM Reference Software Status

10588Filippo ChiariglionePanos KudumakisPascal Nourry

Comments on MPEG-2/4 IPMP Extensions

10589

Yiannis AndreopoulosFabio VerdicchioJoeri BarbarienAdrian MunteanuMihaela van der SchaarPeter Schelkens

Response to Call for Proposals on Scalable Video Coding Technology (proposal 21 - tool)

10590 Vladimir Levantovsky Proposed modifications for implementation of MPEG-4 font compression and streaming

10591 Bruls Jan van der Meer Rational for heterogeneous layered video support in MPEG-2 Systems (as in M10359)

10592 van der Meer Fons Bruls Proposal for MPEG-2 System amendment to support heterogeneous layered video

10593 Gyeong Ja JangJames D. K. Kim

Implementation the Reference software of AFX Encoder and User Guide

10594

Sung Won ParkJong Woo WonSun young LeeYong Ho ChoEuee S.JangWook Joong Kim

Panoramic Video Coding Results

10595 Akio Yamada Sang-Kyun Kim MPEG-7 Visual XM Document version 19.1

10596 Akio Yamada Sang-Kyun Kim Second Editor's Study on ISO/IEC TR 15938-8/PDAM1

10597 Akio Yamada Report on progress of VCE-1

10598 Akio Yamada Comments on MPEG 3D-AV Standardization Activities

28

10599 Takeshi Nakamura Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition

10600Toshio MikiTsutomu HorikoshiC.S. Boon

In Response to ”Call for Comments on 3DAV”

10601 SC 29 Secretariat Late Vote on ISO/IEC 14496-3:2001/Amd.1:2003/DCOR 1 [SC 29 N 5849]

10602 SC 29 Secretariat Late Vote on ISO/IEC 13818-7:2003/DCOR 1 [SC 29 N 5851]

10603 SC 29 Secretariat Late Vote on ISO/IEC 14496-3:2001/DCOR 2 [SC 29 N 5852]

10604Tomokazu MurakamiMasahiro KageyamaYo-ichi Horii

Comments to MPEG on 3DAV activities

10605Myriam AmielhOn behalf of the AhG for MPEG-21 Medialocs

Suggested updates to the definitions of a DID fragment in DID v.2

10606 Tilman LiebchenPatrick Runge

Verification Report on MPEG-4 ALS Core Experiment 3 (Coding of Audio in Floating-Point Format)

10607 Tilman LiebchenTakehiro Moriya

Proposed Core Experiment for Improved Coding of Random Access Frames in MPEG-4 ALS

10608 Singapore National Body SgNB Comment on AVC Fidelity Range Extension

10609 Frederik De KeukelaereRik Van de Walle Contribution to DID 2nd Edition reference software

10610 Frederik De KeukelaereRik Van de Walle Contribution to DII reference software

10611Frederik De KeukelaereJeroen BekaertRik Van de Walle

Comments on ISO/IEC 21000-2 DID 2nd Edition WD v.2

10612 David Singer URL Forms for Container Files

10613 Chris Barlas RDD Registration Authority - Rightscom submission

10614 Holger Crysandt Cross check results of the Audio Pattern Description Schema

10615

Jérôme CaporossiMelanie Dulong de RosnayDaniela ParayrePierre Sarda

Proposed requirement for MPEG-21 IPMP

10616 Marc GauvinMelanie Dulong de Rosnay The Notion of Underlying Work within MPEG 21

10617

Bernhard GrillJohannes HilpertManfred LutzkyMartin Weishart Ernst F. Schroeder

MPEG-1/2 Audio Layer 3 For Low And High Sampling Rates

10618

Youngjoo SongKyunghee JiFX NuttallAndrew Tokmakoff

Proposed MPEG-21 Event Reporting Data Structure as Digital Item

10619 Kyunghee Ji Proposed Definition on Delivery Time and Recipient of

29

Nammee MoonYoungjoo SongJinwoo Hong

MPEG-21 Event Reporting

10620 Simon Watt CRF Liaison to MPEG

10621

Jeroen BekaertFrederik De KeukelaereRobbie De SutterRik Van de Walleon behalf of the Belgian NB

BNB Comments on ISO/IEC 21000-10 CD Part 10: Digital Item Processing

10622 Giorgio ZoiaJames Ingram A New Application Scenario for Music Notation in MPEG

10623Hanspeter Pfister Anthony Vetro Huifang Sun

Response to the Call for Comments on 3DAV

10624Hanspeter Pfister Anthony Vetro Huifang Sun

3D TV System

10625Xin WangThomas DeMartiniBrad Gandee

Comments on Requirements for MPEG-21 IPMP and Reference Model

10626

Lukasz BlaszakMarek DomanskiRafal LangeAdam Luczak

Scalable AVC Codec

10627 Jeongil SeoJerome Daniel

CE Report on AdvancedAcousticScene node for MPEG-4 Audio BIFS version 3

10628

Thomas DeMartiniVenugopal Venkatraman TJ Pannu Xin Wang

Contribution to MPEG-21 REL Interpretation Conformance Test Cases

10629 Kate Grant Requirements for conversion descriptions in a live radio broadcasting environment

10630

Munchurl Kim (ICU)Hendry (ICU)Keonsoo Park (KBS)Huang Zhongyang (PSL)

CE reports on DIBO explorations

10631Wook-Joong KimEuee. S. Janget al.

A response to the call for comments on 3DAV

10632Wook-Joong KimEuee. S. Janget al.

B-map method for the partial decoding and rendering of panoramic video

10633Merrill WeissOliver MorganPeter Symes

SMPTE Liaison to MPEG on V/ISAN and ISO 13818-1 DAM4

10634 Etsuko Sugimoto Proposed Corrigendum to ISO/IEC 14496-4:200X

10635 Senator JeongJi-Hyun Park

Response to the CfP on Event Reporting; Proposed Event Reporting Language

30

Yeon-Jeong JeongWeon-Guen OhChang-Yeol Lee

10636Gernot Ziegler Hendrik Lensch Marcus Magnor

Multi-Video Compression in Texture Space

10637 Yuriy Reznik Comments on MPEG-4 ALS CE3 reference software

10638 Yuriy Reznik Proposed CE on Coding of LPC Coefficients in MPEG-4 ALS

10639 Sang-Kyun Kim Introduction report: The emerge of MS Longhorn

10640Sang-Kyun KimSeungji YangYong Man Ro

Initial report on Visual tools and DS for images or photos libraries (VCE-1)

10641

Eunmi OhJung-Hoe KimMiao LeiSangWook Kim

Report on MPEG-4 SLS Core Experiment 3 (Context-dependent entropy coding)

10642Eunmi OhMiyoung KimSangWook Kim

MPEG-4 BSAC multi-channel support

10643 Ernest WanMyriam Amielh Two Proposed DIBOs for handeling a DID Anchor

10644 Stephen DavisIan Burnett Binarisation of MPEG-21 DIDs

10645

Yongju ChoYoungkwon LimHyung-Joong KimMoon-Sup SongJinwoo HongJinwoong Kim

Proposed Resource Reference Box for media resource referencing

10646Itaru Kaneko (Waseda) Mika Onishi Neergaard (MMG)

MMG-Waseda proposal onIssues in binary coding(binaization) of MPEG-21 DID

10647

Itaru Kaneko (Waseda)Osama K Alshaykh (Packet Video)Junya Tsutsumi (HI)Mark Callow (HI)Jiro Katto (Waseda)Daisuke Inoue (Waseda)<B

HI Corp., Waseda Univ. and Packet Video’s Response to Call for Proposal (SC29 WG11 N 6095)

10648 Wo Chang Preliminary FCD on MPEG-7 Profile

10649 Hideaki Kimata JNB comments on MPEG 3DAV

10650

Takuyo KogureCS Lim Toshiya Takahashi Taka Senoh

Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition

10651 Hideaki Kimata Comments to MPEG 3DAV activities

10652 Hideaki Kimata Preliminary results on inter-view coding for the dense Ray Space representation (3DAV EE2.2.1)

31

10653Mayumi Koike Takuyo KogureTerumasa Aoki

Profiling Consideration for MPEG-4 IPMP

10654

Paolo NesiPierfrancesco BelliniGiorgio ZoiaJerome Barthelemy

Music Notation Technical Requirements and Integration in MPEG-4

10655Marius PredaFrancoise PreteuxFrederic Vexo

MorphShape Node Implementation in Reference Software

10656Marius PredaFrancoise Preteux Frederic Vexo

BBA stream update for morphing-based virtual character animation

10657 Titus ZahariaFrancoise Preteux Comparative study for 3D and 2D/3D Shape Descriptors

10658 Akira MorishitaYuzo Hirayama Response to the Call for Comments on 3DAV

10659 IEC TC 100 via SC 29 Secretariat

IEC CDV 62297-1: Triggering messages for broadcast applications -- Part 1: Format [SC 29 N 5856]

10660 IEC TC 100 via SC 29 Secretariat

IEC CDV 62297-2: Triggering messages for broadcast applications -- Part 2: Transport [SC 29 N 5857]

10661

Paolo NesiPierfrancesco BelliniGiorgio ZoiaJerome Barthelemy

Proceedings of AHG on Music Notation Requirements

10662 Shlomo BirmanYorame Elichai SynthesizedTexture Implementation in IM1

10663 Oliver BaumJürgen Schmidt Comments on 3DAV Report regarding 3D Audio

10664 chenchiu bit reordering in SLS enhancement layer

10665 Steliaros K Grant UKNB comment on Graphics API

10666 Marco Rittermann Response to the Call for Comments on 3DAV

10667 Kazumasa Yamazawa Proposal of Application Format for Omni-directional Video

10668 Masayuki TanimotoToshiaki Fujii

Comparison of Temporal and Spatial Predictions for Dynamic Ray-Space Coding

10669Andreas DanteleMarco RittermannChristian Weigel

Response to the Call for Comments on 3DAV

10670 Masayuki TanimotoToshiaki Fujii Data Compression and Interpolation of Spherical Ray-Space

10671 JNB JNB Comment on MPEG-4 AVC Fidelity Range Extension

10672 Murray K Grant UKNB Position paper on CVS Server

10673 Aljoscha Smolic Response on Call for Comments on 3DAV

10674 Aljoscha SmolicSebastian Heymann

Demonstration of a MPEG-4 Complient System for Omni-directional Video

32

Karsten MuellerYong Guo

10675 Rump Overview of responses to N6278 : MPEG-21 Event Reporting Call for Proposals

10676

Aljoscha SmolicKarsten MuellerPhilipp MerkleTobias ReinPeter EisertThomas Wiegand

Results for EE2 on Model Reconstruction Free Viewpoint Video

10677 Kohtaro Asai Response to the Call for Comments on 3DAV

10678 Kristofer KjörlingProposed additions to the ISO/IEC 13818-4:200X/PDAM2 (Audio Conformance) document in order to specify SBR conformance for MPEG-2.

10679 Kristofer KjörlingAndreas Schneider

Additions to, and clarifications of MPEG-4 SBR conformance.

10680 Kristofer Kjörling Proposed corrections and additions to the present ISO/IEC 14496-4:2001/AMD1:2003/Dcor1.

10681 Rongshan Yu Crosscheck for Samsung’s Proposal on Context-Dependent Entropy Coding for MPEG Audio SLS

10682

Rongshan Yu Xiao Lin Susanto Rahardja Haibin Huang

Proposed WD2 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS)

10683

Rongshan Yu Xiao Lin Susanto Rahardja Haibin Huang

Proposed Core Experiment for Improving Coding Efficiency of MPEG-4 Audio Scalable Coding (SLS)

10684Jean-Claude DufourdOlivier AvaroCyril Concolato

Support of SVG1.2 in LASER

10685 Jean-Claude DufourdOlivier Avaro Test Data set Description for LASER Evaluation

10686 Jean-Claude DufourdOlivier Avaro Additional Requirements for LASER

10687 Olivier AvaroJean-Claude Dufourd Statement of Support for LASER

10688 Olivier AvaroJean-Claude Dufourd Proposed coordination between MPEG and W3C on LASER

10689 Olivier AvaroJean-Claude Dufourd Evaluation Software Requirements for LASER

10690

Karsten MüllerAljoscha SmolicHanspeter PfisterStephan WürmlinMatthias Zwicker

Proposal of 3D Camera Calibration Parameters for MPEG-4 AFX

10691 Karsten MüllerAljoscha Smolic

View-Dependent Multi-Texturing for MPEG-4 AFX, Syntax and Semantics Specification

33

Thobias Rein

10692 Heiko PurnhagenKristofer Kjörling Information on HE-AAC decoder delay and timestamps

10693 Heiko PurnhagenKristofer Kjörling

Comments on Draft Call for Proposals on Spatial Audio Coding

10694 Heiko PurnhagenMartin Wolters Proposed clarifications of AAC conformance testing

10695Andreas HutterDaniel PeintnerJoerg Heuer

Algorithms in BiM Version 2 Reference Software

10696Jérôme RoyanChristian BouvillePatrick Gioia

Proposal of new requirements for streaming geo-visual contents

10697 Mariam Kimiaei-AsadiJean-Claude Dufourd

Proposal to Digital Item Adaptation Amendment 1 on Conversion Descriptors and Transmoding

10698 Mariam Kimiaei-AsadiJean-Claude Dufourd

Contribution to Digital Item Adaptation Amendment 1 on Transcoding and Transforming Conversion Descriptors

10699 Melanie Dulong de Rosnay FNB comments on Text of ISO/IEC 21000-1 2nd ed. PDTR

10700 Ralph Sperschneider Status on MPEG-4 Audio Conformance

10701 Ralph Sperschneider Proposed addition to ISO/IEC 14496-3:2001/Cor.2

10702

Roberto GarciaJaime DelgadoEva RodriguezIsabel Gallego

MPEG REL and RDD Ontologies API

10703Roberto GarciaJaime DelgadoIsabel Gallego

RELOntos (REL Ontologies)

10704 Patrick Gioia Proposal for Compressed 3D Profile

10705 Abdellatif Benjelloun Touimi Usage Scenarios Analysis for MPEG-21 in Broadcasting

10706 Hanke Spatial Highpass Transition Filtering for Interframe Wavelet Video Coding

10707Raphaèle BalterPatrick GioiaLuce Morin

Preliminary tests and evidences for EE on 3D model-based movie streaming

10708 Bober Suggestions on experimental methodology in CE on Visual tools and DS for images or photos libraries (VCE-1).

10709 Bober Report on progress of VCE-1

10710 Ralf Geiger Markus Schmidt

Cross-Check Report for MPEG-4 SLS Core Experiment 2 (Improved Coding Efficiency)

10711Ralf Geiger Markus Schmidt Jürgen Herre

Proposed Core Experiment on MPEG-4 SLS

10712 Thomas Rusert Layered Motion Vector Coding for Improved Spatial Scalability in Interframe Wavelet Video Coding

10713 Juergen Herre Evaluation of Spatial Audio Coding Schemes: Performance

34

Criteria and Test Methods

10714 Holger Crysandt (Lossy) DescriptorModel compression

10715 S. R. Quackenbush Audio Subgroup Report for the 67th MPEG Meeting

10716

Charith Abhayaratne Nikola Sprljan Marta MrakEbroul Izquierdo

Response to the SVC CfP: A spatial decomposition tool for improved spatial resolution scalability in video coding

10717

Andrea Kofler-Vogt;Joerg Heuer;Andreas Hutter;Harald Kosch;

Report on CE (Indexing)

10718

Christian TimmererHermann HellwagnerJörg HeuerClaude SeyratAndreas Hutter

BinaryXML – A Comparison of Existing XML Compression Techniques

10719Thomas Di Giacomo Chris Joslin Marius Preda

Proposal for MassSpring Node for Animation

10720 S. R. Quackenbush Cross-check on I2R’s Proposed Core Experiment

10721 Takhiro Moriya Comments on Lossless Coding of Audio in Floating-Point Format

10722 Debargha MukherjeeSam Liu

Proposal to support AdaptationQoS adaptation in DIA for multi-step adaptation

10723Chung-Neng WangTihao ChiangHuifang Sun

Text of DTR 14496-7 Fifth Edition

10724

Hsiang-Chun HuangWen-Hsiao PengYao-Chung LinChung-Neng WangTihao ChiangHsueh-Ming Hang

Update of the Response to Cfp on Scalable Video Coding Technology: Proposal S07 -- A Robust Scalable Video Coding Technique

10725 3D Consortium via SC 29 Secretariat Liaison Statement from 3D Consortium [SC 29 N 5858]

10726 Ji Ming Study Text of ISO/IEC 14496-4:2002/FPDAM4 (MPEG-4 IPMPX Conformance)

10727 Korea National Body (KNB) KNB comment on 15938-5 PDAM2 : ContentCS extension

10728 Claude Seyrat Editors study of the ISO/IEC 15938-1/FPDAM

10729 Claude SeyratCédric Thiénot MPEG-7 Systems extensions: Results of Mini-Experiment #2

10730 Marius PREDAFrancoise Preteux

Extensibility feature of the BBA stream. Corrigendum Proposal

10731 Chris Barlas ISO/IEC 21000-6 : Proposal for Corrigendum

10732 Yiliang Bao none Marta Karczewicz Scalable video coder with AVC-like properties

35

10733 Mikael Bourges-SevenierAaron E. Walsh X3D Interactive profile, bitstream exchange update

36

Annex 4Output document list

Number Source Title

6298 Convener List of Documents from the Munich, DE Meeting

6299 Convener Resolutions of the Munich, DE Meeting

6300 Convener List of AHGs Established at the 68th Meeting in Munich, DE

6301 Convener Report of the 68th Meeting in Munich, DE

6302 Convener Guidelines for Electronic Distribution of MPEG and WG 11 Documents

6303 Convener Press Release of the 68th Meeting in Munich, DE

6304 HoD Meeting Notice of the 69th Meeting in Redmond, WA (US)

6305 HoD Guide for WG 11 Meeting Hosts

6306 HoD MPEG 101

6307 ISG ISO/IEC 14496-9/PDAM of AM 1: Information Technology – Coding of Audio Visual Objects - Part 9: Reference Hardware Description.

6308 ISG Request for Reference Hardware Description Extensions

6309 Convener AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.

6310 SNHC AFX CE description

6311 SNHC ISO/IEC 14496-16/AMD1 WD 4.0

6312 SNHC AFX VM 14.0

6313 SNHC AFX 14496-16/DCOR1

6314 Systems DoC on ISO/IEC 13818-1:2000/PDAM4

6315 Systems Text of ISO/IEC 13818-1:2000/FPDAM4

6316 Systems DoC on ISO/IEC 13818-1:2000/PDAM5

6317 Systems Text of ISO/IEC 13818-1:2000/FPDAM5

6318 Systems Text of ISO/IEC 14496-1/DCOR3

6319 Systems DoC on ISO/IEC 14496-11/PDAM3

6320 Systems Text of ISO/IEC 14496-11/FPDAM3

6321 Systems Text of ISO/IEC 14496-11/COR2

6322 Systems DoC on ISO/IEC 14496-12/PDAM1

6323 Systems Text of ISO/IEC 14496-12/FPDAM1

6324 Systems Study Text of ISO/IEC 14496-17/FCD

6325 Systems DoC on ISO/IEC 15938-1/FPDAM1

37

6326 Systems Text of ISO/IEC 15938-1/FDAM1

6327 Systems DoC on ISO/IEC 15938-1/DCOR1

6328 Systems Text of ISO/IEC 15938-1/COR1

6329 Systems Core Experiments for Systems Extensions

6330 Systems MPEG-7 Systems reference software work plan

6331 Systems Text of ISO/IEC 21000-9 CD

6332 Systems Technology under consideration for 21000-9

6333 Systems WD1.0 of Text of ISO/IEC 21000-16

6334 Systems Core Experiment on MPEG-21 Binarization

6335 Systems MPEG Multimedia Middleware Context and Objectives

6336 Systems Requirements on the MPEG Multimedia Middleware

6337 Systems CfP on Lightweight Application Scene Representation

6338 Systems MPEG IPMP Extensions Overview

6339 Systems Call for Registration Authority for IPMP_Tool_Id

6340 Liaison Liaison Statement to the TV-Anytime Forum

6341 Liaison Liaison Statement to SMPTE on V/ISAN and ISO 13818-1 DAM4

6342 Liaison Liaison Statement to AVS China

6343 Liaison Liaison Statement to ISO TC 46/SC 9

6344 Liaison Liaison Statement to IEEE-LTSC

6345 Liaison Liaison Statement to W3C

6346 Liaison Liaison Statement to JPEG

6347 Liaison Statement of benefits from establishing a Class C liaison with AVS China

6348 Liaison Responses to NB Comments

6349 Liaison List of WG11 Liaisons

6350 Convener AHG on AFX documents, CEs, and software

6351 Convener AHG on MPEG-J extensions for rendering

6352 JVT Request for Amendment 9 for ISO/IEC 14496-4: AVC Fidelity Range Extensions Conformance

6353 JVT Working Draft 1 of Amendment 9 for ISO/IEC 14496-4: AVC Fidelity Range Extensions Conformance

6354 JVT Study of FPDAM Text for AVC Conformance Amendment

6355 JVT Request for Amendment 8 for ISO/IEC 14496-5: AVC Fidelity Range Extensions Reference Software

6356 JVT Working Draft 1 of Amendment 8 for ISO/IEC 14496-5: AVC Fidelity Range Extensions Reference Software

38

6357 JVT Disposition of Comments on ISO/IEC 14496-10:2003/DCOR 1

6358 JVT Text of ISO/IEC 14496-10:2003/COR 1

6359 JVT Text of ISO/IEC 14496-10:2004 (second edition)

6360 JVT Study of FPDAM Text for AVC Professional Extensions Amendment

6361 Video Disposition of Comments on ISO/IEC 14496-2:2004 DCOR 1

6362 Video Text of ISO/IEC 14496-2:2004 COR 1

6363 Video MPEG-4 Visual: List of Problems Reported version 12.0

6364 Video WD 1.0 of 14496-4 Visual Bitstreams Conformance Corrigendum

6365 Video Text of 14496-7:200X (second edition)

6366 Video Request for 15938-3 Amd.2 (New Visual Extensions)

6367 Video WD 1.0 of MPEG-7 New Visual Extensions

6368 Video MPEG-7 Visual XM Document version 20.0

6369 Video Description of Core Experiments for MPEG-7 Visual Extensions

6370 Video Disposition of Comments on ISO/IEC TR 15938-8/PDAM1

6371 Video Text of ISO/IEC TR 15938-8/DAM1

6372 Video Scalable Video Model Version 1.0

6373 Video Description of Core Experiments in MPEG-21 Scalable Video Coding

6374 Video Draft Call for Evidence on Multiple View Video Coding

6375 Video Study of Video Coding Tools Repository

6376 Convener AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

6377 Convener AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software

6378 Convener AHG on Description Tools for New Visual Extensions

6379 Convener AHG on Core Experiments in Scalable Video Coding

6380 Convener AHG on 3DAV Coding

6381 Convener AHG on Video Coding Tools Repository

6382 Test Results of the MPEG-4 Error Resilient Simple Scalable Profile Verification Test

6383 Test Subjective test results for the CfP on Scalable Video Coding Technology

6384 Requirements MPEG-2/4 Profiles under Consideration

6385 Requirements DoC for ISO/IEC 15938-9 CD

6386 Requirements Text of ISO/IEC 15938-9 FCD

39

6387 Requirements DoC on PDTR of ISO/IEC 21000-1 Second Edition

6388 Requirements Text of DTR of ISO/IEC 21000-1 Second Edition

6389 Requirements Requirements for MPEG-21 IPMP

6390 Requirements Updated Call for Proposals for MPEG-21 Intellectual Property Management and Protection

6391 Requirements DoC on PDTR of ISO/IEC 21000-11

6392 Requirements Text of DTR of ISO/IEC 21000-11

6393 Requirements Requirements for Omni-directional AV 0.1

6394 Convener AHG to evaluate responses to the MPEG-21 IPMP CfP

6395 Convener AHG on Multimedia Application Format (MAF)

6396 Convener AHG on MPEG-7 Profiles

6397 MDS DoC on ISO/IEC 15938-5 PDAM/2

6398 MDS ISO/IEC 15938-5 FPDAM/2 “MDS User Preference Extensions”

6399 MDS MPEG-7 MDS XM v.19

6400 Convener Terms of Reference

6401 Convener MPEG Standards

6402 Convener Table of unpublished standards at FDIS level

6403 Convener Work plan and time line

6404 Convener Work item assignment

6405 Convener List of patent statements received

6406 MDS ISO/IEC 15938-5 DCOR/1

6407 MDS DoC on ISO/IEC 15938-10 CD

6408 MDS ISO/IEC 15938-10 FCD “Schema Definition“

6409 MDS ISO/IEC 21000-2 DID 2nd Edition CD

6410 MDS Work plan for Core Experiment on Media Locators

6411 MDS MPEG-21 REL/RDD Software Implementation Plan v.6

6412 MDS ISO/IEC 21000-6 COR/1 WD v.1

6413 MDS MPEG-21 DIA AMD/1 WD v.2 “Conversions and Permissions”

6414 MDS MPEG-21 DIA Software Implementation Plan v.7

6415 MDS ISO/IEC 21000-10 Study of CD “Digital Item Processing”

6416 MDS Study of Draft Comments on Digital Item Processing CD

6417 MDS MPEG-21 DIP Software Implementation Plan v.2

6418 MDS Work plan for Core Experiment on DIBOs for REL

6419 MDS ISO/IEC 21000-15 WD v.1 “Event Reporting”

6420 MDS Request for Subdivision to ISO/IEC 21000 for “Event Reporting”

40

6421 MDS Work plan for Core Experiment on Event Reporting

6422 Convener AHG on Core Experiments for MPEG-21 DID 2nd Edition

6423 Convener AHG on Core Experiments for MPEG-21 DIP

6424 Convener AHG on Core Experiments for MPEG-21 Event Reporting

6425 Liaison Information on MPEG-21 IPMP Call for Proposals

6426 Audio DoC on ISO/IEC 13818-7:2003/DCOR 1:2004, AAC

6427 Audio Text of ISO/IEC 13818-7:2003/COR 1:2004, AAC

6428 Audio Text of ISO/IEC 13818-7:2004, AAC Third Edition

6429 Audio DoC on ISO/IEC 14496-3:2001/DCOR 2

6430 Audio Text of ISO/IEC 14496-3:2001/COR 2, Misc. Corrections

6431 Audio DoC on ISO/IEC 14496-3:2001/AMD 1:2003/DCOR 1:2004

6432 Audio Text of ISO/IEC 14496-3:2001/AMD 1:2003/COR 1:2004, Bandwidth Extension

6433 Audio Study on ISO/IEC 14496-3:2001/FPDAM 3, MP3 on MP4

6434 Audio Request for Amendment: ISO/IEC 14496-3:2001/AMD 4, Audio Lossless Coding

6435 Audio WD3 of Audio Lossless Coding

6436 Audio Request for Amendment: ISO/IEC 14496-3:2001/AMD 5, Scalable Lossless Coding

6437 Audio WD2 of Scalable Lossless Coding

6438 Audio Request for Amendment: ISO/IEC 14496-3:2001/AMD 6, Lossless Coding of Oversampled Audio

6439 Audio ISO/IEC 14496-3:2001/PDAM 6, Lossless Coding of Oversampled Audio

6440 Audio Request for Amendment: ISO/IEC 15938-4:2002/AMD 2, High-level Descriptors

6441 Audio WD1 of MPEG-7, High-level Descriptors

6442 Audio Request for New Work Item on MPEG-A

6443 Audio Text of MPEG-A Part 1, Music Player Application Format

6444 Audio Proposed High-Sampling Rate for MPEG-2 Layer III

6445 Audio Proposed Enhancements to MPEG-4 BSAC multi-channel

6446 Audio Work plan for Verification Test of MPEG-4 Parametric Audio Coding

6447 Audio Work plan for Audio Lossless Coding (ALS)

6448 Audio Work plan for Scalable Lossless Coding (SLS)

6449 Audio Study on Timestamps and Audio Codec Behavior

6450 Audio Work plan for Audio Contribution to MPEG-4 Conf. Bandwidth

41

Extension

6451 Audio Status of MPEG-4 Audio Conformance

6452 Audio Status of MPEG-7 Audio Contribution to XM and Conformance

6453 Audio Work plan for Audio Rhythmic Pattern CE

6454 Audio Work plan for Instrumentation and Weighted Scale Type CE

6455 Audio Call for Proposals on Spatial Audio Coding

6456 Audio Draft Evaluation Procedures for Spatial Audio Coding

6457 Audio Draft Call for Proposals for Symbolic Music Representation

6458 Convener AHG on Spatial Audio Coding

6459 Convener AHG on MPEG-4 Lossless Audio Coding

6460 Convener AHG on Symbolic Music Representation

6461 Integration DoC on ISO/IEC 13818-4:200X/PDAM2 Audio Conformance Ext.

6462 Integration Text of ISO/IEC 13818-4:200X/FPDAM2 Audio Conformance Ext.

6463 Integration DoC on ISO/IEC 14496-4:2003/FPDAM4 IPMP Conformance Ext.

6464 Integration Text of ISO/IEC 14496-4:2003/FDAM4 IPMP Conformance Ext.

6465 Integration DoC on ISO/IEC 14496-4:2003/FPDAM7 AFX Conformance Ext.

6466 Integration Text of ISO/IEC 14496-4:2003/FDAM7 AFX Conformance Ext.

6467 Integration Doc on ISO/IEC 14496-4:2003/PDAM8 HE-AAC, ABIFS & SA Conf.

6468 Integration Text of ISO/IEC 14496-4:2003/PDAM8 HE-AAC, ABIFS & SA Conf.

6469 Integration WD of ISO/IEC 14496-4:2003/AMD9 AVC PE Conformance

6470 Integration Text of ISO/IEC 21000-8 CD MPEG-21 Reference Software

6471 Integration Study of ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource Delivery

6472 Integration WD3.0 of ISO/IEC 21000-14 MPEG-21 Conformance

6473 Convener AHG on MPEG Reference Software

6474 Convener AHG Group on XML Structure Binarization and Streaming

6475 Convener AHG Group on Scene Representation

6476 Convener AHG on MPEG Multimedia Middleware

6477 Requirements Multimedia Applications Overview

6478 Convener AHG on the Communicating MPEG to the business Community

6479 Systems Request for subdivision 21000-16 of MPEG-21 Binary Format

42

6480 SNHC Request for subdivision 14496-21 of MPEG-4, MPEG-J extensions for rendering

43

Annex 5Report of Requirements meeting

Source: Rob Koenen, InterTrust Technologies

NB: this report does not duplicate the resolutions, but rather complement them. This implies that not all output documents and not all Ad Hoc Groups are explicitly listed in the report below.

Agenda

Monday  9:00-13:00 opening plenary meeting Plen13:00-14:00 Lunch (ends one hour after plenary ends)  

14:00-15:30

MPEG-21 Requirements Plenary; tasks for the week (we will not go over all contributions on detail)MPEG-21 Part 11 DTR10549 Summary of Voting on ISO/IEC PDTR 21000-11 - SC 29 SecretariatMPEG-21 IPMP Requirements10495 Discussion on MPEG-21 IPMP Requirements - Craig Schultz10556 Comments on MPEG-21 IPMP Requirements – F. Chiariglione, et.al. 10615 Proposed requirement for MPEG-21 IPMP - Caporossi, et.al.10625 Comments on Reqs for MPEG-21 IPMP and Reference Model - Xin Wang,

et.al.10489 AHG to complete requirements for MPEG-21 IPMP - Watt, Van den Heuvel,

Schultz

N1070

16:00-17:00

MPEG-21 Event Reporting – Joint with MDS10618 Proposed MPEG-21 ER Data Structure as Digital Item - Youngjoo Song, et.al. 10619 Proposed Definition on Delivery Time,Recipient of MPEG-21 ER - Kyunghee Ji,

et.al. 10635 Response to the CfP on ER ; Proposed E Language - Senator Jeong, et.al.10675 Overview of responses to N6278: MPEG-21 Event Reporting Call for Proposals

- Rump10494 AHG on MPEG-21 Event Reporting - FX Nuttall, Andrew Tokmakoff

MDSZ995

17:00-17:30 M3W – Joint with Systems10530 MPEG Multimedia Middleware: Context and Objective (Update) - Jean Gelissen

Sys

17:30-18:00 MPEG-21 IPMPStatus update N1070

Tuesday

09:00-09:30 Intra-only coding in MPEG10488 AHG on Intra-only Coding in MPEG - Kohtaro Asai N0115

09:30-10:30

Broadcasting in MPEG-21 10629 Reqs for conversion descriptions in a live radio broadcasting environment -

Grant10563 MPEG-21 in Broadcasting Use-Case: Metadata Filtering (refinement 1) - Artur

Lugmayr10564 MPEG-21 for exchange of personal profiles between embedded devices-

Lugmayr, Duan10705 Usage Scenarios Analysis for MPEG-21 in Broadcasting - Abdellatif Benjelloun

Touimi

N0115

11:00-12:00

MPEG-21 Requirements – GeneralMPEG-21 Profiles10491 AHG on Profiles and Extensions for the MPEG-21 REL - Gandee, Chris BarlasGeneral10616 The Notion of Underlying Work within MPEG 21 - Gauvin, Dulong de RosnayIssues referred to Requirements Group by MPEG-21 IPMP AHG

N1070

12:00-13:00MAF – joint with Systems, Audio and Video

10493 AHG on Multimedia Application Format (MAF) - Wo Chang, Olivier Avaro10536 Multimedia Application Format (MAF) Overview Document - Wo Chang

Sys

13:00-14:00 Lunch

44

14:00-14:30 M3W – Joint with Systems, ISG10530 MPEG Multimedia Middleware: Context and Objective (Update) - Jean Gelissen Sys

14:30-15:30

LASER – Joint with Systems10686 Additional Requirements for LASER - Jean-Claude Dufourd, Olivier Avaro10687 Statement of Support for LASER - Olivier Avaro, Jean-Claude Dufourd10688 Proposed coordination between MPEG and W3C on LASER - Avaro, Dufourd10689 Evaluation Software Requirements for LASER - Olivier Avaro, Jean-Claude

Dufourd

Sys

15:30-16:30

MPEG-4 Profiles – Joint with SNHC, Systems10647 HI Corp., Waseda Univ. and Packet Video’s Response to CfP (N 6095) –

Kaneko et.al.10696 Proposal of new requirements for streaming geo-visual contents - Jérôme

Royan, et.al.10733 X3D Interactive profile, bitstream exchange update - Bourges-Sevenier, Walsh

Sys

17:00-17:30

MPEG-21 PDTR10548 Summary of Voting on ISO/IEC PDTR 21000-1 [2nd Edition] - SC 29

Secretariat (including JNB, USNB and UKNB comments)10586 Austrian NB comments on PDTR 21000-1 2nd Edition - Timmerer, Hellwagner,

for ANB10699 FNB comments on Text of ISO/IEC 21000-1 2nd ed.– M. Dulong de Rosnay,

on beh…

N1070

17:30-18:00 MPEG-21 IPMP Requirements Document Status update N1070

Wednesday  09:00-11:00

Plenary meeting Plen

11:30-12:30

MPEG-7 Profiling and MAF (Joint with MDS, Systems, Video, Audio)10559 USNB Contribution: MPEG-7 profiles - A. G. Tescher for USNB10492 AHG on MPEG-7 Interoperability and Profiling - Wo Chang, Masanori Sano10648 Preliminary FCD on MPEG-7 Profile - Wo Chang10502 Terms and Definitions for MPEG-7 Profiles – Bhavan Gandhi, e.al. Withdrawn

Plen

12:30-13:00Several – joint with MDS

10560 USNB Contribution: Demographic Information - A. G. Tescher for USNB10561 USNB Contribution: MPEG-21 Media Locators - A. G. Tescher for USNB

Plen

13:00-14:00 Lunch14:00-14:30 Joint with Audio Aud

14:30-15:00 Intra-only coding in MPEG10488 AHG on Intra-only Coding in MPEG - Kohtaro Asai N0115

15:00-16:00Joint with Systems on MPEG-4 IPMP

10653 Profiling Consideration for MPEG-4 IPMP - Mayumi Koike et.al.10734 Profiling Consideration for MPEG-2/4 IPMP - Ji Ming

N0115

16:00-16:30 Joint with SNHC10704 Proposal for Compressed 3D Profile - Patrick Gioia N0115

16:30-17:00 MPEG-21 Persistent Association PDTRApproving the DTR N1070

17:00-18:00 MPEG-21 IPMPStatus update N1070

Thursday11:00-12:00 MPEG-21 part 1 PDTR N011512:00-12:30 Joint with Systems on Laser N109012:30-13:00 Joint with JVT 399913:00-14:00 Lunch 14:00-15:00 Joint with Video on 3DAV and SVC N108015:00-15:30 MPEG-21 and Broadcast N0115

16:00-18:00

Requirements PlenaryMPEG-21 IPMP Requirements and parts 1 PDTR Final Approvalparts 11 PDTR Final Approval

N1070

Friday

08:30-08:45Concluding Several Audio Calls

Symbolic Music Representation Draft CfP and Requirements - Spatial Audio Coding

N1070

08:45-09:00 Concluding MPEG-4 N1070

45

MPEG-4 Profiles under Consideration document SNHC AMD with X3D Profile LASER Requirements/CfP

09:00-9:45Concluding MPEG-7

Profiles DoC Profiles FCD

N1070

9:45-10:00

Concluding Explorations M3W MAF Requirements 3DAV

N1070

10:00-12:00

Concluding MPEG-21 MPEG-21 IPMP Requirements document MPEG-21 part 1 v.2 PDTR DoC for 210001-1 PDTR MPEG-21 part 11 DoC MPEG-21 part 11 DTR

N1070

12:30-14:00 Lunch  14:00-22:10 Plenary meeting Plen

 

Explorations, General

Multimedia Application Formats10493 AHG on Multimedia Application Format (MAF) - Wo Chang, Olivier Avaro10536 Multimedia Application Format (MAF) Overview Document - Wo Chang

The Overview of the Multimedia Application Formats was updated; it now contains a set of requirements for these Formats and no longer highly detailed technical descriptions. A request for a new Project was issued. MAF’s will form a new set of MPEG Standards.

3DAVRequirements met jointly with the Video Group to discuss 3DAV. The response to the Call for Comments resulted in two activities. On Multiview Coding, a Call for Evidence is being readied. It was issued in draft form at this meeting. On Omni-directional AV, a Draft Requirements Document was produced that summarizes the requirements for the work on a Multimedia Application Format for this application. Requirements for Audio still need to be added.

M3W10530 MPEG Multimedia Middleware: Context and Objective (Update) - Jean Gelissen.M3W was discussed in joint meetings with Systems. A new Context and Objectives Document was released, and a start of a Requirements Document for M3W was published as well.

Intra-only in MPEG10488 AHG on Intra-only Coding in MPEG - Kohtaro AsaiThe intra-only work, while progress is being made, has not yet been able to expand its support basis. In joint meeting with Video, it was agreed to continue the effort in the context of the video tool repository, which would start with collecting all intra coding tools from across the MPEG standards. The option of an intra-only Profile across all MPEG standards was discussed, and considered of interest. The continued need for getting more active participants in this activity was also noted.

46

Spatial Audio CodingA Call for Proposals for spatial audio coding was discussed in joint meetings with the Audio Group. The Requirements Group approved the requirements in the call and the call was subsequently published.

Music NotationAlso in a joint meeting with the Audio Group, the Draft Call for Proposals for Symbolic Music Notation was discussed and refined. The plan is to issue this call at the next meeting.

MPEG-4 (and a bit of MPEG-2)

Systems (Part 1)10653 Profiling Consideration for MPEG-4 IPMP - Mayumi Koike et.al.10734 Profiling Consideration for MPEG-2/4 IPMP - Ji MingIn a joint meeting with the Systems Group, the request to add Profiles to IPMP-X was discussed. The proposal is for both the MPEG-2 and MPEG-4 standards, and the Profile would be identical for both. A Simple (or “lightweight”) Profile would be useful for mobile devices and a Core Profile would be suited for Set Top Box-like devices. The proposals were added to the Profiles under Consideration Document, with the aim to expose them to other potentially interested parties and to allow these parties to express their interest at the next meeting. The meaning of ‘support’ was clarified in the opening sections of the Profiles under Consideration document. The meeting discussed how to move this forward rapidly. If enough support is expressed at the next meeting, the required Amendments could go straight to CD. It is now up to the proponents to gather such support.

AVC (part 10)In a joint meeting with the Joint Video, Profiles for the AVC Fidelity Extensions were discussed. In the Study of the Amendment, the following profiles are mentioned: 4:2:2/8-bit 4:2:0/10-bit 4:2:2/10-bit 4:4:4/12-bitThe Requirements Group expressed some concern that this may be a bit much for the extension, but agreed to adding this proposal to the Study at this point. The possibility of a 14 bit Profile is submitted to NB’s for their consideration.

Systems- and SNHC-related Profiles (Notably part 11)10696 Proposal of new requirements for streaming geo-visual contents - Jérôme Royan, et.al.In a joint meeting with SNHC and Systems, the requirements for MPEG standardization stemming from the streaming of geo-visual contents were discussed. It was concluded that MPEG is not the right place to standardize geo-spatial coordinate systems, but that application developers can combine existing standards for geo-spatial coordinate systems with MPEG tools. The standardization of a 3D representation suitable for representing buildings in this application can be considered in MPEG. SNHC will, for the moment, further discuss the issue.

47

10733 X3D Interactive profile, bitstream exchange update - Bourges-Sevenier, WalshThe Requirements Group was happy to learn that the bitstream requirements for this profile have been met, and recommended its adoption in AMD1 to part 16 of MPEG-4 (AFX Extensions), at the next meeting and depending on NB requests for doing so.

Scene Representation API10647 HI Corp., Waseda Univ. and Packet Video’s Response to CfP (N 6095) –Kaneko et.al.The response of the response to the Call for Proposals was discussed in a joint meeting with SNHC and Systems. The conclusion was that existing standards (JSR184), to a large extent, may pose a solution, and that MPEG work should build on them. The SNHC group further discussed the matter.

10225 AHG on MPEG-4 Scene Representation - Jean-Claude Dufourd, Yuval Fisher, Juergen Schmidt10686 Additional Requirements for LASER - Jean-Claude Dufourd, Olivier Avaro10687 Statement of Support for LASER - Olivier Avaro, Jean-Claude Dufourd10688 Proposed coordination between MPEG and W3C on LASER - Avaro, Dufourd10689 Evaluation Software Requirements for LASER - Olivier Avaro, Jean-Claude Dufourd

In a joint meeting with the Systems Group, the LASeR Requirements and CfP were edited and approved. Please see the Systems report for further details.

Scene Description (part 11)10704 Proposal for Compressed 3D Profile - Patrick Gioia Small updates to the Compressed 3D Profile were proposed and accepted into the Profiles under Consideration Document.

MPEG-7

Profiles and Levels (part 9)10559 USNB Contribution: MPEG-7 profiles - A. G. Tescher for USNB10492 AHG on MPEG-7 Interoperability and Profiling - Wo Chang, Masanori Sano10648 Preliminary FCD on MPEG-7 Profile - Wo Chang

All of the suggestions on MPEG-7 Profiles by National Bodies were reviewed and accepted. Due to partial availability of the editor during the meeting, editing could not be finalized and a one-month editing period was agreed.

In the discussion, the following conclusions were reached: The USNB suggested that use of BiM and size of access units would be Level issues,

but the meeting concluded that they might well be better placed in a Systems Profile dimension. This dimension would be orthogonal to the Description Profiles dimension.

WG11 should keep the notion of Description Profile because it is likely there will also be (a) Systems Profile(s)

MPEG will adopt, as a guiding principle, that a Profile should use the same Schema for all its Levels. It is not completely ruled out that there may be exceptions, but they will be discussed on an individual basis and only made in exceptional circumstances

48

resulting in minor changes to the schema. This means that in principle, all the Levels shall conform to the Profile Schema.

Every Profile has its own Level definitions. Nothing in the Levels of one Profile will necessarily mean something for another Profile (although they may be harmonized)

On the definition of Levels, the following was noted:o Cardinality, which seems a Level issue but could change the Schema, doesn’t

really provide control over the size of the description. “Size of Description” could be a valid Level variable, however.

o Related to the previous point, some Level variables may not be able to be validated using the Schema itself, such as the size or the depth of the description. Still, these could be relevant Level variables, and they can be easily checked for conformance.

o It should be possible to change the range of attributes in a Level definition.

MPEG-21

General

Profiles10491 AHG on Profiles and Extensions for the MPEG-21 REL - Gandee, Chris BarlasThe assumption in the profiling work was the timely availability of relevant OMA specs. As these weren’t available, no simple Profile could be defined based on them. It was decided that there be no continuation of this AHG for now, until more information is available or other contributions on required profiles are brought to MPEG.

MPEG-21 in Broadcasting

10629 Requirements for conversion descriptions in a live radio broadcasting environment - Grant10563 MPEG-21 in Broadcasting Use-Case: Metadata Filtering (refinement 1) - Artur Lugmayr10564 MPEG-21 for exchange of personal profiles between embedded devices- Lugmayr, Duan10705 Usage Scenarios Analysis for MPEG-21 in Broadcasting - Abdellatif Benjelloun Touimi

The Requirements group hosted two sessions on the role of MPEG-21 in Broadcasting. It was concluded that the current activity lacked a clear problem definition and a coherent view on the role that MPEG-21 could play in broadcasting, possibly because the participation of direct stakeholders appeared minimal. The Requirements Group appreciated the efforts of the people that participated in the activity, but decided that the activity be closed for the time being, but the Group is open to new contributions. Any new or continued activity in the realm of MPEG-21 in broadcasting will be reviewed in the light of submissions received at the next meeting. There must be a clear vision for a role of MPEG-21 in broadcast applications, a coherent view of the contribution of MPEG, and a well-defined statement of what MPEG needs to standardize. In addition, there must be people with knowledge of and interest in the broadcast world to carry out the work.

49

Vision, Strategy and Technologies Technical Report (Part 1) and related10616 The Notion of Underlying Work within MPEG 21 - Gauvin, Dulong de Rosnay10548 Summary of Voting on ISO/IEC PDTR 21000-1 [2nd Edition] - SC 29 Secretariat (including

JNB, USNB and UKNB comments)10586 Austrian NB comments on PDTR 21000-1 2nd Edition - Timmerer, Hellwagner, for ANB10699 FNB comments on Text of ISO/IEC 21000-1 2nd ed.– M. Dulong de Rosnay, on beh…

N1070

The comments to the PDTR were taken into account in producing the DTR. While not all comments could be implemented as suggested, all National Bodies were happy with the result and those that had voted ‘No’ changed their votes ‘Yes’.

Digital Item Declaration (Part 2)10561 USNB Contribution: MPEG-21 Media Locators - A. G. Tescher for USNBThe conclusion of a joint meeting with MDS on this issue was that a Core Experiment would need to be drafted to come to a decision in this matter. The Core Experiment was further defined in the MDS Group.

IPMP (part 4)10495 Discussion on MPEG-21 IPMP Requirements - Craig Schultz10556 Comments on MPEG-21 IPMP Requirements – F. Chiariglione, et.al. 10615 Proposed requirement for MPEG-21 IPMP - Caporossi, et.al.10625 Comments on Reqs for MPEG-21 IPMP and Reference Model - Xin Wang, et.al.10489 AHG to complete requirements for MPEG-21 IPMP - Watt, Van den Heuvel, Schultz

Extensive editing resulted in a much-improved specification of the requirements for IPMP. To reduce travel for delegates, it was decided to not have a separate evaluation meeting in June, but rather do a 3-day pre-meeting before the 69th meeting. This also led to extending the deadline of submission to 25 June. The Requirements Group regrets losing Bas van den Heuvel as a very active participant and co-chair of Ad-Hoc Groups and Break-out Groups.

DIA (part 7)10560 USNB Contribution: Demographic Information - A. G. Tescher for USNBThe Requirements Group notes that the request is in line with similar requests from other NB’s at previous meetings, and that earlier concerns seem to have given way to recognizing the use of supporting this information. WG11 will allow such attributes to be adopted in the MPEG-21 DIA Standard.

Persistent Association (part 11)10549 Summary of Voting on ISO/IEC PDTR 21000-11 - SC 29 SecretariatThe comments to the PDTR were taken into account in producing the DTR. While the Requirements Group would be happy to address Video in the DTR, there have simply not been enough contributions to implement the suggestion. WG11 is ready to create a second version of the PDTR, if enough video experts commit to seeing it through. All National Bodies were happy with the result and those that had voted ‘No’ changed their votes ‘Yes’.

Event Reporting10618 Proposed MPEG-21 ER Data Structure as Digital Item - Youngjoo Song, et.al.

50

10619 Proposed Definition on Delivery Time,Recipient of MPEG-21 ER - Kyunghee Ji, et.al. 10635 Response to the CfP on ER ; Proposed E Language - Senator Jeong, et.al.10675 Overview of responses to N6278: MPEG-21 Event Reporting Call for Proposals - Rump10494 AHG on MPEG-21 Event Reporting - FX Nuttall, Andrew Tokmakoff

The event reporting work was handed off to the MDS Group. It looks like proposals have been received to fulfill the majority of the required functionality.

51

Annex 6Report of Systems meeting

Source: Systems Chair and Break-out group ChairsTitle: Systems Meeting ReportStatus: DraftEditor: Olivier Avaro (France Telecom R&D)

Contributors: Olivier Avaro (France Telecom R&D), Claude Seyrat (Expway), Oliver Baum (Fraunhofer IIS), David Singer (Apple)

OverviewThe main outputs of the meeting from the Systems Sub-group perspective are:

No. Title TBP Available

13818-1:2000/Amd.4 Metadata Application Format CPN6314 DoC on ISO/IEC 13818-1:2000/PDAM4 No 04/03/19N6315 Text of ISO/IEC 13818-1:2000/FPDAM4 No 04/03/19

13818-1:2000/Amd.5 New Audio P&L SignalingN6316 DoC on ISO/IEC 13818-1:2000/PDAM5 No 04/03/19N6317 Text of ISO/IEC 13818-1:2000/FPDAM5 No 04/03/19

14496-1 :2003/Cor Items for CorrectionsN6318 Text of ISO/IEC 14496-1/DCOR3 No 04/03/19

14496-11 :2003/Amd.3 Audio BIFS ExtensionsN6319 DoC on ISO/IEC 14496-11/PDAM3 No 04/03/19N6320 Text of ISO/IEC 14496-11/FPDAM3 No 04/03/19

14496-11:2003/Amd.4 XMT and MPEG-J ExtensionsN6321 Text of ISO/IEC 14496-11/COR2 No 04/03/19

14496-12:2003/Amd.1 ISO File Format ExtensionsN6322 DoC on ISO/IEC 14496-12/PDAM1 No 04/03/26N6323 Text of ISO/IEC 14496-12/FPDAM1 Yes 04/03/19

14496-17 Streaming Text FormatN6324 Study Text of ISO/IEC 14496-17/FCD Yes 04/03/26

15938-1 SystemsN6325 DoC on ISO/IEC 15938-1/FPDAM1 No 04/03/19N6326 Text of ISO/IEC 15938-1/FDAM1 No 04/04/19N6327 DoC on ISO/IEC 15938-1/DCOR1 No 04/03/19N6328 Text of ISO/IEC 15938-1/COR1 No 04/03/19N6329 Core Experiments for Systems Extensions No 04/03/19N6330 MPEG-7 Systems reference software workplan No 04/03/19

21000-9 MPEG-21 File FormatNxxxx Request of ISO/IEC 21000-9 No 04/04/03N6331 Text of ISO/IEC 21000-9/CD No 04/04/03N6332 Technology under consideration for 21000-9 No 04/03/19

21000-16 MPEG-21 Binary Format

52

N6333 WD1.0 of Text of ISO/IEC 21000-16 No 04/03/19N6334 Core Experiment on MPEG-21 Binarization No 04/03/19

Explorations and SupportN6335 MPEG Multimedia Middleware Context and Objectives No 04/03/19N6336 Requirements on the MPEG Multimedia Middleware No 04/03/19N6337 CfP on Lightweight Application Scene Representation No 04/03/19N6338 MPEG IPMP Extensions Overview Yes 04/03/19N6339 Call for Registration Authority for IPMP_Tool_Id No 04/03/19

General issues

GeneralThe meeting report from Waikaloa has been approved.

M10576: MPEG IPMP Introduction from Panasonic. Slides presenting the MPEG-4 and MPEG-2 IPMP (background, technology, …). For information.

M10588: Cancelled.

M10557: The Systems subgroup thanks the USNB for pointing the mistake made on the edition of Text of ISO/IEC 14496-11/COR1. An updated version of this document has been sent to the secretariat implementing the decisions made by the Systems subgroup.

M10590: Proposed modifications for implementation of MPEG-4 font compression and streaming. Request for new handler for font compression and streaming. This will be handled by the RA for 4CC and OTI.

List of standards under development

Pr

Pt Edit.

Project

Description CfP WD CD FCD FDIS

2 1 2000 Amd.4 Metadata Application Format CP

03/10

04/03

04/07

2 1 2000 Amd.5 New Audio Profile and Level Sig.

03/10

03/12

04/03

04/07

4 1 2003 Cor.3 AFX Code table correction 04/03

04/07

4 11 2003 Cor.2 Valuator/AFX related correction

04/03

04/07

4 11 2003 Amd.3 Audio BIFS Extensions 03/10

03/12

04/03

04/07

4 11 2003 Amd.4 XMT and MPEG-J Extensions

03/10

03/12

04/07

05/01

4 12 2003 Amd.1 ISO File Format Extensions

03/10

03/12

04/03

04/07

4 17 2003 1st Ed. Streaming Text Format 03/0 03/0 03/1 04/0

53

3 7 2 74 20 2004 1st Ed. Lightweight Application

Scene04/03

04/07

04/10

05/03

21 9 200x 1st Ed. File Format 03/12

04/03

04/07

05/01

21 16 200x 1st Ed. Binary Format 04/03

04/07

04/10

05/03

DemonstrationsNone.

FAQThe FAQ were updated as needed.

AOBNone.

MPEG-2 Systems (13818-1)

13818-1:2000 Amd.4

Topics1. ISAN and VISAN Signaling.

ContributionsM10633: See liaison.M10738: See liaison.M10504: See DoC and Amd. Text.

13818-1:2000 Amd.5

Topics1. New Audio Profile and Level Indication; 2. Audio_Type Table split for ISO reserved and User Private

ContributionsM10558: See DoC and audio report.M10544: See DoC and Amd. Text.

MPEG-4 Systems (14496-1)

14496-1:2003 Cor. 3M10391: (From Hawaii). Proposed addition to BBA stream in the AFX code table. The table will be shifted to the AFX specification (by corrigendum of ISO/IEC 14496-1 and amendment of ISO/IEC 14496-16).

54

MPEG-4 Scene Description (14496-11)

14496-11:2003 Cor. 2

Topics1. Miscellaneous Corrigenda Item.

ContributionsItems added to the current corrigendum : remove unimplemented technology from SNHC from the Node Coding table.

M10570: Improvment of point texture compression. Requires extensions of the bitwrapper node. Expose lack of extensibility for the bitwrapper node. Decision to develop a more general and future proof solutions for technology that will use the bitwrapper functionnality.

14496-11:2003 Amd.3

Topics1. Advanced Audio Buffer Node;2. AudioChannelConfig;3. Pre-defined effects using ExterProto;4. Support for Ambisonic.

ContributionsScene Description

M10627: See Audio report.M10546: See DoC et Amd. text.

14496-11:2003 Amd.4

Topics1. XMT Extensions;2. MPEG-J Extensions.

ContributionsScene Description

None.

55

ISO File Format (14496-12)

14496-12:2003 Amd.1

Topics1. Support for Static Metadata;2. Support for IPMP at the File Format Level.

ContributionsExtensions of the ISO File Format

M10554, M10692: Handling Audio Pre-roll in MPEG-4. Information on HE-AAC decoder delay and timestamps. Continue documentation of the understanding of these complex issues. No action requested by Systems prior Audio has addressed the issue at the codec level.

M10547, M10555, M10612: All comments were addressed. See DoC and specification. Detailed discussions are documented below.

On the technology under consideration, we agree to simplify it to a flat structure, no mention of coding systems (e.g. SMIL etc.) and then consider the residual as to whether it should be included; no conclusion was reached on this question. The residual technology is:

a) the progressive download informationb) chunking (extents) of resourcesc) start-location OR the in-line meta-datad) ability to attach name, type, encoding, and protection info to resources.

The editors are instructed to insert an annex into the amendment documenting the RA, if approval of the RA is achieved in a suitable time-frame. In systems plenary we learned that the secretariat can insert the contact information into the annex once the RA is approved (even after document approval).

On the technology under consideration, the plenary instructed the editors to integrate the technologies directly relevant to the immediate use cases: MPEG-7 and MPEG-21, and make no mention of SMIL. Those technologies are the initial resource location, progressive download information, chunking (dividing into extents) of resources, and providing a name, type, encoding, and protection information for resources.

On the 3GPP2 RA question, the RA is directed to note on the RA/sample-entry table that the appropriate specs must be consulted for when each may be used for any given codec. The RA is also instructed to go back and allocate OTI for all codecs used in the family that have a sample-entry code.

On the constraint_flag, more detail was received into the plenary from the absent author, and it will be retained with more explanation into the next text.

The editors are instructed to produce sufficient text for the JPEG meeting in Madrid, to enable balloting immediately after. Balloting will close after Seattle, however, NB comment is earnestly desired before the meeting.

56

Streaming Text (14496-17)

Topics1. Coded Representation of Text Stream.

ContributionsNone: Specification has been reviewed and a study was produced.

Discussion : Text positionning wrt Video. Support on character sets. Use of text profiles in text streams. To be further studied in the Scene AHG.

LASeR (14496-20)

Topics1. Lightweight Application Scene Representation

ContributionsM10685: Test Data set Description for LASER Evaluation. Discussed. Taken as a basis to finalize the CfP on Laser.

M10686: Additional Requirements for LASER. Proposition discussed and CfP has been updated accordingly.

M10687: Statement of Support for LASER. Additionnal companies supporting the development of LASER. For information.

M10688: Proposed coordination between MPEG and W3C on LASER. Agreement on the proposed process within the Systems group. Further discussed within Liaison. Cf. Liaison statement to W3C.

M10684: Support of SVG1.2 in LASER. Integrated in the CfP to indicate the minimal set of functionality required based on the SVG1.2 specification.

M10689: Evaluation Software Requirements for LASER. Shall have an implementation and be implementable on some plate-forme. Joint meeting with ISG. Results implemented in CfP.

MPEG-7 Systems (15938-1)

GeneralM10492, M10559, M10648, M10502 : MPEG-7 Profiles Definition. Cf. Req. Report.

M10717 - Report on CE (Indexing)The contribution presents results of the indexing CE. A first attempt to compare them to the TV-Anytime has been done, however evaluation criterion are not clear enough. The core

57

experiment related to indexing mechanism will be continued and evaluation criteria have been clarified.

Other itemsNo contributions have been made about the copy command CE since several meetings. The Core Experiment will not continue.

15938-1/Cor1

Topics1. Miscellaneous corrections to MPEG-7 Systems.

ContributionsM10728 - Editors study of the ISO/IEC 15938-1/FPDAM & CORThe contribution presents a new study of FPDAM & DCOR. This document will be used as the basis of the Amd and the cor.

15938-1/Amd 1

Topics1. Schema Transmission;2. Optimised codecs;3. Insertion of elements.

ContributionsM10587 - MPEG-7 BiM Reference Software StatusThe contribution presents the status of the BiM reference software which nows integrates every tool defined in the amendment.

M10695 – Report on CE on MPEG-7 Systems Extensions: Extended Type CodesThe contribution presents a comparison between different type code allocation strategy. It demonstrates compression improvement compared to AdvancedTypeCode (global code) strategy. However the complexity of the method raised complexity concerns. The proposal is not accepted.

M10729 - MPEG-7 Systems extensions: Results of Mini-Experiment #2The contribution presents a general review of the schema transmission issues and proposes several solutions and improvements to the FPDAM. This contribution has been used to solve the issues raised at the 67th meeting by NBs.

MPEG-21 File Format (21000-9)

21000-9

Topics1. MPEG-21 File Format

58

ContributionsThe following points were discussed and approved : Make the moov atom optional, i.e. derive the M21 file format from techs in the ISO base,

but not require all that it requires. Have both binary and textual handler types: m21b, m21t. The chunking/interleave may be appropriate for binarized/interleaved digital items.

The CD text should have some worked examples, with diagrams etc. Simple case, more complex cases and so on, including URL forms. We need comment on whether the protection structures proposed for the amendment are needed or appropriate in the MPEG-21 use case.

M10645: We agree that it is necessary that we get the right indirections in place to enable the right flexibility. But the proposal as presented suggests re-writing the DID as it is packaged, and we desire that we do not have to do that in the general case, so that for example signing etc. remain valid. It seems that the file-entry structures serve a similar function, but allow the DID to be packaged without re-writing. There may be value in having fragment identifiers outside the DID etc. but it’s not entirely clear whether the fragment identifier should or should not remain within the XML; we really need to see why it is an advantage to move the fragment identifier out of the XML into the resource directory. It may allow some editing of the external resource (editing that required the fragment identifier to change) without changing the DID (e.g. when a scene of a movie was referred to, and the resource re-packaged so that the scene is substituted for the entire movie, obviating the need for a fragment, but there was no consensus that this was even desirable). This contribution will be documented as a technology under consideration in the next document, requesting comment,

MPEG-21 Binary Format (21000-16)

21000-16

Topics1. Binarization of MPEG-21 Data

Contributions

M10718 - BinaryXML - A Comparison of Existing XML Compression TechniquesThe contribution shows figure on DIA compression and compared several compression techniques on qualitative and quantitative measures. It appears that BiM has unique features (progressive transmission & direct data access). The contribution recommends to adapt BiM in order to improve compression of large, highly repetitive documents. Proposal of backward compatible extensions of BiM with specific codecs.

M10644 - Binarisation of MPEG-21 DIDsThe contribution shows figure on DID compression and compared several compression techniques. BiM is leading followed by XMill. Proposal to improve efficiency for MPEG-21 specifics. Progressive transmission is required for large DID. However several items should be addressed by BiM to fully satisfy DID compression requirements. The encoding of any

59

wildcard (with no schema & according to external attributes “mimeType”) should be improved and the issue of properly dividing DID should be addressed (is signalling of DID validity required?).

M10646 - MMG-Waseda proposal on Issues in binary coding(binarization) of MPEG-21 DIDThe contribution presents MPEG-21 use cases in highly constrained environment (targeting mobile environment). The contribution presents the notion of domain dependent coding which could have the following positive impact on DID decoding: Easy mapping of DID to relational database, More compressed DID & Small footprint decoder. While the benefits are clear, technical more work has to be done. Proposed to perform Core Experiment on MPEG-21 binarization.

Decision:There is now a critical mass of people interested in MPEG-21 binarization enabling MPEG to start a work item on the topic. This will lead to the production of: A new part of MPEG-21 describing how BiM is used in the MPEG-21 specific context.

This will be part 16 of MPEG-21; Possible amendments of MPEG-7 Systems to accommodate MPEG-21 specifics.BiM will be used as a starting point.

Next Steps: Issue Working Draft 1.0 of ISO/IEC 21000-16. Define and execute core experiment to further evaluate the need of BiM extensions to

cover MPEG-21 requirements.

Exploratory Activities

MPEG-2 Exploratory Activities

Topics1. Scalability at the Systems Level.

ContributionsM10592, M10591 : Rational and Proposal for MPEG-2 System amendment to support heterogeneous layered video. Similar features are under consideration by the Video subgroup but the timeline is less aggressive than the proposed amedment of the MPEG-2 Systems specification. Liaison to possible clients of this technology (DVB) to get their feed-back on the appropriate time-to-market for such technology. See liaison to DVB.

MPEG-4 Exploratory activity

Topics1. MPEG-J Extensions2. Others

60

ContributionsOthersM10696: Proposal of new requirements for streaming geo-visual contents. See Req. report.

MPEG-21 Exploratory Activities

Topics1. Architecture

ContributionsNone.

Multimedia Application Formats

Topics1. Application specific format framework;2. Usage of MP3 in MP4 with metadata;3. Usage of JPEG in MP4 with metadata.

ContributionsM10536: Multimedia Application Format (MAF) Overview Document. Review of the document.

Review list of open issuesRelation with MPEG-21: MPEG-21 is structure (not metadata). MPEG-21 File Format will build on top of the ISO Base File Format. What is done in MAF can then be re-used within the context of the MPEG-21 File Format.

Issue on file format overhead: Overhead of the file format could be an issue for small sized media + metadata (ex:images thumbnail). Image does not need a movie atom which represents a large part of the overhead. So this should not be an issue.

Multimedia Middleware

Topics1. Use cases;2. Middleware Architecture;3. Multimedia APIs.

ContributionsM10530: MPEG Multimedia Middleware: Context and Objective (Update). Document updated and reviewed.

61

Latest References and Publication Status

Pr Pt Standard No. Issue Status Doc. with Purpose2 1 ISO/IEC 13818-1/Amd.7 Published 2000/122 1 ISO/IEC 13818-1:2000 (MPEG-2 Systems 2nd Edition) 00/12 Published 2000/122 1 ISO/IEC 13818-1:2000/COR1 (FlexMux Descr.) N3844 01/01 Pisa Published 2002/032 1 ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) + COR2 N5867 03/07 Trondheim Published 2003/122 1 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2) N5604 03/03 Pattaya Published 2004/032 1 ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-

2)N5771 03/07 Trondheim FDAM ITTF FDAM 04/04/26

2 11 ISO/IEC 13818-1:2003 (IPMP on 2) N5607 03/03 Pattaya Published 2003/124 1 ISO/IEC 14496-1 (MPEG-4 Systems 1st Ed.) Published 1999/124 1 ISO/IEC 14496-1/Amd.1 (MP4, MPEG-J) Published 2001/114 1 ISO/IEC 14496-1/Cor.1 Published 2001/114 1 ISO/IEC 14496-1:2001 (MPEG-4 Systems 2nd Ed.) Published 2001/114 1 ISO/IEC 14496-1:2001/Amd.1 (Flextime) Published 2002/104 1 ISO/IEC 14496-1:2001/Cor.1 01/07/20 FDAM SC294 1 ISO/IEC 14496-1:2001/Cor.2 02/10/26 FDAM SC294 1 ISO/IEC 14496-1:2001/Amd.2 (Textual Format) 02/03 FDAM SC294 1 ISO/IEC 14496-1:2001/Amd.3 (IPMP Extensions) FDAM ITTF FDAM 04/03/224 1 ISO/IEC 14496-1:2001/Amd.4 (SL Extension) Published 2003/124 1 ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) N5277 02/10 Shanghai FDIS SC29 Final Text Editing4 1 ISO/IEC 14496-1:2001/Amd.7 (AVC on 4) N5976 03/10 Brisbanne FDAM SC29 FDAM to be issued4 1 ISO/IEC 14496-1:2001/Amd.8 (ObjectType Code Points) N6202 03/12 Hawaii FDAM SC29 FDAM to be issued4 6 ISO/IEC 14496-6:2000 Published 2000/124 8 ISO/IEC 14496-8 (MPEG-4 on IP Framework) N4712 02/03 Jeju FDIS SC29 FDIS 04/04/124 11 ISO/IEC 14496-11 (MPEG-4 Scene Description) N5279 02/10 Shanghai FDIS SC29 Final Text Editing4 11 ISO/IEC 14496-11/Amd.1 (AFX) N5480 02/10 Awaji AMD SC29 By 05/01/054 11 ISO/IEC 14496-11/Cor.1 N6203 03/12 Hawaii COR SC29 By 05/01/05

62

4 11 ISO/IEC 14496-11/Amd.2 (Advanced Text and Graphics) N6205 03/12 Hawaii FDAM SC29 By 05/01/054 12 ISO/IEC 14496-12 (ISO Base Media File Format) N5295 02/10 Shanghai IS ITTF To be published

03/124 13 ISO/IEC 14496-13 (IPMP-X) N5284 02/10 Shanghai FDIS ITTF4 14 ISO/IEC 14496-14 (MP4 File Format) N5298 02/10 Shanghai 2004/01 Published4 15 ISO/IEC 14496-15 (AVC File Format) N5780 03/07 Trondheim FDIS ITTF Ballot to be issued4 18 ISO/IEC 14496-18 (Font Compression and Streaming) N6215 03/12 Hawaii FDIS ITTF FDIS by 04/05/114 19 ISO/IEC 14496-19 (Synthesized Texture Stream) N6217 03/12 Hawaii FDIS ITTF FDIS to be issued7 1 ISO/IEC 15938-1 (MPEG-7 Systems) N4285 01/07 Sydney Published 2002/077 1 ISO/IEC 15938-1/Amd.1 (MPEG-7 Systems Extensions) N6326 04/03 Munich FDAM Editor7 1 ISO/IEC 15938-1/Cor.1 (MPEG-7 Systems Corrigedum) N6328 04/03 Munich COR SC297 2 ISO/IEC 15938-2 (MPEG-7 DDL) N4288 01/07 Sydney Published 2002/02

63

Resolutions of Systems

Cf. WG11 resolution.

64

List of reviewed contribution

N° Title Authors1049

2AHG on MPEG-7 Interoperability and Profiling Wo Chang et al.

10502

Terms and Definitions for MPEG-7 Profiles Bhavan Gandhi et al.

10504

Summary of Voting on ISO/IEC 13818-1:2000/PDAM 4 [SC 29 N 5808]

SC 29 Secretariat

10530

MPEG Multimedia Middleware: Context and Objective (Update) Jean Gelissen

10530

MPEG Multimedia Middleware: Context and Objective (Update) Jean Gelissen

10536

Multimedia Application Format (MAF) Overview Document Wo Chang

10539

Liaison Statement from 3GPP [SC 29 N 5842] 3GPP

10544

Summary of Voting on ISO/IEC 13818-1:2000/PDAM 5 SC 29 Secretariat

10546

Summary of Voting on ISO/IEC 14496-11/PDAM 3 SC 29 Secretariat

10547

Summary of Voting on ISO/IEC 14496-12/PDAM 1 & ISO/IEC 15444-12/PDAM 1

SC 29 Secretariat

10554

Handling Audio Pre-roll in MPEG-4 David Singer

10555

USNB Contribution: ISO/IEC 14496-12 modifications A. G. Tescher for USNB

10557

USNB Contribution: ISO/IEC 14496-11 issues A. G. Tescher for USNB

10558

USNB Contribution: “Audio Type” Issues A. G. Tescher for USNB

10559

USNB Contribution: MPEG-7 profiles A. G. Tescher for USNB

10576

MPEG IPMP Introduction Systems Group

10587

MPEG-7 BiM Reference Software Status Gregoire Pau et al.

10588

Comments on MPEG-2/4 IPMP Extensions Filippo Chiariglione et al.

10590

Proposed modifications for implementation of MPEG-4 font compression and streaming

Vladimir Levantovsky

10591

Rational for heterogeneous layered video support in MPEG-2 Systems (as in M10359)

Bruls & Jan van der Meer

10591

Rational for heterogeneous layered video support in MPEG-2 Systems (as in M10359)

Bruls & Jan van der Meer

10592

Proposal for MPEG-2 System amendment to support heterogeneous layered video

Van der Meer Fons Bruls

10592

Proposal for MPEG-2 System amendment to support heterogeneous layered video

Van der Meer Fons Bruls

10612

URL Forms for Container Files David Singer

1062 CE Report on AdvancedAcousticScene node for MPEG-4 Audio BIFS version Jeongil Seo et.65

N° Title Authors7 3

10633

SMPTE Liaison to MPEG on V/ISAN and ISO 13818-1 DAM4 Merrill Weiss et al.

10644

Binarisation of MPEG-21 DIDs Stephen Davis et al.

10645

Proposed Resource Reference Box for media resource referencing Yongju Cho et al.

10646

MMG-Waseda proposal onIssues in binary coding(binaization) of MPEG-21 DID

Itaru Kaneko et al.

10648

Preliminary FCD on MPEG-7 Profile Wo Chang

10653

Profiling Consideration for MPEG-4 IPMP Mayumi Koike et al.

10665

UKNB comment on Graphics API Steliaros K Grant

10684

Support of SVG1.2 in LASER JC Dufourd et al.

10684

Support of SVG1.2 in LASER JC Dufourd et al.

10684

Support of SVG1.2 in LASER JC Dufourd et al.

10685

Test Data set Description for LASER Evaluation JC Dufourd et al.

10685

Test Data set Description for LASER Evaluation JC Dufourd et al.

10685

Test Data set Description for LASER Evaluation JC Dufourd et al.

10686

Additional Requirements for LASER JC Dufourd

10687

Statement of Support for LASER Olivier Avaro et al.

10688

Proposed coordination between MPEG and W3C on LASER Olivier Avaro et al.

10689

Evaluation Software Requirements for LASER JC Dufourd et al.

10689

Evaluation Software Requirements for LASER JC Dufourd et al.

10692

Information on HE-AAC decoder delay and timestamps Heiko Purnhagen

10695

Algorithms in BiM Version 2 Reference Software Andreas Hutter et al.

10696

Proposal of new requirements for streaming geo-visual contents Jérôme Royan et al.

10717

Report on CE (Indexing) Andrea Kofler-Vogt et al.

10718

BinaryXML – A Comparison of Existing XML Compression Techniques Christian Timmerer et al.

10728

Editors study of the ISO/IEC 15938-1/FPDAM Claude Seyrat

10729

MPEG-7 Systems extensions: Results of Mini-Experiment #2 Claude Seyrat et al.

10734

Profiling Consideration for MPEG-2/4 IPMP Ji-Ming et al.

10738

Liaison from TC46/SC9

66

Annex 7Report of MDS meeting

Contact (MPEG Multimedia Description Schemes Sub-group Chair):John R. SmithIBM T. J. Watson Research Center19 Skyline DriveHawthorne, NY 10532 USAjrsmith@watson.ibm.com

The MPEG Multimedia Description Schemes (MDS) sub-group’s activities included work items for MPEG-7 and MPEG-21 standards as shown in Figure 1. The primary work items for the week included the following:

MPEG-7:o MPEG-7 Extensions (Part 5):

Review NB comments on MDS AMD/2 Review proposals on MDS AMD/2 MPEG-7 MDS AMD/2 FPDAM MPEG-7 MDS COR/1 DCOR

o MPEG-7 Conformance (Part 7): AMD/1 (Version 2 bitstreams) Study of FPDAM

o MPEG-7 Schema Definition (Part 10): Review NB Comments on Schema Definition CD MPEG-7 Schema Definition FCD

MPEG-21:o MPEG-21 Digital Item Declaration (Part 2):

Review proposals on location schemes, binarization, comments

MPEG-21 DID 2nd Ed CD

o MPEG-21 Rights Data Dictionary Review responses from RA information request MPEG-21 RDD COR/1 WD

o MPEG-21 Digital Item Adaptation (Part 7): MPEG-21 DIA AMD/1 WD v.2

o MPEG-21 Reference SW (Part 8): Review AHG report, SW contributions MPEG-21 Ref. SW CD

o MPEG-21 Digital Item Processing (Part 10): Review preliminary comments, AHG report, CE results MPEG-21 DIP Study of CD

o MPEG-21 Conformance (Part 14): Review AHG report and proposals MPEG-21 Conformance CD

67

o MPEG-21 Event Reporting (Part 15): Review results from CfP MPEG-21 Event Reporting WD

MPEG- 21:• DI D 2nd Ed (CD)• REL (“Profiles”)• RDD (“RA”, COR/1)• DI A AMD/ 1 (WD v2)• DI P (Study of CD)• Ref SW (CD)• Conformance (CD)• Event Reporting (WD)

MPEG- 7 v.2:• MDS AMD/ 2

(FPDAM)• MDS Cor/ 1(DCOR)• Conf . Ext. (Study

of FPDAM)

MPEG- 7 v.1:• MDS (FDI S)• Profi les• Schema Def . (FCD)

Figure 1. Overview of MPEG Multimedia Description Schemes Sub-Group work items for 68th Munich meeting.

MPEG Multimedia Description Schemes (MDS) Group activities

Num.

Contributions

 Agenda, Goals and Issues for the Week for Multimedia Description Schemes (MDS) Sub-Group

Agenda, Goals and Issues for the Week for Multimedia Description Schemes (MDS) Group

John R. Smith

During the kick-off session, the workplan for the week for MPEG-7 and MPEG-21 development was discussed and approved. Furthermore, the following points were discussed:

Organization of work into main MDS track with BoGs (REL/RDD/DIA/DIP)

o All work held in main MDS track except where indicated for specific Break-out Groups (BoG)

Scheduling of MDS sub-group plenary meetings for Wednesday and Thursday

Plan for MPEG-7 Multimedia Description Schemes AMD/2 and COR/1 Plan for MPEG-21 Digital Item Declaration Plan for MPEG-21 Rights Expression Language Plan for MPEG-21 Rights Data Dictionary Plan for MPEG-21 Digital Item Adaptation Plan for software development for MPEG-21 REL, RDD, DIA

68

Schedule of joint meetings

Joint Meetings (as of Monday): MPEG-7:

o Wed (11h30 - 12h00): MDS Requirements (with Requirements) o Wed (12h00 - 13h00): MPEG-7 Profiles (with Requirements,

Systems, Audio, Video) MPEG-21:

o Mon (16h00 - 17h00): MPEG-21 Event Reporting (with Requirements)

o Tues (09h00 - 10h00): MPEG-21 Binarization (with Systems)o Tues (15h30 - 16h00): MPEG-21 Conformance (with

Integration)o Tues (16h00 - 17h00): MPEG-21 REL/RDD SW (with

Integration)o Tues (17h00 - 18h00): MPEG-21 DID/DIA/DIP SW (with

Integration)

Break-out Groups:

Event Reporting BoG (created at kick-off meeting):o Mandates:

Create initial draft of architecture combining elements from ER proposals

Map to requirements and identify gaps and areas needing expertise from other parts of MPEG-21 (eg., REL+RDD)

Create initial plan for evaluation / core experiments AHG + CE (need to create CE workplan document) Prepare request for subdivision Planning for two passes of WD, going to CD in 10/2004

o Time/place: Tues 09:00—12:00, Room Z947 Tues 14:00—18:00, Room Z947 Wed 11:00—13:00, Room Z947

DIP BoG:o Mandates:

Define RequestResourceAuthorization using REL/RDD interfaces (rename DIBO)

Develop consistent strategy for get object interface to DID, statements, and embedded info; consider ExtractDIAXDI specifically

Explore solutions for playing of fragment Make recommendation on defining DIBOs vs. DIML object

methods Review draft NB comments, discussing with NB

representatives, and create draft disposition Create draft of study document with revisions

corresponding to draft dispositionso Time/place:

Tues 18:00—20:00 Wed 11:00—13:00 Wed 14:00—15:30, Room Z947

69

Thurs 10:00—13:00, Room Z947 Thurs 14:00—16:00, Room Z947

Review of AHG resolutions and action points:

Doc No. Contribution Source

10469

Myriam Amielh, Gerrard Drury, Sylvain Devillers, Yongju Cho, Craig Brown

AHG on MPEG 21 Media Locators

Results: Requirements text already finalized in Hawaii Discussion on XPointer, hierarchical reference Updates to DID proposing changes

Questions: How are media locators relevant for file format? Media locator

references within file.Actions:

New contribution on logical media locator (m10503) Submit updates to DID Discuss & refine design principals Discuss candidate technologies Harmonize various schemes Joint meeting with file format and MPEG-7 MDS Keep alive to complete mandate 2

10470

Xin Wang, Jaime Delgado , Chris Barlas

AHG on MPEG-21 REL and RDD Reference Software

Results: 8 input documents Initial set of conformance test cases Integration SW REL/RDD with DID Ontology for REL/RD

Actions: Discuss content of REL/RDD reference SW suite (how do DIA and

DIP work with REL/RDD?); collection of tools

10491 Brad Gandee, Chris Barlas

AHG on Profiles and Extensions for the MPEG-21 REL

Actions: Activity is important, but there has been little traction with industry;

suggest to suspend exploration of profiles temporarily and consider something like CE to produce report on hypothetical profiles

10471

Anthony Vetro, Christian Timmerer, Sylvain Devillers, Thomas DeMartini AHG on DIA Editing

Results: AMD.8 done FDIS submitted to SC29 Maintain schema and examples Editor’s input on WD of AMD.1

70

Three input contributions; some partially in response to CfC Questions:

What is content of AM document? What tools should be kept as under consideration in AM?

Actions: Add time to schedule to go through AM contents and remove

tools that are no longer under consideration

10472

Jorg Heuer, Debargha Mukherjee, Sylvain Devillers, Christian Timmerer

AHG on Bit-stream Adaptation in Constrained and Streaming Environments

Results: Evaluation criteria How to improve BSD framework performance for low complexity

and streaming environments Approach 1: BSDL + STX to support streams (stream of SAX

events) Approach 2:gBSD + XSLT (could require AMD to BSDLink) Evaluation has difficulties because of comparing Java and C++

Questions: Questions were raised about investigation and how it is relevant

for standardization? This is exploration activity leading to standardization;

Actions: Plan to continue work – AHG may not be necessary; time-frame

still being clarified, but work should continue to July 2004-Dec 2004.

Clarify the goals of this work leading towards some kind of standardization

10473

Christian Timmerer, Gerrard Drury , Frederik De Keukelaere

AHG on MPEG-21 DIA Reference Software

Results: Updated SW modules (3); care needs to be taken with CVS.

Questions: What is XMLPULL?

Actions: Keep this activity alive (could be through joint AHG) Review contributions and update SW plan

10474

Gerrard Drury, Frederik De Keukelaere, Munchurl Kim

AHG on MPEG-21 DIP Reference Software

Results: Contributions will be uploaded

Questions: How close to a common code base

Actions: Common code base from existing contributions Update plan; update SW to be compliant with DIP CD

10475

Gerrard Drury, Rik Van de Walle, Munchurl Kim

AHG on Editing and Core Experiments for DIP

Results: Editing of CD; draft comments

Questions: Relationship to REL

71

Actions: Present results of DIBO explorations

(RequestResourceAuthorization) to IPMP – needs more discussion Produce Study

10487

Thomas DeMartini, Sylvain Devillers, Frederik De Keukelaere, Gerrard Drury

AHG on MPEG-21 Conformance

Results: Two contributions relate to REL conformance, see: W10628: Contribution to MPEG-21 REL Interpretation Conformance

Test Cases W10573: DMAG REL Interpretation ConformanceActions: AHG recommends launching more complete activity on MPEG-21

Conformance

MPEG-21 Event Reporting with Requirements

Doc No. Contribution Source

10494 FX Nuttall, Andrew Tokmakoff

AHG on MPEG-21 Event Reporting

10675 Niels Rump

Overview of responses to N6278 : MPEG-21 Event Reporting Call for Proposals

Results: Received responses to call (from 67th meeting) Believe have a good basis for “global” architecture that can

produce a structure for ER (XML fields) ER represented as DIs (can inherit properties) Basis architecture – syntax description of some elements How to generate event report requests (ER requests)? Event analyzer Generate event report (XML data structure)? How to describe

event, need very precise semantics of eventsQuestions:

Do we have complete starting point Will new semantics need to be defined for RDD? Can possibly be

based on initial set of verbs in RDD?Actions:

Plan for week to produce WD 1.0 Define architecture Identify where further expertise is needed ER requirements related to other parts should go to

Requirements document

10618

Youngjoo Song, Kyunghee Ji, FX Nuttall, Andrew Tokmakoff

Proposed MPEG-21 Event Reporting Data Structure as Digital Item

Results: Data structure for event reporting requests and messages

72

represented as Digital Items (req. 2.2.17) Initially proposed at 66th meeting ERR (request) peer ER

o What (eg., id)o Condition (eg., play has occurred)o ToWhom (recipient)o Delivery outputo Descriptor

ER Messageo ER description datao Requested actiono Sourceo Descriptor

Questions: How to represent that address of recipient? Do protocols/messaging/communications need to be

standardized here? Either protocols should not be part of this or should be defined at

different level of standardRecommendations:

Starting point for formation of ER messages

10619

Kyunghee Ji, Nammee Moon, Youngjoo Song, Jinwoo Hong

Proposed Definition on Delivery Time and Recipient of MPEG-21 Event Reporting

10635

Senator Jeong, Ji-Hyun Park, Yeon-Jeong Jeong, Weon-Guen Oh, Chang-Yeol Lee

Response to the CfP on Event Reporting; Proposed Event Reporting Language

MPEG-21 DID Binarization with Systems:

Doc No. Contribution Source

10718

Christian Timmerer, Hermann Hellwagner, Jörg Heuer, Claude Seyrat, Andreas Hutter

BinaryXML – A Comparison of Existing XML Compression Techniques

Results: Experiments of compressing gBSD using a variety of

compression techniques. (gBSD describes the high-level structure of a resource – layers, headers, etc.)

Encoders that take advantage of redundancy perform better on larger size input

BiM performs best on small source data BiM also seems to have best functionality in compressed domain,

eg., binary access, streamingQuestions:

May be a special case of source data for MPEG-21, which is bitstream syntax description – this experiment is specific to BSDs

Actions: Next step use to use version 2 of BiM codec Try on larger set of source data and other parts of MPEG-21 Proponents interest continue experiments

73

10646

Itaru Kaneko (Waseda) , Mika Onishi Neergaard (MMG)

MMG-Waseda proposal onIssues in binary coding(binaization) of MPEG-21 DID

Results: Domain independent encoding

Questions: Why coding directly from RDB

Actions: Collect test data Consider RDB mapping Identify various dimensions of evaluation criteria

10644 Stephen Davis, Ian Burnett Binarisation of MPEG-21 DIDs

Results: Consider standard set of codec when embedded data or XML

with no schema, eg., base64 codec, or string codec Progressive DIDs – streaming of fragments of DID How to fragment DID – transmission order? How to keep DID valid? Could use signaling to indicate when DID becomes valid in case

of progressive deliveryQuestions:

Is there anything special about MPEG-21 (DID and BSD) that requires changes to BiM?

Actions: MPEG-7 systems should be investigated to see whether it

completely addresses requirements for DID fragmentation and progressive delivery

Make output document – new part of MPEG-21, possible amendment of MPEG-7 systems

MPEG-21 Responses to Call for RDD Registration Authority:

Doc No. Contribution Source

10518 IDF via SC 29 Secretariat

IDF's Response to Evaluation Criteria for Appointing JTC 1 RA of ISO/IEC 21000-6 [SC 29 N 5825]

10613 Chris Barlas

RDD Registration Authority - Rightscom submission

Results: Received two responses to call for RA for RDD in Hawaii meeting Requested more information from candidates DOI with Rightscom as subcontractor has responded with more

information Resulted in one withdrawal (Rightscom) and one response (IDF

w. Rightscom)Actions:

Evaluated response and recommend selection of IDF for RA

74

MPEG-21 RDD Extensions:

Doc No. Contribution Source

10731 Chris Barlas

ISO/IEC 21000-6 : Proposal for Corrigendum

Results: Found error to figure 1 – not consistent with Table 1. Also, mistake in way Figure 1 is referred to as normative

Actions: Create RDD COR/1 WD at this meeting with this correction

MPEG-21 DIA AMD/1:

Doc No. Contribution Source

10516 Thomas DeMartini

Suggested Edits for Digital Item Adaptation Amendment 1 Working Draft 1.0

Results: Edits to text for DIA AMD/1

Questions: Questions about ##any for conversions

Actions: Adopt to DIA AMD/1 WD

10629 Kate Grant

Requirements for conversion descriptions in a live radio broadcasting environment

Results: Report on some requirements for conversions in live radio

broadcastingQuestions:

Use as response to call for conversion operators?Actions:

Example conversions from audio domain have been provided Use these examples (audio, JC) to validate the DIA conversions

framework Also use these as example representations or classification

schemes for the framework Some difficulties have been recognized for validating the

framework given that conversion composite is not adequate for expressing arbitrary assembly of conversion operators?

Response to call was not adequate to understand the wide range of conversions and requirements for expressing them

Create a new call – ask for more information; create template Target specific industries – broadcasters, (check list of MPEG

liaisons), DANAE, Melisa Gather the set of conversions already under investigation

internally in MPEG, and use them to validate the DIA conversions framework – these conversions should be implemented and the descriptors should be generic by abstracting out the essential parts (eg., minimal set of required parameters)

75

Next steps: Agree to standardize conversion description framework as

normative Agree to develop set of conversions / conversion parameters

conforming to framework and incorporate as informative examples but later consider adopting common elements as normative

Agree to validate the conversion description framework using conversions and conversion parameters that are from genuine use cases and industry practices

Validation includes working out relationship with RDD Agree to produce examples of expressing conversion

descriptions and mapping/specialization in RDD

10697

Mariam Kimiaei-Asadi, Jean-Claude Dufourd

Proposal to Digital Item Adaptation Amendment 1 on Conversion Descriptors and Transmoding

10698

Mariam Kimiaei-Asadi, Jean-Claude Dufourd

Contribution to Digital Item Adaptation Amendment 1 on Transcoding and Transforming Conversion Descriptors

Actions: Jean-Claude to work with Thomas to revise the definition of

conversion descriptor framework

10722 Debargha Mukherjee, Sam Liu

Proposal to support AdaptationQoS adaptation in DIA for multi-step adaptation

Actions: Not presented because authors could not attend 68th meeting. Will

be submitted again to 69th meeting, which will be attending by authors.

MPEG-21 DIP:

Doc No. Contribution Source

10630

Munchurl Kim (ICU), Hendry (ICU), Keonsoo Park (KBS), Huang Zhongyang

CE reports on DIBO explorations

Results: Propose DIBO for RequestResourceAuthorization Propose DIBO for ExtractDIAXDI

Questions: Relationship to REL and IPMP – RequestResourceAuthorization

DIBO may be part of solution for IPMP requirementsActions:

Postpone decision on RequestResourceAuthorization DIBO until more discussion on Reference SW, REL, IPMP

ExtractDIAXDI is one example of get object type of interface for DID, DIA, etc. There are NB comments related to this; Wait until discussing NB comments before deciding direction

76

10643 Ernest Wan, Myriam Amielh

Two Proposed DIBOs for handeling a DID Anchor

Results: PlayFragment DIBO, GetFragmentArguments DIBO

Questions: What is relationship with fragment part of URI? Could this be implemented by including fragment resource

Actions: Discuss in BoG; CE?

10572

Thomas DeMartini, Vishy Swaminathan , Anthony Vetro

Preliminary Comments on DIP CD

Actions: Review and dispose in BoG

10585

Christian Timmerer, Hermann Hellwagner

Comments on MPEG-21 DIP CD

Actions: Review and dispose in BoG

10621

Jeroen Bekaert, Frederik De Keukelaere, Robbie De Sutter, Rik Van de Walle, on behalf of the Belgian NB

BNB Comments on ISO/IEC 21000-10 CD Part 10: Digital Item Processing

Actions: Review and dispose in BoG

10630

Munchurl Kim (ICU), Hendry (ICU), Keonsoo Park (KBS), Huang Zhongyang

CE reports on DIBO explorations

Actions: Review and dispose in BoG

MPEG-21 Conformance:

Doc No. Contribution Source

10487

Thomas DeMartini, Sylvain Devillers, Frederik De Keukelaere, Gerrard Drury

AHG on MPEG-21 Conformance

10573

Eva Rodriguez, Jaime Delgado, Silvia Llorente

DMAG REL Interpretation Conformance

10628

Thomas DeMartini, Venugopal Venkatraman , TJ Pannu , Xin Wang

Contribution to MPEG-21 REL Interpretation Conformance Test Cases

Actions: Do not promote Conformance WD to CD Achieve a stable definition of “description” conformance for DID, DIA

and REL Scope of “interpretation” or “engine” conformance still needs to be

clarified within larger context of MPEG-21 architecture Questions on liability of conformance specification.

MPEG-21 REL/RDD Ref. SW with Integration:

77

Doc No. Contribution Source

10521

Xin Wang, Venugopal Venkatraman, Frederik De Keukelaere, Rik Van de Walle

Simple Integration Reference Software for MPEG-21 REL and DID

10574 Eva Rodriguez, Jaime Delgado

DMAG REL License Interpretation using RDD term genealogy – Implementation using Web Services

10575

Victor Torres, Jaime Delgado, Eva Rodriguez

Contribution to DID/REL/RDD reference software: DMAG REL License Interpretation within DID using RDD term genealogy

10577

Jaime Delgado, Eva Rodriguez, Silvia Llorente, Roberto Garcia, Victor Torres

Status of DMAG Reference Software for MPEG-21 REL/RDD/DID

10702

Roberto Garcia, Jaime Delgado, Eva Rodriguez, Isabel Gallego

MPEG REL and RDD Ontologies API

10703

Roberto Garcia, Jaime Delgado, Isabel Gallego RELOntos (REL Ontologies)

Actions: Adopt Six SW contributions of REL/RDD for MPEG-21 Ref. SW

MPEG-21 Location Schemes:

Doc No. Contribution Source

10469

Myriam Amielh, Gerrard Drury, Sylvain Devillers, Yongju Cho , Craig Brown

AHG on MPEG 21 Media Locators

10605

Myriam Amielh, On behalf of the AhG for MPEG-21 Medialocs

Suggested updates to the definitions of a DID fragment in DID v.2

Questions: What inconsistency is fixed by proposed changes? Presumes that fragment attribute is solution for full media

locator functionalityActions:

Do not adopt at present Consider for next steps for media locating -- CE?

10503 Alan K. Melby, John R Smith

Proposal for logical media locator for MPEG 7&21

Results: Proposal of logical media locator for MPEG-7 syntax, which

provides functionalityQuestions:

Make this DID relevant, eg., locating with DID elements Need clear definition of logical unit locator – to be worked on off-

line78

Actions: Consider in context of MPEG-7

10561 A. G. Tescher for USNB

USNB Contribution: MPEG-21 Media Locators

Results: Response to USNB: WG11 thanks USNB for contribution on MPEG-21

Media Locators. WG11 has established a core experiment on media locators that will evaluate candidate technologies for MPEG-21 addressing schemes, including solutions based on MPEG-7 Media Locators. The results of this core experiment will be reported in the 69th meeting.

10747 Adam Lindsay

An alternative non-amendment approach to track numbers for MAF

Results: Proposal to address locating of logical units using existing MPEG-

7 tools – SemanticStateDS, since it provides name-value pairs Provides also a classification scheme for logical unit types

Questions: Don’t we also need classification scheme that is specific to media

rather than something generic Generic classification scheme is comparable with DID

MPEG-21 DID 2nd Edition:Doc No. Contribution Source

10611

Frederik De Keukelaere, Jeroen Bekaert, Rik Van de Walle

Comments on ISO/IEC 21000-2 DID 2nd Ed WD v.2

Results: Proposing some revisions to DID spec to update some attributes Accepting most changes – minor clarifications Not accepting some for which the semantics of original

definitions is changing – will be further studied.Actions:

Comments for which there was agreement will be adopted to DID CD v.2

Comments for which more work needs to be done will be further investigated and will be reconsidered at next meeting

MPEG-7 Extensions:

Doc No. Contribution Source

10714 Holger Crysandt

(Lossy) DescriptorModel compression

Actions: Needs to be further explored in context of audio and visual

applications Adopt to XM to allow further study

10528 SC 29 Secretariat

Summary of Voting on ISO/IEC 15938-5/PDAM 2 [SC 29 N 5835]

79

10727 Korea National Body (KNB)

KNB comment on 15938-5 PDAM2 : ContentCS extension

Results: Reviewed and disposed of NB comments Results reflected in DoC1050

3 Alan K. Melby, John R SmithProposal for logical media locator for MPEG 7&21

Topic: Proposal to extend MPEG-7 media locator functionality to address

logical units, eg., title, chapter, section, etc. This functionality is currently missing from MPEG-7 and is needed in

order to be able to map ID3 music tags to MPEG-7. This is required for new MPEG work item on music file format.

Results: Adopt to MPEG-7 XM to allow further experimentsActions: Examine in core experiment along with applicability to MPEG-21

addressing scheme requirements

MPEG-7 Multimedia Description Schemes (MDS) Liaison Matters:

Doc No. Contribution Source

10501 TVA via SC 29 Secretariat

Liaison Statement from the TV-Anytime Forum [SC 29 N 5789]

Actions: Send MPEG-7 MDS User Preference Extensions FPDAM/2 – (1) point

out that new User Preference types are being developed in MPEg-7, and (2) new ContentCS may provide input for TVAnytime MediaType CS.

Send MPEG-7 Profiles FCD and MPEG-7 MDS DCOR/1 – (1) point out that MPEG is defining profiles, including User Description profile and (2) MPEG-7 is adding signaling mechanism for profiles and levels to MPEG-7 MDS

MPEG-7 Schema Definition:

Doc No. Contribution Source

10253 SC 29 Secretariat,

Summary of Voting on ISO/IEC 15938-7/PDAM 1 [SC 29 N 5656]

Results: Reviewed NB comments on Schema Definition Results reflected in DoC

MPEG-21 DID/DII/DIA/DIP Ref. SW with Integration:

Doc No. Contribution Source

80

10609

Frederik De Keukelaere, Rik Van de Walle

Contribution to DID 2nd Edition reference software

10610

Frederik De Keukelaere, Rik Van de Walle

Contribution to DII reference software

10584

Michael Ransburg, Christian Timmerer, Hermann Hellwagner

Status Report and Improvements of the MPEG-21 DIA Reference Software

10739

Jeho Nam, Hyuk-Min Kwon, Man-Bae Kim, Jin-Woo Hong

Examples of Java Native Interface (JNI) for MPEG-21 DIA Reference SW

10474

Gerrard Drury, Frederik De Keukelaere, Munchurl Kim

AHG on MPEG-21 DIP Reference Software

Topic: Reviewed contributions on DID, DII, DIA, DIP reference SWResults: New contributions on DID, DII, DIA including integration of software

packages adopted Produce MPEG-21 Ref SW CD with modules for DID, DII, REL/RDD,

DIA (not complete integrated MPEG-21 solution)

Report of MPEG-21 BoGs:

Doc No. Contribution Source

Event Reporting BoG Event Reporting BoGResults: Created WD v.1 using three input contributions as basis for initial

design ER WD v.1 document structured as follows:

o Event Reporting Request Structureo Event Report Structureo Relation to DID

Skeleton architecture has been developed and CE will further investigate the detailed definition of the elements based on current contributions

DIP BoG DIP BoGResults: Define RequestResourceAuthorization using REL/RDD interfaces

(rename DIBO) Develop consistent strategy for get object interface to DID,

statements, and embedded info; consider ExtractDIAXDI specifically Explore solutions for playing of fragment Make recommendation on defining DIBOs vs. DIML object methods –

O-O implementation will be investigated in period following FCD Review draft NB comments, discussing with NB representatives, and

create draft disposition -- Create draft of study document with revisions corresponding to draft

dispositionsConversion Description Framework BoG

Conversion Description Framework BoG

81

Results: Thomas DeMartini to draft Annex to DIA AMD/1 Conclusions: (1) Need to have very clear and precise descriptions of

conversions such that they will be mapped to the dictionary (crop)

Summary of Results on MPEG Multimedia Description Schemes (MDS) work items:

Results on MDS MPEG-7 work items:

1. MPEG-7 MDS (Part 5): Reviewed & disposed of NB comments on MDS AMD/2 New contributions on lossy descriptor model and logical unit locator

adopted to MPEG-7 MDS eXperimental Model (XM) Output:

o DoC on MPEG-7 MDS “User Preference Extensions” PDAM/2o MPEG-7 MDS “User Preference Extensions” FPDAM/2o MPEG-7 Multimedia Description Schemes DCOR/1

2. MPEG-7 Schema Definition (Part 10) Reviewed & disposed of NB comments on Schema Definition CD Main action was to synchronize with AMD schemas of parts of

MPEG-7 Output:

o DoC on MPEG-7 Schema Definition CDo MPEG-7 Schema Definition FCD

Results on MDS MPEG-21 work items:

1. Analyzed recommendations of AHGs and Core Experiments.

2. MPEG-21 Part 2 – Digital Item Declaration: MPEG-21 Digital Item Declaration (Part 2): Reviewed proposals for location schemes & other contributions Adopted some improvements for DID 2nd Edition Output:

o MPEG-21 DID 2nd Edition CDo Core experiment on MPEG-21 media locators

3. MPEG-21 Rights Data Dictionary (RDD): RDD Registration Authority (RA): Evaluated detailed information response from candidate for RDD RA Recommendation to appoint International DOI Foundation (IDF) as

RDD RA Output:

o MPEG-21 RDD COR/1 WD (correcting figure)

4. MPEG-21 Part 7 – Digital Item Adaptation: Reviewed contributions for conversion description framework Defining normative conversion description framework in AMD/1

82

Developing an example informative set of conversions to validate framework and demonstrate mapping & term specialization in RDD

Output: o MPEG-21 DIA AMD/1 WD v.2

5. MPEG-21 Reference SW (Part 8): Reviewed contributions for MPEG-21 Reference SW Six SW contributions of REL/RDD adopted for Ref. SW New contributions on DID, DII, DIA including integration of software

packages also adopted MPEG-21 Ref SW CD contains modules for DID, DII, REL/RDD, DIA

(not complete integrated MPEG-21 solution) Output:

o MPEG-21 Ref. SW CD & SW Implementation Plans

6. MPEG-21 Part 10 – Digital Item Processing: Released CD in 67th meeting (ballot still open) Reviewed and disposed of most of the 110 draft comments from 3

NBs Reviewed core experiment results and contributions Created core experiment to define DIBOs for REL Outstanding tasks:

o Develop consistent approach for access of DID elements and other DID embedded info

o Develop solutions for playing of fragmento Evaluate OO- versus procedural-design for DIBOs

Output:o Study of Draft Comments on MPEG-21 DIP CDo MPEG-21 DIP Study of CD

7. MPEG-21 Part 15 – Event Reporting: New MPEG-21 work item for MDS group at this meeting Objective:

o Event Reporting supports monitoring of events relating to consumption of and interaction with Digital Items by specifying mechanisms to express Event Report Requests (ERR) and Event Reports (ER)

o Created initial ER design using three responses to CfP as basis Created ER draft:

o Event Reporting Request Structureo Event Report Structureo Relation to DIDo Defined core experiments for evaluating detailed definitions

(syntax and semantics) for ERR and ER elements Output:

o MPEG-21 Event Reporting WD v.1 and “Request for Subdivision”o Core Experiment for Event Reporting

8. Edited and approved output documents (WD, CD, AHGs, new CEs, etc.)

83

Resolutions from MDS Subgroup:

MPEG-7 related resolutions:

Part 5 Multimedia Description Schemes:o The Multimedia Description Schemes subgroup thanks the National

Bodies of Japan, Republic of Korea and United States for comments on MPEG-7 MDS User Preference Extensions PDAM/2. All National Bodies have approved the disposition.

Part 10 Schema Definition:o The Multimedia Description Schemes subgroup thanks the National

Bodies of Great Britain, Japan and United States for comments on MPEG-7 Schema Definition CD. All National Bodies have approved the disposition.

MPEG-21 related resolutions:

Part 6 Rights Data Dictionary:o WG11 would like to thank International DOI Foundation (IDF) for their

interest to serve as the Registration Authority for ISO/IEC 21000-6 and for providing a detailed response to the evaluation criteria developed in 67th meeting. After careful review, WG11 has determined that IDF is suited to perform the task. WG11 therefore requests the SC29 secretariat to issue the ballot asking for IDF to be appointed Registration Authority for ISO/IEC 21000-6.

Part 7 Digital Item Adaptation:o The Multimedia Description Schemes subgroup invites interested

parties to continue the work on bitstream adaptation in streaming and constrained environments and to report on this activity and/or prepare a core experiment workplan for 69th MPEG meeting.

Part 10 Digital Item Processing:o The Multimedia Description Schemes subgroup reminds proponents of

DIP tools that integrated reference software implementations must be provided and that core experiments must be successfully completed in order for promotion of the tools.

Part 15 Event Reporting:o The Multimedia Description Schemes subgroup reminds proponents of

Event Reporting tools that integrated reference software implementations must be provided and that core experiments must be successfully completed in order for promotion of the tools.

84

List of MDS Output documents:

MPEG-7:

No. Title TBP

Available

15938-5 MPEG-7 Multimedia Description Schemes

6397 DoC on ISO/IEC 15938-5 PDAM/2 N 04/03/1

9639

8ISO/IEC 15938-5 FPDAM/2 “MDS User Preference Extensions” Y 04/03/1

9639

9 MPEG-7 MDS XM v.19 N 04/03/19

6406 ISO/IEC 15938-5 DCOR/1 N 04/03/1

9

No. Title TBP

Available

15938-10 MPEG-7 Schema definition 640

7DoC on ISO/IEC 15938-10 CD N 04/03/1

9640

8ISO/IEC 15938-10 FCD “Schema Definition“ Y 04/03/1

9

MPEG-21:

No. Title TBP

Available

21000-2 MPEG-21 Digital Item Declaration640

9ISO/IEC 21000-2 DID 2nd Edition CD Y 04/04/0

2641

0Workplan for Core Experiment on Media Locators N 04/03/1

9

No. Title TBP

Available

21000-3 MPEG-21 Digital Item Identification

No. Title TBP

Available

21000-5 MPEG-21 Rights Expression Language641

1MPEG-21 REL/RDD Software Implementation Plan v.6 N 04/03/1

9

No. Title TBP

Available

21000-6 MPEG-21 Rights Data Dictionary641

2 ISO/IEC 21000-6 COR/1 WD v.1 N 04/03/19

85

No. Title TBP

Available

21000-7 MPEG-21 Digital Item Adaptation641

3MPEG-21 DIA AMD/1 WD v.2 “Conversions and Permissions” N 04/04/1

9641

4 MPEG-21 DIA Software Implementation Plan v.7 N 04/03/19

No. Title TBP

Available

21000-10 MPEG-21 Digital Item Processing641

5ISO/IEC 21000-10 Study of CD “Digital Item Processing”

N 04/04/02

6416

Study of Draft Comments on Digital Item Processing CD

N 04/03/19

6417 MPEG-21 DIP Software Implementation Plan v.2 N 04/03/1

9641

8 Workplan for Core Experiment on DIBOs for REL N 04/03/19

No. Title TBP

Available

21000-15 MPEG-21 Event Reporting641

9ISO/IEC 21000-15 WD v.1 “Event Reporting” N 04/03/1

9642

0Request for Subdivision to ISO/IEC 21000 for “Event Reporting” N 04/03/1

9642

1Workplan for Core Experiment on Event Reporting N 04/03/1

9

86

List of AHGs approved by the MDS group:

N642214.1.1 AHG on Core Experiments for MPEG-21 DID 2nd

EditionMandates 1. Carry out and monitor Core Experiments related to DID.

2. Encourage delivery of reference software contributions by Core Experiment participants.

3. Encourage contributions on improving MPEG-21 DID 2nd Edition CD.

Chairman Gerrard Drury (gerrardx@xenikos.com)Co Chair Frederik De Keukaleare (Frederik.DeKeukelaerex@xugent.be)Duration Until the 68th MeetingMeetings AHG Meeting to be held on the Sunday prior to 68th meeting.

Other business to be conducted by email or phone.Reflector mpeg-21-dipx@xuow.edu.au. Please use the prefix [DID]N6423

14.1.2 AHG on Core Experiments for MPEG-21 DIPMandates 1. Carry out and monitor Core Experiments on DIP.

2. Submit contribution to MPEG-21 IPMP CfP based on work conducted in the CE on DIBOs for REL.

3. Encourage delivery of reference software contributions by Core Experiment participants.

4. Encourage contributions on improving MPEG-21 DIP CD.Chairman Gerrard Drury (gerrardx@xenikos.com)Co Chair Frederik De Keukaleare (Frederik.DeKeukelaerex@xugent.be)

Munchurl Kim (mkimx@xicu.ac.kr)Duration Until the 69th MeetingMeetings AHG Meeting to be held on the Sunday prior to 69th meeting.

Other business to be conducted by email or phone.Reflector mpeg-21-dipx@xuow.edu.auN6424

14.1.3 AhG on MPEG-21 Event ReportingMandate: 1. Produce input for ER WD

2. conduct and report on the Core Experiment.Chairs: FX Nuttall (fx at nuttall.org)

Andrew Tokmakoff (tokmakoff at telin.nl) Duration: Until the 68th MeetingMeetings: A pre-meeting will be held on the Sunday before the Seattle

meeting.Other business will be conducted by E-mail or telephone conference.

Reflector: mpeg-21-list at imec.be messages to use the prefix [ER]Subscribe: To subscribe, send an email to owner-mpeg-21-list at imec.be

87

MPEG MDS group schedule for 68th meeting:

MDS Sub-Group Schedule  MPEG MDS Chair: John R. Smith    

  MPEG-7 and MPEG-21 FINAL    Numb

er TITLE ROOM & SOURCE STD NOTES

         Monday Morning (9h00-13h00)       MPEG Plenary  Plenary room    

         Monday Afternoon (14h00-20h00)       

         Kick-off of MPEG MDS activities (14h00-14h30)  Z995 (MDS Room) ALL  

 Agenda, Goals and Issues for the Week for MDS Group John R. Smith    

         Review of AHG resolutions and action points (14h30-16h00)  Z995 (MDS Room) ALL  

10469

Myriam Amielh, Gerrard Drury, Sylvain Devillers, Yongju Cho, Craig Brown AHG on MPEG 21 Media Locators    

10470Xin Wang, Jaime Delgado , Chris Barlas

AHG on MPEG-21 REL and RDD Reference Software    

10491 Brad Gandee, Chris BarlasAHG on Profiles and Extensions for the MPEG-21 REL    

10471Anthony Vetro, Christian Timmerer, Sylvain Devillers, Thomas DeMartini AHG on DIA Editing    

10472Jorg Heuer, Debargha Mukherjee, Sylvain Devillers, Christian Timmerer

AHG on Bit-stream Adaptation in Constrained and Streaming Environments    

10473Christian Timmerer, Gerrard Drury , Frederik De Keukelaere

AHG on MPEG-21 DIA Reference Software    

10474Gerrard Drury, Frederik De Keukelaere, Munchurl Kim

AHG on MPEG-21 DIP Reference Software    

10475Gerrard Drury, Rik Van de Walle, Munchurl Kim

AHG on Editing and Core Experiments for DIP    

10487

Thomas DeMartini, Sylvain Devillers, Frederik De Keukelaere, Gerrard Drury AHG on MPEG-21 Conformance    

10630

Munchurl Kim (ICU), Hendry (ICU), Keonsoo Park (KBS), Huang Zhongyang CE reports on DIBO explorations    

         MPEG-21 Event Reporting with Requirements (16h00 - 17h00) Z995 (MDS Room) MPEG-

21  10494 FX Nuttall, Andrew Tokmakoff AHG on MPEG-21 Event Reporting    

10675 Niels Rump

Overview of responses to N6278 : MPEG-21 Event Reporting Call for Proposals    

10618Youngjoo Song, Kyunghee Ji, FX Nuttall, Andrew Tokmakoff

Proposed MPEG-21 Event Reporting Data Structure as Digital Item    

88

10619Kyunghee Ji, Nammee Moon, Youngjoo Song, Jinwoo Hong

Proposed Definition on Delivery Time and Recipient of MPEG-21 Event Reporting    

10635

Senator Jeong, Ji-Hyun Park, Yeon-Jeong Jeong, Weon-Guen Oh, Chang-Yeol Lee

Response to the CfP on Event Reporting; Proposed Event Reporting Language    

         Define BoGs and Mandates (17h00-17h30)  Z995 (MDS Room) ALL    REL, RDD, DIA, BSD, DIP BOG Room = N0116                      Tuesday Morning (09h00-13h00)                MPEG-21 Event Reporting BoG (09h00 - 12h00) 

Z947 (MDS BoG Room) MPEG-

21           MPEG-21 DID Binarization with Systems (09h00 - 10h00)  Z995 (MDS Room) MPEG-

21  

10718

Christian Timmerer, Hermann Hellwagner, Jörg Heuer, Claude Seyrat, Andreas Hutter

BinaryXML – A Comparison of Existing XML Compression Techniques    

10646Itaru Kaneko (Waseda) , Mika Onishi Neergaard (MMG)

MMG-Waseda proposal onIssues in binary coding(binaization) of MPEG-21 DID    

10644 Stephen Davis, Ian Burnett Binarisation of MPEG-21 DIDs             MPEG-21 RDD Reg. Authority (10h00 - 10h30)  Z995 (MDS Room) MPEG-

21  

10518 IDF via SC 29 Secretariat

IDF's Response to Evaluation Criteria for Appointing JTC 1 RA of ISO/IEC 21000-6 [SC 29 N 5825]    

10613 Chris BarlasRDD Registration Authority - Rightscom submission    

         MPEG-21 RDD Extensions (10h30 - 11h00)  Z995 (MDS Room) MPEG-

21  

10731 Chris BarlasISO/IEC 21000-6 : Proposal for Corrigendum    

         MPEG-21 DIA AMD/1 (11h00- 12h00)  Z995 (MDS Room) MPEG-

21  

10516 Thomas DeMartini

Suggested Edits for Digital Item Adaptation Amendment 1 Working Draft 1.0    

10629 Kate Grant

Requirements for conversion descriptions in a live radio broadcasting environment    

10697Mariam Kimiaei-Asadi, Jean-Claude Dufourd

Proposal to Digital Item Adaptation Amendment 1 on Conversion Descriptors and Transmoding    

10698Mariam Kimiaei-Asadi, Jean-Claude Dufourd

Contribution to Digital Item Adaptation Amendment 1 on Transcoding and Transforming Conversion Descriptors    

10722 Debargha Mukherjee, Sam LiuProposal to support AdaptationQoS adaptation in DIA for multi-step    

89

adaptation                  Tuesday Afternoon (14h00-20h00)                 MPEG-21 Event Reporting BoG (14h00 - 20h00) 

Z947 (MDS BoG Room) MPEG-

21           MPEG-21 DIP (14h00 - 15h30)  Z995 (MDS Room) MPEG-

21  

10630

Munchurl Kim (ICU), Hendry (ICU), Keonsoo Park (KBS), Huang Zhongyang CE reports on DIBO explorations    

10643 Ernest Wan, Myriam AmielhTwo Proposed DIBOs for handeling a DID Anchor    

10572Thomas DeMartini, Vishy Swaminathan , Anthony Vetro Preliminary Comments on DIP CD    

10585Christian Timmerer, Hermann Hellwagner Comments on MPEG-21 DIP CD    

10621

Jeroen Bekaert, Frederik De Keukelaere, Robbie De Sutter, Rik Van de Walle, on behalf of the Belgian NB

BNB Comments on ISO/IEC 21000-10 CD Part 10: Digital Item Processing    

         MPEG-21 Conformance (15h30 - 16h00) with Integration  Z995 (MDS Room) MPEG-

21  

10487

Thomas DeMartini, Sylvain Devillers, Frederik De Keukelaere, Gerrard Drury AHG on MPEG-21 Conformance    

10573Eva Rodriguez, Jaime Delgado, Silvia Llorente

DMAG REL Interpretation Conformance    

10628Thomas DeMartini, Venugopal Venkatraman , TJ Pannu , Xin Wang

Contribution to MPEG-21 REL Interpretation Conformance Test Cases    

         MPEG-21 REL/RDD Ref. SW with Integration (16h00 - 17h00)  Z995 (MDS Room) MPEG-

21  

10521

Xin Wang, Venugopal Venkatraman, Frederik De Keukelaere, Rik Van de Walle

Simple Integration Reference Software for MPEG-21 REL and DID    

10574 Eva Rodriguez, Jaime Delgado

DMAG REL License Interpretation using RDD term genealogy – Implementation using Web Services    

10575Victor Torres, Jaime Delgado, Eva Rodriguez

Contribution to DID/REL/RDD reference software: DMAG REL License Interpretation within DID using RDD term genealogy    

10577

Jaime Delgado, Eva Rodriguez, Silvia Llorente, Roberto Garcia, Victor Torres

Status of DMAG Reference Software for MPEG-21 REL/RDD/DID    

10702Roberto Garcia, Jaime Delgado, Eva Rodriguez, Isabel Gallego MPEG REL and RDD Ontologies API    

10703Roberto Garcia, Jaime Delgado, Isabel Gallego RELOntos (REL Ontologies)    

         MPEG-21 DIP BoG (18h00 - 20h00)  TBD MPEG-

21           MPEG Plenary (9h00-11h30)  Plenary room MPEG Plenary

         

90

MPEG-21 Event Reporting BoG (11h00 - 13h00) 

Z947 (MDS BoG Room) MPEG-

21           MPEG-21 DIP BoG (11h00 - 13h00)  TBD MPEG-

21           MPEG-7 Profiles (11h30 - 12h30) with Req., Video, Audio, Systems 

Plenary Room (Requirements) MPEG-7  

10492 Wo Chang, Masanori SanoAHG on MPEG-7 Interoperability and Profiling    

10648 Wo Chang Preliminary FCD on MPEG-7 Profile    6162 John R. Smith MPEG-7 MDS COR/1 WD v2.0    

         MPEG-21 USNB Contributions (12h30 - 13h00) with Requirements 

Plenary Room (Requirements) MPEG-

21  

10560 A. G. Tescher for USNBUSNB Contribution: Demographic Information    

10561 A. G. Tescher for USNBUSNB Contribution: MPEG-21 Media Locators    

                  Wednesday Afternoon (14h00-17h30)                MPEG-21 DIP BoG (14h00 - 15h30) 

Z947 (MDS BoG Room) MPEG-

21           MPEG-21 Event Reporting (14h30 - 15h30)  Z995 (MDS Room) MPEG-

21           

MPEG-21 Location Schemes (15h30 - 16h30)  Z995 (MDS Room) MPEG-

21  

10469

Myriam Amielh, Gerrard Drury, Sylvain Devillers, Yongju Cho , Craig Brown AHG on MPEG 21 Media Locators    

10605Myriam Amielh, On behalf of the AhG for MPEG-21 Medialocs

Suggested updates to the definitions of a DID fragment in DID v.2    

10503 Alan K. Melby, John R SmithProposal for logical media locator for MPEG 7&21    

10561 A. G. Tescher for USNBUSNB Contribution: MPEG-21 Media Locators    

10747 Adam LindsayAn alternative non-amendment approach to track numbers for MAF    

         MPEG-21 DID 2nd Edition (16h30 - 17h00)   Z995 (MDS Room) MPEG-

21  

10611Frederik De Keukelaere, Jeroen Bekaert, Rik Van de Walle

Comments on ISO/IEC 21000-2 DID 2nd Ed WD v.2    

10616Marc Gauvin, Melanie Dulong de Rosnay

The Notion of Underlying Work within MPEG 21    

         MPEG-21 File Format (17h00 - 18h00) with Systems 

N1090 (Systems Room) MPEG-

21  91

         Plenary MDS and Reports of BoG (18h00 - 18h30)  Z995 (MDS Room) MDS Plenary

         MPEG Social Event (18h30 - midnight)              Thursday Morning (09h00-12h30)                MPEG-21 BoG on DIA Conversion Description Framework (09h00 - 10h00) 

Z947 (MDS BoG Room) MPEG-

21           MPEG-21 DIP BoG (10h00 - 13h00) 

Z947 (MDS BoG Room) MPEG-

21           MPEG-21 ER BoG (09h00 - 13h00) 

1601 (MDS BoG Room) MPEG-

21           

MPEG-7 Extensions (09h00 - 10h00)  Z995 (MDS Room) MPEG-7  

10714 Holger Crysandt(Lossy) DescriptorModel compression    

10528 SC 29 SecretariatSummary of Voting on ISO/IEC 15938-5/PDAM 2 [SC 29 N 5835]    

10727 Korea National Body (KNB)KNB comment on 15938-5 PDAM2 : ContentCS extension    

10503 Alan K. Melby, John R SmithProposal for logical media locator for MPEG 7&21    

10560 A. G. Tescher for USNBUSNB Contribution: Demographic Information    

         MPEG-7 MDS Liaison Matters (10h00 - 10h30)  Z995 (MDS Room) MPEG-

21  

10501 TVA via SC 29 SecretariatLiaison Statement from the TV-Anytime Forum [SC 29 N 5789]    

         MPEG-7 Schema Definition (10h30 - 11h00)  Z995 (MDS Room) MPEG-

21  

10507 SC 29 SecretariatSummary of Voting on ISO/IEC CD 15938-10 [SC 29 N 5911]    

10499 CieplinskiUK NB comments on Text of ISO/IEC CD 15938-10    

         MPEG-21 Event Reporting (11h00 - 12h00)  Z995 (MDS Room) MPEG-

21           Thursday Afternoon (14h00-19h00)                MPEG-21 DIP BoG (14h00 - Z947 (MDS BoG MPEG-

21 

92

16h00)  Room)         MPEG-21 ER BoG (14h00 - 16h00) 

1601 (MDS BoG Room) MPEG-

21           

MPEG-21 DID/DII/DIA/DIP Ref. SW with Integration (15h00 - 16h00) 

N1090 (Systems Room) MPEG-

21  

10609Frederik De Keukelaere, Rik Van de Walle

Contribution to DID 2nd Edition reference software    

10610Frederik De Keukelaere, Rik Van de Walle

Contribution to DII reference software    

10584Michael Ransburg, Christian Timmerer, Hermann Hellwagner

Status Report and Improvements of the MPEG-21 DIA Reference Software    

10739Jeho Nam, Hyuk-Min Kwon, Man-Bae Kim, Jin-Woo Hong

Examples of Java Native Interface (JNI) for MPEG-21 DIA Reference SW    

10474Gerrard Drury, Frederik De Keukelaere, Munchurl Kim

AHG on MPEG-21 DIP Reference Software    

         Plenary MDS and Reports of BoG (16h00 - 17h00)  Z995 (MDS Room) MDS PlenaryReview of Output documents, AHGs, CEs, DoC, Std (17h00- 18h00)  Z995 (MDS Room)             Friday Morning (09h00-13h00)       Wrapping up (09h00 - 13h00)  Z995 (MDS Room) MDS Plenary

 

Approval of resolutions, AHGs and Output documents      

         Friday Afternoon (14h00-21h00)       MPEG Plenary  Plenary room MPEG Plenary

93

Annex 8Report of Video meeting

Source: Jens-Rainer Ohm, Miroslaw Bober

MPEG-4

Corrigendum MPEG-4 Visual Third Edition (14496-2:2004) has been proofread by editors and is now in publication process. COR1 of this edition (N6362+ N6361 DoC) has been finalized in the 68th

meeting. By request of NBs in the DCOR ballot, the final text is based on the Study of DCOR (N6163 of 67th meeting), as well as additional comments received by US and Japan NBs.

Documents reviewed: 10505 Summary of Voting on ISO/IEC TR

14496-7:2002/Amd.1/DCOR 1 [SC 29 N 5909] SC 29 Secretariat

New Versions of MPEG-4 Visual List of Problems Reported Version 12 of the document "MPEG-4 Visual List of Problems Reported" (N6363) was issued. This contains some minor issues related to text part (14496-2:2004) which in general are of low priority, to be resolved in a later corrigendum. The LPR contains a detailed report on software bug fixing. All known bugs from the MS part of the software are fixed at this time, and the new package is in the process of being published within Amendment 5 of 14496-5:2001. Some problems with the Momusys package remain, but are planned to become fixed in the near future. All problem reports related to Conformance streams have been removed from the document and were considered in the Working Draft of a Conformance Corrigendum (see 1.3).

Documents reviewed:

10517 MPEG-4 Visual: List of Problems Reported, v.11.1

Yi-Shin TungChung-Neng WangTihao ChiangJens-Rainer Ohm

Conformance Corrigendum WD

Fixing of Conformance streams being listed as erroneous in the previous List of Problems Reported is at a very early stage. The Video Subgroup presently has not sufficient resources to maintain the conformance streams; more input and expertise is required by the previous contributors of these streams. A first effort in this direction was made by three companies who provided input documents related to fixed conformance streams, and propose to produce a Corrigendum. As only a small percentage of streams that are known to be erroneous were provide, the video subgroup decided to produce a WD for this corrigendum (N6364), which will be updated in the following meetings when more streams will be made available. This corrigendum also includes a number of typo correction, where the names of existing (correct) streams deviate from the names by which they are described in 14496-4. The procedure of this corrigendum is presently planned is as follows:

– A request is made to NIST to provide a CVS repository for all Visual conformance streams, and all bitstreams which are becoming corrected will be collected at this site;

– The DCOR will be issued October 2004;– All bitstreams that are not received until then will be removed from conformance part

(14496-4);94

– This implies a follow-up action where the related profiles and levels could be removed from the standard (14496-2).

Documents reviewed: 10599 Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd

Edition Takeshi Nakamura

10634 Proposed Corrigendum to ISO/IEC 14496-4:200X Etsuko Sugimoto

10650 Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition

Takuyo KogureCS Lim Toshiya Takahashi Taka Senoh

Optimised Reference Software The second edition of 14496-7 (Optimised Reference Software) was provided as input document, reviewed and approved. This integrates the original PDTR text, Amendment 1 and Corrigendum 1 of Amendment 1 into one single document.

Documents reviewed:10505 Summary of Voting on ISO/IEC TR

14496-7:2002/Amd.1/DCOR 1 [SC 29 N 5909] SC 29 Secretariat

10723 Text of DTR 14496-7 Second Edition

Chung-Neng Wang Tihao ChiangHuifang Sun

AVC

In Munich, a JVT meeting took place in parallel with the Video Subgroup. Main topics in MPEG-4 part 10 (AVC) were related to the professional extensions amendment (Study text of FPDAM in N6360) and the finalization of Corrigendum 1 (N6358 with DoC N6357). To simplify the processing of documents and readability of standards, the Corrigendum will not be published, but integrated right away into a new edition of 14496-10 (N6359). The video subgroup recommended approval of all the related documents by MPEG.

Documents reviewed:10551 Summary of Voting on ISO/IEC 14496-10/DCOR 1 SC 29 Secretariat10562 USNB Contribution: 14-bit sample depth support A. G. Tescher for USNB10608 SgNB Comment on AVC Fidelity Range Extension Singapore National Body10671 JNB Comment on MPEG-4 AVC Fidelity Range Extension JNB

10742 CANNB Comment on MPEG-4 AVC Fidelity Range Extension CANNB

Output documents related to MPEG-4

No. Title TBP Available

14496-2 MPEG-4 VisualN6361 Disposition of Comments on ISO/IEC 14496-2:2004 DCOR 1 N 04/03/19N6362 Text of ISO/IEC 14496-2:2004 COR 1 N 04/03/19N6363 MPEG-4 Visual: List of Problems Reported version 12.0 Y 04/03/19

14496-4 MPEG-4 ConformanceN6364 WD 1.0 of 14496-4 Visual Bitstreams Conformance Corrigendum Y 04/04/16

14496-10 Advanced Video Coding

95

N6357 Disposition of Comments on ISO/IEC 14496-10:2003/DCOR 1 Y 04/04/10N6358 Text of ISO/IEC 14496-10:2003/COR 1 N 04/04/10N6359 Text of ISO/IEC 14496-10:2004 (second edition) N 04/04/10N6360 Study of FPDAM text for AVC Professional Extension

Amendment Y 04/05/01

MPEG-7

MPEG-7 related work in Munich

The MPEG-7 breakout group was active during the whole week. Input documents as reviewed are listed in the subsequent table.

10498 UK NB comments on Text of ISO/IEC 15938-8/PDAM1 Cieplinski

10514 Summary of Voting on ISO/IEC TR 15938-8/PDAM 1 [SC 29 N 5820] SC 29 Secretariat

10532 Release of Perceptual 3D Shape (P3DS) XM software

Hui ZhangDuck Hoon KimIn Kyu Park

10566 Experimental results for a Search & Retrieval System using MPEG-7 still image descriptors

IST-SCHEMAVasileios MezarisYiannis KompatsiarisStephan HerrmannJosep Casas

10595 MPEG-7 Visual XM Document version 19.1 Akio Yamada Sang-Kyun Kim

10596 Second Editor's Study on ISO/IEC TR 15938-8/PDAM1 Akio Yamada Sang-Kyun Kim

10597 Report on progress of VCE-1 Akio Yamada10639 Introduction report: The emerge of MS Longhorn Sang-Kyun Kim

10640 Initial report on Visual tools and DS for images or photos libraries (VCE-1) Sang-Kyun Kim

10657 Comparative study for 3D and 2D/3D Shape Descriptors Titus ZahariaFrancoise Preteux

10708Suggestions on experimental methodology in CE on Visual tools and DS for images or photos libraries (VCE-1).

Rob O’Callaghan,

Miroslaw Bober

New interesting applications of MPEG-7 were reported in M10567. It describes retrieval of car components based on 3D shape descriptors. Full demo will be shown during the forthcoming MPEG meeting.

M10566 describes strategy on combination and joint use of MPEG-7 descriptors.

A request for New Visual Extensions (Amd.2 of 15938-3) was made (N6366). A WD was produced (N6367). This presently includes the new 3D shape descriptor which previously was adopted for XM. In addition to other low-level descriptor elements as required e.g. for photo libraries, Amd.2 will most probably contain higher-level (e.g. semantics of scenes) Visual description tools. Optionally, a Call for such technology could be issued in the future. A new Version (20.0) of MPEG-7 Visual XM was edited (N6368).

96

The text of DAM1 for 15938-8 (Extraction and Usage of MPEG-7 Visual Descriptors Extensions, N6371+N6370 DoC) was issued. The Study of PDAM (N6191 of Waikoloa) was adopted by NB request.

Core Experiments will be continued for further testing of new Visual extensions (N6369).

Joint meeting on Multimedia Application Formats was held with Requirements, Systems, Audio and MDS. Systems group responded positively to video request to modify the ISO file-format in order to support non-timed metadata with small overhead.

Output documents related to MPEG-7

No. Title TBP Available

15938-3 MPEG-7 VisualN6366 Request for 15938-3 Amd.2 (New Visual Extensions) N 04/03/19N6367 WD 1.0 of MPEG-7 New Visual Extensions N 04/04/02N6368 MPEG-7 Visual XM Document version 20.0 N 04/03/19

N6369 Description of Core Experiments for MPEG-7 Visual Extensions

N 04/03/19

15938-8 Extraction and Use of MPEG-7 DescriptionsN6370 Disposition of Comments on ISO/IEC TR 15938-8/PDAM1 N 04/04/09N6371 Text of ISO/IEC TR 15938-8/DAM1 N 04/04/09

MPEG-21

Scalable Video CodingFollowing the CfP on Scalable Video Coding, a total number of 14 full proposals (complete algorithms submitted for subjective testing) and additional 7 tools proposals have officially been received by the deadline. In addition, 5 technical contributions had been submitted as regular MPEG input documents, which mostly described standalone tools (10524, 10535), additional tools for algorithms submitted (10706, 10712) or concepts for complete algorithms with preliminary results (M10723). A thorough technical analysis was done on all the submissions. The most important properties of the algorithm submissions can be highlighted as follows:S01 (Polytech Milano&TILAB)In-band method with MCTF (overcomplete DWT), MC based on 16x16 blocks, same vector for all wavelet bands. ME is performed within subbands, where e.g. horizontal displacement estimator uses HL, vertical displacement estimator uses LH etc., full search of LL band first to avoid local minima. Hierarchical MC by spatial subdivision and subband subdivision. Scalable coding of motion vectors is also implemented (tree based method related to the different subdivision splittings)S03 (HHI)AVC with MCTF (open loop), deblocking filter only at decoder side (deblocking at analysis affected performance), multi-reference pictures, direct mode slightly modified; residual prediction coding using multiple transforms at encoder (could be avoided). SNR scalability levels are at QP+6 points (half/double quantizer step sizes). Spatial scalability by classical difference pyramid approach, using the AVC interpolation filter. Performance of non-scalable MCTF (with optimization for a certain rate point) usually better than AVC. Prediction of low temporal subbands is used.S05 (Microsoft I: subband)

97

"Barbell lifting", 5/3 filters without specific block structure, barbell function can be integer, interpolation, OBMC …, "energy distributed update" for best reconstruction by inverse motion, different prediction modes, adaptive block size similar to AVC. Multiple motion layers for scalable motion representation. Uses 3D EBCOT, RD optimized bit allocation. SNR scalability by bitplane coding.S06 (Microsoft II: PFGS)AVC as base layer, options are enhancement prediction modes from base layer only, from enhancement layer only or average of both. Enhancement layer prediction can potentially introduce drift. Joint ME for base and enhancement layers, use ABT and CABAC. TS can use either base or enhancement as reference (no drift). SS also uses enhancement-layer prediction. Uses an older version of AVC. At low rates same performance as AVC, deteriorates towards higher rates. Low coding delay.S07 (NCTU I: RFGS)Base layer is AVC compatible, enhancement layer scalable, wavelet transform of residual is used for spatial scalability. Leak and bitplane selection are used for minimization of drift problem. An additional low-rate AVC stream is simulcasted to correct the drift at each 4 th frame, this also saves motion vector rate. Both streams are decoded and results added (i.e. 2 AVC decoders are needed). Low coding delay. Useful tools are (also in context of wavelet coding) the intra coding with boundary mirror and the CABAC bitplane coding.S08 (NCTU II: Wavelet)Based on MCTF with Haar filters, but uses the interframe prediction of AVC and CABAC encoding of motion vectors and modes; signaling of connected/unconnected blocks additionally, not only derived from the MVF. Scalable motion representation 1 pel, ½ pel, ¼ pel, and simultaneously refinement of block sizes 16, 8, 4. S09 (NEC)Uses conventional low-pass filter for downsampling, MCTF/EZBC separately at each layer, but skip the spatial lowpass information at the higher spatial resolution; drift compensation applied in the reconstruction of this lowpass signal for higher resolutions from lower resolutions. Finer quantization of low-resolution signal is needed for the higher resolution reconstructions. Estimation and encoding of motion vectors separately for all three layers.S11 (ITRI)Based on MC-EZBC, uses AVC-like intra prediction in the encoding of lowest temporal/spatial subband; saves in average 12% of rate for this part of information. Total bit rate saving is not too high.S13 (Poznan)Classical spatial scalability with interpolation-based prediction from lower layers, independent motion estimation in the layers, encoding of motion vectors in enhancement layer can use base-layer motion vectors. Edge-adaptive interpolation is used. Uses AVC syntax, but in some cases modified semantics for the enhancement layer coders. FGS is introduced by macroblock skipping. This introduces drift, but this is bounded by cyclic introduction of frames which are only predicted from base layer.S15 (RPI)MCTF with color-based ME, directional prediction for I-Blocks, OBMC, P-Block and reverse in addition to connected mode. Scalable motion vectors with motion vector encoding done by CABAC (investigation of contexts). Scalability in accuracy (up to 1/8 pixel)S16 (RWTH Aachen)MCTF with optional 1 level of spatial subband in advance. 5/3 filters with adaptation, quantizers are also adapted according to the switching. RD optimized motion estimation. Motion representation like HVSBM starting from 64x64, encoding by median prediction and CABAC. Proposal does not provide multiple adaptations, is a kind of "scalable simulcast", where the different spatial resolutions are simulcasted.S17 (Samsung)

98

STAR is MCTF with only prediction step, multiple reference frames, allows low delay mode as no update step is used. Closed-loop approach to reduce encoder/decoder mismatch. Low-band correction, which allows to use scalable motion information. Scheme is capable for low delay with loss of less than 1 dB.S18 (Thomson)MCTF using 2 filter types (pixel level, block level), different modes (forward, backward, bidirectional, intra), motion accuracy scalable (up to 1/8 pel for higher rates), slightly higher cost at high rates, but saving approx. 25% at low (QCIF resolution) rates. Coder based on JPEG2000. Switching between different temporal filters (Haar,5/3,truncated 5/3). Cluster proposals around requirements, as delay, multiple adaptations,Proposals for CE: Mode switching, delay, ER, scalable motion, scalable entropy codingS20 (Visiowave)Spatial transform before temporal transform, integer implementation (5/3 spatial wavelet). Uses an UMCTF-like scheme (4 temporal dyadic scalability levels) without update. Uses different GOP sizes for different spatial resolution levels. Motion field is spatially scalable. Could be used in closed loop, compatibility with JPEG2000 "keyframes". Low-delay configuration, no update step.

A first clustering of the full algorithm proposals was then made into the following categories: A: AVC based proposals (S03 including AVC+MCTF): S03, S06, S13 B: "t+2d": MCTF ® 2D Wavelet: S05, S08, S11, S15, S17, S18 C: "2D+t": 2D Wavelet ® MCTF: S01, S09, S20 D: Scalable Simulcast (of different spatial resolutions): S07, S16It must be noted however, that the boundaries of these categories cannot be drawn sharply, i.e. some proposals might even fit into different categories. The possibility of performing multiple adaptations of scalable streams (high-to-medium-to-low rates) was considered important to judge the results, such that the simulcast solutions were not fully taken into consideration, Exact weighting in trade-off with other specific requirements (e.g. low delay) was considered very difficult, as it requires a more detailed analysis of different operating modes, which can only be done in Core Experiments. Furthermore, it was emphasized that more background is necessary on detailed requirements of application cases to judge the pros and cons of different approaches on a more profound basis.

Formal subjective tests had been performed around two different test scenarios: Test 1: 3 layers of spatial resolution, wider range of bit rate scalability; Test 2: 2 layers of spatial resolution, less wide range of bit rate scalability.Not all proposals had participated in both test scenarios, and this was not mandatory from the CfP conditions. The analysis of test results, which was performed jointly with the Test subgroup, can be summarized as follows: For both test scenarios, scalable coders exist which are close in decoded quality to the single-

layer anchors. The best proposals are within a range of <0.5 MOS deviation from the anchors in average. It should be noted that some scalable approaches performed superior to the single layer anchor at some rate points.

Depending on technology, the best operating range is rate dependent.

A more simplified grouping of proposals was then done into only 2 categories: Category 1: MCTF/2D Wavelet methods, in particular the t+2d (MCTF before spatial

wavelet) methods: These showed best performance in Test 1, and performed reasonably good in Test 2.

Category 2: AVC based, in particular on proposal combining AVC+MCTF with a conventional base-layer upsampling: This showed best performance in Test 2, but did not participate Test 1.

99

The results show clear evidence that technology exists which can be used as starting point of SVC standardization, but can be clearly expected to further improve in the process of Core Experiments. In particular, motion-compensated temporal filtering (MCTF) is a common basis used in many (in particular the best-performing) proposals. MCTF establishes a framework beyond the traditional MC prediction techniques of previous standards, which can in fact be seen as a generalization including the traditional MC prediction closed loop, Progressive FGS (closed/open loop combinations) and lifting (prediction/update) based MCTF (fully open loop). Therefore, a first version of the Scalable Video Model (SVM) was drafted (N6372), which is built around this generic MCTF framework. It was decided to test the other elements around this common basis in Core Experiments.A set of Core Experiments (see N6373) was designed for optimization and convergence of different proposals within the two categories listed above. As starting points, the best performing proposals in each category were selected. Core Experiments will be based on two software implementations (one per category). The result of Core Experiments will be used in the July meeting for the decision to adopt one complete codec architecture into the WD 1.0. While a high degree of commonality can be observed about the approaches to achieve efficient temporal and SNR scalability, the best method for the goal of spatial scalability is still open, This will have a high impact on the adoption of the spatial transform for the WD, which could in fact either be a 2D wavelet transform or a block-based transform.Common conditions for the CE were derived from the CfP rate/resolution points. Test 1 (3 layers of spatial scalability) was adopted similarly, but reduced to only 6 different rate points, which appears reasonable as the subjective quality was practically transparent at the 6 Mbit/s, while the lowest rate point in some cases of sequences was even hard to decode by sufficient quality for the single-layer anchor. For Test 2 (2 layers of spatial scalability) test conditions remained unchanged. A methodology was defined jointly with the test group to evaluate selected CE results by expert viewing tests in future meetings. In addition, one CE (CE 3) was defined to explore methodologies which would allow to use objective criteria e.g. based on PSNR at least for optimization of single tools within one scalable algorithm.

The following Core Experiments were defined:a) CE 1 (MCTF+2DWT =category 1) 1a: Scalable Motion Information 1b: Spatial Transform & Entropy Coding 1c: Intra Modes 1d: Introduction of a base layer 1e: MCTF with de-blockingb) CE 2 (AVC based/extended =category 2) 2a: Combination of MCTF and MC Prediction 2b: Inter-layer prediction modes and upsampling 2c: Comparison of SNR scalability technologies 2d: Dynamic spatial transformsIt is within the mandate of the SVC CE Adhoc group to refine the definitions and conditions of CEs within 3 weeks after the meeting.

With A joint meeting was held with the Systems subgroup to review two input documents (M10591, 10592) which proposed to implement Layered Video Coding at the Systems layer of existing MPEG standards, which could e.g. combine decoder outputs from one or two different video coding standards in a traditional layered (base layer upsampling + enhancement difference) approach. This method would however fully be accomodated by the SVM framework (and is a simple case of it). Clearly, it is technically feasible, however the efficiency in terms of compression performance, and the evidence about market needs are not clear. There is no need for any urgent action.

100

A joint meeting was also held with JVT on the different aspects of SVC. This is rather important as certain tendencies of convergence between AVC and SVC can be observed. Single-layer AVC could be very important for usage as base layer in SVC applications, which seems possible in both categories, and is also part of the CE explorations. SVC proposals from category 1 have used some tools (e.g. motion vector encoding, CABAC) from AVC. SVC proposals from category 2 are merely extensions from AVC. The MCTF framework could well be implemented as an extension (though not minor) from AVC motion compensation tools, or also as an evolution or superset of more traditional MC approaches, which have found their most advanced development so far in AVC. Therefore, the MCTF framework seems to be of high interest for both groups. Results of the CfP have shown that MCTF can even increase compression efficiency as compared to single layer coding, but still performs competitive when operated scalable due to the open loop concepts. It is the common opinion of both groups that it is necessary to make the best use of existing technology and avoid divergence of standards.Documents reviewed:

a) CfPM10569 Registered Responses to the CfP on Scalable Video Coding Jens-Rainer Ohm/S01 Fast In-band MCTF with Scalable Motion Vectors Stefano Tubaro, Giovanni Cordara

/S02 Interframe Wavelet Coding with Frame Adaptive Spatial Wavelet Transform

Wonha Kim, Seyoon Jeong, Kyuheon Kim, Jinwoong Kim

/S03 Scalable Extension of H.264/AVC Heiko Schwarz, Detlev Marpe, Thomas Wiegand

/S04 JVT Compliant Adaptive 3-D FGS (JCAF) Scalable Video Coding Hayder Radha, Kiran Misra

/S05 3D Sub-band Video Coding using Barbell liftingJizheng Xu, Ruiqin Xiong, Bo Feng, Gary Sullivan, Ming-Chieh Lee, Feng Wu, Shipeng Li

/S06 Progressive Fine Granularity Scalable (PFGS) video codingXiaoyan Sun, You Zhou, Yi Wang, Gary Sullivan, Ming-Chieh Lee, Feng Wu, Shipeng Li

/S07 A Robust Scalable Video Coding TechniqueHsiang-Chun Huang, Wen-Hsiao Peng, Yao-Chung Lin, Chung-Neng Wang, Tihao Chiang, Hsueh-Ming Hang

/S08 A Scalable Video Coding Scheme Based on Interframe Wavelet Technique

Chia-Yang Tsai, Han-Kuang Hsu,Hsueh-Ming Hang, Tihao Chiang

/S09 Multi-Resolution Motion-Compensated Temporal Filtering for 3-D Wavelet Coding

Takahiro Kimoto, Yoshihiro Miyamoto

/S11 A Scalable Video Coding Technology With Intra Prediction Hsin-Hao Chen, Guo-Zua Wu, Yi-Jung Wang

/S13(M10626) Scalable AVC Codec

Łukasz Błaszak, Marek Domański, Rafał Lange, Adam Łuczak

/S14 A method for upsampling, compression and decompression of image and video data

Yotam Toib, Ran Boneh, Ahik Man

/S15 MC-EZBC scalable video coder Yongjun Wu, Abhijeet Golwelkar, John W. Woods

/S16 RWTH Proposal for Scalable Video Coding Technology Mathias Wien, Thomas Rusert, Konstantin Hanke

/S17 Responses of Call-for-Proposal for Scalable Video Coding Woo-Jin Han

/S18(M10534)

Fully scalable video coding based on 2D+t wavelet technology

J.Vieron, E. François, V. Bottreau, C.Guillemot, G.Marquant, G.Boisson

/S20 Low Latency Video Codec Using Inband Prediction and Block Arithemetic

Guillaume Baud, Martin Duvanel, Julien Reichel, Francesco Ziliani

/S21(M10589)

Response to Call for Proposals on Scalable Video Coding Technology

Yiannis Andreopoulos, Fabio Verdicchio, Joeri Barbarien, Adrian

101

Munteanu, Mihaela Van der Schaar, Peter Schelkens

/S22(M10537)

Motion-compensated scalable subband video codec with optimized temporal prediction and update operators

Béatrice Pesquet-Popescu, Gregoire Pau

/S23(M10538) Motion-compensated triadic temporal scalable codec Béatrice Pesquet-Popescu,

Christophe Tillier

/S24(M10724)

A spatial decomposition tool for improved spatial resolution scalability in video coding

Charith Abhayaratne, Nikola Sprljan, Marta Mrak, Ebroul Izquierdo

M10737 Subjective test results for the CfP on Scalable Video Coding Technology

Vittorio Baroncini, Tobias Oelbaum

b) Technical input10524 Inter-block shuffling FGS Doug Young Suh

Seung Ho Park

10535 Curved Wavelet Coding for Scalable Video CodingDemin WangLiang ZhangAndre Vincent

10706 Spatial Highpass Transition Filtering for Interframe Wavelet Video Coding Hanke

10712 Layered Motion Vector Coding for Improved Spatial Scalability in Interframe Wavelet Video Coding Thomas Rusert

10723 Scalable video coder with AVC-like properties Yiliang Bao, Marta Karczewiczc) Systems related10591 Rational for heterogeneous layered video support in MPEG-

2 Systems (as in M10359)Fons Bruls Jan van der Meer

10592 Proposal for MPEG-2 System amendment to support heterogeneous layered video

Jan van der Meer Fons Bruls

Output documents related to MPEG-21 SVC

No. Title TBP Available

21000-13 Scalable Video CodingN6372 Scalable Video Model Version 1.0 N 04/03/19

N6373 Description of Core Experiments in MPEG-21 Scalable Video Coding

N 04/03/19

N6383 Subjective test results for the CfP on Scalable Video Coding Technology

Y 04/03/19

Explorations

3D AV Coding

The main activities in the 3D AV exploration by the beginning of the week were to review progress achieved in the Exploration Experiments (EE), and to summarize the responses received on the Call for Comments (CfC) on 3D AV.

For EE1 (omni-directional video), it was proven that fast local decoding (for random access determined by viewpoint request) is possible using tools from existing standards. A method of "B-maps" was further investigated which provides another moderate reduction in bitrate for the random access functionality. It is however consensus in the group that it is not worthwhile presently to take any action in additional standardization for this aspect, as the existing tools are sufficient.

102

For EE2 (free viewpoint adaptation), 3 new sets of test material for "3D-TV" and "cave navigation" scenarios have been made available by participants. New exploration results are reported related to the reconstruction quality achievable by disparity-based view interpolation with and without

residual encoding (starts from 200 bits/frame); Switching between inter-view and inter-frame prediction (gain of up to 2 dB over simulcast); Spherical ray space coding; Average Coding from multiple views.

23 responses were received on the CfC and analysed in detail. The high number of responses shows the strong support and industry demand for Free Viewpoint Video as investigated in this exploration. Many responses support the scenarios as described in the existing Applications and Requirements document. Some responses give more concrete application examples that may be planned for future products. Some responses also requests to start a more concrete standardization effort. Relevant application scenarios were identified from the responses which could be used for technology evaluation in a possible future CfP a) 3D TV: Cameras are arranged in an array (e.g. 2x8). View adaptation is done by user interaction or used for presentation on multiview (e.g. autostereoscopic) displays. In this application domain, the main problem is an efficient multiview compression as compared to simulcastb) Interactive view selection: Cameras are distributed around a moving object or a larger scene (e.g. around a sports stadium), and the user is allowed to navigate by selecting preferred viewing position. In both cases, the main issue related to the work of the video group is the efficiency of multiview video representation, which however must not necessarily mean pixel-true representation, but could also include high-quality synthesis of views.

In the context of EE1 and the former EE4, it was found that many functionalities of 3DAV can already be achieved using existing standards tools by proper combination. Concrete cases will be studied by the AHG with potential option to define a Multimedia Application Format, following the requirements of Omnidirectional Video.Results from EE2 are not conclusive yet about the maturity of 3DAV technology that might require new tools standardization. This is partially due to the fact that test material that was used earlier (until the Munich meeting) did not cover sufficient realistic application cases. To go one step further in investigating the maturity of 3DAV technology, an MPEG-internal "Draft Call for Evidence" (N6374) is issued instead of re-defining EE2. The expected outcome of this Call is further clarification of maturity of existing solutions and exploration/refinement of testing conditions for a possible follow-up CfP. It was decided that only compression performance of multiview data representations can be evaluated at the moment. The rendering process must be excluded, as this might bias the results or put certain technical solutions in disadvantage. Therefore, technical proposals for exploitation of interframe/inter-view redundancies and compact representation of multiview video data will be compared against simulcast at same data rates. The simulcast anchors will be encoded by AVC, and the comparison in July will be made using a similar expert viewing procedure as described above in the context of the SVC Core Experiments.Documents reviewed:a) Responses to CfC

10510 Comments to MPEG 3DAV activities Ryoichi Kawada10513 Response to 3DAV CfC George Chen10515 Comments to MPEG 3DAV activities Ken-ichiro Yamamoto10520 Comments to MPEG on 3DAV activities Ali Tabatabai10522 Comments to MPEG 3DAV activities Hideyuki Kanayama10553 Comments to MPEG 3DAV activities Morimura

103

10565 Comments to MPEG on 3DAV activities Okui10598 Comments on MPEG 3D-AV Standardization Activities Akio Yamada

10600 In Response to ”Call for Comments on 3DAV”Toshio MikiTsutomu HorikoshiC.S. Boon

10604 Comments to MPEG on 3DAV activitiesTomokazu MurakamiMasahiro KageyamaYo-ichi Horii

10623 Response to the Call for Comments on 3DAVHanspeter Pfister Anthony Vetro Huifang Sun

10631 A response to the call for comments on 3DAVWook-Joong KimEuee. S. Janget al.

10649 JNB comments on MPEG 3DAV10651 Comments to MPEG 3DAV activities

10658 Response to the Call for Comments on 3DAV Akira MorishitaYuzo Hirayama

10666 Response to the Call for Comments on 3DAV Marco Rittermann

10669 Response to the Call for Comments on 3DAV

Andreas DanteleMarco RittermannChristian Weigel

10673 Response on Call for Comments on 3DAV10677 Response to the Call for Comments on 3DAV Kohtaro Asai 10667 Proposal of Application Format for Omni-directional Video Kazumasa Yamazawa

b) Technical input10511 ST dataset for 3DAV EE2 George Chen10512 Using inter-view prediction for multi-view video compression George Chen10533 KDDI multiview video sequences for MPEG 3DAV use Ryoichi Kawada

10581 Average Coding of Free-viewpoint Video in MPEG-4

Michael WaschbueschStephan WuermlinEdouard LamborayMarkus GrossHanspeter Pfister

10594 Panoramic Video Coding Results

Sung Won ParkJong Woo WonSun young LeeYong Ho ChoEuee S.JangWook Joong Kim

10624 3D TV SystemHanspeter Pfister Anthony Vetro Huifang Sun

10632 B-map method for the partial decoding and rendering of panoramic video

Wook-Joong KimEuee. S. Janget al.

10636 Multi-Video Compression in Texture SpaceGernot Ziegler Hendrik Lensch Marcus Magnor

10652 Preliminary results on inter-view coding for the dense Ray Space representation (3DAV EE2.2.1)

10668 Comparison of Temporal and Spatial Predictions for Dynamic Ray-Space Coding

Masayuki TanimotoToshiaki Fujii

10670 Data Compression and Interpolation of Spherical Ray-Space Masayuki TanimotoToshiaki Fujii

10674 Demonstration of a MPEG-4 Compliant System for Omni-directional Video

Aljoscha SmolicSebastian HeymannKarsten MuellerYong Guo

10676 Results for EE2 on Model Reconstruction Free Viewpoint Video

Aljoscha SmolicKarsten Mueller

104

Philipp MerkleTobias ReinPeter EisertThomas Wiegand

Video Coding Tools Repository

A new explorational investigation on a possible definition of a Video Coding Tools Repository (VCTR) was started in a breakout group which held two meetings during the week. The background of this activity is as follows: The landscape of media coding usage has changed a lot for the last two decades The traditional One tool=One functionality rule may not always apply, and in fact does not

even exist across different MPEG standards, where newer standards may re-define tools from older standards

MPEG Video Standards are in competition with non-MPEG standards Similar building blocks are used over different standards, even though with (sometimes)

significant differences Building blocks from different standards could be combined

The following definition of the repository was made by the breakout group: The repository is a collection of decoding functional units extracted from existing MPEG

standards and updated with new tools whose addition has been considered beneficial by MPEG

The collection materializes in textual description of different functional units, reference software (and possibly hardware description), and conformance testing tools

The repository could be used by adding new functional units or extend the functionalities of the existing functional units to

create new profiles of existing standards or new standards; creating combinations of old/new functional units; implementers can integrate multiple decoders; upgrading video decoding capabilities; creating multimedia middleware components. The definition of a functional unit is not the same as tool from existing standard and in most cases is probably more granular. Definition of glue elements may be needed to fit different functional units together. Study of typical functional units was started (e.g. DCT/IDCT, MC, DC/AC prediction). However, even at this level, divergent definitions in different standards can be found, which might make it difficult to achieve a common definition. Much more detail can be found in Study of Video Coding Tools Repository (N6375)Breaking existing standards into pieces that would allow their usage for this purpose might require major re-definitions. This is due to the fact that previous standards definitions such as MPEG-2 and MPEG-4, though formally based of tools, are syntactically similar to structured programming in C syntax instead of taking a clean object-based approach. It was further discussed that intra-only Video Coding could be an interesting example of the Video Coding Tools Repository usage. In previous meetings, interest from industry had been shown to combine intra tools from MPEG standards within standalone profile(s). Furthermore, for intra coding tools, no complicated inter-relationships with prediction loop exists, such that intra coding tools could relatively easy be isolated in terms of syntax, semantics and decoding processes. The technical feasibility of intra-only coding shall therefore further be studied within the work of the AHG on the repository.

Output documents related to Explorations

105

No. Title TBP Available

3D AVN6374 Draft Call for Evidence on Multiple View Video

CodingN 04/03/19

Video Coding Tools RepositoryN6375 Study of Video Coding Tools Repository N 04/03/19

AHGs established by the Video Subgroup No. Title Mtg6376

AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance N

6377

AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software N

6378 AHG on Description Tools for New MPEG-7 Visual Extensions Y

6379 AHG on Core Experiments in Scalable Video Coding Y

6380 AHG on 3DAV Coding Y

6381 AHG on Video Coding Tools Repository Y

106

Annex 9Report of Audio meeting

Source: S. Quackenbush, Chair, Audio Subgroup

1 OPENING OF THE MEETING..........................................................................................................3

2 ADMINISTRATIVE MATTERS.........................................................................................................3

2.1 Approval of previous meeting report........................................................................................................ 3

2.2 Approval of agenda and allocation of contributions................................................................................3

2.3 Communications from the Chair.............................................................................................................. 3

2.4 Joint meetings............................................................................................................................................ 3

2.5 Received National Body Comments and Liaison matters........................................................................3

2.6 Task Groups.............................................................................................................................................. 3

3 RECORD OF AHG MEETINGS........................................................................................................3

3.1 MPEG-4 Extension 2, Parametric Audio Coding (Sunday 0900-1030)....................................................4

3.2 Audio Exploration (Sunday 1030-1300)....................................................................................................4

3.3 Lossless Audio Coding (Sunday 1400-1700)..............................................................................................53.3.1 SLS..................................................................................................................................................... 5

4 RECORD OF AUDIO PLENARY, JOINT MEETINGS AND TASK GROUP ACTIVITIES..................6

4.1 Review of AHG reports............................................................................................................................. 6

4.2 Received national body comments and liaison matters............................................................................6

4.3 Audio plenary discussions......................................................................................................................... 64.3.1 New Test Material............................................................................................................................... 64.3.2 Spatial Audio Coding........................................................................................................................... 7

4.4 Joint Meetings........................................................................................................................................... 84.4.1 With Systems, Tue 1000-1200............................................................................................................. 84.4.2 Joint meeting with All on MAF, Tue 1200-1300..................................................................................94.4.3 With All on M3W, Tue 1400-1430......................................................................................................94.4.4 With MDS, Video on MPEG-7, Wed 1130-1300..................................................................................9

107

4.4.5 With Requirements, Wed 1400-1430...................................................................................................9

4.5 Task Group discussions........................................................................................................................... 104.5.1 MPEG-2 Layer III.............................................................................................................................. 104.5.2 MPEG-2/4 Audio............................................................................................................................... 104.5.3 MPEG-4 Lossless Audio Coding........................................................................................................114.5.4 MPEG-7 Audio.................................................................................................................................. 124.5.5 Spatial Audio Coding......................................................................................................................... 134.5.6 Symbolic Music Representation.........................................................................................................13

5 MEETING DELIVERABLES...........................................................................................................13

5.1 Press statement........................................................................................................................................ 13

5.2 Dispositions of Comments....................................................................................................................... 13

5.3 Responses to Liaison and NB comments.................................................................................................13

5.4 Recommendations for final plenary........................................................................................................13

5.5 Establishment of Ad-hoc Groups............................................................................................................ 13

5.6 Approval of output documents................................................................................................................ 13

6 FUTURE ACTIVITIES.................................................................................................................... 13

6.1 Schedule of future meetings.................................................................................................................... 14

6.2 Agenda for next meeting......................................................................................................................... 14

6.3 All other business..................................................................................................................................... 14

6.4 Closing of the meeting............................................................................................................................. 14

ANNEX A PARTICIPANTS...............................................................................................................15

ANNEX B AGENDA AND SCHEDULE FOR THE 68TH MPEG AUDIO MEETING...........................16

ANNEX C TASK GROUPS...............................................................................................................22

ANNEX D OUTPUT DOCUMENTS...................................................................................................23

Annex E Agenda for the 69th MPEG Audio Meeting..........................................................................24

108

Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 68th meeting of WG11, March 15-19, München, DE. The list of participants is given in Annex A.

Administrative matters

Approval of previous meeting reportThe 67th Audio Subgroup meeting report had been previously distributed by e-mail and was approved.

Approval of agenda and allocation of contributionsThe agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in Annex B.

Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.

Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.Groups What Where Day TimeAudio, Systems m10554 (Audio Pre-roll)

m10692 (Audio timestamps)m10558 (Audio Type)m10627 (BIFS)

Audio Tue 1000-1200

All MAF Req Tue 1200-1300

All M1530 (M3W) Req Tue 1400-1430

MDS, Audio, Video

MPEG-7 Profiles Plen Wed 1130-1300

Audio, Req M10629 (Req. for Conversation…)Requirements for Spatial Audio Coding,Requirements for Symbolic Music Representation

Audio Wed 1400-1430

Received National Body Comments and Liaison mattersThe NB Comments and Liaison documents for the meeting that require a response are as shown below.No. Title Response by

10567 SgNB Comment on the Collaborative Phase of the Audio Scalable Lossless(SLS) Coding Work Item.

Audio Subgroup

Task GroupsTask groups were convened for the duration of the MPEG meeting, as shown in Annex C. Results of task group activities are reported below.

109

AhG meetingsIn order to obtain a compete view of the business of this MPEG meeting, discussion of contributions in AhG meetings are recorded in this section of the Audio report.

MPEG-4 Extension 2, Parametric Audio Coding (Sunday 0900-1030)Werner Oomen reported that all aspects of the Extension 2 Final Verification Report (e.g. the open items in N6136), were now resolved. The only exception is to verify that FhG can provide AAC LC reference bitstreams.

Audio Exploration (Sunday 1030-1300)Kristofer Kjörling, Coding Technology, presented 1069

3Comments on Draft Call for Proposals on Spatial Audio Coding

Heiko PurnhagenKristofer Kjörling

This proposed that the new work have two separate requirements: Best possible 5.1 presentation Best possible 5.1 presentation that in addition has a high-quality 1- or 2- channel

presentation capability.

There was a discussion on how to evaluate the stereo downmix. Both Kristofer Kjörling and Werner Oomen, Philips, felt that the stereo downmix should be evaluated as one item amongst a set of 5-channel items.Kristofer Kjörling observed that this technology could be very valuable in conjunction with HE AAC with a total bitrate that is quite low. Hence he recommended that such an operating point be tested in the course of developing the technology. On the other hand, Werner Oomen, Juergen Herre, FhG, and Christof Faller, Agere, agreed that Spatial Coding should be tested using very high coding bitrates.The Chair noted that use cases for the various operating points (tested in the course of developing the technology) need to be clearly stated in some output document.Kristofer Kjörling, Werner Oomen and Juergen Herre all agreed that the backwards-compatible part should be tested and should be taken into account in the course of selection of RM0 and subsequent CE work. Juergen Herre, FhG, presented1071

3Evaluation of Spatial Audio Coding Schemes: Performance Criteria and Test Methods

Juergen Herre

This contribution proposes the following Figures of Merit Performance of 5.1 channel presentation Performance of 2-channel presentation Rate of spatial side information

The contribution proposed a number of additional requirements Same technology works for both 1-to-n and 2-to-n channel systems,

where the point is that there should be only one technology for these two use cases.There was some discussion as to whether there needs to be both 1- and 2-channel backwards compatibility. Again, these use cases must be clarified and agreed upon. All agree that there should be a single unified architecture, although Werner Oomen and Heiko Purnhagen, Coding Technologies, proposed that the 1 or 2 transmitted channels (1- and 2-channel backwards compatibility) should not be constrained. Stereo backwards compatible – for evaluation purposes, may have common conditions such that the all proponents agree to use a single core codec.Highest possible compression – may wish to let each proponent optimize the core codec to best serve the needs of their technology. The chair noted that we need to carefully specify what is tested and when:

110

Selection of RM0 Evaluation of CE Final Verification of Technology

The contribution proposes that The syntax should support all common loudspeaker arrangements. Werner Oomen,

Philips, proposed that the technology should be able to encode for one loudspeaker configuration and decode to a different configuration. This could be proposed as an “additional functionality” in the CfP, however there was no discussion as to whether this functionality would be tested.

The contribution proposes that The spatial coding technology should be able to be represented at different rates, e.g.

responsive to the total bitrate flowing over the channel.

The contribution proposes that The downmix be constrained during the course of RM0 selection and possible CE work.

This has the benefit of simplifying the test load. Note that one might specify both the downmix module and the core audio codec in the RM0 selection phase. Presentation of the remainder of the contribution (dealing with subjective evaluation methodology for multi-channel signals and first results for a spatial audio coding based system) was deferred to the Audio subgroup meeting.In summary, the presented part of the contribution proposes that

If ITU-R downmix is used, then only need to test multi-channel output signals. If encoder-based downmix is used, then need to test both 5.1 and downmix presentations

for both 1- and 2- transmitted channels.

Juergen Herre would like to see evidence that evaluating a stereo downmix within a 5.1 channel presentation gives meaningful information. The Chair noted that he would like to see this at the July MPEG meeting.

Lossless Audio Coding (Sunday 1400-1700)

SLSRalf Geiger, FhG, presented

10710

Cross-Check Report for MPEG-4 SLS Core Experiment 2 (Improved Coding Efficiency)

Ralf Geiger Markus Schmidt

This verified the performance of SLS CE2, in terms of compression ratio, percent improvement in compression ratio and execution time. The CE showed 0.73 percent improvement in compression and 20% improvement in execution time. The cross-check agreed with the proponent report (I2R), so we take this as a verification of the CE. This concludes this CE2.Eunmi Oh, Samsung, presented

10641

Report on MPEG-4 SLS Core Experiment 3 (Context-dependent entropy coding)

Eunmi OhJung-Hoe KimMiao LeiSangWook Kim

Samsung received the optimized RM2 code from I2R on February 6, 2004 and gave the CE3 result to I2R for cross-check on March 2, 2004.Relative to optimized RM2, the CE shows an improvement in compression ratio of 0.5%, and the decoder complexity of CE relative to RM2 is

200 words of tables 5%-9% increase in computational complexity.

Rongshan Yu, I2R, presented

111

10681

Crosscheck for Samsung’s Proposal on Context-Dependent Entropy Coding for MPEG Audio SLS

Rongshan Yu

This verified the performance of SLS CE3, in terms of compression ratio, percent improvement in compression ratio and execution time. The CE showed approximately 0.5 percent improvement (depending on the context mode) in compression and 10% increase in execution time. The cross-check agreed with the proponent report (Samsung), so we take this as a verification of the CE.The sense of the group was that this was a significant improvement in performance and that is should be accepted. However the Chair noted that there is another CE (CE4) that is available for evaluation at this meeting that appears to compete with CE3. Hence a decision on incorporating CE3 technology into the RM was postponed until after CE4 was presented.Rongshan Yu, I2R, presented

10683

Proposed Core Experiment for Improving Coding Efficiency of MPEG-4 Audio Scalable Coding (SLS)

Rongshan Yu Xiao Lin Susanto Rahardja Haibin Huang

Relative to optimized RM2, this CE shows an improvement in compression ratio of 0.8%, and the decoder complexity of CE relative to RM2 is

468 bytes of tables 8% increase in execution time.

Discussion followed as to the differences between CE3 (Samsung), and CE4 (I2R). Schuyler Quackenbush, Audio Research Labs, presented1072

0Cross-check on I2R’s Proposed Core Experiment S. R. Quackenbush

This verified the performance of SLS CE4, in terms of compression ratio, percent improvement in compression ratio and execution time. The CE showed 0.8 percent improvement in compression and 8% increase in execution time. The cross-check agreed with the proponent report (I2R), so we take this as a verification of the CE proposal.AhG recommends to Audio Subgroup that CE3 and CE4 are more alike than different, that context-dependent coding shows benefit in the SLS architecture and that the final decision be made in the Audio Subgroup. Tilman Liebchen, TUB, presented the AhG report, and the AhG members checked the details of the report.

Audio plenary, joint meeting and task group activities

Review of AHG reportsThere were no requests to review any of the AHG reports.

Received national body comments and liaison mattersThe Chair presented1056

7SgNB Comment on the Collaborative Phase of the Audio Scalable Lossless(SLS) Coding Work Item.

Singapore National Body

Yuriy R, RN, commented that “complexity” has the dimensions of computation (i.e. MIPS), memory, programs space, documentation and implementation cost and time. In this respect, the compression/complexity trade-off is difficult. For example, a decrease in complexity that brings little or no increase in compression might still be very valuable. The Chair noted that as the specification progresses, the CEs tend to be less the type that adds new modules, and more the type that makes existing tools more efficient, and the latter tend to reduce complexity with little or no gain in compression.A response was prepared later in the week, and can be found in the WG11 liaison response document.

112

Audio plenary discussions

New Test Material

Paul Jessop, IFPI, gave a presentation on multi-channel test material. He notes that this is not limited to the MPEG community, and hence there may be quite a large community that would like a new archive of audio test material. This could be a DVD-R containing:

Waveforms in WAV file format various recordings various recording formats incomplete tracks documentation on how the recording was made

A licence for the material would be executed directly between IFPI and the company that will use the material. The material could then be used within the MPEG community and also for demonstration purposes at e.g. trade shows.The IFPI expects the material to be

Mono, Stereo, Multichannel 5.1, Ambisonics B Various microphone methods, plus synthetic recordings (e.g. Structured Audio) Various formats 44.1, 48, 88.2, 96 and 192 kHz sampling rates, 16 and 24 bit word lengths.

Some 5.1 channel signals may have a parallel track of stereo material that could be An independent manual mix An active or passive downmix (with documentation as to how it was done)

Chair noted that this is urgently needed by the July. MPEG Audio experts are asked to recommend material that is appropriate for test use within our community. Paul Jessop noted that minor artists on major labels are most likely the easiest works to obtain. It would be very helpful if the audio experts could cite interesting material as a specific CD or DVD-A or SACD with track and segment.Paul Jessop, IFPI, can be contacted at Paul.jessop@ifpi.org

Spatial Audio Coding

Juergen Herre continued with his presentation on 1071

3Evaluation of Spatial Audio Coding Schemes: Performance Criteria and Test Methods

Juergen Herre

He notes that the Audio Subgroup should choose a test methodology that is sufficient but also efficient. He notes that the MUSHRA methodology, that facilitates the direct comparison of systems under test, is particularly efficient and effective. He also notes that BS.1116-1 recommends the dynamic switching between Ref/A/B stimuli, although with a fade-out, 100ms silence and fade-in to enhance sensitivity to imaging alterations. An issue in any test is the choice of anchors. While MUSHRA mandates a low-pass filtered anchor, this contribution proposes that, in addition, some “matrixed” multi-channel representation (e.g. Dolby ProLogic II) be used as a low anchor and discrete multi-channel (e.g. MPEG AAC) be used as a high anchor. FhG has run a test using the MUSHRA methodology with a BS.1116-1 type dynamic switching and looping. The anchors were

Dolby Prologic II (on PCM stereo channel) MPEG AAC LC at 320 kb/s

While the system under test was MP3 with Spatial Coding side information at 192 kb/s total rate

Discussion:Gerhard Stoll, IRT, notes that MUSHRA is most appropriate for “intermediate quality” while BS.1116-1 is for “small impairments.” The chair noted that there are several phases in

113

development of the technology: selection of RM0, subsequent CE work, and final verification test. In this respect, the modified MUSHRA might be fine for the RM0 and CE phases, while BS.1116-1 best for the verification test.Gerhard Stoll also noted that for the final verification test, it would be appropriate to gather new material and to do critical material selection. Juergen Herre proposed that for the RM0 selection phase, proponents could propose material for the selection test.Conclusions on this topic:MUSHRA with dynamic switching is appropriate for RM0 selection and subsequent CE work. BS.1116-1 may be appropriate for Final Verification Testing.Further remarks:Juergen Herre, FhG, remarked that RM0 should be selected such that audio coding distortion is minimal to none. Werner Oomen, Philips, has observed that there is interaction between the core audio codec and the Spatial Audio technology. Christof Faller remarked that we should be careful to eliminate any interaction between the distortion of the core codec and that of the spatial audio coding.Consensus from this discussion: There shall be one technology.Perhaps two use cases:

A. Both high quality 5.1 and mono/stereo compatibilityB. High quality 5.1, no mono/stereo compatibility

Evaluation of use case A:Technology shall be tested at two operating points:

Proponent downmix encoded by Reference AAC LC at 128 + X kb/s SI; 16<=X<=32o AAC bitstr in one file, SI in anothero No two-pass enc or per-item tuning

48 kb/s total; proponent reports side info avg rate.Where all rates are the average over the entire signal duration. The quality of the stereo/mono compatibility signal is important in both operating points

RM0 selection criterion: best 5.1 presentation quality 128+X stereo presentation “no worse than the Downmix Reference” 48 stereo, if present, shall be downmixed to mono, and the mono presentation “no worse

than the Downmix Reference”

where “Downmix Reference” at 128+X kb/s is ITU-R 5.1 to stereo downmix which is then coded at 128 kb/s using the “reference

MPEG-4 AAC LC coder” ITU-R 5.1 to mono downmix which is then coded at 24 kb/s using the “reference MPEG-

4 HE AAC coder”Final consensus:

After subsequent discussion in task group and in Audio Plenary, the consensus of the Audio Subgroup was recorded in N6456, Draft Evaluation Procedures for Spatial Audio Coding.

Joint Meetings

With Systems, Tue 1000-1200

Sam Narasimham, Motorola, presented1055

8USNB Contribution: “Audio Type” Issues

A. G. Tescher for USNB

114

This proposes changes to the table of Audio Types, specifically that “default” be changed to “main audio” and that a set of user private values be opened up. It was agreed to incorporate this into 13818-1/AMD 5.Dave Singer, Apple, presented1055

4Handling Audio Pre-roll in MPEG-4

David Singer

This proposal raises the issue of deterministic behavior of AAC codecs when encoding a segment of audio signal (as opposed to a stream of audio signal).The proposed solution is to associate additional information with the compressed audio data:

Pre-roll as in AVC file format. An AMD is in progress to support this in the ISO file format.

Edit list as in the ISO file format.

The Audio Chair referred the group to Timestamp and Audio Codec Behavior (m10554/N6140). Dave Singer proposes that start-up behavior is the same as for streaming behavior (i.e. give an AU, get a CU), and confirmed that both of the following are “per track” in the MPEG-4 file:

Pre-roll in frames frames prior to first output frame (see AVC file format, “roll-group”)

Edit list in samples samples prior to first output sample (see ISO FF 14496-12, “edit list”)

He further noted that Audio may have to make encoder and decoder start-up and

shut-down behavior normative (e.g. that an AAC decoders cannot “drop

Composition Units” on startup). Heiko Purnhagen, Coding Technologies, presented

10692

Information on HE-AAC decoder delay and timestamps

Heiko PurnhagenKristofer Kjörling

The issue raised by this proposal is that a given bitstream may be decodable by more than one decoder (e.g. HE-AAC with an AAC decoder and a HE-AAC decoder), and this affects the decoder delay. The chair noted that one solution is to have identical delay without regard to which decoder is used. However this is only valid for decoders that are aware of both decoding options, i.e. it is not a solution for the case of legacy decoders.There was consensus that Audio will take the following actions at this meeting:

Initiate a Corrigendum that specifies That timestamp is associated with the first sample of the CU derived from the AU. That decoders shall have normative behavior at start-up and shut-down (e.g. never

discard output blocks).

Revise 6140 to show how pre-roll and edit list parameters

can be used to achieve deterministic behavior in the case of encode to file and decode from file.

And that the following are topics for further study Audio will study how to specify deterministic behavior in the case that a single

bitstream can be decoded with more than one decoder with more than one decoding delay.

Jeongil Seo, ETRI, presented1062

7CE Report on AdvancedAcousticScene node for MPEG-4 Audio BIFS version 3

Jeongil SeoJerome Daniel

115

This CE presented preliminary listening tests, but need a more extensive listening test. It is not clear if the measured implulse response gives significant added value to BIFS. It was concluded that the action for this week: is to determine if this capability is already supported within BIFS. Later in the week it was confirmed that virtually all if not all of the desired capability of this proposal could be met with existing BIFS technology. Hence this CE was withdrawn.

14.1.4 Joint meeting with All on MAF, Tue 1200-1300

Wo Chang, NIST, presented

10536 Multimedia Application Format (MAF) Overview Document

Wo Chang

MAF under development 3on4 (from Audio) Jon4 3GPP

Requirements MAF shall provide a simple solution for the identified application MAF shall be build on existing MPEG specification, and not write new specification

These are normative specifications, should be constricted without regard to existing profiles, and may become a profile themselves. Currently, they should consider only static metadata. An overview will present common requirements.

With All on M3W, Tue 1400-1430

Jean, Philips, presented1053

0MPEG Multimedia Middleware: Context and Objective (Update)

Jean Gelissen

The Audio Chair attended this meeting. The work is in its preliminary stages, and should continue to be monitored.

With MDS, Video on MPEG-7, Wed 1130-1300

Audio did not attend this meeting.

With Requirements, Wed 1400-1430

The Requirements Chair reviewed the requirements for CfP for Spatial Audio and Draft CfP for Symbolic Music Representation. Requirements made valuable comments, which were incorporated into the two documents.Kate Grant, Nine Tiles, presented1062

9Requirements for conversion descriptions in a live radio broadcasting environment

Kate Grant

See 9390 from Pattaya for details of Audio Management Information Base (MIB).

Task Group discussions

MPEG-2 Layer III

Bernhard Grill, FhG, presented the listening test results associated with contribution m10617. He reported that the 96 kHz MP3 yielded much better performance for transient signals, e.g. Castanets, and that if one changed the scale factor band structure, to maintain the same degree of resolution for 96 kHz as is found for 48 kHz, then the proposal has improved performance for densely tonal items. A listening test in the document showed that the mean performance of the proposed 96 kHz MP3 system at 96 kHz was better than that of the 48 kHz MP3 system at 96 kHz. Werner Oomen, Philips, remarked that if 96 kHz operation is standardized, then decoders in the marketplace will have to support it. That would place a factor of 2 computational burden on

116

decoder platforms, and would most likely mean that manufacturers would have to move to a new platform.It was decided to accept the “MPEG 2.5” 8 kHz mode and incorporate it into the amendment, while moving the 96 kHz mode text into a “Proposed High Sampling Rate for MP3” output document and ask for National Body comments on the proposal.

MPEG-2/4 Audio

Eunmi Oh, Samsung, presented

10642

MPEG-4 BSAC related issues

Eunmi OhMiyoung KimSangWook Kim

This contribution proposed a method to extend BSAC syntax and semantics to support multi-channel signals. Samsung advises that there is only 1- and 2-channel BSAC equipment in the field, so that proposed changes will not affect backward compatibility to legacy equipment. There is a Digital Multimedia Broadcast project in Korea, and it is proposed that this use multi-channel BSAC. Samsung reported that the proposed changes are necessary to support BSAC within this project.Audio experts will review the proposal and consider e.g. the need to expand BSAC to multi-channel as opposed to using existing MPEG multi-channel technology. A decision on whether to proceed with an amendment will be made later in the week. In discussions on Thursday it was clarified that, currently, BSAC can only use M/S coding for stereo presentations. The new aspects of the proposal is to

Make M/S coding available for e.g. 5-channel presentations using BSAC Support bitrate scalability on a per-channel basis.

Bernhard Grill, FhG, Heiko Purnhagen, Coding Technologies and Gerhard Stoll, IRT, all commented that “channel dropping” as a method of scalability would not be acceptable to most customers. The consensus of Audio Subgroup was to

Take no action at this meeting. Produce a “Proposed Enhancements to BSAC” output document Ask Samsung to bring to the next MPEG meeting

o Clear goals supported by proposed changes.o Clear evidence that proposed goals lead to enhanced performance.

Ralph Sperschneider, FhG, presented1070

1Proposed addition to ISO/IEC 14496-3:2001/Cor.2

Ralph Sperschneider

This proposes many extensions to the syntax of LATM, however it may be that it supports some combinations that may not be valuable in industry. Bernhard Grill, FhG and Heiko Purnhagen, Coding Technologies, remarked that perhaps this should not be incorporated into LATM, but rather that users should be advised that such combinations would not work within the LATM structureKristofer Kjörling, Coding Technologies, presented these little changes:1068

0Proposed corrections and additions to the present ISO/IEC 14496-4:2001/AMD1:2003/Dcor1.

Kristofer Kjörling

The Chair confirmed that all proposed corrections are in response to ballot comments. The consensus of the Audio Subgroup is to add these proposals to the COR.Kristofer Kjörling, Coding Technologies, presented1067

8Proposed additions to the ISO/IEC 13818-4:200X/PDAM2 (Audio Conformance) document in order to specify SBR conformance for MPEG-2.

Kristofer Kjörling

The Audio Subgroup accepted this proposal, and it will be incorporated into the amendment.Kristofer Kjörling, Coding Technologies presented

117

10679

Additions to, and clarifications of MPEG-4 SBR conformance.

Kristofer KjörlingAndreas Schneider

These are primarily editorial changes that make the conformance specification easier to understand and use. In addition, there is the technical change that additional diagnostic bitstreams are added to the suite of conformance data. The consensus of the Audio Subgroup was to accept the proposal.Heiko Purnhagen, Coding Technologies, presented1069

4Proposed clarifications of AAC conformance test ing

Heiko PurnhagenMartin Wolters

This proposed that the PCM conformance error criterion be clarified to be more in line with the concept used in MPEG-1, which is that the decoder output is measured before quantization, i.e. as an “integer and factional” format rather than just the integer part. The consensus of the Audio Subgroup was to accept the proposal.Ralph Sperschneider, FhG, presented

10700 Status on MPEG-4 Audio Conformance

Ralph Sperschneider

The table of cross-check commitments was revised to incorporate new companies that we expect to be more responsive. Werner Oomen, Philips, presented a Workplan for the Final Verification Test of MPEG-4 Parameteric Coding. All open issues from the previous meeting are addressed: FhG will provide reference quality AAC bitstreams and IRT will perform the listening test and write the associated report.

MPEG-4 Lossless Audio Coding

SLS

The presentation and discussion of contributions that began in Sunday’s AHG meeting was continued later in the week.Based on compression performance, the Audio subgroup agreed to incorporate CE4 (I2R) into RM2. The workplan will reflect the integration of this technology into the RM and WD.Ralf Geiger, FhG, presented

10711

Proposed Core Experiment on MPEG-4 SLS

Ralf Geiger Markus Schmidt Jürgen Herre

This proposes three techniques for improved performance: Oversampling of intIMDCT with respect to the AAC core (by 2 or 4). Integrated M/S coding Noise shaping, such that noise power is emphasized in the low frequency region and de-

emphasized in the high-frequency region. Greatest improvement is realized in the high sampling rates:

Parameters ImprovementFs Wd Oversampling Oversampling M/S Noise

Shaping48 16 1 - 0.20 0.2996 24 2 1.99 2.33 2.73192 24 4 3.55 3.77 4.54Audio subgroup approved this CE proposal, and expects a cross-check of the proposal at the next meeting. Rongshan Yu, I2R, presented

118

10682

Proposed WD2 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS)

Rongshan Yu Xiao Lin Susanto Rahardja Haibin Huang

This is the WD text that integrates CE2, improved coding efficiency for SLS (via “low energy” coding). The integrated CE2 software was put on the FTP site, so all aspects of this CE are complete. Fang-Chu Chen, ITRI, presented1066

4bit reordering in SLS enhancement layer

Fang-Chu Chen, Te-ming Chiu

This presentation was informative only. For the benefit of the submitter, the Chair reviewed the Core Experiment process. ALS

Takehiro Moriya, NTT, presented1057

8Proposed draft for WD 3 of ISO/IEC 14496-3:2001/AMD 4, Audio Lossless Coding (ALS)

Takehiro Moriya

Tilman Liebchen, TUB, presented1060

6Verification Report on MPEG-4 ALS Core Experiment 3 (Coding of Audio in Floating-Point Format)

Tilman LiebchenPatrick Runge

Tilman feels that this proposal does not deliver the best performance possible, due to its using a 16 (rather than a 24-bit) core coder. As an additional point, he suggested that the changes to the RM that occurred as part of the floating-point implementation could be done in a better manner. For example, there is redundancy in the code that could be removed and there are modules that may be more complex than are necessary. This was discussed later in the week, at which time NTT presented more carefully structured RM code, which was acceptable to all parties. It was concluded that this CE advanced based on this new code.Tilman Liebchen, TUB, presented

10607

Proposed Core Experiment for Improved Coding of Random Access Frames in MPEG-4 ALS

Tilman LiebchenTakehiro Moriya

This proposed improved performance for encoding segments immediately following random access. This proposal comes at no cost in computation complexity, but does give an improvement in compression. The Chair noted that this proposal is exactly the case in which an evaluation of performance/complexity trade-off must be made. The consensus of the Audio Subgroup is to accept this CE proposal since it has nearly zero increase in complexity but does yield a moderate increase in compression, especially as the interval at which random access is possible approaches a single accessUnit.Yuriy Reznik, RealNetworks, presented1063

8Proposed CE on Coding of LPC Coefficients in MPEG-4 ALS

Yuriy Reznik

This proposes to use entropy coding to compress the predictor coefficients. While the LPC information was compressed by from 30% to 50%, overall compression increase was approximately 0.19%. There was discussion as to whether both this CE proposal and also the TUB CE proposal are compelling in light of their low complexity and simple integration into the ALS architecture. Consensus of the Audio Subgroup was to accept both of these CEs, and to ask for a cross-check at the next MPEG meeting.

119

MPEG-7 Audio

Benoit Meudic, IRCAM, presented

10568

Proposed MPEG 7 audio tools

Jerome BarthelemyBenoit MeudicMarc Texier

This proposes descriptors to categorize instruments into one or more families (e.g. pipe organ could be in both the keyboard and wind instrument families). Holger Crysandt, Aachen Univ, presented 1061

4Cross check results of the Audio Pattern Description Schema

Holger Crysandt

This cross-check gives identical results as are in the CE proposal. There was some discussion as to whether the cross-check provided sufficient evidence of the utility or viability of the descriptor. Holger also presented the results of a preliminary implementation of a music player that uses MPEG-7 metadata. The meta data was temporal, and segmented the song into “phrases” (e.g. intro, chorus, verse 1, etc.). The consensus of the Audio Subgroup was to that an additional cross-check be presented at the next MPEG meeting that clarifies the utility of this descriptor.

Spatial Audio Coding

Symbolic Music Representation

Paolo Nesi, University of Florence, presented

10654

Music Notation Technical Requirements and Integration in MPEG-4

Paolo NesiPierfrancesco BelliniGiorgio ZoiaJerome Barthelemy

This document was reviewed, especially the informative annex (documents m10622 and m10661 were reviewed during the AHG meeting – see m10466, the AHG report for a very complete record of that meeting). Agreement was reached on some open issues, like possible visual and audio rendering, and authoring/end user scenarios.From this consolidated document, the draft Call for Proposals was produced as an output for this meeting.

Meeting deliverables

Press statementThe Audio part of the press statement was prepared and reviewed.

Dispositions of CommentsAll DoC were prepared and reviewed.

Responses to Liaison and NB commentsThere were no liaison responses. The response to the SnG NB was prepared and approved.

Recommendations for final plenaryThe Audio recommendations were presented and approved.

Establishment of Ad-hoc GroupsThe following ad-hoc groups were established by the Audio subgroup:

120

No. Title Mtg6458 AHG on Spatial Audio Coding Yes

6459 AHG on MPEG-4 Lossless Audio Coding

Yes

6460 AHG on Symbolic Music Representation Yes

Approval of output documentsAll output documents, shown in Annex D, were presented in Audio plenary and were approved.

Future activities

Schedule of future meetingsAd Hoc group meetings are indicated in Section . Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting.

Agenda for next meetingThe agenda for the next MPEG meeting is shown in Annex E.

All other businessThere was none.

Closing of the meeting The 65th Audio Subgroup meeting was adjourned at 13:45.

121

Annex A ParticipantsFirst Name Last Name Country Affiliation E-mail addressAlexandre Cotarmanac’h FR France

Telecom R&Dalexandre.cotarmanach@francetelecom.com

Pierfrancesco

Bellini I UNI Firenze pbellini@dsi.unifi.it

Kok Seng Chong SG Panasonic kschong@psl.com.sgHolger Crysandt DE Aachen Univ. crysandt@ient.rwth-aachen.deJerome Daniel FR France

Telecom R&Djerome.daniel@francetelecom.com

Bernd Edler DE University of Hannover

edler@tnt.uni -hannover.de

Christof Faller CH EPFL Lausanne

cfaller@agere.com

Bernhard Feiten DE Deutsche Telekom

bernhard.feiten@t-systems.com

Ralf Geiger DE FhG IIS IDMT ggr@idmt.fraunhofer.deBernhard Grill DE FhG IIS grill@iis.fraunhofer.deMatthias Gruhne DE FhG IIS IDMT ghe@idmt.iis.fraunhofer.deJürgen Herre DE FhG IIS hrr@iis.fraunhofer.deJohannes Boehm CE Thomson Johannes.Boehm@Thomson.netSang-Wook Kim KR Samsung swkim@samsungait.comKristofer Kjörling S Coding

Technologieskk@codingtechnologies.com

Tilman Liebchen DE TU Berlin liebchen@nue.tu-berlin.deAdam Lindsay UK Lancaster

Universityatl@comp.lancs.ac.uk

Benoit Meudic FR IRCAM meudic@ircam.frTakehiro Moriya JP NTT moriya.takehiro@lab .ntt.co.jp Sua Hong Neo SG Panasonic shneo@psl.com.sgPaolo Nesi I UNI Firenze nesi@dsi.unifi.itKia Ng UK UL kia@computer.orgToshiyuki Nomura JP NEC t-nomura@ da.jp.nec.com Eunmi Oh KR Samsung sait@samsung .com Werner Oomen NL Philips werner.oomen@philips .com Vincent Puig FR IRCAM puig@ircam.frHeiko Purnhagen S Coding

Technologieshp@codingtechnologies.com

Schuyler Quackenbush USA ARL srq@audioresearchlabs .com Susanto Rahardja SG I2R rsusanto@i2r.a-star.edu.sgJean Bernard Rault FR France

Telecom R&Djeanbernard.rault@francetelecom .com

Yuriy Reznik USA RealNetworks yreznik@real.comAndreas Schneider DE Coding

Technologiessnd@codingtechnologies.com

Jeongil Seo KR ETRI seoji@etri .re.kr Ralph Sperschneider DE FhG IIS ralph.sperschneider@iis.fraunhofer.deJacques Steyn ZA Monash

Universityjacques.steyn@infotech.monash.edu

Hervé Taddei DE Siemens AG Herve.taddei@siemens.comNaoya Tanaka JP Panasonic tanaka.naoya@jp.panasonic.comMark Vinton USA Dolby msv@dolby.comDavid Virette FR France

Telecom R&Ddavid.virette@francetelecom.com

Lin Xiao SG I2R linxiao@i2r.a-star.edu.sgRongshan Yu SG I2R rsyu@i2r.a-star.edu.sgGiorgio Zoia CH EPFL giorgio.zoia@epfl.ch

123

Annex B Agenda and Schedule for the 68th MPEG Audio MeetingTime Agenda Item MPEG-

2/4MPEG-7

Number Title Source N1095 N0116

Sunday0900-1030 AHG on MPEG-4 BWE and

Parametric CodingDiscuss verification test (N6136)

1030-1300 AHG on MPEG-4 Audio ExplorationObjectives and evaluation methods

1400-1700 AHG on Lossless CodingSLS

10641Report on MPEG-4 SLS Core Experiment 3 (Context-dependent entropy coding)

Eunmi OhJung-Hoe KimMiao LeiSangWook Kim

X

10681Crosscheck for Samsung’s Proposal on Context-Dependent Entropy Coding for MPEG Audio SLS

Rongshan Yu X

10683

Proposed Core Experiment for Improving Coding Efficiency of MPEG-4 Audio Scalable Coding (SLS)

Rongshan Yu Xiao Lin Susanto Rahardja Haibin Huang

X

10710Cross-Check Report for MPEG-4 SLS Core Experiment 2 (Improved Coding Efficiency)

Ralf Geiger Markus Schmidt X

10720 Cross-check on I2R’s Proposed Core Experiment S. R. Quackenbush X

Monday0900-1330 MPEG Plenary1330-1430 Lunch1430-1800 Audio Plenary 

Opening of the meetingAudio Chair

Administrative mattersApproval of agendaApproval of 67th MPEG meeting report

10715 Audio Subgroup Report for the 67th MPEG Meeting

S. R. Quackenbush X

Communications from the Chair- Review of Sun Chairs meetingAllocation of contributions to agenda and scheduleJoint meetingsReview of AhG reports

10460AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4

Jens Spille X

Time Agenda Item MPEG-2/4

MPEG-7

Number Title Source N1095 N0116

10461 Report of the AHG on MPEG-4 Audio Conformance Ralph Sperschneider X

10462Report of the AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software

Ralph SperschneiderHeiko Purnhagen X

10463 AHG on MPEG-4 Audio Extensions 1 and 2 W. Oomen X

10464 AHG on MPEG-4 Audio Lossless Coding Tilman Liebchen X

10465 AHG on MPEG-7 Audio Matthias Gruhne X

10466 AHG on Music Notation Requirements

Paolo NesiGiorgio Zoia X

10467 AHG on Timestamps and Audio Codec Behavior Schuyler Quackenbush X

10468 AHG on Audio Explorations Schuyler Quackenbush X

Task groups and mandatesNational body comments

10567

SgNB Comment on the Collaborative Phase of the Audio Scalable Lossless(SLS) Coding Work Item.

Singapore National Body X

Liaison

10508Liaison Statement from ITU-T SG 16 on Audio Information [SC 29 N 5813]

ITU-T SG 16 via SC 29 Secretariat

X(no response needed)

Ballot Comments

10540 SC 29 Secretariat

Summary of Voting on ISO/IEC 14496-3:2001/Amd.1:2003/DCOR 1 [SC 29 N 5843]

X

10541 SC 29 Secretariat

Summary of Voting on ISO/IEC 13818-7:2003/DCOR 1 [SC 29 N 5844]

X

10542 SC 29 Secretariat

Summary of Voting on ISO/IEC 14496-3:2001/DCOR 2 [SC 29 N 5845]

X

10544 SC 29 SecretariatSummary of Voting on ISO/IEC 13818-1:2000/PDAM 5

X

10601 SC 29 SecretariatLate Vote on ISO/IEC 14496-3:2001/Amd.1:2003/DCOR 1 [SC 29 N 5849]

X

10602 SC 29 SecretariatLate Vote on ISO/IEC 13818-7:2003/DCOR 1 [SC 29 N 5851]

X

10603 SC 29 SecretariatLate Vote on ISO/IEC 14496-3:2001/DCOR 2 [SC 2 9 N 5852]

X

1600-1730 Plenary discussionsExploration

10693 Comments on Draft Call for Proposals on Spatial Audio Coding

Heiko PurnhagenKristofer Kjörling X

125

Time Agenda Item MPEG-2/4

MPEG-7

Number Title Source N1095 N0116

10713Evaluation of Spatial Audio Coding Schemes: Performance Criteria and Test Methods

Juergen Herre X

1800- HOD Meeting

Tuesday0900 Audio Plenary Audio Chair

Outline plan for the day

0900-1100 Symbolic Music Representation B/O

0900-1100 SLS

10711 Proposed Core Experiment on MPEG-4 SLS

Ralf Geiger Markus Schmidt Jürgen Herre

X

1000-1200 Joint Meeting with Audio, Systems Audio

10554 Handling Audio Pre-roll in MPEG-4 David Singer X

10692 Information on HE-AAC decoder delay and timestamps

Heiko PurnhagenKristofer Kjörling

X

10558 USNB Contribution: “Audio Type” Issues A. G. Tescher for USNB X

10627CE Report on AdvancedAcousticScene node for MPEG-4 Audio BIFS version 3

Jeongil SeoJerome Daniel

X

1200-1300 Joint Meeting: Multimedia Application Format

Sys

10536 Multimedia Application Format (MAF) Overview Document

Wo Chang X

1300-1400 Lunch

1400-1430 Joint Meeting: Multimedia Middleware (m1530)

Sys

10530 MPEG Multimedia Middleware: Context and Objective (Update)

Jean Gelissen X

1430-1630 MPEG-4 ALS, SLSSLS

10682Proposed WD2 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS)

Rongshan Yu Xiao Lin Susanto Rahardja Haibin Huang

X

10664 bit reordering in SLS enhancement layer chen te-ming chiu X

ALS

10578Proposed draft for WD 3 of ISO/IEC 14496-3:2001/AMD 4, Audio Lossless Coding (ALS)

Takehiro Moriya X

10606Verification Report on MPEG-4 ALS Core Experiment 3 (Coding of Audio in Floating-Point Format)

Tilman LiebchenPatrick Runge X

10637 Comments on MPEG-4 ALS CE3 reference software Yuriy Reznik X

126

Time Agenda Item MPEG-2/4

MPEG-7

Number Title Source N1095 N0116

10721 Comments on Lossless Coding of Audio in Floating-Point Format Takhiro Moriya X

1630-1730 Symbolic Music Representation

10622 A New Application Scenario for Music Notation in MPEG

Giorgio ZoiaJames Ingram X

10654Music Notation Technical Requirements and Integration in MPEG-4

Paolo NesiPierfrancesco BelliniGiorgio ZoiaJerome Barthelemy

X

10661 Proceedings of AHG on Music Notation Requirement s

Paolo NesiPierfrancesco BelliniGiorgio ZoiaJerome Barthelemy

X

1730-1800 MPEG-2 Layer III

10617 MPEG-1/2 Audio Layer 3 For Low And High Sampling Rates

Bernhard GrillJohannes HilpertManfred LutzkyMartin Weishart Ernst F. Schroeder

X

1800-1830 Audio PlenaryStatus for Chairs Meeting

1800-1900 Liaison Meeting1900- Chairs Meeting 0938

Wednesday0900-1100 MPEG Plenary1100-1130 Audio Plenary Audio Chair

Report on Chairs meeting and outline of plan for the day

1130-1230 Joint meeting on MPEG-7 profiles and MAF

Plenary

1130-1300 MPEG-4 Audio

10642 MPEG-4 BSAC related issuesEunmi OhMiyoung KimSangWook Kim

X

10701 Proposed addition to ISO/IEC 14496-3:2001/Cor.2 Ralph Sperschneider X

1300-1400 Lunch

1400-1430 Joint Meeting with Audio, Req Audio

10629Requirements for conversion descriptions in a live radio broadcasting environment

Kate Grant X

Review of Spatal Audio, Symbolic Music Representation Requirements

X

1430-1530 MP3+Spatial Audio demonstrations X

1530-1630 MPEG-7

127

Time Agenda Item MPEG-2/4

MPEG-7

Number Title Source N1095 N0116

10568 Proposed MPEG 7 audio toolsJerome BarthelemyBenoit MeudicMarc Texier

X

10614 Cross check results of the Audio Pattern Description Schema Holger Crysandt X

Information on and demonstration of expression of ID3V1 as MPEG-7 metadata

Holger CrysandtX

1700-1800 MPEG-4 Audio

10678

Proposed additions to the ISO/IEC 13818-4:200X/PDAM2 (Audio Conformance) document in order to specify SBR conformance for MPEG-2.

Kristofer Kjörling X

10679 Additions to, and clarifications of MPEG-4 SBR conformance.

Kristofer KjörlingAndreas Schneider X

10680Proposed corrections and additions to the present ISO/IEC 14496-4:2001/AMD1:2003/Dcor1.

Kristofer Kjörling X

10694 Proposed clarifications of AAC conformance test ing

Heiko PurnhagenMartin Wolters X

1800-1830 ALS

10607Proposed Core Experiment for Improved Coding of Random Access Frames in MPEG-4 ALS

Tilman LiebchenTakehiro Moriya

X

10638 Proposed CE on Coding of LPC Coefficients in MPEG-4 ALS Yuriy Reznik X

1900-2200 Social

Thursday

10700 Status on MPEG-4 Audio Conformance

Ralph Sperschneider

10617 Presentation of listening testALS LPC CEBSAC multi-channel proposalParametric Coding Verif. ReportSnG NB Comment responseRevise Timestamps documentRevise Audio Player MAF

1300-1400 Lunch

CfP for Spatial AudioDraft Evaluation DocDraft CFP for SMR

1830-1900 Audio Plenary Audio ChairReview list of deliverablesReview list of AHGsStatus for Chairs Meeting

1900- Chairs Meeting 0938

Friday0830-0900 Requirements

Approval of Spatial Audio and SMR128

Time Agenda Item MPEG-2/4

MPEG-7

Number Title Source N1095 N0116

0900-1300 Audio PlenaryReport on Chairs meeting and outline of plan for the day Audio Chair

Discussion of unallocated contributionsMeeting deliverables

Press statementDispositions of commentsResponses to NB commentsLiaison statementsRecommendations for final plenaryEstablishment of new Ad-hoc groupsApproval of output documents

Future activitiesAgenda for next meeting

A.O.B.Closing of the Audio meeting

1300-1400 Lunch

1400- MPEG Plenary

129

Annex C Task GroupsMain tasks for the week: Document progression (see table below) Spatial Audio CfP Draft Symbolic Music Representation CfP Progress SLS CEs Verification Test of Parametric Stereo Progress

o MPEG Music Player Application Formato Timestamps and Audio Codec Behavior

1. MPEG-2 Layer III Schuyler Quackenbush1.1. Review contributions1.2. Prepare and give to Jean-Claude DuFourd ISO/IEC 13818-4:200X/AMD 2:2000x,

Audio Conformance Extensions 1.3. Prepare Study on ISO/IEC 14496-3:2001/FPDAM 31.4. Revised MPEG Music Player Application Format

2. MPEG-2 AAC Ralph Sperschneider2.1. Review contributions2.2. ISO/IEC 13818-7:2003/COR 1:2004

3. MPEG-4 Audio Kristofer Kjörling (BWE) Ralph Sperschneider (-4 –5) Schuyler Quackenbush (Other)3.1. Review contributions3.2. ISO/IEC 14496-3:2001/COR 23.3. ISO/IEC 14496-3:2001/AMD 1:2003/COR 1:20043.4. Workplan for Verification Test of MPEG-4 Parametric Coding3.5. Assist in preparing DoC for ISO/IEC 13818-1:200X/AMD 5 (coordinate with

Olivier)3.6. Prepare and give to Jean-Claude DuFourd ISO/IEC 14496-4:2001/AMD 83.7. Prepare Study on ISO/IEC 14496-11:200X/PDAM 3

4. MPEG-4 Lossless Coding Tillman Liebchen (ALS) and Ralph Geiger (SLS)4.1. Review contributions4.2. 1-bit lossless Request for Amendment and WD or CD text

5. MPEG-4 Explorations Schuyler Quackenbush5.1. Review contributions5.2. Call for Proposals on Spatial Audio Coding5.3. Draft Evaluation Procedures

6. Symbolic Music Representation Paolo Nesi and Giorgio Zoia6.1. Review contributions6.2. Draft CfP

7. MPEG-7 Matthias Gruhne7.1. Review contributions7.2. Revise Status of Conformance and Reference Software

Audio Standards Under DevelopmentDCOR COR WD CD FCD FDIS

Name Description WDPDA

MFPDA

M FDAM13818-4:200X/AMD 2:2000x Audio Conformance 62 67 68 70

130

Extensions(new bitstreams for Audio LIII)

13818-5:1997/COR 2:2004 AAC 6813818-7:2003/COR 1:200x AAC 66 6814496-3:2001/COR 2 66 6814496-3:2001/AMD 1:2003/COR 1:200x BWE 68

14496-4:2001/AMD 8SBR, Audio BIFS and SA 66 67 68 70

131

Annex D Output DocumentsThe Audio Subgroup produced the following output documents. Those approved for public release are indicated by the entry “Yes” in column TBP (to be public).Prepare for Systems

DoC of ISO/IEC 13818-1:2001/PDAM 5, Text of ISO/IEC 13818-1:2001/FPDAM 5

Prepare for IntegrationDoC on ISO/IEC 13818-4:200X/PDAM 2:2000xText of ISO/IEC 13818-4:200X/FPDAM 2:2000x, Audio Conf. Exten. LIII and SBRDoC on ISO/IEC 14496-4:2001/PDAM 8Text of ISO/IEC 14496-4:2001/FPDAM 8, HE-AAC, Audio BIFS and SA

Audio DocumentsNumber

Title TBP

Avail.

6426 DoC on ISO/IEC 13818-7:2003/DCOR 1:2004, AAC6427 Text of ISO/IEC 13818-7:2003/COR 1:2004, AAC

6428 Text of ISO/IEC 13818-7:2004, AAC Third Edition 04/04/16

6429 DoC on ISO/IEC 14496-3:2001/DCOR 2

6430 Text of ISO/IEC 14496-3:2001/COR 2, Misc. Corrections 04/04/16

6431 DoC on ISO/IEC 14496-3:2001/AMD 1:2003/DCOR 1:2004

6432 Text of ISO/IEC 14496-3:2001/AMD 1:2003/COR 1:2004, Bandwidth Extension

04/03/26

6433 Study on ISO/IEC 14496-3:2001/FPDAM 3, MP3 on MP4 04/04/16

6434 Request for Amendment: ISO/IEC 14496-3:2001/AMD 4, Audio Lossless Coding

6435 WD3 of Audio Lossless Coding

6436 Request for Amendment: ISO/IEC 14496-3:2001/AMD 5, Scalable Lossless Coding

6437 WD2 of Scalable Lossless Coding

6438 Request for Amendment: ISO/IEC 14496-3:2001/AMD 6, Lossless Coding of Oversampled Audio

6439 ISO/IEC 14496-3:2001/PDAM 6, Lossless Coding of Oversampled Audio

04/04/09

6440 Request for Amendment: ISO/IEC 15938-4:2002/AMD 2, High-level Descriptors

6441 WD 1 of MPEG-7, High-level Descriptors

6442 Request for New Work Item: MPEG-A Part 1, Music Player Application Format

6443 Text of MPEG-A Part 1, Music Player Application Format Yes

6444 Proposed High-Sampling Rate for MPEG-2 Layer III 04/04/16

6445 Proposed Enhancements to MPEG-4 BSAC multi-channel

6446 Workplan for Verification Test of MPEG-4 Parametric Audio Coding

6447 Workplan for Audio Lossless Coding (ALS)

132

6448 Workplan for Scalable Lossless Coding (SLS)

6449 Timestamps and Audio Codec Behavior 04/04/16

6450 Workplan for Audio Contribution to MPEG-4 Conf. Bandwidth Extension

6451 Status of MPEG-4 Audio Conformance

6452 Status of MPEG-7 Audio Contribution to XM and Conformance

6453 Workplan for Audio Rhythmic Pattern CE6454 Workplan for Instrumentation and Weighted Scale Type CE6455 Call for Proposals on Spatial Audio Coding Yes6456 Draft Evaluation Procedures for Spatial Audio Coding Yes6457 Draft Call for Proposals for Symbolic Music Representation

133

Annex E Agenda for the 69th MPEG Audio MeetingAgenda Item1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda2.2. Approval of 68th meeting report2.3. Communications from the Chair2.4. Allocation of contributions2.5. Joint meetings2.6. Review of AhG reports2.7. Review of task groups and mandates2.8. Received national body comments and liaison matters2.9. Plenary issues

3. Task group activities3.1. MPEG Maintenance3.2. MPEG-1 Access Units and Music Player Application

Format3.3. MPEG-4 Parametric Coding3.4. MPEG-4 Lossless Coding3.5. MPEG-4 BIFS3.6. MPEG-7 Audio3.7. Spatial Audio Coding3.8. Music Notation

4. Discussion of unallocated contributions5. Meeting deliverables

5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Responses to Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents

6. Future activities6.1. Agenda for next meeting

7. A.O.B.8. Closing of the meeting

134

135

Annex 10Report of SNHC meeting

Source: Mikaël Bourges-Sévenier (Mindego Inc.)

Opening of the Meeting

Approval of the agenda

Goals for the weekThe goals of this week are:

Review the on-going core experiments Review answers of CfP Graphics API Finalize profiles and review supporting materials Finalize AFX conformance and reference software Review technologies ready for AFX/AMD1 Review physical models proposals

136

ScheduleMonday Tuesday Wednesday Thursday Friday

:00:30:00 Player3D secrets…:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30

14

15

08

09

10

11

20

21

22

Time

16

17

18

19

12

13

Lunch break

MPEG Plenary

Lunch break Lunch break Lunch break Lunch break

MPEG Plenary

MPEG Plenary

Roll call, agendaFAQ, web site, ref sw, conf.10730 - BBA extensibility

10655 - MorphShape10656 - BBA update for morphing10707 - EE results on 3D model based movie streaming

10519 - CE Shadow

10704, 10733, 10696 - Discussion AFX profiles

10571 - XMT-A PointTexture10593 - AFX encoder usage

10647 - Answer to CfP Graphics API

10570 - PointTexture compression

10691 - CE multi-texturing

10704, 10733, 10696 - MPEG-4 profiles10690 - Camera calibration10579 - CE Point-based rendering

10582, 10583 - Water, Cloth, simulations

Output document review

Document reviewPresentation reviewDocument number attribution… last items...

10571 - XMT-A for PointTextureQuaternions in BBA

10704 Compressed 3D profile

AFX/AMD1 review

Part1/AMDx/COR1 reviewPart11: add

Graphics API discussion AFX encoder

Physics model discussion

Social event

Liaison

Chairs Chairs

Graphics API discussion

10719 - mass-spring models

Player3D secrets / Graphics API discussion

Liaison

137

Allocation of joint meetingsSub-Groups Monday Tuesday Wednesday Thursday Friday

Systems 15:00-16:00AFX encoder16:00-17:00

Part 1/COR1 reviewRequirements 15:30-16:30 with Systems

MPEG-4 profiles16:00-16:30

Compressed 3D profileN0115

MPEG-7 Video

Video/3DAVMDS

Joint meetings notesTue 12-13, Req: MAFTue 14-14:30, Req: M3WTue 14:30-15:30, Req: LaSeRTue 15:30-16:30, Req: MPEG-4 profiles

Rooms allocationSNHC 0999Systems N1090Requirements N1070Chairs/HoD/Liaisons0947

Allocation of contributions

N° Title Schedule ActivityD1 Monday D1

MPEG Plenary D1 09h00-14h00 MPEG Gen.

138

N° Title Schedule ActivityReport of AhG on MPEG-J extensions Mikaël Bourges-

SévenierSNHC D1 15h00-16h00 SNHC Gen.

Agenda, FAQ, Web site Mikaël 15:00AFX Reference software, integration issues Patrick 15:30AFX Profiles Marius 15:45SNHC D1 16h00-19h00 AFX CE

10730 Extensibility feature of the BBA stream. Corrigendum Proposal

Marius PREDAFrancoise Preteux

16:00

10655 MorphShape Node Implementation in Reference Software

Marius PredaFrancoise Preteux Frederic Vexo

17:00

10656 BBA stream update for morphing-based virtual character animation

Marius PredaFrancoise PreteuxFrederic Vexo

17:30

10707 Preliminary tests and evidences for EE on 3D model-based movie streaming

Raphaèle BalterPatrick GioiaLuce Morin

18:00

D2 Tuesday D2SNHC D2 9:00 – 13:00 Graphics

10519 CE Shadow Algorithm Helge Drumm 9:00SNHC D2 10:00 – 11:00 AFX profiles/requirements

10704 Proposal for Compressed 3D Profile Patrick Gioia 10:00 (discussion)10733 X3D Interactive profile, bitstream exchange

updateMikael Bourges-SevenierAaron E. Walsh

(discussion)

10696 Proposal of new requirements for streaming geo-visual contents

Jérôme RoyanChristian BouvillePatrick Gioia

(discussion)

SNHC D2 11:00 – 12:00 AFX

139

N° Title Schedule Activity10593 Implementation the Reference software of

AFX Encoder and User GuideGyeong Ja JangJames D. K. Kim

11:00

SNHC D2 12:00 – 13:00 Graphics

10647 HI Corp., Waseda Univ. and Packet Video’s Response to Call for Proposal (SC29 WG11 N 6095)

Itaru Kaneko (Waseda)Osama K Alshaykh (Packet Video)Junya Tsutsumi (HI)Mark Callow (HI)Jiro Katto (Waseda)Daisuke Inoue (Waseda)

12:00

SNHC D2 14:00 – 15:30 AFX

10570 Improvement of PointTexture Compression in Depth Image-Based Representation (DIBR)

Shinjun LeeMahnjin Han

14:00

10691 View-Dependent Multi-Texturing for MPEG-4 AFX, Syntax and Semantics Specification

Karsten MüllerAljoscha SmolicThobias Rein

14:30

Requirements D2 15:30 – 16:30 MPEG profiles

10647 HI Corp., Waseda Univ. and Packet Video’s Response to Call for Proposal (SC29 WG11 N 6095)

Itaru Kaneko (Waseda)Osama K Alshaykh (Packet Video)Junya Tsutsumi (HI)Mark Callow (HI)Jiro Katto (Waseda)Daisuke Inoue (Waseda)

15:30

10733 X3D Interactive profile, bitstream exchange update

Mikael Bourges-Sevenier

140

N° Title Schedule ActivityAaron E. Walsh

10696 Proposal of new requirements for streaming geo-visual contents

Jérôme RoyanChristian BouvillePatrick Gioia

SNHC D2 16:30 – 18:00 AFX

10579 Results on Core Experiment on Point based Rendering for MPEG-4 AFX

Stephan WuermlinMatthias ZwickerMichael WaschbueschMarkus GrossHanspeter Pfister

17:00

10690 Proposal of 3D Camera Calibration Parameters for MPEG-4 AFX

Karsten MüllerAljoscha SmolicHanspeter PfisterStephan WürmlinMatthias Zwicker

14:30

D3 Wednesday D3MPEG Plenary D3 09h00-11h00 MPEG Gen.SNHC D3 11h00-13h00 AFX

10582 Proposal for Real-Time Water Simulation James D. K. KimJeong-Hwan AhnSang Oak Woo

11:00

10583 Proposal for Cloth Animation Jeong-Hwan AhnJames D. K. KimSang Oak Woo

10719 Proposal for MassSpring Node for Animation

Thomas Di GiacomoChris JoslinMarius Preda

SNHC D4 14h00-16h00 AFX

10571 Proposal of XMT-A specifications for PointTexture Compression

Gyeong Ja JangShinjun LeeJames D. K. Kim

14:00

141

N° Title Schedule ActivityMahnjin Han

Requirements D4 15h00-16h00 General

10704 Proposal for Compressed 3D Profile Patrick Gioia 16:00D4 Thursday D4

Systems D4 9h00-13h00 AFX

10593 XMT-A implementation user guide 14:00-15:00Part 1/COR1 review 16:00-17:00

D5 Friday D5SNHC D5 9h00-11h00 SNHC Gen.

Document number attribution 9:00

MPEG Plenary D5 14h00-22h00 MPEG Gen.

142

General issues

Web siteThe SNHC Web site is http://www.sait.samsung.co.kr/snhc/src/index.html

ResolutionAs the web site hasn't been updated for a while, SNHC participants will add AFX Tutorial and other documents to promote AFX technologies.

AFX Reference softwareThe AFX Reference Software has been transferred to NIST and is available via CVS at

1. Register your login/password at http://mpeg.nist.gov/reg/login_new.php2. :pserver:<your login>@mpeg.nist.gov:/big/mpegcvs3. <your password>4. Checkout "MPEG-4/Systems2/IM1" module (case sensitive).

The AFX-related code is in OpenGL/AFX and conformance samples are in Tests/AFX.

Standards from SNHCAFX conformance is finished; it has reached FDIS status at this meeting.AFX AMD1was to be CD at this meeting but without AFX nodes expressed in XMT, it remains at WD level.MPEG-J extensions for rendering is the new MPEG-4 Part 21. It will be WD in July.AFX COR1 has just started. The DCOR will be released at July meeting for 3-month ballot

In red, status reached at this meeting. In yellow, status reached at next meeting. Projects that reached International Standard status have been removed.

Std

Pt Edit. Project Description CfP WD CDPDAMDCOR

FCDFPDA

M

FDISFDAMCOR

4 5 2003 Amd.7 AFX Reference SW 02/10

02/12 03/12 04/07

4 11 2003 Amd.4 XMT and MPEG-J extensions

03/12 04/07 05/01

4 16 2004 Cor.1 AFX Corrigendum 04/03

04/07 05/01

4 16 2004 Amd.1 AFX extension 03/07

04/07 05/01 05/07

4 21 2005 MPEG-J extensions for rendering

03/12

04/07

04/10 05/01 05/07

143

AFX activities

Specifications updatesThe list of modifications for existing specifications handled by SNHC is as follows.

Part 1/COR1AFX bitstream carriage in MPEG-4 Systems is moved to 14496-16/AMD1.14496-1 will contain a normative reference to ISO/IEC 14496-16/AMD1 for AFX bitstream carriage.

Part 11/AMD4XMT-A Schema updated with AFX nodes.

Part 11/COR1Update node coding tables with AFX nodes removed (see section ).

Part 16/COR1Update MeshGrid DecoderSpecificInfo (see proposal m10377)Update MeshGrid stream (see proposal m10377)Update WaveletSubdivisionSurface stream Add Bone-Based Animation corrections and quaternion support (see sections and )

Update node coding table update but leave the node code.

Remove the following technologiesLight Field Mapping, Solid modeling, Particle systems

Part 16/AMD1Delay at this time since XMT Schema is not ready.Add BBA stream and PointTexture stream identifiers.Move AFX stream decoder specific info from 14496-1.

Conformance and reference softwareConformance bitstreams are available and have all been tested by Samsung.SNHC would like to thank Samsung for checking all the bitstreams.

M10655 – MorphShape nodeThis is a follow up of the MorphShape node proposed at last meeting. The node is now implemented in IM1.

ResolutionTechnology is stable and implemented. It is added to AFX/AMD1.

M10656 – BBA update for morphingIt is proposed to use MorphShape as a child of SBSegment and analyze how the stream needs to be updated.Using proposal m10730, this extension to BBA stream can be done.

ResolutionThis update is accepted in AFX/AMD1.

M10730 – BBA extensibilityCorrect BBA stream of AFX with a NoTypes indicator for future extensions.

144

ResolutionAdd the proposal into AFX/COR1 to ensure backward compatibility with potential future extensions.

M10707 – EE results on 3D model-based movie streamingResolutionPromising results but it seems too limited at this time, more explorations are needed.Also, we cannot start a CE at this meeting; we need more industry support.

M10519 – CE ShadowA new approach to the modeling of shadows was presented using shadow volumes. This works well with static shadows. However, it is very time consuming, so it is recommended to use this algorithm for simple geometry (no parametric surfaces). It was not tried with IndexedFaceSet node.

Shadow is implemented into reference software.

CommentsThe scenegraph management for shadow nodes and relationships with shapes and lights seems to be too big. We need to analyze this in detail. As this is a multi-pass algorithm, we also need to understand in more details the complexity of the proposed solution.

ResolutionContinue CE for penumbra and generic meshes. Complexity analysis of the different passes is needed.

M10593 – Implementation of AFX encoderThe following picture shows the architecture of the AFX bitstreams encoder provided generously by Samsung. This encoder enables all AFX/SNHC bitstreams to be generated and multiplexed into an mp4 files using IM1 tools.The architecture is extensible so that any AFX bitstream encoder can be added. This is a great tool

Resolution

145

Companies with AFX bitstreams should extend this tool with their bitstreams encoder.This software is added to the list of MPEG reference software.SNHC expresses its gratitude to Samsung for the donation of this tool.

M10570 – Improvement of PointTexture compressionThis proposal shows improvements in compression of PointTexture node for the depth and color fields.It was also proposed to update the BitWrapper node to support PointTexture streams. However, it was found that only the AFX stream identifier needed to be updated not the BitWrapper node coding.

ResultsDepth improvement 32-52%, color improvement 2-5%

ResolutionStill need some improvement for color information compression. So the technology is kept in the AFX/AMD1 WD.

M10691 – CE results on view-dependent multi-texturingGoal: Perform real-time view-dependent weighting of the textures.

Syntax and semantics specificationProposal is to add a weight array into the existing MultiTexture node.

The technology relies on 2 new nodes: MultiTexture is a Texture node to be used in Material.texture field. MultiTextureCoordinate is a new TextureCoordinate node to be used in

IndexedFaceSet.texCoord field.

ResolutionThe technology goes into AFX/AMD1 CDImplementation in reference software and text editing will be done within 1 month

M10579 – CE point-based renderingFor point-based rendering, it is proposed to extend existing DIBR nodes: DepthImage, SimpleTexture, PointTexture, by simply adding 'V2' at the end.Regarding compression, the scheme proposed by Samsung for PointTexture could be used but it is believed a more efficient compression is possible taking advantage of the extra fields for these nodes.

ResolutionThe CE finished: the nodes are defined and functional with very good result.Technology will be included in AFX/AMD1 CD with 1 month editing period if implemented in reference software. Compression of this node will be defined for a new AFX amendment.

M10690 – Camera calibrationThe proposal is to enhance computer graphics camera already in BIFS with more physical parameters such as lens information.

Resolution

146

MPEG-4 already provides camera support from a computer graphics point of view. We need to study the need for adding other physical parameters to model real cameras correctly.

Discussion: using quaternions in BBAIn BBA rotations is represented using Euler angles but in some cases Euler angles produce Gimbal lock effects as already discussed during Trondheim meeting last year. It is proposed to add a flag to select either Euler angles or Quaternions.This adds one bit for rotation.

ResolutionAccepted (should have been a while ago!). Correction to BBA bitstream is added to Part 16/COR1.

Physical model proposals

M10582 – Real-time water simulationA water simulator is proposed based on perturbation of a mesh representing the water. Using environment mapping and other texturing effects, stunning visual representation can be achieved in real-time.However, the proposal focuses on simulation of oceans and lakes but may not address water in small environments such a glass, sinks etc.

Other questions: How about collision detection with water? How about reflections on water?

ResolutionStart a CE on water simulation. Explore the simulation in a more global perspective with collision with other objects, reflections and so on.

M10582 – Cloth simulationA physical model is built on top of mesh linking vertices by springs. External forces apply to the mesh and collision makes it behave like a real cloth.

This type of simulation is more generally addressed by the following proposal.

M10704 – Mass-springGeneric method using physically-based animation using forces, physical models (mass-spring models). It applies on whatever anisotropic/isotropic topology.The information that must be added to such a model is:

For each vertex: mass or inverse of mass For each spring: rest length, damping, stiffness, starting and ending mass For the overall object: masses on which forces are applied

ResolutionA core experiment about physic modeling is started. The goal is to define a general and efficient representation for physically-based models.

MPEG-4 Part 21 MPEG-J extensions for renderingMPEG-4 will be extended with a new Part 21 "MPEG-J extension for rendering"

Rational for new MPEG-4 Part 21

147

The MPEG-J extensions for rendering is a set of Java APIs enabling efficient graphics capabilities to meet emerging industrial needs in graphics application combined with MPEG-J Application Engine.

Consensus in SNHCIn order to write the Working Draft for the next meeting, we agreed

To use M3G (JSR-184) as a starting point To maintain compatibility as much as possible e.g. extend M3G but not modify the APIs To work in liaison with JCP regarding extensions of JSR-184 specification To study extension of M3G for general platforms, if needed To study extension of MPEG-J for mobile platforms, if needed To study usage of M3G with MPEG

o Getting access to decoder's buffer for compositiono Investigate synchronization issueso Investigate architecture considerations for MPEG-J to support M3G, such as

MPEGlets are not MIDlets. JSR-184 is intended to be used within a Canvas. MPEG-J can't use Canvas.

Following Thursday Chairs meeting, it was decided to extend MPEG-4 with a new part:Part 21: MPEG-J extension for rendering, will contain

Normative reference to Mobile 3G Graphics (M3G) API 1.0/2003 (technically referred as JSR-184)

Extension to more general platform than mobiles Identify classes from other core Java APIs related to graphics and user interface

functionalities necessary to implement the MPEG-J Graphics API Study streaming of M3G file format Study the need for subset to cover needs in smaller footprint implementations

Editors: Mikaël Bourges-Sévenier, Vishy Swaminathan, Itaru Kaneko

AhG meeting May 17-19, Japan, hosted by Hi Corp.And Sunday before 69th meeting

Reflector: mpgj-sys

Requirements…This section summarizes the discussions with MPEG Requirements group.

SNHC profiles

M10704 - Compressed 3D profileWe propose to extend the Simple3D profile with 2 new graphics tools + backchannel:

SubdivisionSurface and WaveletSubdivisionSurface are added to Graphics' simple compressed profile

Backchannel support is added to Scenegraph's simple compressed profile profile. This doesn't increase decoder complexity since backchannel has nothing to do with decoding.

148

It has been decided that Compressed3D profile will replace Simple3D profile since the complexity is not that big between the two profiles and Compressed3D enables more applications

Support: France Telecom, Superscape, Orange, Mindego, Samsung.

ResolutionThe profile will be adopted in 14496-16/AMD1 at the next meeting if bitstream exchange is done.

M10733 - X3D Interactive profileResolutionThe bitstream exchange has been conducted. MPEG adopts the profile. It is added to 14496-16/AMD1.

M10696 – Geo-referencingMany consortia are working on geo-referencing: GeoVRML, GeoWeb, OpenGIS on the problem of coordinate systems.

Examples of applications demonstrated: "Vivre a Rennes" from ArchiVideo Geo-positioning using GPS on mobile phone: 3D rendering on mobile, 3D maps, geo-

information (shops/hotels info etc.), virtual tourism (plan your travel, find hotel, virtual monuments…)

Adaptability on bandwidth Crisis management for disaster relief management (fire, earthquakes…) Urban planning Flight simulators and games

Technologies used Wavelets for streaming city map, not for building 2.5D representation for buildings: send the footprint of the building and the client

reconstructs it. Scalability: adaptation to network bandwidth and to terminal capabilities View-dependent streaming Walkthrough or fly-over navigation

What is missing in MPEG-4 to do such applications?It seems the efficient representation of so many buildings is not possible with current MPEG-4 technologies. However, we need to understand the technical details of the technology.

It is proposed to add a new requirement to MPEG-4: Support of different coordinate systems (Cartesian, Geodetic, UTM, Geocentric). However, it is not believed that it is the role of MPEG to support different coordinate systems. More exploration is needed.

ResolutionThis is a very promising application and we encourage the proponents to submit more technical details about the technology used and to study what is missing in MPEG-4. However, the requirement proposed (MPEG should support other coordinate systems) has not been accepted.

Review of Call for Proposals on MPEG Graphics APITwo contributions: Hi's Mascot Capsule APIs and JSR-184 by UK NB.

Resolution (with Requirements and Systems)

149

MPEG should not reinvent the wheel. SNHC will study JSR-184 and recommend how to use it in MPEG-4 in a sensible way. Liaison with Java Community Process (JCP) that handles JSR-184 will be established. We need to understand the copyright issues regarding modifications of JSR-184 API.

Resolutions of SNHC

Output documentsNo. Title TB

PAvailable

Editor

14496-16 MPEG-4 Animation Framework eXtension (AFX)

6310

AFX CE description No 04/04/02 Marius Preda

6311

ISO/IEC 14496-16/AMD1 WD 4.0 No 04/03/26 Marius Preda

6312

AFX VM 14.0 No 04/03/26 Marius Preda

6313

AFX 14496-16/DCOR1 No 04/03/26 Marius Preda

ResolutionsMPEG-4Part 4

The SNHC subgroup would like to thank all the companies who contributed bitstreams for conformance of AFX technologies.

The SNHC subgroup would like to express its gratitude to Samsung for conducting the verification of all the conformance bitstreams.

Part 5 The SNHC subgroup acknowledges the development and donation of the generic AFX

streams encoder by Samsung.Part 16

The SNHC subgroup informs on the removal of the following tools from the specification if no implementation is provided until the 69th meeting:

o Light-Field mapping proposed by Intel Corp.o Solid modeling proposed by SGDL Systemso Particle systems proposed by Octaga

The SNHC subgroup informs companies that no technology will be promoted to Committee Draft stage without implementation in MPEG reference software.

Part 21 The SNHC subgroup would like to thank the companies who responded to the Call for

Proposals on MPEG Graphics API: Hi Corp., PacketVideo, Waseda University, UK National Body.

The SNHC subgroup is pleased to announce that Mobile 3D Graphics (JSR-184) specification has been chosen as the starting point for its graphics API in the new MPEG-4 Part 21 MPEG-J extensions for rendering specification.

150

Establishment of SNHC Ad-Hoc groups

No. Title Meeting

Chair

6350

AhG on AFX documents, CEs, and software

04/07/18

Marius Preda

6351

AhG on MPEG-J extensions for rendering

04/07/18

Mikaël Bourges-Sévenier

N6350 Ad Hoc Group on AFX documents, CEs, and softwareMandates: 1. Maintain and edit 14496-16/AMD1 WD document

2. Maintain and edit SNHC VM document.3. Coordinate SNHC CE activities.4. Coordinate XMT representation of AFX technologies5. Coordinate AFX/AMD1 software implementation

Chairman: Marius Preda (INT)Co-chairs: Mahnjin Han (Samsung AIT)

Mikaël Bourges-Sévenier (Mindego)Duration: Until 69th meeting Meetings Sunday before 69th meetingReflector: mpeg-snhc AT gti. ssr. upm. esSubscribe: Send an email to mpeg-snhc-request AT gti. ssr. upm. es with the message

“subscribe” as the first line in the body.

N6351 Ad Hoc Group on MPEG-J extensions for renderingMandate: 1. Maintain and edit 14496-21 WD document

2. Study extension of M3G for general platforms3. Study feasibility of M3G subset for smaller footprint implementations4. Study the combination of MPEG-J and M3G

Chairman: Mikaël Bourges-Sévenier (Mindego Inc.)Co-chairs: Vishy Swaminathan (Sun Microsystems)

Itaru Kaneko (Waseda University)Duration Until 69th meeting Meetings: May 17-19, Tokyo, Japan hosted by Hi Corp.

Sunday before 69th meetingReflector: mpgj-sys AT advent. ee. columbia. eduSubscribe: Send an email to mpegj-sys-request AT advent. ee. columbia. edu with the

message “subscribe” as the first line in the body.

Closing of the MeetingSee you in Seattle i

151

Annex 11Report of Integration meeting

Opening of the Meeting

Allocation of contributionsMonday Plenary

10459 Mahnjin HanPatrick Gioia AHG on AFX Conformance

10460 Jens Spille AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4

10461 Ralph Sperschneider Report of the AHG on MPEG-4 Audio Conformance

10462 Ralph SperschneiderHeiko Purnhagen Report of the AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software

10470 Xin Wang, Jaime Delgado, Chris Barlas AHG on MPEG-21 REL and RDD Reference Software

10473 Christian TimmererGerrard Drury … AHG on MPEG-21 DIA Reference Software

10474 Gerrard DruryFrederik De Keukelaere… AHG on MPEG-21 DIP Reference Software

10476 T. Chiang, Yi-Shin Tung, Chung-Neng Wang

AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

10485 Jean-Claude Dufourd AHG on Reference Software

10486 Chun-Jen TsaiMihaela van der Shaar… AHG on MPEG Multimedia Test Bed

10487 Thomas DeMartiniSylvain Devillers… AHG on MPEG-21 Conformance

Joint with MDS in MDS room, Tuesday 15:50-18:00, on MPEG-21 Conformance

10573 Eva RodriguezJaime Delgado… DMAG REL Interpretation Conformance

10628 Thomas DeMartiniV. Venkatraman… Contribution to MPEG-21 REL Interpretation Conformance Test Cases

Joint with MDS in MDS room, Tuesday 18:00-19:00, on MPEG-21 Reference Software

10521 Xin WangV. Venkatraman… Simple Integration Reference Software for MPEG-21 REL and DID

10574 Eva Rodriguez, Jaime DelgadoDMAG REL License Interpretation using RDD term genealogy – Implementation using Web

Services

10575 Victor Torres, Jaime Delgado…Contribution to DID/REL/RDD reference software: DMAG REL License Interpretation within

DID using RDD term genealogy

10577Jaime Delgado, Eva

Rodriguez… Status of DMAG Reference Software for MPEG-21 REL/RDD/DID

10702Roberto Garcia, Jaime

Delgado… MPEG REL and RDD Ontologies API

10703Roberto Garcia, Jaime

Delgado… RELOntos (REL Ontologies)

Integration Plenary, Thursday 14:00 to 16:00, Systems room

Conformance

10700 Ralph Sperschneider Status on MPEG-4 Audio Conformance

10550 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/PDAM 2

10543 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 7

10545 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/PDAM 8

10726 Ji Ming Study Text of ISO/IEC 14496-4:2002/FPDAM4 (MPEG-4 IPMPX Conformance)

10733 Mikael Bourges-SevenierAaron E. Walsh X3D Interactive profile, bitstream exchange update

10678 Kristofer Kjörling Proposed additions to the ISO/IEC 13818-4:200X/PDAM2 (Audio Conformance) document in order to specify SBR conformance for MPEG-2.

152

10679 Kristofer KjörlingAndreas Schneider Additions to, and clarifications of MPEG-4 SBR conformance.

10694 Heiko PurnhagenMartin Wolters Proposed clarifications of AAC conformance testing

Reference Software

xxxx CJ et al Study of Multimedia Test Bed document

xxxx JCD / Ralph Progression of WD of MPEG-2 Software Simulation 2nd Edition

10527 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-4:200X/FDAM 3 [SC 29 N 5834]

10584 Michael RansburgChristian Timmerer… Status Report and Improvements of the MPEG-21 DIA Reference Software

10593 Gyeong Ja JangJames D. K. Kim Implementation the Reference software of AFX Encoder and User Guide

10609 Frederik De KeukelaereRik Van de Walle Contribution to DID 2nd Edition reference software

10610 Frederik De KeukelaereRik Van de Walle Contribution to DII reference software

10655 Marius PredaFrancoise Preteux… MorphShape Node Implementation in Reference Software

10739 Jeho NamHyuk-Min Kwon… Examples of Java Native Interface (JNI) for MPEG-21 DIA Reference SW

xxxx past resolution

In order to fill with appropriate text the Description section of the MPEG Reference Software Guide, the Integration subgroup kindly requests from all implementers a short description of their production including: language, status, functional description, input format or API, output format or API, dependencies and any other information deemed appropriate.

xxxx Frederik and Gerrard update on software for DIP

10662 Shlomo Birman et al SynthesizedTexture Implementation in IM1

List of standards under developmentStd Pt Edit. Projec

tDescription Cf

PWD CD FCD FDIS

2 4 2004 Amd.1 IPMP Conformance Ext. 03/03

03/07

03/12

04/07

2 4 2004 Amd.2 Audio Conformance Ext. 03/10

03/12

04/03

04/07

2 5 2004 Dam1 IPMP Ref.Soft. Ext. 03/07

03/12

4 4 2003 Amd.4 IPMP Extension Conformance

02/07

02/12

03/07

04/03

4 4 2004 Amd.6 AVC 03/07

03/12

04/07

4 4 2003 Amd.7 AFX Conformance 02/07

02/12

03/10

04/03

4 4 2004 Amd.8 HE-AAC, ABIFS and SA 03/10

03/12

04/03

04/10

4 4 2004 Amd.9 AVC PE Conformance 04/03

04/07

04/10

05/03

4 4 2004 Cor.1 Visual Bitstreams 04/03

04/10

05/01

4 5 2004 Amd.6 AVC and Audio SBR 03/03

03/07

03/12

04/07

4 5 2003 Amd.7 AFX Reference SW 02/10

02/12

03/12

04/07

153

7 6 2001 Amd.1 Reference software extensions

01/12

03/03

03/12

04/07

7 7 2004 Amd.1 Conformance extensions 03/03

03/07

03/12

04/07

21 8 200x 1st Ed. Reference software 03/03

04/03

04/07

05/01

21 12 200x 1st Ed. Test Bed for MPEG-21 Resource Delivery

02/12

03/12

04/07

21 14 200x 1st Ed. Conformance 03/10

04/03

04/07

05/01

Latest references

Project P. Standard Issue No.MPEG-4 4 ISO/IEC 14496-4:2003 (MPEG-4

Conformance 2nd Ed.)02/12 Awaji N5457

MPEG-4 4 ISO/IEC 14496-4:2001/Amd.1 (FlexTime, Studio and Streaming Video Profile)

02/07 Klagenfurt

N5083

MPEG-4 5 ISO/IEC 14496-5:2001 (Ref. Soft 2nd Ed.) 01/07 Sydney N4368MPEG-4 5 ISO/IEC 14496-5:2001/Amd.1 (FlexTime) 02/03 Jeju N4711MPEG-4 5 ISO/IEC 14496-5:2001/Amd.2 (XMT) 02/05 Fairfax N4865MPEG-7 6 ISO/IEC 15938-6:2002 (Reference Software) 01/12 Pattaya N4475MPEG-7 7 ISO/IEC 15938-7:2002 (Conformance) 02/07

KlagenfurtN4937

Request documentsn4904, Fairfax, request for 21000-8, editors: Olivier Avaro, Ian Burnett, Andrew Perkis

MPEG-2 ConformanceContributions were presented in the Audio group. This results in the promotion of 13818-4 FPDAM2.

MPEG-2 Reference SoftwareWe are waiting for a COR to be voted to integrate it in the second edition, so the draft 2 nd edition is not promoted at this meeting.

MPEG-4 Conformance (14496-4) 10726 Ji Ming Study Text of ISO/IEC 14496-4:2002/FPDAM4 (MPEG-4 IPMPX Conformance)

This is an updated conformance document with additional bitstreams. This comes with a demo. The group recommends to have a look at this demo during the plenary, if time permits.

154

MPEG-4 Reference Software (14496-5)

10593 Gyeong Ja JangJames D. K. Kim Implementation the Reference software of AFX Encoder and User Guide

This contribution was presented. This is a missing element in the utility software.

10662 Shlomo Birman et al SynthesizedTexture Implementation in IM1

This contribution was not presented because neither of the authors was present during the Integration plenary

MPEG-21 Conformance1057

3Eva RodriguezJaime Delgado… DMAG REL Interpretation Conformance

This contribution and the software were presented. The status of the software was discussed and clarified: it will go into the utility section of the reference software document for MPEG-21. To be added to the conformance WD.

10628

Thomas DeMartiniV. Venkatraman…

Contribution to MPEG-21 REL Interpretation Conformance Test Cases

This contribution presents a set of test cases that were used in the validation of the previous tool. These sequences will serve as basis of the initial test set for REL conformance.To be added to the conformance WD.

State of the WD and possible promotion to CD:The current WD contains conformance for all sections but DID. Action: Rik to provided a suitable paragraph to the editors. The DIA section is then discussed. The REL is discussed for a long time. In the end, we decided to only specify description conformance (bitstream conformance in previous MPEG standards).

MPEG-21 Reference Software

10521 Xin WangV. Venkatraman…

Simple Integration Reference Software for MPEG-21 REL and DID

10574 Eva Rodriguez, Jaime Delgado

DMAG REL License Interpretation using RDD term genealogy – Implementation using Web Services

10575 Victor Torres, Jaime Delgado…

Contribution to DID/REL/RDD reference software: DMAG REL License Interpretation within DID using RDD term genealogy

10577 Jaime Delgado, Eva Rodriguez…

Status of DMAG Reference Software for MPEG-21 REL/RDD/DID

10702 Roberto Garcia, Jaime Delgado… MPEG REL and RDD Ontologies API

155

10703 Roberto Garcia, Jaime Delgado… RELOntos (REL Ontologies)

These contributions were presented. There was discussion about how to insert these in the reference software working draft.No decision yet on the promotion of the document.

10609 Frederik De KeukelaereRik Van de Walle Contribution to DID 2nd Edition reference software

This is a candidate for the integration of MPEG-21 reference software and material for the DII part. The Integration group is impressed and thanks UGhent for their excellent work.

10610 Frederik De KeukelaereRik Van de Walle Contribution to DII reference software

This is part of the above software.

10584 Michael RansburgChristian Timmerer… Status Report and Improvements of the MPEG-21 DIA Reference Software

This contribution describes the current status of the DIA reference software, with a few missing bits, and also many improvements since last meeting’s version. There is a need until next meeting to update the reference software to FDIS status (could not be done before because the FDIS has only been available since the beginning of the week). The Integration group thanks Christian and UniKLU for their excellent integration work.

10739 Jeho NamHyuk-Min Kwon… Examples of Java Native Interface (JNI) for MPEG-21 DIA Reference SW

This contribution gives a useful example guiding proponents for integration of a native module.

xxxx Frederik and Gerrard update on software for DIP

This is a report from discussions on what the reference software for DIP should be. The basis will be a refactored version of the Wollongong software, and the Ghent software will be integrated to it, and the Sun contributions as well. Last question: promotion of MPEG-21 reference software as CD. The consensus of the group is that the components are all ready (everything which has reached FDIS). The editing period will be one month. Frederik is to be named coordinating editor of the MPEG-21 Reference Software document and the list of co-editors needs to be cleaned up.

Multimedia Test BedThere was a discussion about the need for a Study document. The rationale was presented:

- port of DIA and IPMP- as a consequence new APIs- two week editing period

MPEG Reference Software Guide

156

xxxx Convenor

In order to fill with appropriate text the Description section of the MPEG Reference Software Guide, the Integration subgroup kindly requests from all implementers a short description of their production including: language, status, functional description, input format or API, output format or API, dependencies and any other information deemed appropriate.

IPMP group has modified their document to answer that request. After the meeting, this will be formatted into a module description and offered as example to follow for the other module authors.

157

Unpublished Integration Standards

13818-4 200X

Conformance testing 03/10/24 Editor

To be submitted to SC 29

13818-5 200X

Reference Software 03/12/12?

13818-5 200X

Amd.1

Reference Software (MPEG-2 IPMP)

03/12/12?

DAM

14496-4 2003 2nd Ed Conformance testing ITTF To be published14496-4 2003 Amd.

1Conformance Testing (Conformance testing for MPEG-4)

ITTF FDAM to be issued by ITTF

14496-4 2003 Amd.2

Conformance Testing (MPEG-4 Conformance extensions for XMT and media nodes)

ITTF FDAM to be issued by ITTF

14496-5 2001 Amd.2

Reference SW2nd ed. (XMT, DMIF)

02/05/10 ITTF to be published

14496-5 2001 Amd.3

Reference SW2nd ed. (Visual new level and tools)

03/03/14?

15938-6 Reference Software 01/12 ITTF Under FDIS ballot (Closing 2003-04-04-27)

15938-7 Conformance testing 02/10/25 Editor

Prepare FDIS text

158

Resolutions of Integration

Resolutions

1. The Integration subgroup reiterates its kind request to reference software authors for all parts of all MPEG standards to document their production for insertion in the MPEG reference software guide by the next meeting. An example based on a contribution from the IPMPX contributors will be posted on the MPEG Reference Software ad-hoc group reflector.

2. The Integration subgroup recommends appointing Frederik De Keukelaere (University of Ghent), Xin Wang (ContentGuard), Gerrard Drury (ENIKOS) and Chistian Timmerer (University of Klagenfurt) as editors of the 21000-8 MPEG-21 Reference Software.

Documents

MPEG-2

No. Title TBP Available

13818-4 MPEG-2 Conformance 6461 DoC on ISO/IEC 13818-4:200X/PDAM2 Audio Conformance Ext. N 04/03/196462 Text of ISO/IEC 13818-4:200X/FPDAM2 Audio Conformance Ext. N 04/03/19

MPEG-4

No. Title TBP Available

14496-4 MPEG-4 Conformance 6463 DoC on ISO/IEC 14496-4:2003/FPDAM4 IPMP Conformance Ext. N 04/03/196464 Text of ISO/IEC 14496-4:2003/FDAM4 IPMP Conformance Ext. N 04/03/196465 DoC on ISO/IEC 14496-4:2003/FPDAM7 AFX Conformance Ext. N 04/03/196466 Text of ISO/IEC 14496-4:2003/FDAM7 AFX Conformance Ext. N 04/03/196467 Doc on ISO/IEC 14496-4:2003/PDAM8 HE-AAC, ABIFS & SA Conf. N 04/03/196468 Text of ISO/IEC 14496-4:2003/PDAM8 HE-AAC, ABIFS & SA Conf. N 04/03/19

6353 WD of ISO/IEC 14496-4:2003/AMD9 AVC Fidelity Range Extension Conformance

N 04/04/30

MPEG-21

No. Title TBP Available

21000-8 MPEG-21 Reference Software6470 Text of ISO/IEC 21000-8 CD MPEG-21 Reference Software 04/03/19

No. Title TBP Available

21000-12 MPEG-21 Test Bed for MPEG-21 Resource Delivery 6471 Study of ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource N 04/04/04

159

Delivery

No. Title TBP Available

21000-14 MPEG-21 Conformance6472 WD3.0 of ISO/IEC 21000-14 MPEG-21 Conformance 04/03/19

160

AHG

N6473 AHG on MPEG-21 Reference SoftwareMandate: 1. Develop and maintain reference software for the individual parts of MPEG-

21 as well as integrated MPEG-21 reference software,2. Follow the implementation plans of relevant parts of MPEG-213. Investigate transfer of the MPEG-21 reference software to the NIST site,4. Check and improve the MPEG Reference Software Guide.

Chairman:

Xin Wang (ContentGuard, xin.wangX@Xcontentguard.com), Christian Timmerer (University Klagenfurt – christian.timmererX@Xitec.uni-klu.ac.at), Gerrard Drury (ENIKOS, gerrardx@xenikos.com), Jean-Claude Dufourd (ENST, dufourdX@Xenst.fr)

Duration: Until 69th Meeting Meetings No meeting. Business will be conducted by E-mail or telephone conference.Reflector: mpeg-21-refsw@uow.edu.au Subscribe: Send email with “Subscribe mpeg-21-refsoft” to majordomo@uow.edu.au

161

Annex 12Report of Test meeting

Opening of the Meeting

Goals for the weekThe goals of this week are:

Presentation and discussion on results from SVC CfP Discussion on CE for ongoing SVC activities Presentation of results from Verification Tests for the MPEG-4 Error Resilient Simple

Scalable Profile

Joint MeetingsThe following joint meetings were scheduled

with JVT – Objective video quality measure with Video – SVC & Error resilience Test reports

Contributions10737 Subjective test results for the CfP on Scalable Video Coding Technology (Baroncini / Oelbaum)10744 Results of the MPEG-4 Error Resilient Simple Scalable Profile Verification Test (Baroncini / Reid)

Test Activities

Subjective test results for the CfP on Scalable Video Coding Technology (Baroncini / Oelbaum)Subjective tests were made at TUM (Munich) and ISCTI (Rome) between February 27th and March 12th . A SS (single stimulus) method was used to obtain the results, votes were given based on a discrete eleven grade scale. Confidence intervals were below 0.7 for all results. Parts of the tests were performed independently in both laboratories.Results have shown evidence that new scalable video coding technologies exist that provide subjective results within the range of <0.5 average deviation measured by an MOS scale, as compared to a high-quality single layer anchor. In some cases of rate points, it was found that scalable algorithms could perform superior to the anchor

SVC CEAn „expert viewing“ test method will be used to evaluate the different proposals in the CE process. With this method a ranking between different proposals can be made using only very few (4 to 5) experts and without the need of special resources. This method provides reproducible results for a CE process. A detailed description of this test method will be given as an input document to the next meeting.

162

Results of the MPEG-4 Error Resilient Simple Scalable Profile Verification Test (Baroncini / Reid)The new MMDSCQE (Multi Media Double Stimulus Continuous Quality Evaluation) was used in this test to compare the unimpaired (but compressed) with the impaired video. Progressive scan displays were used for the test and a PC mouse was used by the subjects to provide their quality observations. Error patterns were gained using a GPRS link layer simulator.The results clearly show the effectiveness of the Error Resilient Simple Scalable Profile compared to the Simple Scalable Profile in an error prone environment as it is typical for a GPRS based communication.

Objective video quality measure The work presented in JVT-J024 contains some very strong weaknesses of which the most important one is that the quality evaluation presented here does only consider the luminance values and ignores the color information. The test group believes, that current objective quality measures can not replace a careful designed subjective evaluation.The author is encouraged to continue his work in groups that work on objective quality measurements (e.g. VQEG).

Test Resolutions

Output Documents 6382 Results of the MPEG-4 Error Resilient Simple Scalable Profile Verification Test 6383 Subjective test results for the CfP on Scalable Video Coding Technology

AdHoc GroupsNo AdHoc Groups have been set up at this meeting. The video group has setup the AhG for the “SVC call for proposal”.

ResolutionsThe Test Subgroup would like to thank the following companies for their financial support to the AVC verification test

Microsoft Motorola NTT DoCoMo

The Test Subgroup would like to thank all parties involved in the MPEG-4 Error Resilient Simple Scalable Profile Verification Test, in particular

Vittorio Baroncini (FUB) for preparation of the test subjective test conduction and results processing.

Gus Reid (Motorola) for preparation of the test and reporting the results.

The Test Subgroup would like to thank all the participants to the SVC CfP testing activities and in particular:

Konstatin Hanke Thomas Russert and Matthias Wien, (RWTH Aachen) for the preparation of the test material.

Vittorio Baroncini (FUB) for preparation of the subjective test. Vittorio Baroncini (FUB), Angelo Ciavardini and Giancarlo Gaudino (ISCTI); for

the subjective test conduction and results processing.

163

Vittorio Baroncini (FUB) for the preparation of the report.

164

Annex 13Report of ISG meeting

Source: ISG ChairEditor: Marco Mattavelli (EPFL)

OverviewThe main work items of the Implementation Studies Subgroup in Munich are:

1. The advances in the development of the MPEG-4 “Part 9 Reference Hardware Description” Phase 2 concerning the integration of the MPEG-4 Optimized Reference software Part 7 and the Reference Hardware Part 9 so as to constitute a “mixed” software hardware description of MPEG-4 video using the concept of the virtual socket.

2. The planning and extensions of the integrated framework for the support to the development of MPEG-4 Part 9 with MPEG-7 part 7 and AVC (MPEG-4 Part-9) software.

Input contributions w.r.t. the above items are summarized according to the following table:

Contributions

M10457

“Report of the AHG on MPEG-4 Part 9 "Reference Hardware Description"

Marco Mattavelli EPFL, Robert Turney Xilinx Research Lab.

M10523

HDL Virtual Socket Platform Rev 1.0 for MPEG-4 Part 9

Paul SchumacherRobert Turney

Detailed Report

Reference hardware description for MPEG-4

The ISG activity at the Munich meeting has mainly been devoted to: the review of contribution on the “Virtual Socket” concept, the planning of the releases and advances on the integrated framework supporting the virtual

socket idea on the drafting of the new edition of the PDTR for MPEG-4 part 9, on the specification of the July demonstration, on the update of the Part 2 and Part 10 module submission commitments..

The release “1” of the integrated environment running the mixed software/hardware description (MPEG-4 Part 9 and Part 7) using the chosen platform (Wildcard II) has been distributed to the

165

MPEG contributors to the development of Part 9 four weeks before the meeting. The updated work-plan and detailed description of new releases and extensions is the following:

Release “1” (current available version): The initial release of the virtual socket connects to the LAD bus interface on the WildCard-II. The memory-map for the WildCard-II provides each hardware accelerator with four defined regions: Read-Only Registers, Write-Only Registers, Read-Only Memory and Write-Only Memory. There also exists a master interface that provides access to the hardware accelerator identification register. Each virtual socket development team will be assigned a bit that acts as presence indicators so that software may determine which hardware accelerators are present within the framework. The basic functionality of the virtual socket interface is to route the host traffic to and from the appropriate hardware accelerator. As an example of creating a hardware accelerator it has been created a block move design. The VHDL file, vs_blockmove.vhd, demonstrates how one may connect to the virtual socket top-level located in virtual_socket.vhd. This demonstrates the support for the HDL flow in Revision 0. The virtual socket interface provides four strobe signals to each HWA indicating when a read or write is occurring to its register or memory regions. The HWA then must act appropriately and in cases of reads, must provide a strobe back to the top level indicating the data it is providing is valid. Revision 0 also provides support for the Handel-C language. The virtual socket interface is functionally identical to the HDL design with the exception of imported WildCard-II LAD bus interface VHDL source. The interface to the LAD bus is provided in Handel-C code. An external memory interface support is also introduced in this release. There is 2MB of 133 MHz ZBT SRAM located on the WildCard-II, and in Revision 1.0, this memory is accessible by both the host software and hardware accelerators on the virtual socket. Software may address the SRAM memory via the master unit. Since the entire address space of the SRAM is not addressable directly, the user must use a segment-offset technique that requires the writing to a 32-bit start address register mapped in the master unit’s register space. The most significant bit (31) of the start address indicates whether accesses are to the read or write only memory regions of the master: if 0, the ZBT SRAM; if 1, to the SDRAM. A ZBT controller is provided within the virtual socket top-level that allows three hardware accelerators to access the SRAM. An external block move example is provided to demonstrate the additional control signals to interface with the ZBT controller defined by the VHDL file zbt_manager.vhd. Hardware debugging support is also provided via a tool called ChipScope. Using the WildCard-II’s Left User I/O external connector, a hardware accelerator developer can debug their designs.

Release 1.1 (release plan on 15th April 2004) A DRAM controller will be added in Revision 1.1 to read and write to the 64MB of 266 MHz DDR SDRAM located on the WildCard-II. This complements the access to the ZBT SRAM provided in Release 1.0.

Release 2.0 (release on 30th April 2004) Support for co-simulation is provided in Release 2.0. A user can co-simulate their host software with their hardware code defined in either Handel-C code or HDL code.

Release 3.0 (release on 15th may 2004) Release 3.0 will provide DMA access to the virtual socket platform allowing faster access to the hardware accelerators. Support for interrupts will also be provided. The MPEG-4 Part 10/AVC code will also be integrated into the code tree.

Download Instructions for all releases:

All releases will be posted to the following ftp site:

166

ftp://mpeg:76a43uV@ftp.xilinx.com/pub/MPEG-ISG/Each release will be contained in a zip file named MPEG_platform_revXX.zip, where XX is the release number.

An updated table of module submission commitment has been defined (question marks indicate that the commitment is uncertain concerning the delivery date or that the module has not been selected for a submission commitment):

Part 9BlockName

MPEGPart

Document submission

VHDLsubmission

Integration in the Framework

Conformance test

DCT/IDCTUniv. Calgary

2 Done Done Univ. Calgary Framework

4/30/2004

DCT/IDCTXilinx

2 Done Done 4/30/2004 4/30/2004

Motion comp. EngineUniv. Calgary

2 Done Done 4/30/2004 4/30/2004

Part 9 AMD 1BlockName

MPEGPart

Document submission

VHDLsubmission

Integration in the Framework

Conformance test

IDCT (8x8)University of Aveiro-Portugal

2 31/03/2004 31/03/2004 30/04/2004 15/05/2004

IQUniversity of Aveiro-Portugal

2 7/04/2004 7/04/2004 21/05/2004 31/05/2004

ISUniversity of Aveiro-Portugal

2 7/04/2004 7/04/2004 21/05/2004 31/05/2004

VLDUniversity of Aveiro-Portugal

2 7/06/2004 15/06/2004 21/06/2004 31/06/2004

VLD-IS-IQ-IDCTUniversity of Aveiro-Portugal

2 7/06/2004 15/06/2004 30/06/2004 07/07/2004

VLD-IS-IQ-IDCT + Motion Comp??

2 ?? ?? ?? ??

4x4 DCT/IDCT Luma University of Aveiro-Portugal

10 16/08/2004 16/08/2004 21/08/2004 31/08/2004

2x2 Chroma TransformUniversity of Aveiro-

10 16/08/2004 16/08/2004 21/08/2004 31/08/2004

167

PortugalDCT/IDCT for Intra 16x16 macroblock typeUniversity of Aveiro-Portugal

10 16/08/2004 16/08/2004 21/08/2004 31/08/2004

4x4 Transform for SP framesUniversity of Aveiro-Portugal

10 31/08/2004 7/09/2004 15/09/2004 15/09/2004

Motion estimationUniv. Dublin

2/10 Done 31/05/2004 31/05/2004 31/05/2004

Motion estimation Univ Dijon

2/10 July 2004 31/06/2004 31/06/2004 31/06/2004

Direct Quant(LISIF) ?

2/10 ? ? ? ?

Direct Zig-ZagScan LISIF

2/10 31/05/2004 31/05/2004 15/06/2004 30/06/2004

VLC LISIF

2/10 31/05/2004 31/05/2004 15/06/2004 30/06/2004

DCT/Q/ZZS/VLC(LISIF) ?

2/10 ? ? ? ?

CAVLCGhent Univ

10 15/7/2004 15/7/2004 ? ?

CABACGhent Univ

10 15/7/2004 15/7/2004 ? ?

Luma 4x4 integer DCT/IDCTGhent Univ

10 15/7/2004 15/7/2004 ? ?

The ad-hoc group on the development of MPEG-4 Part 9 has been re-established with the usual mandates, including a specific mandate for the specification and development of the demonstration platform. The ad-hoc schedule includes 4 telephone conferences before next meeting. Phone conferences are planned on 15th Apr., 13th May, 3th June, 25th June. at 3 p.m. GMT. Tel: (from US 1-877-582-3182, from outside US 1-706-679-1128, participant code 9202060193).

IMPORTANT: due to mail spamming a new reflector address has been established at : refhwmpeg@listes.epfl.chTo subscribe to the reflector send an email to: refhwmpeg-subscribe@listes.epfl.ch

ResolutionsThe above activities have led to the following resolutions and output document

approval.

168

MPEG-4 part 9 related resolutions:

The Implementation Studies subgroup recommends to approve the following documents

No. Title TBP Available

14496-9 MPEG-4 Reference Hardware Description N6307 ISO/IEC 14496-9/PDAM of AM 1: Information Technology – Coding

of Audio Visual Objects - Part 9: Reference Hardware Description.N 04/04/30

N6308 Request for Reference Hardware Description Extensions N Y

The Implementation Studies subgroup recommends to establish a protected CVS repository for the submission and appropriate maintenance of the reference hardware modules and the integrated framework implementing the virtual socket API for hybrid software hardware platforms.

169

Annex 14Report of Liaisons meeting

Source: Jan Bormans

Following a request of the “Audio Video Coding Standard Working Group of China (AVS)” for a formal Liaison relationship, WG11 has asked SC29 for the approval of a class C Liaison between both organisations. AVS’s mandate is to establish standards for compression, decompression, manipulation and display in digital audio and video multimedia equipment and systems. At present, AVS comprises five sub-groups, concerned with audio, video, requirements and testing, system and implementation, and security and copyright. The benefits of establishing a Class C liaison are to facilitate: The active participation of AVS to MPEG standardization; and The efficient and timely exchange of information of work in progress.(MPEG-2) IPMP technologies are expected to be the first topic of collaboration.

The Liaisons Group considered the following input documents:

Contribution No.

Title

M10496 ISO/IEC FCD 19774: Information technology -- Computer graphics and image processing -- Humanoid animation (H-Anim) (SC24)

M10497 Liaison Statement from the TV-Anytime ForumM10501 Liaison Statement from the TV-Anytime ForumM10539 Liaison Statement from 3GPPM10620 CRF Liaison to MPEGM10633 SMPTE Liaison to MPEG on V/ISAN and ISO 13818-1 DAM4

M10659 IEC CDV 62297-1: Triggering messages for broadcast applications -- Part 1: Format [SC 29 N 5856]

M10660 IEC CDV 62297-2: Triggering messages for broadcast applications -- Part 2: Transport [SC 29 N 5857]

M10725 Liaison Statement from 3D ConsortiumM10736 China AVS Response to WG11 N6119M10738 Liaison Statement from ISO TC 46/SC 9M10750 Liaison Statement from IEEE LTSC

In addition to replying, when appropriate, to the incoming Liaison Statements, it was agreed to take the initiative to send outgoing Liaison Statements to: TV-Anytime Forum (on TV-Anytime metadata specifications), SMPTE (on V/ISAN and ISO 13818-1 DAM4), AVS China (on IPMP), ISO TC 46/SC 9 (on V/ISAN and ISO 13818-1 DAM4), IEEE-LTSC (on MPEG-21 REL), W3C (on Call for Proposal on Lightweight Scene Representation), and JPEG (on JPEG 2000 new activities and explorations).

Given the potential importance of the Call for Proposals on MPEG-21 IPMP for the organisations WG11 is in Liaison with, it was decided to widely distribute it to them: for a complete list of recipients see the list below in the Liaison resolutions.

170

The responses for the non-technical National Body comments as well as an updated list of organisations with which MPEG entertains liaisons were completed.

The following recommendations were issued:

The approval of the following documents (Liaison Statements):

Title No.Liaison Statement to the TV-Anytime Forum N6340Liaison Statement to SMPTE on V/ISAN and ISO 13818-1 DAM4 N6341Liaison Statement to AVS China N6342Liaison Statement to ISO TC 46/SC 9 N6343Liaison Statement to IEEE-LTSC N6344Liaison Statement to W3C N6345Liaison Statement to JPEG N6346Information on MPEG-21 IPMP Call for Proposals N6425

The approval of the following documents (statement of benefits):

Title No.Statement of benefits from establishing a Class C liaison with AVS China N6347

The approval of the following documents (other Liaison documents):

Title No.Responses to NB Comments N6348List of WG11 Liaisons N6349

The Liaison group recommends the approval of the new Class C Liaison with AVS China.

The Liaison groups requests the SC29 secretariat to send N6425 to following organizations in Liaison:

o CIDF: Content ID Forumo Content Reference Forum (CRF)o DAISY Consortiumo DVB: Digital Video Broadcastingo EDItEURo IDF: International DOI Foundationo IEEE Learning Technology Standards Committeeo IFPI: International Federation of the Phonographic Industryo ISMA: Internet Streaming Media Allianceo OASIS - Right Language Technical Committeeo OeBF: Electronic Book Exchange Working Groupo OMG: Object Management Groupo Third Generation Partnership Project (3GPP)o TVA: TV-Anytime Forumo UMTSF ICTG: Universal Mobile Telecommunications Systems Forum, Information

Communication Technology Group

171

Nomination of liaison representatives:o Shen Sheng Mei to AVS China

172