146
INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956 March 2001 Source: Leonardo Chiariglione – Convenor Title: Report of 56 th WG 11 meeting Status : 1 Opening The fifty-sixth WG11 meeting was held in Singapore on 01/03/05-09 at the kind invitation of Singapore Productivity and Service Bureau (PSB), the Singapore National Body. 2 Roll call of participants The attendance list is given in Annex 1. 3 Approval of agenda The attendance list is given in Annex 1. 4 Allocation of contributions The list of submitted contributions is given in Annex 1. 5 Communications from Convenor There were no communications 6 Report of previous meetings The reports of La Baule and Pisa were approved. 7 Processing of NB Position Papers The following documents were presented, discussed and responses drafted where appropriate: 1

INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Embed Size (px)

Citation preview

Page 1: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N3956March 2001

Source: Leonardo Chiariglione – ConvenorTitle: Report of 56th WG 11 meetingStatus:

1 Opening The fifty-sixth WG11 meeting was held in Singapore on 01/03/05-09 at the kind invitation of Singapore Productivity and Service Bureau (PSB), the Singapore National Body.

2 Roll call of participants The attendance list is given in Annex 1.

3 Approval of agenda The attendance list is given in Annex 1.

4 Allocation of contributions The list of submitted contributions is given in Annex 1.

5 Communications from Convenor There were no communications

6 Report of previous meetings The reports of La Baule and Pisa were approved.

7 Processing of NB Position Papers The following documents were presented, discussed and responses drafted where appropriate:

M7110 China NB Comments on the requirements of Advanced FGS M6998 FNB Comment M7034 French NB Support to 2D BIFS Profiles under Consideration M7062 FNB comments for the Singapore meeting M6984 UK NB Position on Document Handling M6985 UK NB Position on MPEG-21 Call For Proposals M6986 UK NB Input to the Guide for Meeting Hosts M6987 NB posiiton on the disposition of meeting funds. M6996 UK NB Position re progression of the MPEG-21 PDTR

1

Page 2: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

M7095 UK National Body position on the development of the MPEG-7 Experimental Model, (XM)

M6954 USNB Contribution: Position on Advanced FGS M6955 USNB Contribution: WG 11 Document Policy M6956 USNB Contribution: Proposed Liaison letter M6957 USNB Contribution: Digital Cinema CfP clarification

8 MPEG Phase 2 No MPEG-2 related work was done at the meeting.

9 MPEG Phase 4

9.1 Requirements 9.2 Systems Work progressed on the different areas of interest with several WDs and Studies of documents under ballot being produced.The Request for Part 8 of 14496 (N4080) and the Text of ISO/IEC 14496-8/CD N4081 were approved.

9.3 Visual 9.3.1 Standard

No specific work done at the meeting.

9.3.2 Extension 1

The workplan for Studio Profile Verification Tests was approved as follows:

Tests July through October 2001Results October 2001

9.3.3 Extension 2

The workplan for Streaming Video Profiles Verification Tests was approved as follows

Tests September 2001Results October 2001

9.4 Audio Work progressed on the different areas of interest, however, no MPEG-4 Audio-related documents were proposed for approval.

9.5 Conformance Testing 9.5.1 Standard

The integrated document “Text of ISO/IEC 14496-4:2001” (N4024) integrating IS and Amd1 of MPEG-4 conformance was approved

9.5.2 Extension 1

The Request for Amendment 1 of ISO/IEC 14496-4:2001 (N4088) and the progression of “Text of ISO/IEC 14496-4:2001/PDAM1” (document N4127) were approved.

9.6 Reference software

2

Page 3: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

9.6.1 Standard

The “Text of COR1 to ISO/IEC 14496-5” (N3858 from Pisa) and the corresponding Pisa resolution (2.2.1, 15th document) were cancelled, to be replaced by the integrated version of part 5 including the IS, Amd1 and COR1 of MPEG-4 reference software. The integrated document “Text of ISO/IEC 14496-5:2001” (document N4025), to be ballotted as an FCD, was approved.

9.6.2 Extension 1

The Request for Amendment 1 of ISO/IEC 14496-5:2001 (N4089) and the “Text of ISO/IEC 14496-5:2001/PDAM1” (N4046) were approved. The latter is composed of the following parts:

N3858, “Text of ISO/IEC 14496-5:2000/PDAM2” from Systems N3901, “ISO/IEC 14496-5:2000/PDAM2 (Studio Profile Reference Software)” from Video

and N3906, “ISO/IEC 14496-5:2000/PDAM3 (Streaming Video Profiles Reference Software)”

from Video

9.7 DMIF No work was done at the meeting.

9.8 Optimised software The Text of 14496-7 PDTR (N4057) was approved.

9.9 4 on IP FrameworkThe Request for Part 8 of 14496 (N4080) and the Text of ISO/IEC 14496-8/CD (N4081) were approved. 9.10 Hardware Reference Two responses to the CfP were received.

9.11 Explorations Work on MP4 Extensions continued.

9.12 Workplan   This was approved.

10 MPEG Phase 7

10.1 Requirements A new version of MPEG-7 Requirements was approved as N4035

10.2 Systems The Disposition of comments of CD 15938-1 (N4099) and the Text of FCD 15938-1 (N4001) were approved

10.3 Description Definition Language The Disposition of comments of CD 15938-2 (N4102) and the Text of FCD 15938-2 (N4002) were approved

10.4 Visual The Disposition of comments of CD 15938-3 (N4061) and the Text of FCD 15938-3 (N4062) were approved

10.5 Audio

3

Page 4: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

The Disposition of comments of CD 15938-4 (N3993) and the Text of FCD 15938-4 (N4004) were approved.

10.6 Description Schemes The Disposition of comments of CD 15938-5 (N3965) and the Text of FCD 15938-5 (N3966) were approved.

10.7 Reference software The Disposition of comments of CD 15938-6 (N3988) and the Text of FCD 15938-6 (N4006) were approved

10.8 Conformance Testing A working draft was produced. 

10.9 Workplan This was approved.

11 MPEG phase 21

11.1 Requirements Work in this area is covered by the Technical Report.

11.2 Technical ReportA study was produced.

11.3 Digital Item Declaration A new WD was produced.

11.4 Digital Item Indentification and Description A WD was produced.

11.5 Rights Data Dictionary and Rights Expression Language   A new Call for Proposals was issued.

11.6 Other MPEG-21 partsNo toher parts were identified.

11.7 Workplan This was approved.

12 Overall WG11 workplan This was approved.

13 Explorations

13.1 Video A Revised Call for Proposals on New Tools for Video Compression Technology (N4065) was approved.

13.2 Digital Cinema  A Revised Digital Cinema Call for Proposals (N4066) was approved.

14 Liaison matters

4

Page 5: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Input documents were considered and responses issued as required. Further liaison documents were issued to related organisations to inform them of the progress of our work.

15 Administrative matters

15.1 Schedule of future MPEG meetings The following schedule was agreed:

No. yy mm dd City Country56 01 03 05-09 Singapore SG57 01 07 16-20 Sydney, NSW AU58 01 10 22-26 Washington, DC US59 01 12 03-07 Pattaya TH60 02 03 18-22 ? KR61 02 07 22-26 Klagenfurt AT62 02 10 21-25 Shanghai CN63 02 12 ? ? ?

15.2 Promotional activities A set of Powerpoint slides (MPEG 101) were produced.

16 Organisation of this meeting

16.1 Tasks for subgroups Tasks were assigned to subgroups.

16.2 Joint meetings The following joint meetings were held:

Group 1 Group 2 What Where Day TimeReq MDS MPEG-21 Dit I&D MDS Mon 15:00-16:00Video Test Verification tests Video Mon 16:00-16:45Video Test Video Cfp Video Mon 16:45-17:30Video Systems MP4Video in Sys Systems Mon 18:00-19:00Req Video Visual Profiles Video Tue 09:00-10:00Req Test, Video Digital Cinema Req Tue 10:00-11:00Req Systems IPMP across MPEG Req Tue 11:00-13:00Req Systems Systems Profiles Sys Tue 14:00-15:00MDS ISG MPEG-21 S/W MPEG-21 Tue 14:00-15:00SNHC Systems AFX and MUW Systems Tue 15:00-16:00Req Aud-Vid-MDS-Sys MP7 Conformance Plenary Wed 11:00-12:30Req MDS MP7 Req MDS Wed 13:30-14:15Video Systems Vbv Systems B-O Wed 15:00-16:00Video Test Digital Cinema Video Wed 16:00-17:00Systems Audio MP4 byte alignment Systems B-O Wed 16:00-17:00Systems Req DigiCinema Requir Req Thu 09:00-10:30SNHC Systems BIFS CfP SNHC Thu 10:00-11:00Audio Systems BiM & BAM Audio Thu 10:00-11:00Systems Req BIFS profiles Req Thu 11:00-12:00Video ISG Complexity

DigiCineVideo Thu 11:00-12:00

5

Page 6: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

ISG Video, Req Vcv definition Req Thu 12:00-13:00Video Systems BiM Video Thu 14:00-15:00ISG MDS XM MDS Thu 14:00-14:30SNHC Systems IM1 Systems Thu 14:00-15:00ISG Systems XM ISG Thu 14:30-15:00

17 Planning of future activities The following ad hoc groups were established:

4110 Ad Hoc Group on IM14108 Ad Hoc Group on MPEG-4 BIFS4107 Ad Hoc Group on MPEG-4 Conformance4109 Ad Hoc Group on MPEG-4 Textual Format4106 Ad Hoc Group on MPEG-7 data binary representation4022 Ad Hoc Group on AFX CE 4023 Ad Hoc Group on AFX SW4048 AHG Describing Terminal Capabilities for UMA4011 AHG on Audio Call for Proposals4013 AHG on Audio part of MPEG-4 Conformance4016 AHG on Audio part of MPEG-7 Conformance3982 AHG on Audio, Video, and MDS harmonization4017 AHG on Consideration of Lossless Audio Coding Technology 4075 AHG on Digital Cinema Proposals3985 AHG on Editing the MPEG-21 WDs3980 AHG on Editing the MPEG-7 MDS XM and FCD3983 AHG on Metadata Integration4113 AHG on MP4 Extensions 4012 AHG on MPEG-2 AAC Clarifications3986 AHG on MPEG-21 Core Experiments4050 AHG on MPEG-21 PDTR 1.2 Study4014 AHG on MPEG-4 Audio 2001 Edition 4111 AHG on MPEG-4 Content on MPEG-2 Systems and IP Network4112 AHG on MPEG-4 IPMP Extensions4071 AHG on MPEG-4 Visual Fine Granularity Scalability4070 AHG on MPEG-4 Visual Studio Profile4047 AHG on MPEG-7 Applications & Promotion to Industry4015 AHG on MPEG-7 Audio 4073 AHG on MPEG-7 Core Experiments and Future Work4105 AHG on MPEG-7 DDL3984 AHG on MPEG-7 IPMP Descriptors3981 AHG on MPEG-7 MDS Core Experiments4104 AHG on MPEG-7 Systems4072 AHG on MPEG-7 Visual Study of FCD4053 AHG on requirements for the Persistent Association of Digital Item identifiers to content4052 AHG on Rights Data Dictionary and Rights Expression Language4049 AHG on Study of MPEG-7 Mobile Applications4074 AHG on Video Compression Technology Proposals3991 AHG on XM Development

6

Page 7: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

18 Resolutions of this meeting These were approved

19 A.O.B There was no other business

20 Closing The meeting closed on 2001/03/09T22:55

7

Page 8: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex 1Attendance list

Name Org Ctry1.

Ernest Y WAN CISRA AU2.

David WALSH CSIRO Mathematical & Information Sciences AU3.

Jane HUNTER DSTC Ltd AU4.

Ian BURNETT University of Wollongong AU5.

Rik WAN DE WALLE HENT UNIVERSITY BE6.

Gauthier LAFRUIT IMEC BE7.

Jan BORMANS IMEC BE8.

Alexandru SALOMIE VRIJE UNIGERSITEIT BRUSSEL BE9.

Spencer CHENG Cloakware Corporation CA10.

Alain MIGNOT SGDL Systems Inc. CA11.

P. HAIGHTON Videospheres Inc. CA12.

Touradj EBRAHIMI EPFL CH13.

Simon ROBINS GENIMEDIA SA CH14.

WANG Baoai Chinese Electronics Standardization Institue CN15.

LU HanQingInstitute of Automation, Chinese Academic of Science CN

16.GAO Wen

Institute of Computing Technology, Chinese Academic of Sciences CN

17.LI Shipeng Microsoft Research China CN

18.WU Feng Mircrosoft Research China CN

19.Andreas HOELZER FhG Erlangen DE

20.Gabriele SPENGER FhG Erlangen DE

21.Juergen HERRE FhG Erlangen DE

22.Ralph SPERSCHNEIDER FhG Erlangen DE

23.Karl-heinz BRANDENBURG FhG Ilmenau DE

24.Frank KLEFENZ FhG Erlangen DE

25.Bernhard GRILL FhG Erlangen DE

26.Patrick NJIKI-NYA Heinrich-Hertz-Institut (HHI) DE

27.Thomas WIEGAND Heinrich-Hertz-Institut (HHI) DE

28.Thomas HINZ PHILIPS SEMICONDUCTORS DE

29.Michael WOLLBORN Robert Bosch GmbH DE

8

Page 9: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

30.Jens-Rainer OHM RWTH Aachen DE

31.Andreas HUTTER SIEMENS-AG-Muenchen DE

32.Carsten HERPEL Thomson Multi Media DE

33.Jens SPILLE Thomson Multimedia DE

34.Angelika KNOLL T-Nova-Berkom Berlin DE

35.Bernhard FEITEN T-Nova-Berkom Berlin DE

36.Ingo WOLF T-Nova-Berkom-Berlin DE

37.Stephan HERRMANN TU-Muenchen DE

38.Jose Martinez Sanchez Grupo de Tratamiento de Imagenes ES

39.Francisco MORAN BURGOS Univ. Politenica Madrid ES

40.Mauri VAANANEN Nokia FI

41.Roberto CASTAGNO NOKIA FI

42.Lilian LABELLE Canon CRF FR

43.Dominique YON CISAC FR

44.Cyril CONCOLATO ENST FR

45.Jean-Claude DUFOURD ENST FR

46.Yuval FISHER Envivio FR

47.Cedric THIENOT Expway FR

48.Claude SEYRAT Expway FR

49.Didier MARY FIAPF/AGICOA FR

50.Alexandre COTARMANACH France Telecom R&D FR

51.Bertrand FOULONNEAU France Telecom R&D FR

52.Dominique CURET France Telecom R&D FR

53.Marc BRELOT France Telecom R&D FR

54.Olivier AVARO France Telecom R&D FR

55.Jean-Bernard RAULT France Telecome R&D FR

56.Jerome FOURNIER France Telecome R&D FR

57.Mariette MAURIZOT France Telecome R&D FR

58.Patrick GIOIA France Telecome R&D FR

59.Frederic DUMAS Institut National de l' Audiovisuel (INA) FR

60.Francoise PRETEUX INT FR

61.Marius PREDA INT FR

9

Page 10: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

62.Philippe JOLY Laboratoire d'Informatique Paris 6 FR

63.Benoit MORY LEP Philips FR

64.Daniel SNOOK LEP Philips FR

65.Myriam CAPRIOGLIO LEP Philips FR

66.Nicolas SANTINI LEP Philips FR

67.Philippe GENTRIC LEP Philips FR

68.Sylvain DEVILLERS LEP Philips FR

69.Yves RAMANZIN LEP Philips FR

70.Marc GUEZ VUCHER SCPP FR

71.Lionel OISEL Thomson Multimedia FR

72.Ioannis KOMPATSIARIS Aristotle University of Thessaloniki GR

73.Eyal FARKASH Celvibe Ltd. IL

74.Zvi LIFSHITZ OPTIBASE IL

75.Gianluca DE PETRIS CSELT IT

76.Guido FRANCESCHINI CSELT IT

77.Leonardo CHIARIGLIONE CSELT IT

78.Massimo BALESTRI CSELT IT

79.Nicola ADAMI Universita' di Brescia IT

80.Craig A. SCHULTZ Access Ticket Inc. Systems JP

81.Itaru KANEKO ASCII Corporation JP

82.Hirotaka SHIIYAMA Canon Inc. JP

83.Junichi TAKEDA Canon Inc. JP

84.Mikio SASAKI DENSO CORPORATION JP

85.Nicholas GIVOTOVSKY DENTSU INC. JP

86.Takahito IIDA DENTSU INC. JP

87.Yasuhiro NAKANISHI DENTSU INC. JP

88.Koiti HASIDA Electrotechnical Laboratory (ETL) JP

89.Kilho SHIN Fuji Xerox Co., Ltd JP

90.Kimihiko KAZUI Fujitsu Laboratories Ltd. JP

91.Makoto YOSHIOKA Fujitsu Limited JP

92.Takehiro FUJITA Hitachi, Ltd. JP

93.Yoshinori SUZUKI Hitachi, Ltd. JP

10

Page 11: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

94.Yoshihisa GONNO IBLabs JP

95.Katsunao TAKAHASHI Matsushita JP

96.Takanori SENOH Matsushita JP

97.Takuyo KOGURE Matsushita JP

98.Yoshinori MATSUI Matsushita Electric Industrial Co. Ltd JP

99.Koichi EMURA Matsushita Electric Industrial Co., Ltd JP

100.Hirofumi NISHIKAWA Mitsubishi Electric Corp. JP

101.Hiroshi ITO Mitsubishi Electric Corp. JP

102.Akio YAMADA NEC JP

103.Eiji KASUTANI NEC JP

104.Hitoshi KOYAMA NEC JP

105.Toshiyuki NOMURA NEC JP

106.Seiichi GOHSHI NHK JP

107.Yoshiaki SHISHIKUI NHK JP

108.Masahiro SHIBATA NHK JP

109.Tatsuya FUJII NTT JP

110.Hiroshi FUJII NTT JP

111.Hideki SAKAMOTO NTT JP

112.Junichi KISHIGAMI NTT JP

113.Takehiro MORIYA NTT JP

114.Yoichi TAKASHIMA NTT JP

115.Minoru ETOH NTT DoCoMo Inc. JP

116.Shun-ichi SEKIGUCHI NTT DoCoMo Inc. JP

117.Hajime MIYASATO Pioneer Corporation JP

118.Kiyoshi SUZUKI RICOH Company, Ltd. JP

119.Takayuki KUNIEDA RICOH Company, Ltd. JP

120.Yuki WAKITA RICOH Company, Ltd. JP

121.Yoshiaki TOMIOKA Sharp Corporation JP

122.Shuichi WATANABE Sharp Corporation JP

123.Yasuaki TOKUMO Sharp Corporation JP

124.Frank BOSSEN Sony Corporation JP

125.Katsumi TAHARA Sony Corporation JP

11

Page 12: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

126.Teruhiko SUZUKI Sony Corporation JP

127.Masayuki NISHIGUCHI Sony Corporation JP

128.Toby WALKER Sony Corporation JP

129.Yoshiaki SHIBATA Sony Corporation JP

130.Yoichi YAGASAKI Sony Corporation JP

131.Osamu HORI Toshiba Corporation JP

132.Toshimitsu KANEKO Toshiba Corporation JP

133.Mayumi NAKATA U. Tokyo JP

134.Tomohiro AZAMI Victor Company of Japan, Limited (JCV) JP

135.Akihisa KODATE Waseda University JP

136.Hiroshi WATANABE Waseda University JP

137.Masumi OKUMURA Waseda University JP

138.Michiko WAKUI Waseda University JP

139.Shin'ichi TAKAGI Waseda University JP

140.WON Chee Sun Dongguk University KR

141.CHEONG Won-Sik ETRI KR

142.KIM Wook Joong ETRI KR

143.Soo Jun PARK ETRI. KR

144.KIM Whoi-Yul Hanyang University KR

145.KIM Hyeokman Kookmin University KR

146.KIM Jinsang Korea Telecom KR

147.LEE Sangyoun Korea Telecom KR

148.CHANG Doim LG Electronics KR

149.KIM Heon Jun LG Electronics KR

150.LEE Jae-Hyuck LG Electronics KR

151.LEE Jin-Soo LG Electronics KR

152.SONG Young-Won LG Electronics KR

153.YOON Kyoungro LG Electronics KR

154.CHAE Jong Jin MarkAny Inc. KR

155.LIM Young-Kwon mp4cast KR

156.SHIN Jae-Seob MPEGSolutions, Inc. KR

157.Sung Gul RYOO MPEGSolutions, Inc. KR

12

Page 13: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

158.CHO Dae Sung Samsung Advanced Institute of Technology KR

159.HAN Mahnjin Samsung Advanced Institute of Technology KR

160.James D. K. KIM Samsung Advanced Institute of Technology KR

161.JANG Euee-Seon Samsung Advanced Institute of Technology KR

162.KIM Sang Kyun Samsung Advanced Institute of Technology KR

163.KIM Sang-Wook Samsung Advanced Institute of Technology KR

164.PARK Du-Sik Samsung Advanced Institute of Technology KR

165.WOO Sang Oak Samsung Advanced Institute of Technology KR

166.CHOI Yanglim Samsung Electronics KR

167.CHUN Kang-Wook Samsung Electronics KR

168.HUH Youngsik Samsung Electronics KR

169.LEE Yung-Lyul Samsung Electronics KR

170.LEE Jae-Yong Serome Technology, Inc KR

171.SIM Dong-Gyu Varo Vision Co., Ltd KR

172.Ahmad BOU-SHEHRI  University of Kuwait KW

173.Wim MOOIJ Irdeto Access NL

174.JEAN H.A. GELISSEN Philips Research Laboratories NL

175.Erik OLTMANS Telematica Instituut NL

176.Iver GRINI Telenor AS NO

177.Wladyslaw SKARBEK

Warsaw University of Technology and Altkom Akademia PO

178.Ernesto SANTOS INESC PORTO PT

179.Fernando PEREIRA Instituto Superior Tecnico PT

180.Charilaos CHRISTOPOULOS Ericsson Radio Systems AB SE

181.Francisco RIVAS Ericsson Radio Systems AB SE

182.Per FROJDH Ericsson Radio Systems AB SE

183.LU Xueping JVC ASIA Pte Ltd SG

184.LO Sheng Kent Ridge Digital Labs SG

185.MA Kai-Kuang Nanyang Technological University SG

186.WANG Lei NewsTakes Asia Pacific Pte Ltd SG

187.CHAN Wei Luen Panasonic Singapore Laboratories SG

188.KUAH Kim Hann Panasonic Singapore Laboratories SG

189.NEO Sua-Hong Panasonic Singapore Laboratories SG

13

Page 14: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

190.NG Ching-Hua Panasonic Singapore Laboratories SG

191.LIN Weisi System On Chip (IME) SG

192.Ian JAMISON Amphion Semiconductor Ltd UK

193.Jean STRIDE BSI UK

194.Philip GARNER Canon Research Centre Europe Ltd UK

195.Uwe JOST Canon Research Centre Europe Ltd UK

196.P KUDUMAKIS CRL UK

197.S TYLER Grass Valley Group UK

198.Paul JESSOP IFPI Secretariat UK

199.Philippa MORRELL IFPI Secretariat UK

200.N RUMP InterTrust Technologies International UK

201.Rob ROENEN InterTrust Technologies International UK

202.William Knox CAREY InterTrust Technologies International UK

203.A LINDSAY Lancaster University UK

204.Leszek CIEPLINSKI Mitsubishi Electric ITE-VIL UK

205.Miroslaw BOBER Mitsubishi Electric ITE-VIL UK

206.Kate GRANT Nine Tiles UK

207.Keith HILL Rightscom UK

208.Michael STELIAROS Superscape (UK) Ltd UK

209.WU Ping Tandberg Television Ltd UK

210.A BRAY UBQT Media UK

211.Sandeep CASI UBQT Media, Inc. UK

212.Kieron MESSER University of Surrey UK

213.David SINGER Apple Computer, Inc. US

214.Schuyler QUACKENBUSH AT&T US

215.Michel RYNDERMAN Avid Technology, Inc. US

216.Jean LeFeuvre avipix US

217.Christopher WENDT Avipix, LLP US

218.Ji ZHANG Cisco Systems, Inc. US

219.Ana BENITEZ Columbia University US

220.Allan PEACH DemoGraFX US

221.Donald MEAD Digital Electronic Cinema Inc. US

14

Page 15: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

222.Avni RAMBHIA E-Vue Inc. US

223.Paolo MONTALTO E-Vue Inc. US

224.Greg BERRY GMV Network US

225.Kumar SWAMINTHAN Hughes Electronics Company US

226.YANG Chao-Kung Hughes Electronics Company US

227.John R. SMITH IBM Corporation US

228.Michelle KIM IBM Corporation US

229.Pete SCHIRLING IBM Corporation US

230.SHAE Zon-Yin IBM Corporation US

231.Stephen WOOD IBM Corporation US

232.Mark BUXTON Intel Corporation US

233.Todd SCHWARTZ Intel Corporation US

234.Mohamed OULD YAHYA INTELSAT US

235.Mikael BOURGES-SEVENIER iVast Inc. US

236.Jordan ISAILOVIC JRI Technology US

237.Kristine KNEIB KNK-mpeg.com US

238.Aaron E. WALSH Mantis Development Corp. US

239.Tom MCMAHON Microsoft Corp US

240.Andrew G. TESCHER Microsoft Corporation US

241.Gary SULLIVAN Microsoft Corporation US

242.Bruce CHAPLIN Mindport Sentriq US

243.Anthony VETRO Mitsubishi Electronics America US

244.CHIANG Tihao Mitsubishi Electronics America US

245.Hsueh-Ming HANG Mitsubishi Electronics America US

246.Michael CASEY Mitsubishi Electronics America US

247.Huifang SUN Mitsubishi Electronics America US

248.Sam NARASIMHAN Motorola US

249.Wo CHANG NIST US

250.Mike RUBINFELD NIST US

251.Douglas Open EBookForum Liaison US

252.Greg STAHL Optivision, Inc. US

253.TSAI Chun-Jen PacketVideo US

15

Page 16: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

254.WEN Jiangtao Gene PacketVideo US

255.Sylvie JEANNIN Philips Electronics North America US

256.Mihaela VANDERSCHAAR Philips Research Netherlands US

257.Sorin C. CISMAS QuArc US

258.Bruce BLOCK Recording Industry Association of America US

259.Howard C. EDINGER Sarnoff Corporation US

260.Sriram SETHURAMAN Sarnoff Corporation US

261.HUANG Si Jun Scientific-Atlanta US

262.Peter VAN BEEK Sharp Labs of America US

263.Eric REHM singingfish.com US

264.Eric EDWARDS Sony US

265.Peter A DARE Sony Corp US

266.Ali TABATABAI Sony Corporation of America US

267.Hawley K. RISING Sony Corporation of America US

268.Sassan PEJHAN Sorceron, Inc. US

269.LIANG Kyminh Sorenson Laboratories, Inc. US

270.Corinne JORGENSEN State University of New York US

271.Maddalena DI GIURA STMicroelectronics US

272.Michael MCGINTY Telanetix US

273.Munsi HAQUE TVIA, INC. US

274.Bangalore S. MANJUNATH University of California US

275.GU Qunshan Vweb Corporation US

276.Brad GANDEE Xerox Corporation US

16

Page 17: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex 2Document list

No. Title6920 Document Register for 56th meeting in Singapore, SG6921 Position on content representation in MPEG-216922 Position on process for MPEG-21 development6923 Digital Cinema and Object Compression6924 Systems Meeting Report 6925 Report of the AHG on Systems Conformance 6926 Here are a couple of thoughts 6927 MatteTexture Expanded Text 6928 IPMP AHG Working Draft 6929 Skin & bones for efficient animation streaming 6930 General plasma-based procedural textures6931 MPEG Data Site Requirements 6932 KNB comments on Text of ISO/IEC CD 15938-1 Systems, 15938-2 DDL

6933 KNB Comments on Text of ISO/IEC CD 15938-3 Information technology - Multimedia content description interface – Part 3 Visual

6934 KNB Comments on Text of ISO/IEC CD 15938-4 Information technology - Multimedia content description interface - Part 4 Audio

6935 KNB Comments on Text of ISO/IEC CD 15938-5 Information technology – Multimedia content description interface – Part 5 Multimedia description schemes

6936 BIM Extension for forward and backward compatibility6937 Liaison Statement from 3GPP TSG-SA WG4 (SC 29 N 4048)6938 MPEG-7 IPMP AhG Report6939 Summary of Voting on ISO/IEC CD 15938-2 (SC 29 N 4054)6940 Summary of Voting on ISO/IEC 14496-4/PDAM 2 (SC 29 N 4055)6941 Revision of Annex A of the Study of MDS CD6942 MPEG Onsite Support Instruction6943 MPEG-4 Reference Software Architecture AhG Report6944 MPEG-4 Reference Software Architecture Working Draft6945 Report of AHG on MPEG-4 BIFS6946 French NB comment on textual format6947 Updated Study text of ISO/IEC 14496-1:2001/PDAM26948 Proposed amendment text for the generic InputSensor node6949 Reference software implementation of the generic InputSensor node6950 French NB comment on generic input sensor

6951 Report from the AHG on Describing User and User Environment characteristics for UMA

6952 Report on CE on Digital Item Declaration in a streaming environment

17

Page 18: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

6953 Digital Item Identification and Description Proposal based on Content ID Technology

6954 USNB Contribution: Position on Advanced FGS6955 USNB Contribution: WG 11 Document Policy6956 USNB Contribution: Proposed Liaison letter6957 USNB Contribution: Digital Cinema CfP clarification

6958 Proposal of Registration Management Group (RMG) of ISO/IEC 14496-1 for IPMP (SC 29 N 4049)

6959 Summary of Voting on ISO/IEC 14496-1/PDAM 3 (SC 29 N 4066)6960 Summary of Voting on ISO/IEC CD 15938-1 (SC 29 N 4067)6961 IEC CDV 61937-7 (SC 29 N 4068)6962 IEC CDV 61937-6 (SC 29 N 4069)6963 Report of the MPEG-7 Mobile Applications AHG6964 The Latest Evaluation of Dependency DS6965 Report of the AHG on MDS Core Experiments6966 Color Temperature Descriptor6967 Useful JPEG2000 extensions of the MP4 File Format6968 MP4 RTP Hint Track Design6969 Issues in the MP4 File Format6970 Report of AHG on Audio, Video and MDS Harmonization6971 Study of the interface issue between MDS and Video tools6972 Study on the Segment DSs in MDS6973 Study on the MediaLocator Ds in MDS

6974 Open Rights Language Requirements (Response to CFR on Rights Language/Dictionary)

6975 FNB Comments on 15938-5 CD6976 Report of the AHG on Conformance and Interoperability in MPEG-76977 Proposals for OrderingKey DS instantiation in MPEG-7 description6978 Text of Edge Histogram Descriptor6979 Requirements for a rights data dictionary and a rights expression language6980 Integrity Checking Schema for Digital Item Identification6981 Report of Ad hoc Group on Fine Granularity Scalability in MPEG-4 Video6982 CE Results for VideoEditing DS (4th)6983 AHG Report on Editing the MDS XM and Study of CD6984 UK NB Position on Document Handling6985 UK NB Position on MPEG-21 Call For Proposals6986 UK NB Input to the Guide for Meeting Hosts6987 NB position on the disposition of meeting funds.6988 Preliminary comments on ISO/IEC PDTR 18034 : MPEG-216989 MP4 AhG report6990 Support to ES URLs in MP4

18

Page 19: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

6991 Report on the AHG on the Call for Proposals for new tools to further improve video coding efficiency.

6992 Screening Architecture for MPEG-7 IPMP (etc.)

6993 Response to the Call for Requirements for a Rights Data Dictionary and a Rights Expression Language

6994 Report of AHG on MPEG-4 Audio Reference Software

6995 A System for the Identification and Description of Sound Recording Releases and Other Related Intellectual Property

6996 UK NB Position re progression of the MPEG-21 PDTR6997 Truly Hierarchical Coding of 3D Models with Subdivision Surfaces6998 FNB Comment6999 Comments on the Dead Reckoning proposal7000 Advanced BIFS compression results

7001International Standard Identifiers for Use in the Music, Film, Video, Sound Recording and Publishing Industries: Joint Response to the MPEG Call for Proposals for Digital Item Identification and Description

7002 Requirements for Rights Expression Language7003 Request for a New Level of Simple Scalable for Wireless Devices7004 Report of AHG on MPEG-4 Audio 2001 Edition7005 Report of The AHG on The TV-Anytime Application

7006 A response to the CfR for a Rights Data Dictionary: Requirements for Indirect Creation

7007 TV-Anytime Rights Management and Protection Requirements

7008 Requirements for a Rights Data Dictionary and a Rights Expression Language from the Perspective of the Surveillance Industry

7009 Report of CE on Semantic DS7010 Revised Study Text of ISO/IEC 15938-2/CD7011 Australian National Body Comments on Text of ISO/IEC CD 15938-4 (Audio)7012 Proposal for shape-sequence descriptor for core experiment VCE1

7013 Text Description of the Automatic Face Extraction Algorithm for the MPEG 7 Visual XM

7014 Ad hoc Group Report on Studio Profile in MPEG4 Video7015 Cross-Verification of Results for Experiment VCE-4: Face Detection7016 Summary of Discussions on Advanced Scalable Video Coding7017 Liaison Statement from NATO on IPMP Requirements for Digital Cinema7018 Proposal of lossless audio coding as an extension of MPEG-47019 Group Node Issue in Simple 2D Scene Graph Profile Specification7020 Report of AHG on binary and dynamic MPEG-7 data representation7021 Results of core experiment on MPEG-7 phonetic descriptions7022 Results of mini experiment BiME-2 on BiM random access and extensibility7023 Request for BiM software verification before FDIS approval7024 Results of Mini Experiments on MPEG-7 Binary and Dynamic Descriptions

19

Page 20: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

7025 Report of AHG on XM Development

7026 Generic Messaging Framework and XML based description for the flexible IPMP standard

7027 Report of CE on Streaming Scalable Texture for 3D rendering

7028 Evaluating MPEG-4 Video Complexity for an Alternative Video Verifier Mechanism Complexity Model

7029 Extension of MPEG-7 BiM fragment structure for containerization of sub-trees7030 Extension of semantics on length information in MPEG-7 BiM sub-tree coding7031 Report of the DDL AHG7032 A DDL parser implementation7033 Results of the BiM mini experiments7034 French NB Support to 2D BIFS Profiles under Consideration7035 A study of content-based profiling and complexity7036 Requirements for a Rights Data Dictionary and a Rights Expression Language7037 Definition of the MPEG-7 Sync Layer7038 MeshGrid model features and CE 7039 Spanish NB comments on ISO/IEC CD 15938-37040 Spanish NB comments on ISO/IEC CD 15938-57041 Study Text Of ISO/IEC 15938-1/CD7042 Report of AhG on Audio Call for Proposals7043 Report of the AHG on Metadata Integration 7044 MPEG-7 Dictionary7045 MPEG-7 Dictionary Generator7046 MPEG-7 Dictionary: Recommendations for improvement

7047 Response to the Call for Requirements for a Rights Data Dictionary and a Rights Expression Language

7048 Abstraction and Instantiation7049 Report of AHG on MPEG-4 Content on MPEG-2 Systems and IP Network7050 Requirement for Linguistic Description7051 Responses to Rights Language/Dictionary CfR7052 Responses to DIt Indentification & Declaration CfP

7053 Bitstream Syntax Definition Language: an input to MPEG-21 Content Representation

7054 On the requirements for advanced scalable video coding7055 Descriptors for User Terminal Resources

7056 Report of AHG on evaluation to the responses to MPEG-21 Call for Proposals for Digital Item Identification and Description

7057 BIFS-Anim in XMT-A 7058 Use of QuantizationParameter in 2D Profiles7059 MediaXXX Conformance7060 Extensibility issues in MPEG-7 7061 BiM sub-tree encoding implementation

20

Page 21: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

7062 FNB comments for the Singapore meeting7063 Discontinuity state7064 Proposal for the BIFS bistream exchange format.7065 Overview of XML Schema tools for textual extensibility of MPEG-77066 RTP payload format for FlexMux streams7067 XML syntax for FlexMux descriptors7068 Steaming text proposal7069 Results on CE on distributed animation streams7070 AHG on AFX Core Experiments report7071 Report of MPEG-7 Audio Ad Hoc Group7072 UKNB comments on 15938-47073 MatteTexture portion of WD 2.0 of ISO/IEC 14496-1:2001 AMD 27074 PNG as a Registered MPEG Stream7075 Study on MPEG-4 Audio 2001 Edition7076 Web3D-MPEG Document Request7077 Web3D-MPEG Interoperability and Conformance Testing7078 New arguements for a packed editing command for multi-valued fields7079 IM1 AHG Report7080 Report of Liaison between MPEG-7 and XML Schema7081 A Proposal for a Framework for Future Metadata Integration7082 Elementary concepts on forward and backward compatibility7083 Ruminations on assessing video coding efficiency

7084 Liaison Statement from CEN on "Frameworks, architectures and models for electronic commerce"

7085 Summary of Voting on ISO/IEC CD 15938-37086 Summary of Voting on ISO/IEC CD 15938-47087 Summary of Voting on ISO/IEC CD 15938-57088 Report of AHG on Digital Cinema7089 Philips 2D BIFS Bitstreams for Conformance7090 IEC CDV 62028-17091 Summary of Voting on ISO/IEC 14496-1:2001/DCOR 17092 Adding closed-caption and subtitle to VideoText DS7093 BiM navigation path encoding software7094 Report on AHG Group on MPEG-21 Digital Item Declaration Core Experiments

7095 UK National Body position on the development of the MPEG-7 Experimental Model, (XM)

7096 A Fast and Robust Static Sprite Generation Tool for MPEG-4 Video Coding7097 Status and Workplan for MPEG-4 Audio Conformance7098 Proposed corrections to the MPEG-4 Version 1 and Version 2 Audio Conformance7099 Report of the Ad-hoc Group on the Audio part of MPEG-4 Conformance7100 Proposed Corrections to MPEG-4 Audio

21

Page 22: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

7101 Validation of Extension of Colour Structure Descriptor to Multiple Disconnected Arbitrarily Shaped Regions

7102 MPEG-7 presentation at IAB Workshop7103 Report of FBA Conformance adhoc

7104 Progress on the MPEG-7 visual core experiments on 3D coordinate system and camera parameter descriptors

7105 Report of AHG on MPEG-21 PDTR Study7106 New and updated BIFS profiles7107 Results of CE on interpolator compression7108 The Proposal for Coordinate Interpolator Coding7109 Streamlining MPEG-7 Classification Schemes and Controlled Terms7110 China NB Comments on the requirements of Advanced FGS

7111 The proposed test conditions for wireless channel in MPEG-4 visual FDAM4 (FGS) verification test plan

7112 Macroblock-based Progressive Fine Granularity Spatial Scalability (mb-PFGSS)7113 The Digital Item Description Language (DIDEL)

7114 Report on CE on the use of Digital Item Declaration for representing digital photo albums

7115 Contribution to MPEG-4 AFX VM 2.07116 Generic articulated model definition and animation7117 Report of the MPEG-7 Applications and Promotions to Industry AHG7118 UKNB Comments on Text of ISO/IEC CD 15938-3 (MPEG-7 Visual)7119 Proposal on IPMP Tools Information and IPMP Tools Management7120 Descriptors for Content-based Audio Identification7121 Compactness / Precision Considerations for Audio LLDs7122 Verifications results of CE Q7: Sprite Generation7123 Swiss NB Comments7124 Video mapping to system clarification7125 UK NB Comments on ISO/IEC 15938-5 : MPEG-7 : MDS7126 Report of the AHG on Editing of MPEG-7 Visual XM and SoCD7127 Expression of interest in MPEG-4 Part 9: Reference Hardware Description.7128 Proposal for MPEG-4 Standard IPMP Framework7129 Comments on Frame Sizes in MPEG-7 Audio Descriptors7130 New time stamp for IPMP processing7131 Usage of IPMP descriptor and IPMP elementary stream (Categorization of interfaces)7132 Australian National Body Comments on ISO/IEC 15938-5: MPEG-7 MDS

7133 Liaison statement from ISO TC 46/SC 9 on MPEG-21 projects concerning digital item identification

7134 Results of BiME-6 "BiM/Textual Harmonization7135 Results of BiM-ME1 (BiM Efficiency) D/DS Structure Coding

7136 An Efficient Method for Binarization of Schema Documents

22

Page 23: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

7137 Use of XPath in Update Commands7138 Report on CE on Graph Rules, Classification Schemes, and Restrictions7139 Report of the AHG on MPEG-21 Outreach7140 ATSC Request for Proposals - Metadata for Advanced EPG Functionality7141 MPEG-7 Visual part of eXperimentation Model Version 9.17142 Summary of Voting on CD 15938-67143 identification and description based on ISO/10918-37144 XMT AHG Report7145 Report of AHG on MPEG-7 Visual Core Experiments7146 Expression of Interest in MPEG-4 Part 9: Reference Hardware Description 7147 Tutorial - Technology/Tecniques for preventing Software Tampering7148 Collaborative Haptic Sculpting using Mpeg47149 Solutions for IPMP Information Routing7150 Mutual & identity validation of IPMP tools7151 Rationale for IPMP Profiles with Standard Encryption Tools

23

Page 24: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex 3Agenda

1. Opening

2. Roll call of participants

3. Approval of agenda

4. Allocation of contributions

5. Communications from Convenor

6. Report of previous meeting

7. Processing of NB Position Papers

8. MPEG Phase 2

8.1   Requirements  

8.2 Systems

8.2.1 Standard

8.2.2 Amendments

8.3 Workplan

   

9. MPEG Phase 4

9.1 Requirements

9.2 Systems

9.2.1 Standard

9.2.2 Extension 1

9.2.3 Extension 2

9.2.3.1 XMT

9.2.3.2 3D Profiles

9.2.4 Extension 3

9.2.4.1 IPMP extension

24

Page 25: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

9.2.4 Extension 4

9.2.4.1 Multiuser sensors

9.2.5 Extension 5

9.2.5.1 Animation Framework

9.2.6 Corrigenda

9.3 Visual

9.3.1 Standard

9.3.2 Extension 1

9.3.3 Extension 2

9.3.4 Corrigenda

9.4 Audio

9.4.1 Standard

9.4.2 Extension 1

9.4.3 Corrigenda

9.5 Conformance Testing

9.5.1 Standard

9.5.2   Amendment 1

9.5.3 Corrigenda

9.6 Reference software

9.6.1 Standard

9.6.2 Extension 1

9.6.3 Extension 2

9.6.4 Extension 3

9.6.5 Extension 4

9.6.6 Corrigenda

9.7 DMIF

25

Page 26: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

9.7.1 Standard

9.7.2 Corrigenda

9.8 Optimised software

9.8.1 Technical Report

9.9 4 on IP Framework

9.9.1 Standard

9.10   Hardware Reference

9.10.1 Standard

9.11 Explorations

9.12 Workplan

   

10. MPEG Phase 7

10.1 Requirements

10.2 Systems

10.2.1 Standard 

10.3 Description Definition Language

10.3.1 Standard 

10.4 Visual

10.4.1 Standard 

10.4.2 Version 2 

10.5 Audio

10.5.1 Standard 

10.6 Description Schemes

10.6.1 Standard 

10.7 Reference software

10.7.1 Standard 

26

Page 27: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

10.8  Conformance Testing

10.8.1 Standard 

10.9 Workplan

   

11. MPEG phase 21

11.1 Requirements

11.2 Technical Report

11.3 Digital Item Declaration

11.4 Digital Item Indentification and Description

11.5 Rights Data Dictionary and Rights Expression Language  

11.6 Other MPEG-21 parts

11.3 Workplan

   

12. Overall WG11 workplan

   

13. Explorations

13.1  Video 

13.2 Digital Cinema 

   

14. Liaison matters

15. Administrative matters

15.1 Schedule of future MPEG meetings

15.2 Promotional activities

   

16. Organisation of this meeting

16.1 Tasks for subgroups

27

Page 28: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

16.2 Joint meetings

   

17. Planning of future activities

   

18. Resolutions of this meeting

   

19. A.O.B

   

20. Closing

28

Page 29: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex 4Requirements report

Source: Rob Koenen, Keith Hill (MPEG-21)

MPEG-4

Simple Scalable@L0? 7003 Request for a New Level of Simple Scalable for Wireless Devices — C.-J. Tsai et. al.This proposal, for a Simple Scalable Level 0 that is compatible with Simple Level 0, was well received. However, there were not (yet) enough people that would want to commit to do the necessary amendment. Also, while it is claimed the 3GPP might want to use it, there was no such request yet.Moreover, there was no complete technical consensus among proponentsThe conclusion was to not proceed until there is more substantial support, which would allow time to sort out some technical issues as well. One of these issues is introducing a restriction on special scalability that wil break the hierarchy between Simple Scalable and Simple at Levels 0.

Video Coding (reported on Wednesday)7016 Summary of Discussions on Advanced Scalable Video Coding — Jens-Rainer Ohm7054 On the requirements for advanced scalable video coding —Michael Wollborn et. al. 6954 USNB Contribution: Position on Advanced FGS — Andrew G. Tescher7110 China NB Comments on the requirements of Advanced FGS — Wen GaoAn interesting discussion took place over the issue of doing new work in scalability. While the requirements are well understood – as they have always been –, it was not clear how the problem would now be solved, after many attempts to offer scalability. The meeting wanted to give the current FGS a chance to succeed without MPEG immediately embarking on yet another Profile. It was noted that MPEG should not continue to issue new profiles that are a little bit better than the ones that went before, and it was also noted that while there is some evidence of possible improvements, it is difficult to judge if these would warrant another amendment. Also, MPEG has been building on the 1996 CfP submissions for 4 years; it is now time to take a step back and reassess the situation. The July meeting provides a great opportunity for doing so, because there will be test results from the Call for Evidence/Proposals. By then, there should also be:

Evidence of performance of new FGS tools (SNR, tapes) Studies on the operational environments of FGS

As a conclusion: in July, MPEG will look at these elements, assess the situation, and decide if MPEG should start a new effort in video coding. This could be an extension of MPEG-4, an effort in the context of MPEG-21 (where seamless scalability is an important requirement) or something else still.

Level Definitions7028 Evaluating MPEG-4 Video Complexity for an Alternative Video Verifier Mechanism Complexity Model The study reveals what we already thought a few years ago, but never adequately studied: the current definitions of Levels with Natural Video Objects are inadequate, especially when there are many objects in the scene. The study proposes applying a macroblock type-dependent weight factor in calculating the VCV buffer fullness. There has been initial work by ISG at the time the Level definitions for MPEG-4 Version 1 where decided, but ISG never got enough support from companies that were going to implement the spec. While it was clear that more studies are needed

29

Page 30: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

to arrive at the right weight factors, we want to start using a new definition for new Levels. It needs to be studied what the consequences would be for different types of designs, especially hardware designs. (But it is also clear that any technology choice favors certain designs over others). As many ‘normal’ scenes of the ‘typical scene size’ will not be codable under the current definition, a corrigendum is considered. NB’s were asked to comment on the issue.

Systems Profiles7019 Group Node Issue in Simple 2D Scene Graph Profile Specification — L. Herrmann7058 Use of QuantizationParameter in 2D Profiles — Yuval Fisher 7106 New and updated BIFS profiles — Peter Westerink, Steve Wood, Michelle Kim New Profiles were proposed that include Flextime (These were called ‘Web Profiles’ in the proposal, as they seek to harmonize with SMIL content). These profiles would sit next to the other profiles being proposed, and there is a great danger of Systems going the undesirable way of having a separate Profile for every imaginable application. Proponents of the different Profiles were asked to harmonize to the extent possible, even though it was understood that this would not be easy. Also, a number of smaller issues were raised about the Profiles under study. These would continue to be discussed in the AHG period.

It was also understood that while many of the Systems Profiles are mature, they are not yet well enough supported for adoption in the (amendment to the) Standard. It was made clear that July is the last chance to request for these Profiles!

The Requirements Group expects study input at the next meeting, based on the good discussions that were started in Singapore.

7074 PNG as a Registered MPEG Stream — Aaron Walsh, et. al.PNG provides functionality not in MPEG-4: alpha shape with still pictures. The functionality is deemed important. PNG is not the most efficient format for doing this, however, although it is widely used. The question is if MPEG feels the performance penalty is acceptable given th wide deployment of and support for PNG. Further studies will need to reveal how large the penalty is.

MPEG-77117 Report of the MPEG-7 Applications and Promotions to Industry AHG — Neil Day e.a.The Awareness Event (after the actual meeting) was a very successful undertaking. The Requirements Group understands that first discussions on an MPEG-7 Industry Forum are progressing well, and that further steps may be taken in Sydney.

6951 AHG Describing User and User Environment characteristics for UMA — Perkis e.a.7055 Descriptors for User Terminal Resources — Sherman (Xuemin) Chen, et. Al.Again there were discussions on terminal descriptions, and again there was no substantial progress. It was decided to concentrate purely on terminal characteristics for the coming AHG period, to limit the problem space. It is clear that some of the more advance requirements belong to MPEG-21 rather than MPEG-7. The AHG will look at both standardsMPEG-7: try to clarify what MPEG-7 needs to standardize. MPEG-21: ‘terminals and Networks’ – start developing requirements

7035 A study of content-based profiling and complexity — Kiyoshi Suzuki, et. al.This was (again) an interesting study on how description statistics can be used to classify content, which, in return, may be used to give guidelines for creators of descriptions. The Requirements Group, while seeing no direct impact on the standard, heard the presentation with interest.

30

Page 31: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

7082 Elementary concepts on forward and backward compatibility — Y. Huh, Y. Cho6963 Report of the MPEG-7 Mobile Applications AHG —Mikio Sasaki et. al.

The mobile studies continue – they should give some answers on complexity issues

7050 Requirement for Linguistic Description — Koiti HasidaIn a joint meeting with the MDS Group, the desirability of standardizing a Linguistic DS was discussed. So far MPEG hadd not touched this, as in general the feeling was that MPEG is not the place to standardize description s of text. The meeting did feel, however, that a Linguistic DS would fit in a multimedia description context, as it would be used to describe scripts etc. However, there need to be more people to do ensure a reasonable level of guarantees for success. If and when there is critical mass, we can do a Requirements study and issue a CfP.

MPEG-7 Systems and Conformance issues6976 Report of the AHG on Conformance and Interoperability in MPEG-7 — F. Pereira7020 Report of AHG on binary and dynamic MPEG-7 data representation — M. WollbornBiM Requirements added to were added to the Requirements Document. They represent a good start, but need to be further elaborated.

In a discussion about compatibility, the following was concluded: For parsing of new/extended descriptions, you will need the schema (and the semantics!)

and hence the following applies: Native DSs: can be decoded using only MPEG-7 standard (some or all of parts 1-6) Extended DSs: you need MPEG-7 standard (some or all of parts 1-6) plus schema for the

extensions New DSs: need MPEG-7 (parts 1,2) plus new schema A ‘dumb’ terminal (one that doesn’t understand extensions) should be able to use native part

of derived DSs.

There are two interpretations of backward compatibility:1 Not changing BiM spec in future versions2 Allowing changes to the BiM spec

Assuming 1, backward compatibility is no problem. Perhaps though, 2 cannot be excluded. Further studies are done to see how this impacts compatibility. Can BiM specification be designed in such a way that it can be extended? That is the main question – which is under study.

Forward compatibility is a version issue.

7060 Extensibility issues in MPEG-7  — Cédric Thiénot, Claude Seyrat, Grégoire Pau7065 Overview of XML Schema tools for textual extensibility of MPEG-7 — J. Heuer et.al.The great work on a skeleton conformance document by Fernando Pereira was taken by the different groups, and worked into a Draft Conformance part of the MPEG-7 Standard.

An update of MPEG-7 Interoperability, Conformance Testing and Profiling document was also issued. We are starting to see where the complexity is – but are not quite there yet

MPEG-21

MPEG-21 Multimedia FrameworkSignificant progress was achieved during the Singapore meeting to move MPEG-21 beyond its requirements gathering phase to the commencement of the development of actual specifications.

31

Page 32: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Notably, interest in MPEG-21 is now being cultivated amongst the participants of MPEG’s more traditional areas of specialism including content representation.

Digital Item Declaration – Working Draft v2.0 (see N3971)The work to further develop the Digital Item Declaration specification which commenced in Pisa (based on concepts submitted by Intel and LG Electronics) was continued and a second version of the Working Draft was produced (at the time of writing this report, the Working Draft is still being edited).

Call for Proposals for Digital Item Identification and Description A revised Call for Proposals(see N3942 Revised CfP for Digital Item Identification.doc) was issued after the Pisa meeting and during the weekend prior to the Singapore meeting the responses to the Call were evaluated. (A summary of this ‘ad-hoc’ group meeting can be found in m7056 Report from the AHG on CfP for DitIDD.doc).Eight responses were considered (the eighth from JPEG was late but the MPEG plenary approved its consideration with the other submissions). The evaluation procedure commenced with presentations by the proponents of the various systems. This was followed by an exercise to classify them according to the requirements they addressed (e.g. those systems which met the requirements for identification, identifier resolution, description, governance and other). A choice matrix was then constructed which compared and contrasted each system with the other systems to determine whether there were similarities and differences. Finally an exercise was conducted to compare the functionality of each system against their fulfillment of the stated requirements.

The results from the evaluation were carried forward into the main MPEG meeting when the responsibility for the Digital Item ID and Description work was passed from the Requirements Group to the Metadata Description Schemes (MDS) Group. A ‘breakout’ activity of the MDS Group was then tasked with producing a first Working Draft specification for Digital Item Identification and Description as an output of the Singapore meeting. This ‘breakout’ comprised a nucleus of approximately 30 people which included the proponents who had responded to the CfP.

As ever when starting a new specification, particularly within the context of a new standard such as MPEG-21, there were lengthy debates in which alternative views were expressed on how best to approach the work. However, consensus was achieved when it was understood that a common approach to identification that was compatible with each proponent’s submission could be realised by the adoption of the Universal Resource Identifier (URI) syntax. This syntax is the generic identification standard defined by IETF and W3C in RFC 2396 for the identification of ‘resources’ on the Internet (e.g. URL’s follow the syntax of URI’s and conform to RFC 2396). URL’s (Uniform Resource Locators) and URN’s (Uniform Resource Names) are subsets of URI’s. To quote from RFC 2396 “A parser of the URI syntax is capable of parsing both URL and URN references as a generic URI; once the scheme is determined, the scheme-specific parsing can be performed on the generic URI components. In other words, the URI syntax is a superset of the syntax of all URI schemes.” To download RFC 2396 see http://www.ietf.org/rfc/rfc2396.txt. The URI syntax is dependent upon the identifier scheme, but can be generically expressed as:

<scheme>:<scheme-specific-part>

Within this very flexible syntax more precise scheme-specific semantics can be developed which can accommodate all of the different identifier schemes that were submitted in response to the CfP.

32

Page 33: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

One of the activities was to produce a model to explain the organisation and hierarchy for Digital Item Identification and Description. While this will need further elaboration it enables the reader to understand how the description of a Digital Item and the resources it contains can be mapped against the Digital Item Declaration model.

In terms of deciding an approach to Digital Item Description it was decided that an extensible description scheme should be developed based upon a combination of the LG Electronics proposal for a ‘Digital Item Description Language’ and upon the DOI proposal for ‘kernel metadata’. It is likely that the Descriptors (that have yet to be specified) will remain as generic as possible in order to accommodate the requirements of sector specific description schemes currently under development (e.g. the RIAA/IFPI Release Identifier and the requirements which are agreed for BIEM/CISAC societies).

A system for the resolution of identifiers will be defined in the Working Draft that will conform to the URI generic syntax.

The version of the Working Draft at the time of writing this report is in an immature state as the two-week editing period has not yet come to an end and various contributions still need to be integrated.

Call for Requirements for a Rights Data Dictionary and a Rights Expression Language14 responses to this Call, first issued at the Pisa meeting, were received. It is quite clear that the subject matter in question, together with the timing of the Call, has raised considerable interest from different rights holder communities and technology companies who are developing tools for rights management purposes.For a list of the organisations that responded to the CfR see Annex B of N4045 (RDD-REL Reqs). A ‘Breakout’ activity of the Requirements Group was formed to start the task of consolidating the responses to prepare a list of requirements for a Rights Data Dictionary and a Rights Expression Language. As an initial exercise it was decided to categorise the responses into a table (see Annex C of N4045 (RDD-REL Reqs)) as follows:

Those that request an extension to the Call Those that only contain RDD requirements Those that only contain REL requirements Those that contain RDD and REL requirements Those with explicit requirements Those with implicit requirements

In terms of process it was agreed as an initial exercise to take the two largest submissions with explicit requirements and consolidate them into a working document. The other submissions were then compared with the working document which was then further elaborated to include any missing requirements contained in the other submissions. From this point the working document was edited to accommodate changes recommended by the contributors participating in the Breakout group.

The final output of this exercise is represented in the contents of N4045 (RDD-REL Reqs).doc. Those who contributed to its formulation will agree that this is very much a ‘work in progress’ that will require further time and effort in order to reflect a complete set of requirements upon which a Call for Proposals can be based. Consequently the following actions were agreed:

1. The Call for Requirements would be re-issued until Friday 1st June. (Seven of the responses to the first CfR requested an extension to the time available for responses to be submitted.) The re-issue of the CfR can be found in N4044 CfR RDD&REL.doc.

33

Page 34: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

2. In order to progress the work and to ensure the widest possible consultation, an ‘ad-hoc’ group meeting will be held on 7-8th June, in London, to which all interested parties are invited to attend (see N4044 (CfR RDD&REL) for a registration form for the meeting). The task will be to develop the working document with the intention of finalising and approving the requirements at the Sydney meeting in July.

It is currently planned to issue a Call for Proposals based on the approved requirements at the July 2001 meeting in Sydney.

Study on the Proposed Draft Technical Report V.2 Following the Pisa meeting the PDTR v2 was issued to National Standards Bodies for ballot. Voting will conclude by the end of May together with the submission of any comments accompanying each vote.

During the Singapore meeting a ‘breakout’ of the MPEG-21 Requirements Activity continued the task of editing the PDTR taking into account new contributions from MPEG participants and a major contribution from the UK National Standards Body. The changes were documented in a Study on the PDTR v2 (see N4040 M21 PDTR Study).

As an ‘ad-hoc’ group activity it is planned to hold a meeting in London at the IFPI offices on 6-7th June dedicated to the editing of the PDTR. This meeting will enable the PDTR to be further refined and to take account of the comments received from National Bodies. The document will then be finalised and approved at the Sydney meeting when it is expected to be approved as a Draft Technical Report (DTR).

MPEG-21 Use Case ScenariosA revised version of the use case scenario document was produced (see N4042 M21 Use Cases). As well as providing an easily readable set of examples for managing resources within a multimedia framework across a range of application domains, the use cases will support the work of devising core experiments to establish ‘proof of concept’ for future MPEG-21 specifications. The document contains use cases in support of core experiments for Digital Item Declaration and Digital Item Identification and Description. These include:

Digital Item Declaration in a streaming environment Bit stream Syntax Definition Language (BSDL) Digital Item Identification systems interoperability Complex identification scenarios in music releases Integration of Digital Item Identification and Resolution Scheme

The use case scenario document will continue to be elaborated at future meetings to define the implications of each scenario for the MPEG-21 standard.

Action Plan for MPEG-21 The purpose of the action plan is to decide which parts of the seven architectural elements in the multimedia framework are best suited to specification within MPEG. This was given further consideration at the Singapore meeting and a revised version of the document was produced (see N4043 M21 Action Plan). Three specific areas for further examination were proposed:

1. Digital Item Identification and Description: Persistent association of identifiers to content (define the requirements in July 2001)

2. Content Representation Fine Grain Scalability for video representation (input to Sydney, July 2001)

34

Page 35: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

3. Terminals and Networks Universal Multimedia Access (‘ad-hoc’ group until Sydney meeting)

MPEG-21 OverviewAs is customary within MPEG, an ‘overview’ document was prepared to offer a succinct explanation to the first time reader about the evolving MPEG-21 standard (see N4041 M21 Overview). This document describes MPEG’s approach to the definition of a multimedia framework and to understand the complete picture for enabling transparent and augmented use of multimedia resources across a wide range of networks and devices used by different communities. It defines the seven architectural elements that make up the multimedia framework and recommends how interoperability may be achieved between the elements. The scope of the standard is explained, as is the approach to standardisation from the perspective of the User (a User being defined as any entity that interacts in the MPEG-21 environment or makes use of a Digital Item). The Overview concludes with a set of recommendations for standardisation within the context of each architectural element, a summary of the current MPEG-21 work plan and a timetable for the development of future specifications.

MPEG-21 OutreachThe MPEG-21 Outreach activity continues to play an important part in MPEG’s efforts to engage other standards activities in the definition of the multimedia framework. This work continues as an MPEG ‘ad-hoc’ activity within the mandate of the PDTR Study (see W4050). At least two meetings with other standards activities will occur between Singapore and Sydney, including MPEG’s participation in the ITU-T MediaComm 2004 workshop in April, and a meeting in Paris on 21st March with the Open eBook Forum (see AHG mandate W4051 below).

MPEG-21 related liaison statements: W4118 – Response to liaison statement from ISO TC46 SC9 on MPEG-21 projects concerning

Digital Item Identification W4120 – Response to liaison statement from CEN/ISSS Secretariat regarding Draft CWA on

“Frameworks, architectures and models for electronic commerce” W4121 – Response to liaison statement from CEN on International Standard Identifiers for use

in the music, film, video and sound recording industries W4122 – Response regarding digital rights standards work in the Internet Research Task Force W4125 – Response to TV-Anytime Rights Management and Protection Requirements

‘Ad-hoc’ groups established:Four ‘ad-hoc’ groups have been formed for the period leading up to the next meeting. These are: W4050 AHG on MPEG-21 PDTR 1.2 Study W4051 AHG on MPEG-oEBF W4052 AHG on Rights Data Dictionary and Rights Expression Language W4053 AHG on Requirements for the Persistent Association of Digital Item Identifiers to

content

MPEG-21 related output documents from the Singapore meeting are (some listed for reference as they belong to other groups) W3971 – MPEG-21 Digital Item Declaration WD (v2.0) W3972 – MPEG-21 Digital Item Identification and Description WD (v1.0) W3975 – Workplan for CE on Digital Item Declaration in a Streaming Environment W3976 – Workplan for CE on the Bitstream Syntax Definition Language (BSDL) W3977 – Workplan for CE on Digital Item Identification Systems Interoperability

35

Page 36: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

W3978 – Workplan for CE on an MPEG-21 Identification in Music Releases W3979 – Workplan for CE on Integration of Digital Item ID and Resolution Scheme W4040 – Study of ISO/IEC 18034-1 PDTR 1.2 W4041 – MPEG-21 Overview W4042 – MPEG-21 Use Cases W4043 – Action Plan for MPEG-21 Multimedia Framework W4044 – Reissue of Call for Requirements for a Rights Data Dictionary and Rights Expression

Language W4045 – Requirements for a Rights Data Dictionary and a Rights Expression Language

Digital CinemaThe Requirements for digital Cinema were considerably reviewed, and all the MPEG elements are collected into a single Requirements Document, suitable for publication. In the Visual part, it was noted that transcoding support is important, but not mandatory; this requirements was denoted by a ‘should’. Audio requirements remained unchanged. Systems requirements were substantially updated, and now included a good set of IPMP requirements. (see N4046)

IPMP across MPEG (Wednesday – for reference)6938 MPEG-7 IPMP AhG Report — Niels Rump for the AhG6992 Screening Architecture for MPEG-7 IPMP (etc.) — Paul Jessop

The following Overview of IPMP work was given (bulleted list, see IPMP Overview Output of Pisa meeting which gives an extensive description of all these activities and past ones.)

Extension of MPEG-4 worko Should be applicable to all MPEG’s

IPMP in MPEG-7 Authentication Protection

o Work has started Identification of content in MPEG-21 Rights Language and Dictionary requirements collection AHG meeting end May / early June CfP in July IPMP Requirements collection in Digital Cinema

W3C workshop on DRM (Wednesday)The following is a short bulleted recount on the W3C workshop on DRM that took place just after the Pisa meeting.

There were many different contributions Requirements Implementations Thoughts about W3C’s role

There were many different opinions on W3C’s role in IPMP Rights Language and Data Dictionary often mentioned Accessibility concerns

o Disabled peopleo And also in general – how can I keep accessing my database, also after 40 years

from now?

36

Page 37: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

MPEG extended an invitation to W3C to cooperate This was supported by quite a few participants And welcomed by W3C representatives MPEG repeated this invitation in emails after the meeting

o No specific actions yeto Current status: waiting for the meeting report and further actions

TV-Anytime IPMP Requirements7005 (IPMP issues in) Report of The AHG on The TV-Anytime — Sezan, Mulder, Evain7007 TV-Anytime Rights Management and Protection Rqs — I. SezanThe Group reviewed IPMP requirements in TV-Anytime.TV-A wants to achieve interoperability between different ‘RMP’ (Rights Management and Protection) systems. Current status there is an extensive requirements document. Responses to document are due by the middle of May. MPEG will respond in the form of a liaison with the current IPMP Working Draft attached, for private consumption by TV-A. The liaison contains a number of questions for clarification.

37

Page 38: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex 5Systems report

Source: Systems Chair and Break-out group ChairsTitle: Systems Meeting ReportEditor: Olivier Avaro (France Telecom R&D)

Contributors:Olivier Avaro (France Telecom R&D), Jean-Claude Dufourd (ENST), Guido Franceschini (CSELT), Carsten Herpel (Thomson Multimedia), Mike Mc Ginty (Telanetix), Michelle Kim (IBM), Young-Kwon Lim (MP4Cast), Zvi Lifshitz (Optibase), Claude Seyrat (Expway), Michael Wollborn (Bosch), Steve Wood (IBM)

OverviewThe main results of the meeting from the Systems Sub-group perspective are:

Document No.Draft DoC on ISO/IEC 14496-1:2001/DCOR1  N4076Study text of ISO/IEC 14496-1:2001/DCOR1  N4077WD 1.0 of ISO/IEC 14496-1:2001/COR2  N4078Amendment of the requirements for the Registration Authority for objectTypeIndication values to include registration of code points in the MP4 file format.

 N4079

Request for Part 8 of 14496  N4080Text of ISO/IEC 14496-8/CD  N4081Carriage of MPEG-4 streams over RTP  N4082WD 3.0 of Corrigendum for 14496-4  N4083ISO/IEC 14496-5:2001  N4025Systems Software Status  N4086Systems Software Implementation Workplan and Demo. Pack  N4087Draft DoC on ISO/IEC 14496-1:2001/PDAM2  N4090Study text of ISO/IEC 14496-1:2001/PDAM2  N4091BIFS technology under consideration for inclusion in ISO/IEC 14496-1:2001 Amd.2  N4092XMT technology under consideration for inclusion in ISO/IEC 14496-1:2001 Amd.2  N4093WD 2.0 of ISO/IEC 14496-4/Amd.3 (XMT part)  N4094WD 3.0 of ISO/IEC 14496-1:2001 Amd.3  N4095MP4 Technology under consideration for inclusion in ISO/IEC 14496-1:2001 Amd. 3  N4096WD 2.0 ISO/IEC 14496-1:2001/Amd.4  N4097Call for Proposal on BIFS Coding technology  N4098DoC on ISO/IEC 15938-1/CD  N4099Text of ISO/IEC 15938-1/FCD N4001Mini Experiment Process for the evaluation of MPEG-7 Binary and Dynamic Descriptions  N4100Workplan for BiM Software Implementation N4101DoC on ISO/IEC 15938-2/CD N4102Text of ISO/IEC 15938-2/FCD N4002FAQ Revision 16.0 N4103

A detailed report can be found below as well as the resolutions from Systems and the list of the reviewed contributions.

General issues

38

Page 39: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

GeneralM6924 : Systems Meeting report. The report was approved. M7062 : Various NB Comments. The general comments has been answered by the HoD sub-group. The pointed technical contributions has been disposed of by the technical break-outs.M6958 : Report on the progress for the set-up of the IPMP registration authority. Informative.

Reference Software Implementation and demonstrationsThe following demonstrations have been made :1. MPEG Solution : MPEG-4 Audio, Video and Systems streaming on iPaq terminal.2. Fuji/Xerox : First implementation of the IPMP Extensions messaging system.3. CSIRO : MPEG-4 Systems based systems for sculpting in 3D worlds.4. IBM : Interoperability between SMIL, XMT-O, XMT-A and BIFS.

M6944 : Current status about the MPEG-4 Reference Software document architecture and improvement. The Systems part has been progressed by providing to Wo Chang the requested information on the structure of the Systems reference software and the way to operate it.

Web siteThe Systems Web site at http://garuda.imag.fr/MPEG4/ still needs major redesign and updates. Resources and process should be discussed in the general MPEG Systems reflector between now and next MPEG meeting.

FAQThe FAQ were updated and output at this meeting.

AOBNone.

MPEG-4 Systems (14496-1)

14496-1:2001 Corrigendum 1Topics

Miscellaneous correction to 14496-1:2001

Status

Ballot closed on DCOR1. National body comments received and disposed. Issue of COR delayed to Sydney to allow minor profile corrections as listed below to be added.

Contributions

M7091: Summary of Voting on ISO/IEC 14496-1:2001/DCOR 1: All National Body comments reviewed and accepted.

M6926: Here are a couple of thoughts. Input on Sound2D profile to be added as part of minor profile corrections (replace Group by OrderedGroup).

Other issuesM6752 (from LaBaule): BIFS Profiles under consideration. Replace Group by OrderedGroup in Simple2D profile.

“Lost’ text that had been approved for Systems and did not get into Version 2

39

Page 40: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Profile text that had been approved by Systems had editing between Melbourne meeting and Maui and was intended to go into Version 2 but somehow got lost. This text should be added.

14496-1:2001/Amd.1Topics

Elementary Stream Management1. Flextime2. Rebufering

Scene Description3. Flextime (Temporal Transform, Temporal Group)4. ServerCommand5. ExternProto6. Advanced BIFS Coding

Profiles and Levels7. 3D Audio Scene Graph Profile8. 3D Audio Graphics Profile

Profiles and Levels

Conformance and bitstream exchange

Reference Software Implementation9. Software Implementation10.Demonstration11.Demo. Pack.

Status

Final text.

Contributions

Conformance and bitstream exchangeM7064 : The contribution was presented. The format for the info file got updated. More updating will need to be done on the reflector, before 3 weeks.M6940 : Summary of voting on FlexTime Conformance. There is no disapproval vote, so no need for a DoC.

14496-1:2001/Amd. 2Topics

MPEG-4 Textual Format1. XMT-A

XMT-

Scene Description2. Media Sensor3. MediaControl

40

Page 41: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

4. MediaBuffer5. MatteTexture

Elementary Stream Management6. OD Framework additions (OD execute, Segment Descriptors)7. MP4 additions

Profiles and Levels8. Web3D Core (Scene Graph and Graphics) profile.9. Basic2D, Core2D, Advanced2D (Scene Graph and Graphics) profile.

Conformance and bitstream exchange

Reference Software Implementation10.Software Implementation11.Demonstration12.Demo. Pack.

Status

Inputs and comments requested through NBs.

Contributions

MPEG-4 Textual FormatM7057 , M6947: The documents were discussed and the following recommendations have been made:

1. BIFS-Anim in XMT-Aa. Align the XMT-A syntax of BIFS-Anim with the MPEG-4 SDL spec following the

BIFS to XMT-A rules;b. Reuse type definitions already in the XMT-A schema;c. Having more than one animation frame in a <par> container should be avoided

because no two animation frames can have same timing;d. Quantization cannot be deterministic. Can deterministic mapping be achieved from

XMT-A BIFS-Anim to mp4? i. Use of encoding hints to provide deterministic mapping for conformance

needs to be investigated.ii. Check conformance points for BIFS-Anim and quantization and possibly

modify the conformance doc to provide alternate conformance points 2. Proto in XMT-A

a. Yuval and Alex will provide a format that is compatible with the X3D.3. Modularization of XMT-A schema is useful to share schemas with the X3D. This is an

editorial issue, and we can do this later. a. BIFS, BIFS commands, ODs, OD commands.

4. Define default values in the XMT-A schema as defaults, because default values need not be encoded if they were identified as such in the schema.

ODId, nodeID issues: XML ids are unique, but OD and node ids can be reused. An XMT tool, when encoding XML ids to MPEG-4 is free to re-use nodeIDs or ODIds. If an author explicitly wishes to reuse MPEG-4 ids then binary ids can be used to do this as these do not have to be unique.

M6946 : WG11 thanks the National Body of France for this comment. The M6946 document has been taken into account in the elaboration of study text of ISO/IEC 14496-1:2001/PDAM2.

41

Page 42: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

M6959 : All comments from National Body have been addressed successfully and decisions have been recorded in the DoC.

M7067: XML syntax for FlexMux descriptors: the document has been improved and adapted to XML Schema. It will be included in the XMT specification.

Scene descriptionM7073, M6927 : The contribution was presented. A few changes were suggested on the document, and the big question was about “overwrite”, which will be resolved over the reflector. The use of SMPTE names for transitions will also be explored. As a conclusion, the node is still in the technology under consideration and movable to the Amd2, pending implementation.

M6926 : The contribution was presented. The points discussed were:- Curve2D should be fillable and texturable. The comment is accepted pending merge with COR;- Gradient node: OK for the WD of Amd4, to be put in sync with AFX and SVG;- Time dependent: discussion deferred until the right people are in the room;- Audio profile: wrong top node, needs to go into COR. Discussed and agreed in the joint meeting with requirements about profiles.

M6948& M6949 : The contributions were presented. A comment about conditional and decoding on demand was discussed for a long time, and after clarification and presentation of the detailed implementation, it was deemed adequate. There was also a proposal to replace the SFCommandBuffer buffer field with a set of valuators and routes. This is simpler than the proto proposal and easier to implement, but has the same limitations. The conclusion is that the node is accepted in its current state, for inclusion in 14496-1:2001/Amd. 2.

Note: the discussion clarified the scope of the InputSensor. The InputSensor node achieves the following: it defines a framework in which any new sensor can be defined without having to change the bitstream syntax. However, it does not remove the need for the specification of new sensors, in order to achieve interoperability. For example, the Web3D KeySensor will need to be finalized, and then endorsed by MPEG-4, whenever Web3D is ready, and it will have no consequence on the bitstream. The InputSensor framework defines a node and a mechanism to bring input data into the scene, including the presence of an InputStream decoder, and some participants wished to standardize more, e.g. the format of the InputStream.Additional side points were discussed:- in which group should the InputsSensor node be placed (or any other node for that matter). There was no consensus about putting one node in different groups, one proposal to tag the ndt in the node table with the group number, agreement about defining space in new groups. To be revisited on the reflector.- there was a proposal to define default & fallback for the device type.

M6950 : WG11 thanks the National Body of France for this comment. The M6950 document has been analysed. Further, since there has been no implementation of the MatteTexure, MediaControl, MediaSensor, and MediaBuffer nodes in the current version of the reference software, the system group decided not to promote these nodes to the FCD. The InputSensor node is accepted in its current state, for inclusion in 14496-1:2001/Amd. 2

42

Page 43: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Elementary Stream Management

Conformance and bitstream exchangeM7059 : The contribution was presented. The document is in a good shape and accepted for inclusion in the main document (WD of XMT... conformance). SegmentDescriptor conformance is still missing.M7089 : The contribution was not presented, but does not really need to be. It is only a wrap around a set of bitstreams with information. They will be included in the test of conformant test streams.

Bitstream exchange workplanWork items:

complete the formalization of the XML file for bitstream information; few small bugs in the bitstreams: contributors please update your stuff; finish the organization of the third party check; follow up on pledged streams.

Reference Software ImplementationM6949 : Implementation of the InputSensor. The technology will be included in the FCD.MediaSensor is implemented. The technology was not promoted to FCD since MediaControl, a technology to which MediaSensor relates, is not yet implemented.

Profile and LevelsM7034 : Statement of support from the FNB to the 2D profiles under consideration. WG11 and the System group would like to thank the French National Body for its contribution to the definition of new profiles. The M7034 document has been analysed. The System and Requirements Groups recognise that the profiles are of interest and fully mature. Nevertheless, since only one national body asks for their inclusion the FCD so far and since a new proposal close to the Core2D profile occurred at this meeting, it has been decided not to promote these profiles in the FCD.M7019 : The correction is accepted. Cor1 of 14496-1:2001 will be delayed (one more round of ballot) in order for this correction to be made as quick as possible. M7058 : Justification of the use of quantization in 2D profiles with data showing the compression gain in a simple use case. Discussion were raised on the use of quantization.M7106 : This contribution has been submitted late. Brings many clarifications of existing profiles that have been discussed and disposed of. Proposes new profiles. These profiles are close to existing profiles.M7074 : This contribution proposes to register PNG as a valid MPEG streams. Some useful functionality from PNG are currently not supported by MPEG (alpha map on still images, gamma correction, …). Some concerns where raise about the compression efficient of PNG. SNHC will investigate whether PNG provides an efficient solution for all these functionality.

14496-1:2001/Amd. 3Topics

IPMP Extensions

Elementary Stream Management13.MP4 Extensions14.Time stamps discontinuity

43

Page 44: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Profiles and Levels

Conformance and bitstream exchange

Reference Software Implementation15.Software Implementation16.Demonstration17.Demo. Pack.

Status

Inputs and comments requested.

Contributions

IPMP ExtensionsMonday afternoon was spent reviewing the text of the WD from the activities of the AHG on Saturday. This continued Tuesday morning. Several areas were identified for further work based on the submissions. Breakout groups were formed to generate text input for inclusion in the document. This work was review at the Wednesday plenary.

The Wednesday plenary reviewed the work in progress and recommended direction for continued work. In a joint meeting with requirement, it was determined that there was no overlapping of effort by the various groups working on IPMP. This group will need input from the MPEG-21 group working on rights language and dictionary to complete the Amendment.

The editing continued Thursday. The major issue that came up was whether the document was MPEG-n or MPEG-4. This was brought up again in plenary and the direction was reiterated to be MPEG-n. Edits to implement this are still in progress and will be ready for release on Friday.

The following documents have been reviewed and disposed of :

M7119 : Proposal on IPMP Tools Information and IPMP Tools Management. A description of a method for identifying needed IPMP Tools in the bitstream.M7026 : Generic Messaging Framework and XML Based Description for the Flexible IPMP Standard. A presentation of an XML based description of required IPMP Tools in the bitstream.M7128 : Proposal for MPEG-4 Standard IPMP Framework. This proposal describes an IPMP architecture based on the security model of Java 2 security. It is designed to have minimum impact on the terminal player. The framework is applied to an MPEG-4 environment. The document contains useful design goals (independence of the player from the IPMP Systems) that should be matched to the current IPMP Extension framework. It contains as well useful concepts like progressive building of trust. The document does not address the current framework but the proponents are willing to make specific contributions on the current MPEG-4 framework for the next MPEG meeting.M7130 : New Time Stamp for IPMP Processing. A proposal for a new time stamp in the IPMP stream for establishing more strict synchronization with media stream. During the meeting, this problem was fixed by redefining the existing syntax of DTS/CTS.M7131 : Usage of IPMP descriptor and IPMP elementary stream. Proposal of categorizing the interfaces of the IPMP tools. The idea of the framework will be took into account for the further editing.M7149 : IPMP Information Routing. This presentation covered the identification of IPMP Tools in the bitstream and the routing of IPMP stream information to the tools.

44

Page 45: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

M7150 : Mutual & identity validation of IPMP tools. This presentation described a messaging architecture and messages that provide a means to do mutual and identity validation.M7151 : Lessons from Pay-TV. This report reviewed the experiences of using MPEG-2 and IPMP in Pay-TV and called for standard encryption tools to be included in the normative specification of the IPMP Extensions to encourage their inclusion in MPEG-4 support chips for set-top boxes, cell phones, PDA and other small devices.M7152 : Trust Concept for multiple Ringed Topology IPMP Systems. This presentation outlines the necessary elements in the structure of the Tool List for multiple IPMP system and a method of assuring that all IPMP systems are used to render the content.M7153 : This contribution shows the generic syntax and diagram for MPEG-n IPMP system, and at the same time it proposes IPMP Manager module with the syntax for MPEG-4/MPEG-2 system, together with the IPMP Tools Information. It also proposes the possible IPMP Tools ID Table to be used in IPMP system if it can be approved by MPEG registration authority.M7154 : Required IPMP tool list and IPMP information process synchronization. This presentation describes the format of the required IPMP Tool List in the content and as transferred to the tools. It further decribes a method of synchronizing the IPMP processes with the content stream.M7155 : Extending MPEG-4 IPMP Beyond the Hooks. This presentation outline the necessary steps needed to further standardize encryption and other algorithms. It advises that the work be limited to specifying the architecture or issuing a new call for complete systems.M7174 : Tutorial - Technologies/Methods to Defend Against Software Tampering. This presentation was systems view on the cost of software security.

Elementary Stream ManagementA couple of issues related to the MP4 file format have been raised recently. Some of them are corrections that will be made in a new corrigendum of the specification. Others are extensions. All of them are summarized below.

M6817 : Multiple UserData atoms to be disallowed (m6817 approved in Pisa): ACCEPTED for COR. Text in M6817 to be integrated by Dave.M6833 : Allowing duration of last system streams (BIFS, OD’s, and MPEGJ) sample to be zero (m6833 presented in Pisa). ACCEPTED for COR. Text to be provided by Dave.M6967 : Restoring video width and height back into the headers (m6967, section 2). ACCEPTED for COR. Text to be provided by Dave. Addition of an introductory Annex (m6967, section 3). ACCEPTED for AMD or COR, whatever it should be. Text to be provided by Dave. File type identification (from JPEG2000) (m6967, section 1). ACCEPTED for AMD. Text to be provided by Dave.M6969 : Clarification/constraint on Atom order (m6969, section 1). ACCEPTED for COR. Text to be provided by Dave. Reserved/predefined fields (m6969, section 7). ACCEPTED for COR. Text to be provided by Dave. ‘wide’ atom (m6969, section 5). REJECTED. Make IOD atom optional (m6969, section 6). ACCEPTED for COR. Text to be provided by Dave. Clarification on audio storage (ep=0) (m6969, section 3). Need Audio experts. New ‘padb’ atom (UsePaddingFlag) (m6969, section 4). Maybe not needed in Audio. SNHC? Seems no harm to define it, maybe just useless. Aggregation of audio Access Units into MP4 Samples (m6969, section 4). Rejected (already died on this battlefield). Clarification on edit list (m6969, section 8). ACCEPTED for COR (add a sentence for clarification). Text to be provided by Dave.Issues raised on the reflector : Version size in the Data entry url/urn atoms. ACCEPTED for COR. Text in e-mail to be integrated by Dave. Inconsistency about the mandatory atom. ACCEPTED for COR. Text in e-mail to be integrated by Dave. Handler reference atom (editorial). ACCEPTED for COR. Text in e-mail to be integrated by DaveM6990 : Support for URLs in ESD (m6990) ACCEPTED for COR. Text in m6990 to be integrated by Dave, plus some update (MAXINT, constrain to 1 ESD).

45

Page 46: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

In addition, at the request 3GPP (M6937), the requirements for the registration authority issued in Pisa will be amended in order to support the registration of MP4 code points as well.

M6968 : RTP Hint Track, SDP and statistics support (m6968). RTP related Part is ACCEPTED for AMD (just fix 15 bytes to 14); the SDP related part is almost ACCEPTED (review user data definitions); the Statistics part as proposed doesn’t fit nicely: to accept it, it should be improved and reconciled with the Hint Media Header Atom. The Hint Media Header Atom itself should be reviewed, since it contains fields that derive from old drafts of Systems, and was not aligned. It is almost useless in its current form.

M6395 : Fragmented movies (m6395 presented in La Baule). ACCEPTED for AMD, but add support for degradationPriority. Text to be provided by Dave.

M7063Discontinuity state: the issue will be dealt with at the SL Layer.

Reference softwareThe following issues related to the MP4 reference software have been raised :

1) Shadow Sync Atom : Implemented but not accessible by APIs. Jean will provide better, clearer text!!!

2) Support for BIFS/OD carousel. By means of Shadow Sync Atom3) CTS/DTS bug in the reference software. The code refers to a ‘dtts’ atom that is named ‘ctts’

instead; this likely reflects a former implementation that is probably at the origin of the misuse of CTSs and DTSs in some part of the code. Apple (or any other volunteer) should fix the reference software

4) Reference software maintenance. Apple confirms its commitment. No time to discuss the implementation in the reference software of the COR and AMD items.

Degradation priority and AU fragmentsIn addition, the following issues have been discussed :

1) DegradationPriority is not much useful if limited to AUs; Systems recognized this, and DegradationPriority is now associated to each SL-Packet. The MP4 File Format has no provision for AU fragments, except that almost everything can be done by means of hint tracks. Since it is desirable to include AU fragment related information in a standardized way, contributions to cover this aspect are welcome.

2) The predefined SLConfig for MP4 does not expose degradationPriority, which is inconsistent with the availability of such information in the file. Especially in case AU fragments become supported in MP4, the predefined SLConfig should be fixed.

3) What is the DegradationPriority order in MP4? I.e. 0 represents the highest or the lowest priority? The definition of DegradationPriority in MP4 is simply meant to correspond to the Systems’ definition, but the DegradationPriority definition in Systems is vague! Thus MP4 ends up being vague as well. The Systems specification will be clarified.

14496-1:2001/Amd. 4Topics

Scene Description18.Multi-user applications19.Animation Framework Extension

46

Page 47: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Profiles and Levels

Conformance and bitstream exchange

Reference Software Implementation20.Software Implementation21.Demonstration22.Demo. Pack.

Status

Inputs and comments requested.

Contributions

Scene DescriptionM6999 : The contribution was presented. It was noted that the contribution lacked proper semantic descriptions. It needs fixing, but the concept is applicable. Dead reckoning (DR) is indeed specifiable as an update or as a node with equivalent results. The matter will be explored on the reflector.

M7069 : The contribution was presented. The DR functionality is very desirable and accepted as a functionality. The specification as a node or as an update is still not decided, while arguments are below:

implementation complexity; how it fits in Systems; should the stacks be exposed to the author ? link with MuW (immature yet).

The present company recognised that there is a need for a breakout of the CE-participating companies: a strength/weakness analysis should be performed.

M6998 : Concern that so far no evidence has been brought for a work item on BIFS compression to be started. The concern has been accepted. More contributions have addressed this issue to the light of which the conclusion on this contribution have been revisited. Conclusion described below. WG11 thanks the National Body of France for this comment. The M6998 document has been analysed, and has lead to a call for proposal (CfP) for Interpolator compression.

M7107, M7000 : Results on compression for coordinate interpolator coding. The decision is that: WG11 should investigate new technology for the coding of MFField : evidences have been

brought at the Singapore meeting. A core experiment will be issued at the Singapore meeting to depart the already standardized

predictive MFField coding and the interpolator compression algorithms. Factor of 2 has to be reached in order to standardize new technology.

New technology addressing this issue will be accepted until the Sydney meeting.

M7108 : Proposal for coordinate interpolator coding. It will be introduced in the core experiment procedure described above.

M7078 : The contribution was presented. Two proposals have been done for optimizing it: have a consecutive bit which allows to send the position only once, and then have a parameterized length of the position field. David’s proposal is accepted to go into the WD of MuW. David is asked to

47

Page 48: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

experiment with it and gather statistical data. One related proposal was to define a bunch of new commands with parameterized position.

M7068 : The contribution was presented. It contains a TextBuffer node and a new type of “text” stream. It was objected that all of the applications of this node/stream can be done in an equivalent manner with existing BIFS tools. HTML 4.0 node was evoked. No consensus could be achieved.

Other issues on Scene description That session was a follow-up on the recommendation from the AHG on BIFS. The brain storming was about quantization, updating BIFSConfig and adding new BIFS update types. After exploring many solutions, the following recommendations were made: More BIFS updates : There is a need for more BIFS updates commands. As there is no easy

way to update the current framework as it is specified, we need to change the way we look at the current framework. We will now consider the first four bits as update tag, which means that there are two free tags (one of the insert combination and one of the delete combination). One of these free tags will be specified as escape tag to a new set of 256 BIFS updates. The new BIFS updates will be designed like the OD framework, allowing extensions and skipping of unsupported updates.

Quantization : The requirement was for a way to specify “default” or “global” quantization. The final consensus was that two solutions should be further explored, and the first is currently preferred by the majority (1) set of quantization parameters in new BIFS update commands and (2) one of the new GlobalQuantizationParameter node. The rationale is that global quantization would be better done outside of the scene tree. It may be simpler to implement as a node, and more coherent with the existing stuff.

BIFSConfig update : Along the discussion about in-band and out-of-band headers, we explored the possible changes to BIFSConfig. It was recognized that the BIFSConfig contains both information that should remain static and never changed, and information that should updatable. The new update framework should contain a new ConfigUpdateCommand designed to update the dynamic part of the BIFSConfig.

Joint Meeting with SNHCDiscussion on the line drawing between SNHC and Systems. Systems : Generic algorithms that affect the scene graph (ex : interpolator compression,

dynamic animation streaming of any type, …). SNHC : Tools for graphic entities (ex : node definition and compression).CE done according to this either in BIFS or in SNHC. AHG Meeting in May with SNHC and Systems.

14496-8 Transport of MPEG-4 over IP NetworkTopics23.IETF RFC for transport of MPEG-4 over IP24.Framework for the carriage of MPEG-4 content over IP network.

Status

Inputs and comments requested.

Contributions

M7124 : Propose clarification of mapping rules from Video syntax elements to SL packets. Major issues are related to Video Object Sequence Headers, Video Object Layer Headers, Group of Video

48

Page 49: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Object Headers and video_sequence_end_code. All the proposed clarifications are accepted and agreed to be part of the next Video corrigendum.M7066 : Propose improved text for Internet Draft on FlexMux payload format. One important issue is a way to carry FlexMux configuration information. Since minimizing the size of SDP parameters is a preference of IETF, we propose to use any other out-of-bands means to carry the configuration information but if there is no other means than SDP available, SDP to be used optionally.

Changes of Internet-Draft for generic payload format to accommodate all the requests on clarification and documentation from IETF has been reported.

Added section on segmentation rules Video Packet (normative) Data Partition (recommend)

added section on handling scene description streams Only the point IETF raised concern. (needs better explanation) Reliable transportation of OD & BIFS stream is required in some cases. Scene Description carousel should be also mentioned explicitely because AU number has to be

transported in this case. Added an acknowledgement section Fixed figures to fit better IETF style Updated section on multiplexing to refer to recent IETF draft For improved clarity, changed "XXXX section" into names: "XXXXSection" Removed name collision for SLPPSize into SLPPayloadSize (was same name for RTP field and

SDP parameter) Fixed typos, updated references, dates, etc

MPEG-7 Systems (15938-1)

15938-1Topics

Architecture

MPEG-7 binary format

MPEG-7 dynamic descriptions

Delivery of MPEG-7 Description25.Transport of metadata over MPEG-2 (See MPEG-2)26.Transport of metadata within MPEG-4

Profiles and Levels

Conformance and bitstream exchange

Reference Software Implementation27.Software Implementation28.Demonstration29.Demo. Pack.

Status

Inputs and comments requested through NBs.

Contributions

49

Page 50: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

GeneralM6960, M6932 : All documents containing NB comments with respect to the ballot on the ISO/IEC 15938-1/CD have been reviewed and disposed with in the DoC on the ISO/IEC 15938-1/CD.

M7041 : Study Text Of ISO/IEC 15938-1/CD. Taken as a starting point as suggested by the NB.

ArchitectureM7037 : The proposal is to define explicit syntax for a MPEG-7 Sync Layer. Discussion revealed that the concept of “sync layer”, including syntax, exists in various domains including MPEG-4 SL, MPEG-2 Systems, RTP,etc. The group assessed that a specific MPEG-7 syntax is bound to fail. Instead, the MPEG-7 approach should be to define how MPEG-7 data is mapped to existing “sync layers” rather than defining a new one. The “Metadata over MPEG-2” specification is an example of such a mapping, but needs generalization. The MPEG-7 Systems ad hoc group will work on this. Input contributions to the next meeting are strongly solicited in order to improve the MPEG-7 Systems specification.

M7022: reports results of several mini experiment, disposal of which is described below Extensibility: propose TBC extension code for extensions; harmonised with proposal in M7024;

theoretical calculations show average size increase on 3% at maximum; propose to include in FCD; covered by NB comment; agreed to adopt the proposal to the FCD.

Fast filtering: propose to include special navigation commands with RA markers for fast search and filtering; uniqueness of markers is still an open issue, should be covered by further studies; current solution is proposed to be adopted into FCD; is covered by NB comment; agreed to adopt the proposal to the FCD.

Access unit harmonisation: propose modified section 6 and 7, describing binary part of access unit and new proposed BiM fragment header; as outcome of proposals and discussions harmonised structure and text was adopted to the FCD.

M6936: result of mini experiment on extensibility; propose to use namespace-construct like technique also in BiM; results show only small overhead; relates to binary sub-tree coding, can be mixed with proposals for navigation path; propose to include into FCD; covered by NB comment; agreed to adopt the proposal to the FCD. WG11 thanks the National Body of France for this comment. The M6936 document has been reviewed and the extensibility requirements have been fullfilled.

M7060: general discussion about how MPEG-7 terminal looks like, and how possible stages of info sets could look like; how would MPEG-7 APIs look?; try to identify how textual and binary formats (wrt extensions and compatibility) fit into this framework; reflects strategies for extensibility (like e.g. in XHTML); informational, should be further discussed in the BiM AHG; was also discussed in requirements/conformance.

M7082: this document was dealt with in the requirements/conformance discussion; in the breakout group the issue was only shortly discussed; however, it is in particular acknowledged that the possibility to provide forward compatibility is not clear yet with respect to future versions of the BiM itself; it was agreed that this should be further studied in the AHG, however probably that will not happen before the next meeting due to the high workload of the AHG members with respect to MPEG-7 Systems Reference Software implementation and verification.

MPEG-7 binary formatM7024: reports results of several mini experiment, disposal of which is described below

50

Page 51: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Access unit harmonisation: proposed modified section 6 and 7, describing binary part of access unit and new proposed BiM fragment header; as outcome of proposals and discussions harmonised structure and text was adopted to the FCD.

Extensibility/Compatibility: B-/F-compatible codec implemented, same test set used as in M6936; bw-compatibility does not increase size; fw-compatibility slightly increases size (depending on version/description size); propose to include in FCD; covered by NB comment; agreed to adopt the proposal to the FCD

Efficiency: report gain between 5-13%; for each element navigation path was used; request to adopt method to the FCD; minor impact on BiME-2 (need small modification of DS_Update() syntax); covered by NB comment; agreed to adopt the proposal to the FCD.

Fast filtering: propose re-ordering of navigation path to separate position codes from TBCs; search experiment were successful; it was assumed that RA markers are available in order to know where BiM fragment starts; overhead of length field is between 15-25%, should not be mandatory but optional; problems for finding all instantiations of a particular data type (e.g. in recursive schema); propose to include re-ordering into FCD, but at the moment not the length field (further investigate in ME?); covered by NB comment; agreed to adopt proposal to FCD, but without length field.

Generic datatype encoding: two proposals Specific vs. Generic regular expression coding is compared to string coding; provides higher efficiency, and is in principle appreciated; however, due to short amount of time available until the software verification deadline, it was agreed that the proposal is not adopted but left for further studies and possible Version 2 BiM items.

Observed problems: report present results on position encoding; it is believed global position with respect to TBC can be used for position encoding; the benefits and complexities of local position code needs to be studied further; it was agreed to adopt a slightly modified proposal combining global and local position codes, both of which have been investigated in the respective ME.

M7029: propose extension of BiM fragment structure for better tree decomposition; more than one binary sub-tree allowed in one BiM fragment; propose to establish ME to investigate if proposal is more efficient than using BiM fragments (compared to the FCD); it was agreed that this issue should be further studied in a mini experiment.

M7030: extend semantics of length information in sub-tree coding; length should allow to skip not to next sibling but to next cousin or next subsequent element with same schema definition; aims at faster data access for applications (e.g. filtering/search); propose to include into BiM FCD; however, since there were some concerns about the impact such change may have to the specification of the BiM, it was finally agreed that this issue should be further studied in a mini experiment.

M7033: reports results of several mini experiment, disposal of which is described below Observed problems: present results on position encoding; it is believed global position with

respect to TBC can be used for position encoding. The benefits and complexities of local position code needs to be studied further; it was agreed to adopt a slightly modified proposal combining global and local position codes, both of which have been investigated in the respective ME.

Observed problems: repetition of Pisa document, seems that current codes are defined based on position in the schema definition, propose to use lexicographical ordering; status did not change compared to last meeting; no clear preference in the group yet; agreed to use lexicographic ordering to order the elements/attributes declared in a schema, but care has to be taken when dealing with imports or inclusions; in case of extensions or restrictions of “native” MPEG-7 DSs, special rules for the ordering apply; agreed to adopt proposal to FCD.

51

Page 52: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Efficiency: report results of efficient Float encoding; float uses 32 bit to be coded 6 to 9 significant digits? It is too big in many cases we do not need such large numbers? How too compact them?; use MPEG-4 type of encoding (Vmin , Vmax and nbits); BiM is missing the bitsize value, facets can be used to signal Vmin and Vmax; group agreed about the general idea. While it is too late for the FCD, it is recognised that this is an important issue that should be further studied and possibly solutions can be found for a BiM Version 2. -> Joint meeting with audio on this issue: general idea to use more efficient coding for specific datatypes like vectors, matrices etc., using signal-aware methods like Huffmann coding; but use clear interface so that BiM provides the efficient coding tools and they can be used for all such datatypes regardless of the signal behind; more elaboration needed, but very good work item for Version 2!

M7061: report of BiM encoder/decoder implementation, sub-tree representation part; informational, acknowedged.

M7134: result of mini experiment on access unit harmonisation; propose modified section 6 and 7, describing binary part of access unit and new proposed BiM fragment header; in addition proposes inclusion of fragment references as proposed already in an input document to Pisa; after some discussions it was decided that the fragment references should be further studied in a mini experiment since, while the fragment reference concept is understood, only the syntax has been validated and corrected, but the functionality has not yet been tested; however, the remainder of the proposal lead to a harmonised structure and text that was adopted to the FCD.

M7135: result of mini experiment on efficiency; three possible methods for number of occurrences coding; shown pros and cons for each of them compared with current method; not enough instance documents to really make meaningful statistical investigation; covered by NB comment; agreed to adopt the second solution of the proposal to the FCD.

M7137/M7138: this was submitted for information and further consideration; no current activities necessary, but it was agreed to continue discussion in particular on schema encoding at the next meeting.

M7065 : this document was presented and discussed in a requirements session on MPEG-7 requirements. This needs further study, but is an important issue.

Reference Software ImplementationM7023: request for thorough verification of the BiM Software before FDIS; the AHG acknowledges the high importance of proper SW verification for the MPEG-7 Systems Reference SW before approving the FDIS. Appropriate actions will be taken and a workplan will be defined.

M7093: software for navigation path encoding/decoding as separate part; informational, acknowledged.

MPEG-7 DDL (15938-2)

15938-2Topics

52

Page 53: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

DDL

Profiles and Levels

Conformance and bitstream exchange

Reference Software Implementation30.Software Implementation31.Demonstration32.Demo. Pack.

Status

Inputs and comments requested through NBs

Contributions

GeneralM6939, M7010 : All documents containing NB comments with respect to the ballot on the ISO/IEC 15938-2/CD have been reviewed and disposed with in the DoC on the ISO/IEC 15938-2/CD. M7010 has been taken has a starting point for the production of the FCD.

DDLActivities/Issue Resolution

1. Edited CD to comply with approved comments, group decisions and move to FCD;2. Resolved DDL data type extensions – - mimeType, countryCode, regionCode, currencyCode, characterSetCode moved to MDS and

defined using pattern facets on strings;- basicTimePoint, basicDuration in DDL and semantics checking defined and implemented by

the parser.3. Data inheritance will be resolved by application-specific semantics and parser extensions;4. Proposal from Ernest Wan on forward/backward compatibility at the MDS level rather than

the binary encoded level needs further group discussion;5. Assisted MDS IPMP group with XML Schema representation of ProtectedData;6. Status of XML Schema – request to W3C director by XML Schema WG chairs to move to

PR on March 4;7. Vector, array and matrix data types to be supported by Common Data Type Library

provided by XML Schema;8. Still need to resolve details of parser validation to enable new MPEG-7 parser to be

developed.

Reference Software ImplementationM7032 : Reference software for DDL part of the specification. Parser available based on Xerces in Java.

List of reviewed contributionN° Title Source

6924 Systems Meeting Report Olivier Avaro (France Telecom R&D), et al.

6925 Report of the AHG on Systems Conformance Yuval Fisher6926 Here are a couple of thoughts Yuval Fisher6926 Here are a couple of thoughts Yuval Fisher6927 MatteTexture Expanded Text Yuval Fisher6928 IPMP AHG Working Draft Avni Rambhia

53

Page 54: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

N° Title Source6932 KNB comments on Text of ISO/IEC CD 15938-1

Systems, 15938-2 DDLKorea National Body

6932 KNB comments on Text of ISO/IEC CD 15938-1 Systems, 15938-2 DDL

Korea National Body

6936 BIM Extension for forward and backward compatibility

Cedric Thienot, Claude Seyrat, Gregoire Pau

6937 Liaison Statement from 3GPP TSG-SA WG4 (SC 29 N 4048)

3GPP TSG-SA WG4 via SC 29 Secretariat

6938 MPEG-7 IPMP AhG Report Niels Rump for the AhG6939 Summary of Voting on ISO/IEC CD 15938-2

(SC 29 N 4054)SC 29 Secretariat

6940 Summary of Voting on ISO/IEC 14496-4/PDAM 2 (SC 29 N 4055)

SC 29 Secretariat

6943 MPEG-4 Reference Software Architecture AhG Report

Wo Chang

6944 MPEG-4 Reference Software Architecture Working Draft

Wo Chang (NIST), Heiko Purnhagen (Universitat Hannover), Ed Hartley (Lancaster University), Mahnjin Han (Samsung), Zvi Lifshitz (Optibase)

6945 Report of AHG on MPEG-4 BIFS Jean-Claude Dufourd6946 French NB comment on textual format Jean-Claude Dufourd6947 Updated Study text of ISO/IEC

14496-1:2001/PDAM2Michelle Kim et al

6948 Proposed amendment text for the generic InputSensor node

Cyril Concolato, Jean-Claude Dufourd

6949 Reference software implementation of the generic InputSensor node

Cyril Concolato, Jean-Claude Dufourd

6950 French NB comment on generic input sensor Cyril Concolato, Jean-Claude Dufourd6958 Proposal of Registration Management Group

(RMG) of ISO/IEC 14496-1 for IPMP (SC 29 N 4049)

CISAC via SC 29 Secretariat

6959 Summary of Voting on ISO/IEC 14496-1/PDAM 3 (SC 29 N 4066)

SC 29 Secretariat

6960 Summary of Voting on ISO/IEC CD 15938-1 (SC 29 N 4067)

SC 29 Secretariat

6967 Useful JPEG2000 extensions of the MP4 File Format

DW Singer

6968 MP4 RTP Hint Track Design DW Singer6969 Issues in the MP4 File Format DW Singer6989 MP4 AhG report Guido Franceschini6990 Support to ES URLs in MP4 Guido Franceschini6998 FNB Comment French National Body6999 Comments on the Dead Reckoning proposal Alexandre Cotarmanac'h, Cédric Gégout7000 Advanced BIFS compression results Alexandre Cotarmanac'h7010 Revised Study Text of ISO/IEC 15938-2/CD Jane Hunter7019 Group Node Issue in Simple 2D Scene Graph

Profile SpecificationLaurent Herrmann

7020 Report of AHG on binary and dynamic MPEG-7 data representation

Michael Wollborn (on behalf of the AHG)

54

Page 55: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

N° Title Source7022 Results of mini experiment BiME-2 on BiM

random access and extensibilityMichael Wollborn, Andre Mengel

7023 Request for BiM software verification before FDIS approval

Michael Wollborn

7023 Request for BiM software verification before FDIS approval

Michael Wollborn

7024 Results of Mini Experiments on MPEG-7 Binary and Dynamic Descriptions

Joerg Heuer, Andreas Hutter, Ulrich Niedermeier

7026 Generic Messaging Framework and XML based description for the flexible IPMP standard

Itaru Kaneko

7029 Extension of MPEG-7 BiM fragment structure for containerization of sub-trees

Shuichi WATANABE, Yasuaki TOKUMO

7030 Extension of semantics on length information in MPEG-7 BiM sub-tree coding

Shuichi WATANABE, Yasuaki TOKUMO

7031 Report of the DDL AHG Claude Seyrat, Jane Hunter, Joerg Heuer7032 A DDL parser implementation Grégoire Pau, Claude Seyrat, Cédric

Thiénot7033 Results of the BiM mini experiments Grégoire Pau, Claude Seyrat, Cédric

Thiénot7034 French NB Support to 2D BIFS Profiles under

ConsiderationFrench National Body

7037 Definition of the MPEG-7 Sync Layer SangWoo Ahn, JeHo Nam, YoungTae Kim, KyungOk Kang, JinWoong Kim and Chiedeuk Ahn

7041 Study Text Of ISO/IEC 15938-1/CD Claude Seyrat7049 Report of AHG on MPEG-4 Content on MPEG-2

Systems and IP NetworkYoung-Kwon Lim (mp4cast), Jan van der Meer (Philips), Carsten Herpel (THOMSON multimedia)

7057 BIFS-Anim in XMT-A Yuval Fisher7058 Use of QuantizationParameter in 2D Profiles Yuval Fisher 7059 MediaXXX Conformance Yuval Fisher 7060 Extensibility issues in MPEG-7 Cédric Thiénot, Claude Seyrat, Grégoire

Pau7061 BiM sub-tree encoding implementation Cédric Thiénot, Claude Seyrat, Grégoire

Pau7062 FNB comments for the Singapore meeting [email protected] Discontinuity state [email protected] Proposal for the BIFS bistream exchange format. Boris Felts, Yuval Fisher7065 Overview of XML Schema tools for textual

extensibility of MPEG-7Joerg Heuer, Andreas Hutter, Ulrich Niedermeier

7066 RTP payload format for FlexMux streams [email protected] XML syntax for FlexMux descriptors [email protected] Streaming text proposal Scott Yokim, Mikael Bourges-Sevenier7069 Results on CE on distributed animation streams Mikael Bourges-Sevenier7073 MatteTexture portion of WD 2.0 of ISO/IEC

14496-1:2001 AMD 2Yuval Fisher (Envivio), Jim Kent (Sony Distributed Systems Lab), Richter A. Rafey (Sony, Web3D Consortium)

7074 PNG as a Registered MPEG Stream Aaron E. Walsh, Mantis Development Corp., Richard F. Puk, Intelligraphics

55

Page 56: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

N° Title SourceIncorporated, Mikael Bourges-Sevenier, iVast

7076 Web3D-MPEG Document Request Aaron E. Walsh, Mantis Development Corp.

7077 Web3D-MPEG Interoperability and Conformance Testing

Aaron E. Walsh, Mantis Development Corp.

7078 New arguments for a packed editing command for multi-valued fields

David Walsh, Chris Gunn

7079 IM1 AHG Report Zvi Lifshitz7080 Report of Liaison between MPEG-7 and XML

SchemaJane Hunter

7082 Elementary concepts on forward and backward compatibility

Youngsik Huh, Yanglim Cho

7089 Philips 2D BIFS Bitstreams for Conformance Laurent Herrmann7091 Summary of Voting on ISO/IEC

14496-1:2001/DCOR 1SC 29 Secretariat

7093 BiM navigation path encoding software Jörg Heuer, Ulrich Niedermeier, Xavier Mateo, Andreas Hutter

7106 New and updated BIFS profiles Peter Westerink, Steve Wood, Michelle Kim

7107 Results of CE on interpolator compression Do Kyoon Kim, Sang Oak Woo, Seok Yoon Jung, Manhjin Han, Euee S. Jang

7108 The Proposal for Coordinate Interpolator Coding Sungjin Kim, Shinjun Lee, Mahnjin Han7119 Proposal on IPMP Tools Information and IPMP

Tools ManagementMing Ji/Panasonic Singapore Laboratories Pte Ltd [email protected] Shengmei Shen/Panasonic Singapore Laboratories Pte Ltd [email protected] Taka Senoh/Matsushita Electric Ind. Co. Ltd [email protected] Takuyo Kogure/Matsushita Electric Ind. Co. Ltd [email protected]

7124 Video mapping to system clarification Philippe Gentric7128 Proposal for MPEG-4 Standard IPMP Framework IBM7130 New time stamp for IPMP processing Canon7131 Usage of IPMP descriptor and IPMP elementary

stream (Categorization of interfaces)Canon

7134 BiME-6 Results: Harmonisation of Access Units Ali Tabatabai et.al7135 BiME-1 Results: Efficiency of BiM Ali Tabatabai et.al7137 Use of xpath in update commands (information) Ali Tabatabai et.al7138 Efficient coding of schema (for V2) Ali Tabatabai et.al7149 Solution for IPMP information routing E-Vue7150 Mutual and Identity validation of IPMP tools Fuji Xerox7151 Rational for IPMP profiles with standard encryption tools Mindport7152 Trust concept for multiple ring topology IPMP Systems Telanetix7153 IPMP tools management for MPEG-n IPMP Systems Panasonic7154 Required IPMP Tool list and IPMP synchronization

process synchronizationFuji Xerox

7155 Extending MPEG-4 IPMP beyond the hooks Intertrust7174 Tutorial on technologies to defend against software

tamperingCloakware

56

Page 57: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex 6MDS report

Source: John Smith

Multimedia Description Schemes report

56th MPEG Meeting, Singapore, March 5 - 9, 2001Source: John R. Smith, Philippe Salembier, Touradj EbrahimiOverview:The main activities related to MPEG-7 during the week were as follows: 1. Review the results of the core experiments approved during the Pisa meeting,2. Analyze AHG recommendations,3. Address National Body (NB) comments and produce Disposition of Comments (DoC),4. Produce MPEG-7 MDS Final Committee Draft (FCD),5. Review input contributions, 6. Define the workplan for software development and integration,7. Define new Core experiments,8. Start planning for MDS Version 2.

The main activities related to MPEG-21 during the week have been to: 1. Review the results of the Core Experiment on Digital Item Declaration approved during the Pisa

meeting,2. Analyze AHG recommendations,3. Review the results of the Call for Proposal for Digital Item Identification and Description,4. Define the second Working Draft on Digital Item Declaration,5. Define the first Working Draft on Digital Item Identification and Description,6. Define new CEs for the Digital Item Declaration and Digital Item Identification and

Description.

MPEG-7 activities

During the kick-off session, the workplan for the week was discussed and approved. Furthermore, the following points were discussed: Review of the process to create the standard. Discuss processing of the National Bodies Comments on CD, editing of Study of CD, and

disposition of comments. Discuss developing a shared, company-sponsored effort for improving the MPEG-7 MDS

software for usability and comprehensibility.

Review of MDS MPEG-7 AHG reports

Num. Contributions6983 AHG Report on Editing the MPEG-7 MDS XM and SoCD

57

Page 58: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Num. Contributions6970 Report of AHG on MPEG-7 Audio, Video and MDS Harmonization7005 Report of AHG on TV Anytime7043 Report of AHG on Metadata Integration

m6983 AHG Report on Editing the MPEG-7 MDS XM and SoCD, John R. Smith on behalf of AHG

The results were presented on development of the MPEG-7 MDS Monster description. The possibility of using the Monster description for producing valid description examples for FDIS was discussed. It was decided that an AHG mandate would be developed to address the issue of generating and validating descriptions in the FDIS.

m6970 Report of AHG on MPEG-7 Audio, Video and MDS HarmonizationYoshi Shibata on behalf of AHG

The AHG had three mandates, and each resulted an input document, which will be covered later during the week (see below).

m7005 Report of AHG on TV AnytimePeter van Beek on behalf of AHG

Report was given on the ongoing efforts of TVA related to MPEG-7. It was reported that the TVA Metadata specification v. 1.0 contains MPEG-7 related DSs for User Preferences, Usage History, Media Review. It was also reported that a new design would be made for TVA navigation and access. MPEG-7 was initially rejected because of the need for something more lightweight and specific to TVA application. For harmonization and thesauri & registration, SMPTE is candidate for genre thesaurus. TVA could make contributions to MPEG-7 MDS on TVA Program information DS (EPG) – description of TV broadcast channels and their relation to TV services. The TVA Rights Management Group submitted TVA IPMP requirements to MPEG (m7007) at the Singapore meeting. Recommendations were given to continue information exchange (as part of mandates of metadata integration AHG), continue harmonization efforts.

m7043 Report of AHG on Metadata IntegrationErik Oltmans on behalf of AHG

Report was given on the work on completing the MPEG-7 Dictionary ver. 1.0 (<1000 entries). Software was also developed that automatically converts SoCD into dictionary using MS Word macro. The software of Dictionary Generator will be made available. The work will likely impact MPEG-7 MDS for Sydney meeting – perhaps renaming of ~50 elements. Future integration (use of RDF and XML-Schema), study duplicated terms will continue. So far, Dublin Core and SMPTE have been analyzed. The final output of the AHG will be methodology and software tools that can be used by others in future, i.e., MPEG-21 for metadata integration.

Review of MPEG-7 Core Experiments results

Num. Contributions6982 CE Results for VideoEditing DS (4th)7009 Report of CE on Semantic DS7021 Results of core experiment on MPEG-7 phonetic descriptions7138 Report on CE on Graph Rules, Classification Schemes, and Restrictions

The CE reports were discussed in the AHG meeting during the Sunday before the meeting and the AHG made recommendations for promotion to the XM and FCD.

m6982 CE Results for VideoEditing DS (4th)Rosa Ruiloba, Michel RyndermanThe contribution reported the progress of the CE on the synthetic part of the VideoEditing DS. For the analytical part of the VideoEditing DS, software was contributed before the Singapore meeting, and as a result,

58

Page 59: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

the corresponding analytical DSs will be promoted to FCD. For the synthetic part, the underlying model (nested scopes, etc.) and how it maps to segment decomposition was not well understood. The proponents were encouraged to work during the meeting on integrating the video editing model with the Segment Decomposition. As a result of this work, it was decided that additional work was needed on the analytic video editing model, and the Analytic VideoEditing DS was integrated into the MDS XM but not the FCD.

m7009 Report of CE on Semantic DSAna Belén Benítez Jiménez (Columbia University), Hawley Rising (Sony), Corinne Jörgensen (SUNY), , Riccardo Leonardi (Univ. of Brescia), Alessandro Bugatti (Univ. of Brescia), Koiti Hasida (ETL)The contribution reported the progress on updates to the Semantic DS and addition of new DSs for SemanticState and Concepts (Membership functions). The proponents were encouraged to develop a mapping to a semantic modeling formalism and the proponents worked on revising the updates to the Semantic DS based on reviewer feedback. Revisions for the following DSs were accepted for FCD: SemanticPlace, SemanticTime, Event DS, AgentObject DS, SemanticState, Abstract and Concept, and Semantic Relations. The group gave an extension for software integration for SemanticState and Membership functions with the material being integrated into FCD.

m7021 Results of core experiment on MPEG-7 phonetic descriptionsMichael Wollborn (Bosch), Andre Mengel (Bosch), Mathias Wien (RWTH Aachen)This CE followed the "fast track" approach (performing the CE and delivering the software to the ISG group). The CE results were judged as being satisfactory and some slight syntax modifications resulting from the discussion were performed during the week. The final syntax was reviewed at the end of the week and it was decided to promote the Phonetic Description DS to the FCD.

m7138 Report on CE on Graph Rules, Classification Schemes, and RestrictionsHawley K. Rising III, Edward HartleyThis contribution reported on Graphical Classification Schemes. The proponents presented a tutorial on Graphical Classification Schemes and worked on preparing a demo. The demo was not ready initially. The proponents worked on it during the week, but were not able to present it during the week. The material was integrated into the FCD under the condition that the software be finalized and integrated into the XM.

MPEG-7 Description Schemes Promoted to XM and FCDThe following table summarizes the group decision with regard to promotion to XM and FCD.

Description Scheme Decision CommentsVideoEditing DS Promotion of Analytic Video Editing

to FCD.Revision of Synthetic Video Editing DS in XM.

Continue the CE on Synthetic Video Editing DS.

Semantic DS (updates) Promotion of Semantic DS updates to FCD

Semantic DS (membership function)

Promotion of membership functions to FCD pending completion of XM software integration

Exception was given for software integration (see MPEG MDS Resolutions)

Phonetic descriptions Promotion of Phonetic Descriptions to FCD

Graph Rules, Classification Schemes, and Restrictions

Promotion of Graphical Classification Schemes pending completion of XM software integration

Exception was given for software integration (see MPEG MDS Resolutions)

59

Page 60: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

MPEG-7 Link and Media Localization

Num. Contributions6973 Study on the MediaLocator Ds in MDS

m6973 Study on the MediaLocator Ds in MDS, Yoshiaki Shibata (on behalf of AVM-H AHG)

The input document was generated as a result of the work of the AVM-H AHG. The report points out the problem that some attributes/elements of MediaLocator are not needed by the derived types of MediaLocators, such as VideoLocater, ImageLocater, etc, and possibly for future extensions like TextLocater. Proposal was made to move the MediaTime to the derived types. The impact is that tools that use MediaLocator need to specify the type of MediaLocator being used. It was decided that the MediaLocator hierarchy would be redesigned such that specialized attributes/elements would be moved to derived types as needed. The changes are to be incorporated into FCD.

Media Information

Num. Contributions6941 Revision of Annex A of the Study of MDS CD

m6941 Revision of Annex A of the Study of MDS CDA. Mufit Ferman

The contribution reports on the results of a study of the MDS classification schemes of Annex A of CD. The report points out various misspellings, poor definitions, and other editorial errors. The report states that the current status of classification schemes defined in Annex is not clear. For example, the schemes themselves are informative, but if used, they are to be used as-is. It was also pointed out that that the MDS classification schemes relationship to the sources that inspired them, i.e., TVA and EBU, needs to be clarified. Furthermore, some elements are missing Classification Schemes such as RatingScheme, ContentType of RelatedMaterial DS, Role element of Rating Source. Improvements to Classification Schemes are to be worked during the meeting and are to be incorporated into FCD.

Structural Aspects

Num. Contributions6971 Study of the interface issue between MDS and Video tools6972 Study on the Segment DSs in MDS

m6971 Study of the interface issue between MDS and Video toolsYoshiaki Shibata (on behalf of AVM-H AHG)

This contribution reported on the study of the interface between MDS Segments and Video tools. An initial proposal was made to develop a type hierarchy for video tools. However, it was found by the video group to be problematic because of the imposition of the classification on video tools. Both breakout meetings and joint meeting of MDS and Video group were held and a revised interface was developed and adopted. The revised interface develops a simple type hierarchy for video tools that allows them to extend directly from VideoDType and VideoDSType. Correspondingly, the MDS Segment DSs embed these base types directly. The revised interface was incorporated into the FCD.

m6972 Study on the Segment DSs in MDSYoshiaki Shibata (on behalf of AVM-H AHG)

60

Page 61: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

This contribution reported on the study of the Segment Decomposition hierarchy. In particular, it was pointed out that the Segment Decomposition hierarchy provides only semantic constraints on the types of allowable parent-child combinations. Improvements were developed and discussed at this meeting, and a revised Segment Decomposition methodology was adopted that provides syntactic constraints. The approach requires specialized decomposition types to be developed for each segment type that explicitly states the allowable decompositions in space, time, spaceTime, and media. The revised Segment Decomposition DSs were incorporated into the FCD.

Requirements Meeting with All

Num. Contributions6976 Report of the AHG on Conformance and Interoperability in MPEG-77060 Extensibility issues in MPEG-77065 Overview of XML Schema tools for textual extensibility of MPEG-7

m6976 Report of the AHG on Conformance and Interoperability in MPEG-7Fernando Pereira

This contribution reported on the need to further development understanding of how complexity of MPEG-7 descriptions should be measured, including interoperability, conformance, profiling, and extensibility issues, such as forwards and backwards compatibility. The MDS group developed several ideas for complexity and conformance related to MDSs and contributed to the Conformance specification.

m7060 Extensibility issues in MPEG-7Cédric Thiénot, Claude Seyrat, Grégoire PauThis contribution presented a layered approach to interoperability based on Infosets. An Infoset is a set of information that an MPEG-7 terminal holds. The concept of a pipeline of Infosets was introduced.

m7065 Overview of XML Schema tools for textual extensibility of MPEG-7Joerg Heuer, Andreas Hutter, U. Niedermeier

This contribution discussed the need for backward and forward compatibility and overview of XML-Schema tools for textual extensibility, such as inclusion of schema definitions

Requirements Meeting with MDS

Num. Contributions6951 AHG Describing User and User Environment Characteristics for UMA7055 Descriptors for User Terminal Resources7050 Requirements for Linguistic Description

m6951 AHG Describing User and User Environment Characteristics for UMAAndrew Perkis, et al.

The contribution reported on the AHG work on user environments for UMA. Mandate 1 involved the collection of requirements for describing user and user environment. UMA involves media resources, network characteristics, user preferences, terminal capabilities, natural environment of the user. Other relevant efforts are underway in WAP, CC/PP, 3GPP. Recommendations were made to launch a CE on UMA application to better understand the requirements for user environment.

m7055 Descriptors for User Terminal ResourcesSherman (Xuemin) Chen, et al.

The contribution made a proposal that MPEG standardize tools for describing terminal resources. However, the proposal was very specific to MPEG codecs and did not fit with current MPEG-7 approach of providing more generic description of multimedia. The proposal would be characterized as an approach

61

Page 62: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

towards scalability. This issue will be addressed next meeting under MPEG’s new work on coding. The proponents are asked to contribute more concrete proposal showing how the technique can be used in real scenarios, i.e., bluetooth, home Ethernet.

m7050 Requirements for Linguistic DescriptionKoiti Hasida

This contribution addressed the requirements for linguistic description. The contributed made the conjecture that semantic structure of linguistic modality is necessary to address content-based retrieval. The recommendation was made that the proposal made to requirements should be accompanied by evidence that the linguistic community is willing to work on this area in MPEG.

MPEG-7 Dictionary

Num. Contributions7044 A MPEG-7 Dictionary7045 MPEG-7 Dictionary Generator7046 MPEG-7 Dictionary: Recommendations for improvement

m7044 MPEG-7 Dictionary, Oltmans, Martinez, Evain, Mulder, Huijsenm7045 MPEG-7 Dictionary Generator, Willem-Olaf Huijsen, Erik Oltmansm7046 MPEG-7 Dictionary: Recommendations for improvement, Oltmans, Huijsen, Martinez

These contributions discussed the purpose of MPEG-7 dictionary and made recommendations based on the AHG work. The goal of the dictionary is the identification of inconsistencies in semantics, duplication, possible framework for future contributions, possible mapping to other standards (DC, SMPTE). The output is a table that gives name, definition, type, parent type, and Mpeg-7 type. The Recommendations for continuing are to process duplications, harmonize semantics of equivalent terms, study of RDF proposal.

Various Issues

Num. Contributions7081 A Proposal for a Framework for Future Metadata Integration7092 Adding closed-captions and subtitles to VideoText DS

m7081 A Proposal for a Framework for Future Metadata IntegrationJane Hunter

This contribution made a proposal to express DS and D semantics in RDF schema by linking XML Schema elements to RDF schema. The integration results from merging RDF schema to define semantic relationships between domains. XSLT + MetaNet are used to map between domains and maintain interoperability in mixed and extended schemas. The framework can be used to harmonize DC, MPEG-7, INDECS, CIDOC. RDF Schema: defined classes, properties, constraints, labels, and comments. MetaNet term Ontology is expressed in RDF Schema to provide machine understanding of equivalence and hierarchical relationships. Recommendations were made to continue investigation under metadata integration AHG.

m7092 Adding closed-captions and subtitles to VideoText DSN. Fatemi, G. Amaudruz, J.-A. De Blasio

This contribution proposed changes to VideoText DS. Questions were raised about whether the proposed information is really appropriate for the VideoText DS? How the subtitle and caption information is modeled as a MovingRegion? Recommendations were made to accept the revisions as the VideoText is modeled as a MovingRegion.

Basic Tools

62

Page 63: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Num. Contributions6977 Proposals for OrderingKey DS instantiation in MPEG-7 description

m6977 Proposals for OrderingKey DS instantiation in MPEG-7 descriptionN. Adami, A. Bugatti, R. Leonardi

This contribution addresses the problem of instantiating the OrderingKey DS in an MPEG-7 description. The proposal was made to extend OrderingKey Ds from HeaderType. The proposal was accepted and the revisions were incorporated into FCD.

Possible new CEs

Num. Contributions7048 Abstraction and Instantiation6964 The Latest Evaluation of Dependency DS

m7048 Abstraction and InstantiationKoiti Hasida, Riccardo Leonardi

This contribution proposed two new DSs: Abstraction DS and Instantiation DS. The Abstract DS defines an abstract concept such as woman kisses man. The Instantiation DS defines an instance of an abstraction such as Mary kisses Tom. The recommendation was made to continue to explore these new DSs as a new CE.

m6964 The Latest Evaluation of Dependency DSMikio Sasaki, Fumihiko Murase

This contribution reported on the latest evaluation of the Dependency DS, which provides user environment dependency information that allows prefiltering of audio-visual content at a server. The dependency information applies for mobile applications. The proponents reported on benefits of prefiltering, semi-automatic classification using application / dependency conversion table. The architecture is as follows: the server – contains content description using Dependency DS; the client – provides a query description using Dependency DS. Recommendation was made to further study dependency information in the Universal Multimedia Access AHG as part of a total study on characterization of user environment. Recommendation was also made to work with individuals of MDS group to investigate alternative means for expressing dependency information.

New MPEG-7 Core Experiments (CEs):

The following MPEG-7 experiments were approved during the Singapore meeting:

Workplan for CE on Video Editing DS (Synthetic)Workplan for CE on Abstraction and Instantiation

DSs Organizations Application Related documentsVideo Editing DS (Synthetic)

LIP6/UPMCAvid Technology

Video editing and browsing document structure

Reports: M6180, M6462, M6728Workplans: M5994, N3417, M3469, N3821Proposals: M5992, M5993

Abstraction and Electrotechnical Retrieval and browsing of Proposals: M7048

63

Page 64: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Instantiation Laboratory, JapanUniversity of Brescia, Italy

multimedia material based on semantic descriptions

MPEG-7 Multimedia Description Schemes in Core Experiments.

List of MPEG-7 Output documents:

Number TITLE

N3964 MPEG-7 Multimedia Description Schemes XM (v7.0)N3965 DoC on ISO/IEC 15938-5 CD N3966 Text of ISO/IEC 15938-5 FCD Information Technology – Multimedia Content

Description Interface – Part 5 Multimedia Description SchemesN3967 MPEG-7 IPMP DescriptorsN3968 MPEG-7 MDS Core ExperimentsN3969 Workplan for CE on Video Editing DS (Synthetic)N3970 Workplan for CE on Abstraction and Instantiation

List of MPEG-7 AHG approved by the MDS group:

Number

TITLE

N3980 AHG on Editing the MPEG-7 MDS XM and FCDN3981 AHG on MPEG-7 MDS Core Experiments N3982 AHG on Audio, Video, and MDS harmonizationN3983 AHG on Metadata IntegrationN3984 AHG on MPEG-7 IPMP Descriptors

MPEG-21 activities

MPEG-21 Digital Item Declaration

Num. Contributionsm6952 Report on CE on Digital Item Declaration in a streaming environmentm7094 Report on AHG Group on MPEG-21 Digital Item Declaration Core Experimentsm7114 Report on CE on the use of Digital Item Declaration for representing digital photo albums

m6952 Report on CE on Digital Item Declaration in a streaming environmentEyvind Fossbakk, Pilar Manzanares Lopez, Jose Luiz, Yago Canto, Andrew Perkis

m7094 Report on AHG Group on MPEG-21 Digital Item Declaration Core ExperimentsAndrew Perkis, Ian Burnett, Vaughn Iverson

m7114 Report on CE on the use of Digital Item Declaration for representing digital photo albumsDoim Chang, Young-Won Song

64

Page 65: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

The work during the week has focused on the results of the two CEs and the outcome of the call for proposals for Digital Item Identification and Description. The main modifications of the Working Draft can be summarized as follows: New general REFERENCE element has been introduced to replace the

INTERNAL_REF and the EXTERNAL_REF. Choice/selection structures can now override other choice/selection structures (for

default or aggregation). Moreover, the Working Draft for the DID has been updated to improve its readability, to

add examples and to more clearly illustrate the basic concepts. Some of these updates were done on the basis of some response to the call for Digital Item Identification and Description.

The main outcome of the CfP was to produce a first version of the Working Draft

MPEG-21 Digital Item Declaration Core Experiments

The ad hoc group on MPEG-21 Digital Item Declaration Core Experiments met for a one day meeting the weekend before the WG11 meeting to review the two Core Experiments on the Digital Item declaration (DID) and make recommendations for updates and improvements of the Working draft. Several issues were identified. These were described in the ad hoc report and recommended solved by the break out-group on the DID WD at the WG11 meeting. All the issues were resolved. The ad hoc group also recommended to produce an MPEG-21 development Process document at the WG11 meeting and outlined its content. This document was produced at the WG11 meeting and will be used as basis for all future MPEG-21 CEs.

MPEG-21 Digital Item Identification and Description

The ad hoc group on Digital Item Identification and Description met on a two-day meeting the weekend before WG11 meeting to examine the proposals made to the "Call for Proposals" on this topic. Eight submissions were considered (over a total of 10 of which one was withdrawn and one was only related and submitted for information purpose). After review of these proposals, they were classified in terms of the area of ID&D they address and the solutions they provide were matched against requirements. During this work, it was also pointed out that many requirements for ID&D need further clarification and update in the PDTR.

After several meetings describing the process towards standardization of ID&D and agreement on the specific steps to follow, the group concentrated on digital item identification first. It was decided that the starting point for identification is the URI (Universal Resource Identification) allowing both URN and URLs. The governance and implementation of URI in specific use cases were also discussed and core experiments were set up to show how identification could be used in various scenarios. The first working draft of DI&D was then issued based on the agreed solution for ID&D and released two weeks after the meeting.

It is planned that this working draft will be promoted to CD at the next meeting in Sydney. Compared to identification, the description part of ID&D needs further work. So far no recommended descriptors for ID&D have been agreed on.

Joint meeting with ISG on MPEG-21 Software activities

65

Page 66: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

This was the first meeting, dealing with potential software implementation related to MPEG-21. The ISG group made a report of their experience on the MPEG-7 XM development. The importance of defining a clear architecture supporting a concrete application has been highlighted. It was recognized that this approach could be difficult to follow for the seven MPEG-21 items. A possible solution could be to narrow the scope of the activity and to focus on the MPEG-21 items that are currently handled by the MDS group. It was decided to include a new mandate of the AHG on MPEG-21 CE to work on the issue of identifying key applications for the development of an MPEG-21 sYstem Model (YM). Possible software architectures are expected for the Sydney meeting.

New MPEG-21 Core experiments:

The following experiments were approved during the Singapore meeting:

DSs Organizations Application Related documents

Digital Item Declaration

NTNUUni. of WollongongEricssonIMECPhilipsLGEPFL

Streaming environment with varying network and terminal resources

Interim CE report (M6952),

Digital Item Declaration

Philips LEPMitsubishiEricssonIMEC

Streaming environment with scalable media resources

Digital Item Identification and Description

CIDfNETIMAGEEPFLLG

Interoperability among different identification systems in the MPEG-21 DII&D considering an archivist aiming to sell (video, image, sound) items to professional users

Digital Item Identification and Description

IFPIIntelCISAC

Mapping of the natural language description to a visualization of its declaration for Music Releases

Digital Item Identification and Description

INA,LG,DoI

Business case for electronic sale of (video, audio) archives

MPEG-21 Core Experiments.

List of MPEG-21 Output documents:

Number TITLE

3971 MPEG-21 Digital Item Declaration WD (v2.0)3972 MPEG-21 Digital Item Identification and Description WD (v1.0)

66

Page 67: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

3973 MPEG-21 MDS Development Process3974 MPEG-21 MDS Core Experiments3975 Workplan for CE on Digital Item Declaration in a Streaming Environment3976 Workplan for CE on the Bitstream Syntax Definition Language (BSDL)3977 Workplan for CE on Digital Item Identification Systems Interoperability3978 Workplan for CE on an MPEG-21 Identification in Music Releases3979 Workplan for CE on Integration of Digital Item ID and Resolution Scheme

(Note: Documents N3971 will be released on the 23rd of March 2001)

List of MPEG-21 AHG approved by the MDS group:

Number

TITLE

3985 AHG on Editing the MPEG-21 WDs3986 AHG on MPEG-21 Core Experiments

Next targets for the Sydney meeting:MPEG-7

Define the MPEG-7 MDS FDIS. Update Description Schemes in MPEG-7 MDS XM to reflect specification in FCD. Perform the Core Experiments approved during the Singapore meeting and review the results. Continue the harmonization and integration work with relevant standards. Define and plan new core experiments.

MPEG-21

Perform the Core experiments approved during the Singapore meeting and review the results. Study and improve the WDs on Digital Item Declaration and Digital Item Identification and

Description. Identify key applications based on the MPEG-21 Use Case Scenarios in order to develop an

MPEG-21 YM architecture

67

Page 68: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex 7Visual Group Report

Source: G. Sullivan, M. Bober

During the Singapore MPEG meeting, Visual issues were addressed in relation to the following efforts:

MPEG-4 MPEG-7 Call for Proposals on New Tools for Video Compression Technology Call for Proposals for Digital Cinema

MPEG-4

Studio and Fine Granularity Scalability Profiles

a. Verification Testing

Verification tests plans progressed in regard to testing of the Studio and Fine Granularity Scalability Profiles specified in 14496-2:2001/AMD1:2001 (N3898) and 14496-2:2001/AMD2:2001 (N3904), respectively. The verification test plans were discussed in joint sessions with the Test group. New verification test plans for these profiles were approved (N4059 and N4058). The target date for completion of these tests is October 2001.

The Studio Profile test plan (N4059) calls for testing of the following tools: 4:4:4 chrominance format 10 bit precision operation (this is judged sufficient without additional testing of 12 bit

precision operation) High bit rate operation (beyond that of MPEG-2 4:2:2 300 Mbits/s) Lossless coding capability

and calls for testing of the following functionalities: Multiple dubbing with shift operation Chromakey processing Contrast change

The Fine Granularity Scalability test plan (N4058) calls for testing of the following tools: FGS FGST

and calls for testing of the following functionalities: Verifying quality over dynamic channels (over a relatively long period), including operation

in the following three model scenarios:o IP network with priorityo IP network with best efforto IP network with best effort and error correction (depending on resources)

Verifying quality in comparison against Simulcast

b. Conformance

The plan for progress of work in regard to approval of the conformance specifications for the Studio and Fine Granularity Scalability profiles was changed so that the conformance specifications for both of these features as well as conformance specifications for some non-visual aspects of MPEG-

68

Page 69: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

4 will all be issued together and approved as a single amendment to part 4 (thus reducing the complexity of the approval process). This work progressed to PDAM status with the issuance of 14496-4:2001/PDAM1 text (N4127).

c. Reference Software

The plan for the progress of work in regard to approval of the reference software for the Studio and Fine Granularity Scalability profiles was changed so that the software for both of these features as well as reference software for some non-visual aspects of MPEG-4 will all be issued together and approved as a single amendment to part 5 (thus reducing the complexity of the approval process). This work progressed to PDAM status with the issuance of 14496-5:2001/PDAM1 text (N4026).

d. Ad-Hoc Group Formation

Ad-Hoc groups were formed to progress the work on the MPEG-4 Studio Profile (N4070) and on MPEG-4 Fine Granularity Scalability (N4071).

Optimized Reference Software

Software for fast motion estimation (previously reviewed), fast global motion estimation (previously reviewed) and fast static sprite generation tools (M7096) were approved at the meeting and were included in the draft for part 7 (Encoder Optimization). The draft was promoted to PDTR (N4057).

Proposed New Work

a. Proposed New Level of Simple Scalable Profile

A proposal was received (M7003) for the addition of a new level (level 0) of the Simple Scalable profile. This proposal was discussed in a joint session with the Requirements group. Although the proposal appeared to describe a logical and straightforward extension of the existing profile, the group did not determine a need to take action on the proposal, and deferred the issue for possible further consideration at some later date.

b. Proposed Work on Advanced Fine Granularity Scalability

Proposals were received (M6954, M7016, M7054, M7110, M7112) that advocated beginning work toward new tools for a more advanced form of fine granularity scalability than that currently found in 14496-2:2001/AMD2:2001 (N3904). These proposals were discussed in a joint session with the Requirements group. The evidence of the performance and benefits of FGS technology provided in these contributions was welcomed by the group. In light of the upcoming work on verification testing of the existing fine granularity scalability profile and of the upcoming proposals tests for potential new tools to further improve video coding efficiency (and in light of the planned reassessment of the goals of the video work that the proposals in that area will entail), it was recommended that a decision be made at the July meeting as to the need for work on more advanced fine granularity scalability.

c. Proposed Modification of Virtual Complexity Verifier

A proposal was made (M7028) to alter the definition of the virtual complexity verifier (VCV) from that presently found in 14496-2. The Video group expressed a recognition that it is likely that the

69

Page 70: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

existing VCV model can be significantly improved, and plans that any future 14496-2 profile@level conformance points should use a more sophisticated VCV buffer status model than that used in the existing conformance points. A draft of such an improved VCV model was drafted (N3990). Also the NBs were requested to evaluate the potential impact of adopting such an improved VCV model as a corrigendum to existing profile@level conformance points.

d. Potential Need for Corrigendum on Relationship to Systems

A contribution was provided (M7124) that discussed the potential need for clarification of the relationship between the MPEG-4 Visual and Systems parts to ensure that the interface between these parts is fully and properly specified. The contribution was discussed in a joint session with the Systems and ISG groups. Further study by the members is requested, and candidate content for a potential corrigendum on this issue was provided (N4060).

e. Document Status Review

The Video group reviewed the evolution of 14496-2, and summarized that evolution as follows:

Designation FDIS/FDAMDoc Number

Subject

14496-2:1999 N2502 MPEG-4 Visual14496-2:1999/COR1:2000 N3307 Corrigendum 1 of 1999 Edition

Note: N3056 already includes the corrections of N3307 even through N3056 was approved before N3307

14496-2:1999/AMD1:2000 =14496-2:2001

N3056 Version 2 = 2001 Edition of MPEG-4 Visual

14496-2:2001/COR1:2001Note: This was previously

referred to as 14496-2: 1999/COR2:2000

N3664 Corrigendum 1Note: In terms of technical content,

N3664 should be considered COR1 to the N3056 text, as it is relative to that text

14496-2:2001/AMD1:2001 N3898 Studio Profile Extension14496-2:2001/AMD2:2001 N3904 Streaming Video Profiles Extension

MPEG-7

The following issues related to MPEG-7 visual were addressed: Review and Approval of the Visual Ad Hoc Group Recommendations Review of the National Body comments and ballot results on MPEG-7 Visual CD,

integration and editorial work on the CD to address these comments Technical work on visual descriptor domains definition Discussions on Conformance for Visual part Review of the input documents and Core Experiments

Approval of the recommendations of the AHG on Core experiments for visual descriptors.

VCE-4 on cross-verification of the Face Detection could not be reviewed as proponents were absent and no other person could present the results. The CE will continue.

70

Page 71: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

All other Core Experiments defined in Pisa were scheduled to deliver results for the Melbourne meeting. The progress of the experiments was reviewed and the decision to continue all CE’s was approved.

New proposal on colour temperature descriptor was reviewed and a new core experiment was established.

Review of the National Body comments and ballot results on MPEG-7 Visual CD, integration and editorial work on the CD to address these commentsNational Bodies submitted 98 editorial, 40 minor technical and 6 major technical comments. All of the comments were discussed during the meeting. A solution to some comment has already been included in the SoCD document; all other remaining comments were discussed and edited during the meeting and the one-week editing period. (Editorial process of introduction of the changes is very time-consuming so it was not possible to edit all the comments during the meeting). The Visual FCD document (N4062) was issued before the deadline.

Disposition of comments was issued in N4061.

Review of the input documents

The following input document were reviewed and appropriate action taken:

M6966 Colour Temperature DescriptorA new proposal for a subjective “colour temperature” descriptor – new CE established

M6978 Text of Edge Histogram DescriptorSome modifications proposed to the technical description - reviewed

M7012 Proposal for shape sequence descriptor for CE-1. Reviewed.

M7013 Text Description of the Automatic Face Extraction algorithm for the MPEG-7 Visual XM Not presented – proposer absent

M7015 Cross-verification of the Results for VCE-4: Face Detection Not presented – proposer absent.

M7101 Validation of Extension of Colour Structure Descriptor to arbitrarily Shaped Regions Proposal presented and after discussion agreed that the extension is validated

M7104 Progress on the MPEG-7 visual core experiments on 3D coordinate system and camera parameters descriptors. Progress reviewed – continue CE to complete in Melbourne

Technical work on definition of domains for visual descriptors

Video group developed a coherent framework to specify the domains of the visual descriptors (e.g. applicable to still images, still regions, moving regions, etc). However, this proposal was not accepted by the MDS group, which preferred to derive all descriptors from a single visual type.

Joint meetings with other groups

The following joint meetings were held:

- Joint meeting with Requirements and Audio on conformance.

71

Page 72: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Video proposed some ideas on partial conformance testing of visual descriptors. More work is needed to determine the feasibility of the proposed approach.

- Joint meeting with ISG on software implementation. All Video tools are fully integrated, performance of each tool has been checked by two parties. A new schedule for software integration (including development and integration of i/o subroutines for XML output in textual format) was approved. We agreed that the performance of all software shall be again examined by two independent parties before the next meeting.

Core Experiments established – see N4064 for a detailed description

4 CE’s continue, 1 new proposed: CE-1 Development and validation of a Shape Sequence Descriptor (cont.) CE-2 on 3D World Coordinate System Origin Descriptor (cont.) CE-3 on Sensor Parameters CE-4 on Face detection (cont.) CE-5 on Binary Representation of Visual Descriptors. (cont.) CE-6 on Colour Temperature Browsing Descriptor (new)

Exploratory Phase Work

Call for Proposals on New Tools for Video Compression Technology

Progress was made on the proposal test plan for new tools for video compression technology. The group was pleased that three organizations were now volunteering to generate code MPEG-4 video sequences to offer as candidate anchor reference material for use in these tests. The plans for testing the submitted proposals were discussed in joint sessions with the Test group. A revised plan for the evaluations of the proposals was approved (N4065), and the formation of an ad-hoc group to further the work was approved (N4074).

The revised schedule for progressing towards subjective testing of new proposals in this area is as follows:

May 18th Selection of MPEG-4 anchor candidatesJuly 1st Submission of coded test materialJuly 9th-13th Subjective tests

Call for Proposals for Digital Cinema

Progress was made on the proposal test plan for video coding for the Digital Cinema application. The group was pleased that the work toward the evaluation of proposals for this important application was progressing essentially as planned. Proposals in the areas of both distribution and archival quality are to be evaluated in these tests. The plans for testing the submitted proposals were discussed in joint sessions with the Test group. A joint meeting was held with ISG and Requirements to refine the definition of requirements for the application and to determine the method for reporting on the complexity aspects of the proposals. A revised plan for the evaluations of the proposals was approved (N4066), and the formation of an ad-hoc group to further the work was approved (N4075).

72

Page 73: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

The revised schedule for progressing towards subjective testing of new proposals in this area is as follows:

May 25th Submission of coded test material for distribution applicationJune 18th-23rd Subjective tests for distribution applicationJuly 2ndSubmission of coded test material for archival application

Three additional documents were also approved by the video group to aid in the progress of work on Digital Cinema:

Digital Cinema CfP Testing Environment Description (N4067) Digital Cinema CfP Logistics Plan (N4068) Preliminary Definition of new Digital Cinema Video Test Methodologies (N4069)

73

Page 74: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex 8Audio report

Source: S. Quackenbush, Chair, Audio Subgroup

Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 56th meeting of WG11 in Singapore, March 5-9, 2001. The list of participants is given in Annex A-1.

Administrative matters

Approval of agendaThe agenda, shown in Annex A-II, was discussed, edited and approved.

Pisa meeting reportThe Audio Subgroup Pisa meeting report, January 2001, had been previously distributed by email and was approved.

Allocation of contributionsAll contributions (see Annex A-IV) were allocated to the agenda and were discussed either in the task groups or in Audio plenary. The Chair brought other relevant documents from Requirements, Systems and MDS to the attention of the group.

Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.

Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.Group 1 Group 2 What Where WhenReq All Conformance Plenary Wed 11:00 –

12:30Systems Audio MP4 FF Issues Sys BO

RmWed 16:00 – 17:00

Audio Systems BiM and BAM Audio Thu 10:00 – 11:00

Received National Body Comments and Liaison mattersThere was one Liaison and one NB Comment document, as shown below.Document Title Source Author of Response6934 KNB Comments on Text of ISO/IEC CD 15938-4

Information technology - Multimedia content description interface - Part 4 Audio

KNB None

74

Page 75: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

6937 Liaison Statement from 3GPP TSG-SA WG4 (SC 29 N 4048)

3GPP TSG-SA WG4 via SC 29 Secretariat

Liaison Chair

6961 IEC CDV 61937-7 (SC 29 N 4068) IEC TC 100 via SC 29 Secretariat

Liaison Chair

6962 IEC CDV 61937-6 (SC 29 N 4069) IEC TC 100 via SC 29 Secretariat

Liaison Chair

7011 Australian National Body Comments on Text of ISO/IEC CD 15938-4 (Audio)

Australian National Body

None

7072 UKNB comments on 15938-4 Adam Lindsay, on behalf of the UKNB

None

7086 Summary of Voting on ISO/IEC CD 15938-4

SC 29 Secretariat Audio Subgroup

Task GroupsEight task groups were convened for the duration of the MPEG meeting, as shown in ANNEX-III. Results of task group activities are reported below.

Record of Audio plenary, joint meetings and task group activities

Audio plenary discussionsAudio plenary discussions consisted of review and approval of work done by the task groups.

Joint MeetingsJoint meeting of all groups on MPEG-7 conformance

There was a stimulating joint meeting of all subgroups on MPEG-7 conformance. A document that is the framework of the MPEG-7 conformance working draft (WD) was presented, and there was discussion on the underlying principles of MPEG-7 conformance. Many aspect of the meeting were incorporated into N3999, the Audio contribution to the MPEG-7 Conformance WD.

Joint meeting with systems and Audio on MP4 FF

Two issues in Version 2 of the MP4 FF were discussed: one concerns how to store error resilient audio bitstreams in mp4ff, and the other concerns a mechanism for indicating the bit length of access units in mp4ff. In the first proposal, it was recommended that only epconfig=0 Version 2 audio streams be stored in mp4ff tracks, and that epconfig=1,2,… Version 2 audio streams be stored in mp4ff hint tracks. This is not mandatory but rather is a guideline. The Audio subgroup members agreed that this would not compromise the capacities of the error resilient bitstreams, but in fact would be a significant enhancement in that hint tracks could aggregate levels of error protection as a specific channel might require. The second proposal provided a means to compactly signal the number of unused (i.e. padding) bits in the last byte of an access unit. Although it is not clear that this is a necessity for MPEG-4 audio streams, the Audio subgroup members agreed that it provided a useful capability at practically no cost. Joint meeting with Systems and Audio on MPEG-7 binary format

Michael Wollborn gave a very helpful tutorial on BiM. This tool typically provdes 98% compression of the XML tags portion of XML instantiations. XML descriptions processed by a BiM encoder/decoder pair are identical to the original with the exception of white space, comments and order of attributes. A special property of BiM is that it can transmit subtrees in an order different from the order in which they appear in the textual format.

75

Page 76: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

BiM operates on fragments, which are composed of four fields. The fields and what each does are shown here:

1. Navigation command, which specifies the type of addressing Absolute with respect to root Absolute with respect to top Relative with respect to current

2. Navigation path Specifies path to the target node

3. Content manipulation command Add, update, replace

4. Sub-tree binary representationBiM supports integers types of arbitrary length (length as defined in the schema), float and double types. All of these are transmitted as native binary, e.g. n-bit words for n-bit integer, 32-bit words for IEEE float and 64-bit words for IEEE double.Currently BiM is signal un-aware. Audio should consider generating standardized tools for Huffman coding of vectors, such as an interface specifying the probability PDF of the data set and the vector to code. Alternatively one could refer to a pre-defined Huffman codebook or to a parametrically defined PDF, for example P(x) = e-ax such that only the parameter “a” needs to be transmitted.

Task group discussionsAudio Call for Proposals

The Call for Proposals was edited and approved. Changes were entirely contained within ANNEX III of the document. The task group observed that in the case of bandwidth extension, proponents should have access to reference quality MPEG-4 bitstreams to use as the base stream, and that it would be fair if all proponents in the comparative test used the identical MPEG-4 bitstream as the base stream. However we note that the optimal bitrate and bandwidth of the base stream may not be the same for all proposed technologies.

MPEG-2 AAC- reported by Ralph Sperschneider

N3797 (Proposed clarifications to MPEG-2 AAC) The document has been reviewed. An output document has been prepared: N3994 (Proposed clarifications to MPEG-2 AAC). The document was slightly restructured, some bugs were fixed. The description of buffer fullness was further revised. One more bug regarding the reference software was identified and described. An unambiguous description of the ADTS CRC computation (see m6252, w3457 Resolution

2.5.9) has been added. The new conformance criterion for “predictor_reset” was reviewed and slightly rephrased. A correction removing the semantics description of “emphasis” was added. A rule about the occurrence of LFE´s has been added. A section regarding test sequence L9 has been added (number_of_raw_data_blocks_in_frame is

used incorrectly within the ADTS header).

Conformance test sequences Some test sequences seem not to fulfill the buffer requirements.

Cross-checking activities have been scheduled as follows:Philips: will be report on 2001-03-16 (AAC Main, AAC LC)AT&T: will cross-check 2001-05-01 (AAC Main, AAC LC)Sony: will try to check AAC SSR sequences

76

Page 77: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

FhG: brought up this issue, continues internal evaluation This affects ISO/IEC 13818-4/AMD1 and ISO/IEC 13818-4/AMD3. This issue is considered in output document N3994 (Proposed clarifications to MPEG-2 AAC). The provided waveforms are in 16 bit resolution.

Waveforms with 24 bit resolution are provided by FhG, they are available on the FhG ftp site to be cross-checked. Concerns are expressed, that 24 bit accuracy is not achieved. Cross-checks are postponed until this issue has been solved.This affects ISO/IEC 13818-4/AMD1 and ISO/IEC 13818-4/AMD3. This issue is considered in output document N3994 (Proposed clarifications to MPEG-2 AAC).

Reference software The RMS criterion appears to fail when comparing the decoder output of the two AAC

decoders provided within the reference software.The reference software needs to be updated to provide 24 bit accuracy. (float/double). This has been scheduled as follows:Philips: will investigate this issue (SIN1, SIN2)AT&T: will investigate this issue (mp4mcDec)Sony: will investigate this issue (SIN3)FhG: brought up this issue, continues internal evaluationThis affects ISO/IEC 13818-5/AMD1.This issue is considered in output document N3994 (Proposed clarifications to MPEG-2 AAC).

It was found, that the data element number_of_raw_data_blocks_in_frame within the adts header seems currently not to be evaluated.

Recommendations To review N3994 (Proposed clarifications to MPEG-2 AAC), especially:

the software bug-fixes (Philips, FhG, AT&T) the predictor reset issue (FhG, AT&T)

To review/update the reference software, especially: the predictor coefficient generation b/Var (AT&T) the software bug-fixes as described in N3994 (Proposed clarifications to

MPEG-2 AAC) (Philips, FhG, AT&T) to assure 24 precision of the test audio output to investigate the interpretation of the data element

number_of_raw_data_blocks_in_frame within the ADTS header. To review/update conformance test sequences:

to cross-check buffer requirements (Philips, Sony, FhG, AT&T) to regenerate test sequence L7 (Dolby) to assure the correct usage of number_of_raw_data_blocks_in_frame in any

ADTS conformance test sequence (AT&T, FhG) to update waveforms that do not fulfill the buffer requirements (AT&T, FhG,

Sony) to update waveforms (16 bit 24 bit accuracy), as soon as the accuracy

issue and the buffer requirements issue have been solved To establish an AhG with mandates similar to the recommendations given above

MPEG-4 Conformance- reported by Ralph Sperschneider

77

Page 78: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Reviewed input papers:M7099 – Report of the Ad-hoc Group on the Audio part of MPEG-4 Conformance (this document)M7097 – Status and Workplan for V1 and V2 Audio ConformanceM7098 – Proposed corrections to MPEG-4 Version 1 and Version 2 Audio Conformance

Conformance work plan / additional test sequences M7097 has been used as starting point. The tables reflecting the test sequence status have been updated. The time schedules have been revised. The definition of additional test sequences has been considered.

The definition of equations is required first, that can assign a given configuration to a certain profile@level. A tool which implements these equations is considerable for testing test sequences.

Proposed corrections on Audio conformance / profile@level indication M7098 has been used as starting point. The tables listing the relevant conformance test sequences for each profile and level

have been reviewed.

Missing references to Audio levels in Systems This issue was clarified; the references will be included by Systems.

Recommendations To continue collecting and verifying conformance test sequences. To review the proposed corrections on Audio conformance. To consider methods to assign a given configuration to a certain profile@level. To establish an AhG with mandates similar to the recommendations given above.

MPEG-4 Edition 2001- reported by Sang-Wook Kim

The task group reviewed input documents m7100 and m7075. Document m7100, presented by Ralph Sperschneider, proposed corrections to MPEG-4 Audio text. Task group members noticed these are possible COR2 issues. Since MPEG-4 Audio 2001 integrates ISO/IEC 14496-3:1999, ISO/IEC 14496-3 AMD1:2000, and ISO/IEC 14496-3 COR1, two ways of handling these errors were considered by task group members:

Produce Audio 2001 text on schedule and then start COR on that text, Hold producing Audio 2001 text until COR2 issued

Schuyler Quackenbush pointed out that a new COR will take another 6 months, and so suggested that to meet market needs, the Audio subgroup produce MPEG-4 Audio 2001 at this meeting, and start any possible COR2 later. The task group members agreed with his idea.Task group members reviewed m7075, which raised some work items:

To incorporate missing COR1 items in subpart 1 In order to references to obsolete terms and standards, to remove terms such as version 1,

version 2, ISO/IEC 14496-3:1999, ISO/IEC 14496-3/AMD1:2000. To check inter-document crosslinks.

To resolve these work items, following members volunteered to review and update each subpart:Subpart 1: Andrea Holzer, Sang-Wook Kim, Subpart 2: Masayuki NishiguchiSubpart 3: Toshiyuki NomuraSubpart 4: Marc Klein Middelink, Andreas Hölzer

78

Page 79: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

For check review, Takehiro Moriya prepared a COR1 item checklist EXCEL sheet, and members checked against it.During reviewing, the task group members realized that they needed to invite a native English speaker to review the introduction part of MPEG-4 Audio 2001. The task group raised this issue at Audio plenary and Schuyler Quackenbush kindly volunteered to review MPEG-4 Audio 2001 introduction part. However, the task group noticed the need to update the cross-references (Table 1.9, etc), and did this in the introduction part of the standard. The task group agreed to prepare and submit final draft to SC29 Secretariat by June 15, 2001.It was agreed in Audio plenary that any potential Corrigendum 2 issue, that needs no further clarification, should be considered within the second edition / edition 2001.

MPEG-7 Audio 15938-3 (FCD Mar 01) – reported by Phil Garner

There was good progress in consolidating audio LLDs. Most notably, the distinction between normative and informative portions was made clearer.There was some harmonisation of Audio with MDS and DDL: Typed references were removed. Matrix and vector types were harmonised.Results of MDS core experiment on Phonetic Description was harmonised with the existing Spoken Content descriptors and description scheme in the Audio text.There were minor editorial changes to enhance the silence descriptor.The biggest changes to the text were to the Audio Framework. Many Low Level Descriptors (LLDs) received a unified structure by way of a new AudioLLDType.A wrapper class was written for the reference software (XM) that facilitated use of the audio AFsp library. This library provides much needed audio file I/O capability in the XM.To support the functionality of robust matching of audio signals, the AudioSpectrumFlatness descriptor was included, based on extensive experimental evidence.

MPEG-7 Reference Software 15938-6 (FCD Mar 01)

Mike Casey reviewed and revised the “Status and Workplan for MPEG-4 Audio Reference Software” document and tables to reflect the current position and objectives of integration of MPEG-7 software.

MPEG-7 Conformance 15938-7 (WD Mar 01)

Schuyler Quackenbush prepared text for the Audio contribution to the MPEG-7 WD. This document conveys the Audio subgroup’s vision of conformance in the MPEG-7 standard and contains a workplan for concrete action on conformance during the AHG period.

Exploration: Lossess Coding – reported by Takehiro Moriya

Task group on exploration of lossless audio coding reviewed input document m7018 collected technical information on MLP and motion JPEG 2000. discussed issues on the necessities, conventional format, requirement, and evidence of lossless

coding technology. created output document N4010, “Issues in considering lossless audio compression as an

extension to MPEG-4,” which will form the basis for further discussion on this issue. created an AHG, “AHG on consideration of lossless audio coding technology,” which will host

further discussion on this topic.

Meeting deliverables

Press statementAn outline of the Audio part of the press statement was prepared and approved.

79

Page 80: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Dispositions of CommentsThe DoC on the MPEG-7 Audio was prepared and will be available after a 3 week editing period.

Responses to Liaison and NB commentsNo responses were required.

Recommendations for final plenaryA list of Audio recommendations were reviewed and approved.

Establishment of new Ad-hoc GroupsThe following ad-hoc groups were established by the Audio subgroup:Title Chair No. MtgAHG on Audio Call for Proposals

S. Quackenbush 4011 Sat or Sun before 57th MPEG Mtg

AHG on MPEG-2 AAC Clarifications

R. Sperschneider 4012 Sat or Sun before 57th MPEG Mtg

AHG on Audio part of MPEG-4 Conformance

R. Sperschneider 4013 Sat or Sun before 57th MPEG Mtg

AHG on MPEG-4 Audio 2001 Edition

S-W. Kim,Co-chair A. Hoelzer, T. Moriya, B. Grill

4014 No

AHG on MPEG-7 Audio P. Garner 4015 May 7, Salt Lake City, May 14, Amsterdam, July 15, Sydney.

AHG on Audio part of MPEG-7 Conformance

F. Klefenz 4016 No

AHG on Consideration of Lossless Audio Coding Technology

T. Moriya 4017 No

Approval of output documentsAll output documents, shown in Annex-IV, were presented in Audio plenary and were approved.

Future activities

Schedule of future meetingsAd Hoc group meetings are shown in the table listing the Ad Hoc groups.

Agenda for next meetingThe agenda for the next MPEG meeting, shown in Annex V, was reviewed and approved.

All other businessThere was none.

Closing of the meeting The Audio chair thanked the MPEG-7 editing task group members for their hard work and long hours. They achieved a major milestone at this meeting with the issuing of MPEG-7 Audio FCD. The chair also thanked the MPEG-4 Audio 2001 Edition task group and its chairs for another major milestone in releasing the text of 2001 Edition at this meeting. Finally, the Audio chair acknowledged and thanked the MPEG-4 conformance task group and its chair for their excellent work. Audio plenary was closed at 12:30, with plenty of time for lunch (or even the pool)!

80

Page 81: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex A-I: ParticipantsName First

NameCountry Affiliation e-mail address

Burnett Ian AUS Univ of Wollongong

[email protected]

Casey Mike USA M E R L [email protected] Wei-Luen SG Panasonic [email protected] Dong-

YanSG Inst of

[email protected]

Feiten Bernhard DE Deutsche Telecom

[email protected]

Garner Philip UK Canon [email protected] Bernhard DE FhG IIS-A [email protected] Jürgen DE FhG IIS-A [email protected]ölzer Andreas DE FhG IIS-A [email protected] Chien-

MinUSA Sorenson Labs [email protected]

Jost Uwe UK Canon [email protected] Sang-

WookKR Samsung [email protected]

Klefenz Frank DE FhG AEMT [email protected] Middelink

Marc NL Philips [email protected]

Kuan Kim-Hann

SG Panasonic [email protected]

Le Guyader Alain FR France Telecom R&D

[email protected]

Lindsay Adam UK Lancaster Univ [email protected] Takehiro JP NTT [email protected] Sua-Hong SG Panasonic [email protected] Masayuki JP Sony [email protected] Toshiyuki JP NEC [email protected] Schuyler USA AT&T [email protected] Jean-

BernardFR France Telecom

R&[email protected]

Sperschneider Ralph DE FhG IIS-A [email protected] Jens DE Thomson

[email protected]

Toguri Yasuhiro J Sony [email protected]äänänen Mauri FIN Nokia Res.

[email protected]

81

Page 82: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex A-II: Agenda for the Singapore Audio MeetingAgenda Item Contributions1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda2.2. Approval of Pisa meeting report2.3. Allocation of contributions2.4. Communications from the Chair2.5. Joint meetings 69692.6. Review of AhG reports 6943S 6970M 6994 7004

7025I 7042 7071 70992.7. Review of task group mandates2.8. Received national body comments (6934) (7011) (7072)

7086mp7ballot2.9. Received liaison matters 6937(3gpp:h.263,amr)

6961(iec/tc100:atrac) 6962(iec/tc100:aac)

2.10. Audio plenary topics (6944S) 70183. Task group activities

3.1. Audio Call for Proposals1.1. MPEG-2 AAC 13818-7/DCOR21.2. MPEG-4 Conformance 7097 70981.3. MPEG-4 Edition 2001 7075 71001.4. MPEG-7 Audio 15938-4 (FCD Mar 01) 6934 7086 7120 7121

71291.5. MPEG-7 Reference Software 15938-6 (FCD Mar 01)

1.5.1. Integration1.6. MPEG-7 Conformance 15938-7 (WD Mar 01)

4. Discussion of unallocated contributions5. Meeting deliverables

5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents

6. Future activities6.1. Agenda for next meeting

7. A.O.B.8. Closing of the meeting

82

Page 83: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex A-III: Task Groups

1. Audio Call for ProposalsChair Schuyler QuackenbushMandates:1.1. Review Audio Call AhG recommendations1.2. Revise logistics of Audio Call for Proposals as necessary

2. MPEG-2 AACChair Ralph SperschneiderMandates:2.1. Review N37972.2. Review conformance/software-related issues2.3. Make recommendations to Audio plenary

3. MPEG-4 ConformanceChair Ralph SperschneiderMandates:3.1. Revise workplan for bitstream definition, collection and cross-check3.2. Review proposed corrections to audio conformance3.3. Review profile and level table3.4. Review systems Cor for correct reference to Audio levels

4. MPEG-4 Edition 2001Chair Sang-Wook Kim, Andreas Hoelzer, Takehiro MoriyaMandates:1.1. Consider “Study on Edition 2001”1.2. Consider if and when to begin Cor21.3. Create workplan for continued work on Edition 2001 text

5. MPEG-7 Audio 15938-4 (FCD Mar 01)Chair Phil GarnerMandates:5.1. Prepare CD DoC5.2. Prepare FCD text5.3. Draft “Proposed additions to MPEG-7 Audio”

6. MPEG-7 Reference Software 15938-6 (NOT: FCD Mar 01)Chair Mike CaseyMandates:6.1. Draft “Status and Workplan for Audio Contribution to MPEG-7 Reference Software”

7. MPEG-7 Conformance 15938-7 (WD Mar 01)Chair Schuyler QuackenbushMandates:7.1. Draft “Status and Workplan for Audio Contribution to MPEG-7 Conformance”

8. Exporation: Lossless codingChair: Takehiro MoriyaMandates:8.1. Discuss motivation and possible requirements for lossless coding8.2. Draft an output document “Considerations for Lossless Audio Compression Extensions for

MPEG-4”

83

Page 84: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex A-IV: Input and Output Documents

Contributed documentsThe following documents were contributed to the Audio Subgroup and were considered during this meeting:Number Section Source Title6934 Audio Korea National Body KNB Comments on Text of

ISO/IEC CD 15938-4 Information technology - Multimedia content description interface - Part 4 Audio

6969 Systems DW Singer Issues in the MP4 File Format6994 Audio Heiko Purnhagen Report of AHG on MPEG-4 Audio

Reference Software7004 Audio Sang-Wook Kim on behalf

of AHG on MPEG-4 Audio 2001 Edition

Report of AHG on MPEG-4 Audio 2001 Edition

7011 Audio Australian National Body Australian National Body Comments on Text of ISO/IEC CD 15938-4 (Audio)

7018 Audio Takehiro Moriya, Sang-Wook Kim, Lin Xiao

Proposal of lossless audio coding as an extension of MPEG-4

7042 Audio S. R. Quackenbush Report of AhG on Audio Call for Proposals

7071 Audio Adam Lindsay, on behalf of the AhG

Report of MPEG-7 Audio Ad Hoc Group

7072 Audio Adam Lindsay, on behalf of the UKNB

UKNB comments on 15938-4

7075 Audio Sang-Wook Kim on behalf of AHG on MPEG-4 Audio 2001 edition

Study on MPEG-4 Audio 2001 Edition

7086 General/All SC 29 Secretariat Summary of Voting on ISO/IEC CD 15938-4

7097 Audio Ralph Sperschneider, on behalf of the Ad-hoc Group on the Audio part of MPEG-4 Conformance

Status and Workplan for MPEG-4 Audio Conformance

7098 Audio Ralph Sperschneider, Andreas Hölzer, on behalf of the Ad-hoc Group on the Audio part of MPEG-4 Conformance

Proposed corrections to the MPEG-4 Version 1 and Version 2 Audio Conformance

7099 Audio Ralph Sperschneider, on behalf of the Ad-hoc Group on the Audio part of MPEG-4 Conformance

Report of the Ad-hoc Group on the Audio part of MPEG-4 Conformance

7100 Audio Andreas Hölzer, Ralph Sperschneider

Proposed Corrections to MPEG-4 Audio

7120 Audio Juergen Herre, Christian Uhle, Oliver Hellmuth

Descriptors for Content-based Audio Identification

7121 Audio Juergen Herre, Christian Compactness / Precision

84

Page 85: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Uhle, Wolfgang Hirsch Considerations for Audio LLDs7129 Audio Melanie A. Jackson, Ian

Burnett, Comments on Frame Sizes in MPEG-7 Audio Descriptors

Output DocumentsThe Audio Subgroup produced the following output documents. Those approved for public release are indicated by the entry “Yes.”Title No. PublicCall For Proposals for New Tools for Audio Coding 3992 YesDoC for MPEG-7 Audio CD 3993Text of ISO/IEC FCD 15938-4 Information Technology - Multimedia Content Description Interface - Part 4 Audio

4004 Yes

Proposed Clarifications to MPEG-2 AAC 3994Text of MPEG-4 Audio 2001 Edition 3995Proposed Corrections to MPEG-4 Audio 3996Status and Workplan for MPEG-4 Audio Conformance 3997Proposed Corrections to MPEG-4 Audio Conformance 3998Audio Contribution to MPEG-7 Conformance WD 3999Status and Workplan for XM Integration of MPEG-7 Audio 4007XM Integration Guide for Audio 4008Proposed Additional Tools for MPEG-7 Audio 4009Issues in Considering Lossless Audio Compression as an Extension to MPEG-4 4010

85

Page 86: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex A-V: Agenda for the Sydney MPEG Audio MeetingAgenda Item Contributions9. Opening of the meeting10. Administrative matters

10.1. Approval of agenda10.2. Approval of Singapore meeting report10.3. Allocation of contributions10.4. Communications from the Chair10.5. Joint meetings10.6. Review of AhG reports10.7. Review of task group mandates10.8. Received national body comments and liaison

matters11. Task group activities

11.1. Audio Call for Proposals11.2. MPEG-2/4 AAC11.3. MPEG-4 Conformance11.4. Exploration of new technology11.5. MPEG-7 Audio 15938-4 (IS Oct 01)11.6. MPEG-7 Reference Software 15938-6 (IS Jul 01)11.7. MPEG-7 Conformance 15938-7 (CD Oct 01)

12. Discussion of unallocated contributions13. Meeting deliverables

13.1. Press statement13.2. Dispositions of comments13.3. Responses to NB comments13.4. Liaison statements13.5. Recommendations for final plenary13.6. Establishment of new Ad-hoc groups13.7. Approval of output documents

14. Future activities14.1. Agenda for next meeting

15. A.O.B.16. Closing of the meeting

86

Page 87: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex 9SNHC report

Author: Euee S. Jang, Chair of SNHC subgroup

SNHC Meeting SummarySNHC objectives were: to check the conformance status of Version 2 tools (i.e., FBA and 3DMC), to discuss and evaluate the AFX CE results and update VM to discuss the AFX S/W development and produce workplan till Sydney. and to review the FAQ of SNHC and e-mail reflectors.

SNHC Objectives & Work ItemsThe outline of more detailed meeting objectives and work is given below:MPEG-4 Version 2A. 3D Model Coding

1. Integration issue in Systems2. Conformance

Reference S/W (with maintenance)B. Face and Body Animation

1. Integration to IM-12. Part 5 Reference Software

MPEG-4 Ext. 4A. Animation Framework eXtension

1.Review CE contributions2.Update VM3.S/W development

SNHC Contributions & Related ReviewDoc. No. Title Authors

m6929 (SNHC)

Skin & bones for efficient animation streaming

Dr Michael Steliaros, Michelle Murphy

m6930 (SNHC)

General plasma-based procedural textures

Dr Michael Steliaros, Jon Grove

m6943(Systems)

MPEG-4 Reference Software Architecture AhG Report

Wo Chang

m6944(Systems)

MPEG-4 Reference Software Architecture Working Draft

Wo Chang (NIST), Heiko Purnhagen (Universitat Hannover), Ed Hartley (Lancaster University), Mahnjin Han (Samsung), Zvi Lifshitz (Optibase)

m6997 (SNHC)

Truly Hierarchical Coding of 3D Models with Subdivision Surfaces

Francisco Morán

m6998 (SNHC)

FNB Comment FNB

m6999 (SNHC)

Comments on the Dead Reckoning proposal

Alexandre Cotarmanac'h, Cédric Gégout

m7000 (SNHC)

Advanced BIFS compression results Alexandre Cotarmanac'h

87

Page 88: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

m7027 (SNHC)

Report of CE on Streaming Scalable Texture for 3D rendering

Gauthier Lafruit

m7038 (SNHC)

MeshGrid model features and CE  Ioan Alexandru Salomie, Rudi Deklerck, Jan Cornelis

m7069 (SNHC)

Results on CE on distributed animation streams

Mikael Bourges-Sevenier

m7070(SNHC)

AHG on AFX Core Experiments report Mikael Bourges-Sevenier

m7103(SNHC)

Report of FBA Conformance adhoc Eric Petajan, Marius Preda

m7107(SNHC)

Results of CE on interpolator compression

Do Kyoon Kim, Sang Oak Woo, Seok Yoon Jung, Manhjin Han, Euee S. Jang

m7108(SNHC)

The Proposal for Coordinate Interpolator Coding

Sungjin Kim, Shinjun Lee, Mahnjin Han

m7116(SNHC)

Generic articulated model definition and animation

Marius Preda, Françoise Preteux, Mikael Bourges-Sevenier

Output Document EditorsDocument Editor

Minutes of the meeting Aaron E. WalshSNHC Homepage review Mahnjin HanVM update Mikael Bourges-Sevenier, Michael Steliaros, Francisco

MoranAFX S/W development plan

Aaron E. Walsh

SNHC FAQ review Gauthier LaFruit, Itaru Kaneko, Alain Mignot, Sassan Pejhan

SNHC & Joint MeetingsSNHC group had the following work schedule along with joint meetings with other groups: MONDAY (1-15-01)9 A.M. – 2 P.M. Monday Plenary3 – 6 P.M. SNHC Plenary Roll Call

Approval of agendaSNHC deliverablesAmd. 1 FBA ConformanceAmd. 1 3DMC ConformanceRef. S/W ArchitectureMPEG-4 S/W rewritingAFX and MUW issues

TUESDAY (1-16-01)9 – 10 A.M. Joint meeting (Systems) BIFS-related issues10 A.M. – 6 P.M SNHC Plenary AFX-CE contributions review

WEDNESDAY (1-17-01)9 – 10:30 A.M. Monday Plenary11:30 A.M. – 6 P.M SNHC Plenary CE Decision making and VM update

Organizational issuesNew CE designAFX S/W development plan

88

Page 89: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

THURSDAY (1-18-01)10 A.M. – 1 P.M SNHC Plenary Still Texture discussion

General SNHC issuesMay interim meeting planningDeliverablesbyte alignment of 3DMC & FBAreview of VM updatesIPMP

2 – 3 P.M. Joint meeting (Systems) Im-1FRIDAY (1-19-01)9 – 10 A.M. SNHC Plenary AFX S/W workplan

SNHC resolutionsAHG groups

2 – 9 P.M. MPEG Plenary

Works & Results

MPEG-4 FBA ConformanceFor FBA, body animation is not currently maintained up to date in Im-1 implementation. The group found that integration of existing SNHC tools in the AFX framework would be a solution. The group has reflected the implementation plan on FBA in the AFX S/W workplan (N4021).

MPEG-4 3DMC Conformance3DMC is not currently maintained up to date in Im-1 implementation. As in the case of FBA, the group found that integration of existing SNHC tools in the AFX framework would be a solution. The group has reflected the implementation plan on 3DMC in the AFX S/W workplan (N4021).

MPEG-4 Ref. S/W ArchitectureRewriting the MPEG-4 S/W for SNHC tools was suggested to be considered as the group’s work item. The group recognized that the integration of all the tools with modularity is a key to this work. So, interfaces (as modules of tools) are being studied by the proponents and are reflected in the AFX S/W workplan (N4021)

MPEG-4 Animation Framework eXtension (AFX)Policy Issue 1 (AFX and MUW): AFX has been a core work item for SNHC group, while multi-user world (MUW) has been a core for Systems group. Some tools that are proposed in AFX are also proposed in MUW, and vice versa. This created confusion on the boundary of works of both groups. Out of a series of joint meetings, both groups concluded that SNHC is to deal with the tools (node definition and its compression) that are specific for graphics contents, and that Systems is to deal with the generic algorithms that affect the scene graph structure (i.e., Interpolator compression, dynamic animation streaming of any type). To support the conclusion, some core experiments that are System specific were moved to Systems group. The moved core experiments are Interpolator compression and dynamic animation streaming. It is worth noting that the AFX specification will be part of MPEG-4 Systems specification where the AFX specification will be comprised of SNHC and Systems tools.Policy Issue 2 (Texture): It has been noted that AFX development will include the texture mapping and its associated coding technologies. Formally, Video group handled coding of visual texture. Due to the increased interest and population of expertise in SNHC, the group requested to handle the issue inside SNHC group to WG11. And it was confirmed. Future discussion on texture issues will be handled continuously in SNHC group.AFX CE Review: 11 input contributions are made and reviewed. Among them, some results are moved to Systems BIFS discussion (M6999, M7000, M7069, M7107, 7108) After reviewing the

89

Page 90: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

details of the input contributions, the group decided to continue 6 core experiments till Singapore (N4019). CECE TitleTitle StatusStatus ContributionsContributionsA1A1 Interpolator compression moved to Systems M6998, M7000, M7107,

M7108A2A2 Subdivision Surfaces M6997A3A3 Distributed animation streaming moved to Systems M6999, M7069A4A4 Texturing M7027A5A5 Solid model representation none

A6A6 Meshgrid model representation M7038A7A7 Bone-based animation for

articulated modelsM6929, M7116

A8A8 Multitexture M6930A1 (Interpolator Compression): This core experiment was meant to bring substantial compression efficiency over the existing tool in BIFS: PredictiveMFField coding. Ad mentioned previously, this CE has been moved to Systems. The discussion was conducted by both SNHC and Systems. After a long and detailed discussion on the competing tools, a decision is made that WG11 is to issue a Call for Proposals for interpolator compression which is detailed in N4098.A2 (Subdivision Surfaces): In this core experiment, two methods are considered to represent subdivision surfaces: extended loop and extended Catmull-Clark. There was a new proposal (N6997) to bring the multi-resolution functionality to subdivision surfaces. The core experiment was not completed at the time and will continue till Sydney. In the mean time, some updates on test models and evaluation criteria are made. A3 (Distributed Animation Streaming): This CE is also moved to Systems discussion, since it addresses the generic scene graph structure for animation. Dead reckoning is currently being considered and there is couple of proposals that might be complimentary to each other. Further investigation with harmonized syntax is anticipated till Sydney, where Systems group will be the place for the discussion.A4 (Texturing): Texturing was one of the hottest topics that are discussed in SNHC group in Singapore. In order to represent a texture format, there may be various image formats that can be supported: PNG, JPEG, JPEG2000, and MPEG-4 VTC (visual texture coding). One contribution was made on top of VTC technology (M7027). The group recognized that no single format is perfect to provide the necessary functionalities: support of gamma correction, support of alpha channel, support of compression efficiency, and support of flexible scalability. This matter will be part of interim AHG meeting in May (Boston, USA) as an on-going core experiment.A5 (Solid model representation): Although there was no input contribution in the CE, proponents were present to give the details of the CE status. This CE will be reviewed in the interim AHG meeting.A6 (Mesh Grid representation): One input contribution (N7038) was reviewed. Two test models are tested and the proposed MeshGrid method outperformed 25 ~ 75 % in compression. Further investigation will be performed as on-going CE till July.A7 (Bone-based animation for articulated models): This CE is created to support a seamless animation for the articulated models. Currently, face and body animation provides a basic framework to achieve animation for the articulated models. Two input contributions are made and reviewed (M6929, M7116). Further investigation will be conducted through CE till July.A8 (Multitexture): This is a new core experiment branched from A4 texture. One input contribution on procedural texture (M6930) was made and reviewed. The description of technology has been accepted as VM, where more experiments with implementation is expected till July.Verification Model 3.0: VM 3.0 has been updated both technically and editorially. Bone-based animation and procedural texture methods have been newly added to VM (N4020).AFX S/W implementation: S/W implementation is a crucial part of AFX development. The group

90

Page 91: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

detected a delay in implementation progress due to the formal release of Contact3D version 5.0. Nevertheless, the Web3D Consortium kindly made their CVS data repository open to MPEG members. In order to excel the progress of the implementation work, the group decided to put the implementation as agenda for the interim meeting at May. Further workplan can be found in N4021.May Meeting: In order to efficiently utilize four month period between Singapore and Sydney meetings, an interim meeting is being planned in Boston, MA, USA at the end of May. Mantis Corp. (with Boston College) has kindly offered a meeting venue. The details on the meeting schedule will be available through the SNHC e-mail reflector. In the meeting, the core experiments (A2, A4, A5, and A7) will be addressed, including the S/W implementation status.

SNHC Homepage reviewSome discussion to improve the SNHC homepage has taken place. New version of home page is expected to appear before July.

SNHC PresentationsThe group found that most contribution are presented by electronic presentation materials. Hence, it is decided to collect the materials during the meeting and to make them available in the SNHC homepage (http://www.sait.samsung.co.kr/snhc).

SNHC FAQ updateFAQ 4.0 of SNHC was reviewed by SNHC members and got fixed with new Q&As (N4018).

Output DocumentsRefer to Clause 7.

Ad Hoc Groups till next meetingRefer to Clause 7.

ParticipantsMany thanks to the following individuals who participated in SNHC meetings:

Name Company Country E-mailMikael Bourges-Sevenier

iVast/Web3D Consortium

US m ikael @ivast.com

Patrick Gioia France Telecom FR patrick [email protected] Mahnjin Han Samsung AIT KR [email protected] Haque TVIA Inc. US [email protected] S. Jang Samsung AIT KR [email protected] Kaneko ASCII Corp KR [email protected] D.K. Kim Samsung AIT KR [email protected] Lafruit IMEC BE [email protected] Mignot SGDL Systems CA [email protected] Moran UPM ES [email protected] Pejhan Sorceron US [email protected] Preda INT FR [email protected] Salomie VUB BE [email protected] Steliaros Superscape UK [email protected] E. Walsh MDC/Web3D

ConsortiumUS [email protected]

Sang Oak Woo Samsung AIT KR [email protected]

91

Page 92: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex 10Test group report

Source: Mark Buxton, Chair

SummaryObjectives for the 56th meeting of WG11 test in Singapore were The finalization and re-issue of the Digital Cinema Call for Proposals Scheduling and logistics for the July Digital Cinema Tests Finalization and re-issue of the verification test plan for MPEG-4 2000 Visual Amendment 1,

the Studio profile Finalization and re-issue MPEG-4 2000 Visual Amendment 2, Fine Granularity Scalability

(FGS)

MPEG Test Agenda1. Approve Agenda2. Input Documents3. Responses to voting

a. None4. Liaison Responses

a. None5. Current Work Items

a. DCinema Testi. Test schedule and work items

ii. Test responsibilities and Test Manageriii. Joint meeting with WG1 (JPEG)

b. MPEG –4 Video Test issuesc. Studio Profile (Amendment 1) Verification Test

i. Review of early documentationd. FGS (Amendment 2) Verification Test

i. Review of early documentation6. Output Document7. AGH’s

a. Digital Cinema Test8. Resolutions9. Liaison

a. DCinema CfP10. Close

Contribution Review

Digital Cinema Testing Procedures M6875

Digital Cinema and Object Compression M6923This document was reviewed and the proposal to adopt an object based compression technique was considered. However, the current requirements do not require or recommend object based tools, so this issue has been returned to requirements.

92

Page 93: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

USNB Contribution: Digital Cinema CfP clarification M6957This document was reviewed and the recommendations integrated into the DCinema Call for Proposals and the Evaluation Procedures.

Liaison Statement from NATO on IPMP Requirements for Digital Cinema M7017(This document was not reviewed due to lack of upload and no representation)

DCinema AHG Report M7088The Digital Cinema AHG Report was reviewed. The progress made against the mandate items has been excellent. All content has been scanned and is in digital form ready for distribution to the pre-registrants. Thanks to Dave Dawson, Frank Bossen, Alan Peach, and Jordan Isailovic for this work. The materials are scattered between LA and Japan so a plan is formed to ship materials to Sony, then to Mark Buxton for duplication and distribution. The dates scheduled for payment has been identified as an issue requiring further discussion. The IPMP issues assigned to this AHG were discussed and a list of 15-20 extracted and forwarded to Requirements. Systems issues were raised and likewise forwarded to Requirements.

No changes to the test equipment were recommended. Sony has donated a screen for use at the ETC facilities. Harnkess Hall also volunteered an acceptable screen.

Several evaluation / test methodology recommendations are drafted. These include:1. A period of formal expert viewing following formal subjective testing.2. Hire a test manager, subject to understanding terms and deliverables, to accomplish the

significant process of setup and testing.3. The proposed (target) bitrates may not be suitable, based on initial encoding by some

members and concern about the spread of the bitrates.

Alan Peach has provided information specifying the DPX file format. Thank you Alan for this critical and valuable input.

Some of the potential future content submitters have expressed concern over the existing copyright statement. Their recommendations include extending the explicit list of inappropriate venues to trade shows. These recommendations are entirely appropriate and have been incorporated into a revised Test Materials Submissions Guideline.

Sony Pictures requested a substantial restriction on the duration of use of the content. There was discussion (but no consensus) and a recommendation to ask for modified terms which would allow use for the duration of the development of the standard. The proposed test conditions for wireless channel in MPEG-4 visual FDAM4 (FGS) verification test plan

M7111

Jens Ohm presented proposed wireless bandwidth variation profiles. These were incorporated into the FGS Verification Test Plan.

Informal Contributions:Dave Dawson presents inputs from the MPA, recommending expert viewing techniques. These sensitivity of these techniques has not been well qualified relative to video-based quality measurement, so an effort is started (see Preliminary Definition of new Digital Cinema Visual Test Methodologies, N4069) to specify the goals and methodologies of these tests, so that they can be

93

Page 94: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

evaluated. A consensus is reached that these test methods may be very valuable for testing (for example, core experiments) subsequent to the initial Digital Cinema testing.

Detailed Work Items and Technical DiscussionMPEG-4 Version 2 Video CfPLittle work was done at this meeting. The test facilities and test costs still need to be determined; the two facilities under consideration are FUB in Italy and Intel in Beaverton.

Digital Cinema CfP

Joint WG1 Motion-JPEG 2000 /WG11 Test meeting

Eric Edwards (Sony) presented the work of WG1 on Motion JPEG-2000. This was a very interesting technical presentation.

WG1 is involved in a work item (currently FCD) to develop a motion-JPEG 2000. The work plan specifies an IS status in December 2001. The technology is baseline JPEG-2000, and similar to M-JPEG it uses only intra coding for individual video frames. The standard includes both lossy and lossless modes, which could make it suitable for the requirements of the distribution and archival formats. The lossless mode claims compression ratios of 2-3:1 for natural imagery, which is claimed to be state-of-the-art.

The license terms under discussion are an agreement not to charge a license fee to users and implementers. The IP license has been crafted with a “Poison Pill” that restricts implementers from claiming IPR.

The format is the MP4 file format. The standard claims to support fast editing due to the wholly intra implementation.

Profiles for Motion-JPEG 2000 are not well defined. The underlying JPEG-2000 technology allows effectively unlimited 2D resolution and bit depth .

At least 3 companies are producing hardware based on the motion JPEG-2000 standard.

Digital Cinema Test PlanningThe projectors continue to be a major technical hurdle. Sony has volunteered the G90 for viewing in LA, reducing concern about this projector. The link has been specified as SMPTE 292 for the tests. Information about the TI DLP projector’s special 4:4:4 10-bit RGB interface is still insufficient. One of the duties of the AHG and test manager is to work with Avica or other server providers to see if we can make this interface work.

Disk storage is projected to require three to four chassis in a rack-mount system, dependent upon the number of proposers and the capacity of suitable SCSI HDD’s (and contingent upon a suitably expandable and interoperable storage interface from the targeted AVICA server).

The content distribution and return schedule is specified and the logistics finalized. Several high-capacity IDE HDD’s were examined for the content distribution, and the IBM 75GXP/75GB was selected for its capacity, speed (relative to other 75+GB offerings), and price. Two hard disks will be required for each submitter. The estimated price for disks and duplication is estimated at $1000 per pre-registrant. Mark Buxton has volunteered to perform the duplication and distribution service.

94

Page 95: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Due to the limited time until the next meeting, the schedule of the materials submission, return, the test facility setup, and the test schedule are prepared in “Work Schedule and Budget of Digital Cinema Tests”.

Due to the extensive test preparation, required pre-validation of the new test methodologies, and long duration of the actual tests, a test manager is seen as a requirement. Vittorio Baroncini from FUB is recommended by the AHG. Preliminary responsibilities are outlined in N4068, but payment and terms will be determined by the AHG after receiving a detailed list of deliverables from Vittorio.

MPEG-4 Version 4 Studio ProfileA joint Video / Test meeting addressed the updated studio profile verification tests. 4:2:2 tools will be verified for multi-generation and post-production work. Concern is expressed that we need to do some tests of Studio 4:2:2 against the older MPEG-2 4:2:2 profile.

After consideration, a consensus is reached that the primary capabilities to be tested using 4:2:2 modes are the higher bitrates (beyond MPEG-2 4:2:2’s 300Mbit/s). Thus direct comparison against 4:2:2 is infeasible.

The primary verification goals are refined to focus on High bitrate support 4:4:4 tools, impacting the quality of chroma key and multi-generation work relative to 4:2:2 10 bit coding tools, impacting multi-generation work and headroom (i.e. contrast

adjustments).

12 bit tools are perceived to be untestable, and natural 12-bit data is not widely available.

MPEG-4 Version 5 FGSDuring the joint Video / Test meeting Jens Rainer Ohm presented the FGS test plan.

List of output documentsTitle NumberTest Materials Submissions Guideline N4054Call For Test Equipment N4055MPEG-4 Visual Fine Granularity Scalable Profile Verification Test Plan N405814496-2:2001 AMD1 (MPEG-4 Studio Profile) Verification Test Plan N4059Call for Proposals on New Tools for Video Coding Efficiency N4065Call for Proposals for Digital Cinema N4066Digital Cinema Evaluation Procedures N4067Work Schedule and Budget of Digital Cinema Tests N4068Preliminary Definition of new Digital Cinema Visual Test Methodologies N4069

Ad hoc groupsAd hoc group Chair(s) Number Mtg

AHG on Digital Cinema Tests Frank Bossen (SONY), Don Mead (DECI), Dave

Dawson (MPA)

N4075 Yes, 3

95

Page 96: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex 11ISG report

Source: ISG ChairEditor: Marco Mattavelli (EPFL)

OverviewThe main topic of the Implementation Studies Subgroup in Singapore is:

1. MPEG-7 XM reference software development for video/audio descriptors and Descriptor Schemes and related editing activity for the MPEG-7 Part 6: Reference Software FCD

2. The propositions and discussion for the definition of a new activity MPEG-4 part 9: Reference hardware description

3. MPEG-4 level definition and evaluations of VCV efficiency 4. Complexity requirements for submitters to the Digital Cinema call for proposals.

Input contributions w.r.t. the above items are summarized according to the following table:

MPEG-7 XM development

M7025 “Report of AHG on XM Development”. Stephan Herrmann

M7142 Summary of Voting on Combined CD Registration and CD Consideration Ballot on ISO/IEC CD 15938-6: Information technology -- Multimedia content description interface -- Part 6: Reference software

Secretariat, ISO/IEC JTC 1/SC 29

M7142J Japan National Body Comments on ISO/IEC CD 15938-6 Information technology - Multimedia content description interface: Reference Software

Japan National Body

M7142US US National Body Comments on ISO/IEC CD 15938-6 Information technology - Multimedia content description interface: Reference Software

US National Body

M7142UK UK National Body Comments on ISO/IEC CD 15938-6 Information technology - Multimedia content description interface: Reference Software

UK National Body

MPEG-4 Reference Hardware Description

M7146 “Expression of interest for VHDL reference code submissions” R. Turney,M7127 “Expression of interest in MPEG-4 Part 9: Reference Hardware” Jan Bormans

MPEG-4 Levels definition

M7028 “Evaluating MPEG-4 Video Complexity for an Alternative Video Verifier Mechanism Complexity Model”

J. Valentim, P. Nunes, F. Pereira

96

Page 97: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Detailed Report

MPEG-7 XM reference software developmentFour joint meetings have been taken place during the week between the ISG team involved in the XM development and video, MDS and Systems groups. Discussions have started with the MDS group with the review of the current status of the integration of the XM. The main outcomes of the discussions can be summarized as follows:

Joint Meeting ISG-MDS

New revisions to the already integrated packages are needed. This is due to the several modifications done to the MDS specifications in the FCD. CVS software version must be used to make updates. Second step is the verification of the code and the completion of documentation. Glue software is missing for many packages. The “Dummy Type” template provides all indications of parts needed for integration.It was agreed that code verification will be performed also by a third party that will report on the functionality of the implemented DS.The table in the document reporting the status of the integration and the integration schedule for the various MDS components has been reset to “red” for all modules since a verification is needed by all code submitters. Some participants raised the problem of CVS that cannot be accessed by terminals inside corporate firewalls. Unfortunately it is not possible to use alternative to CVS that present the same functionality. Another problem is the media data base. Media data sets should not be loaded on the CVS server, but should be grouped on a separate server for the code verification end core experiments.

Another joint meeting was held on the MPEG-21 SW, XM o VM model. The subject of the discussion was the selection of a correct approach for MPEG-21. General ideas and objectives were presented by MPEG-21 MDS group. ISG reported on the experience of MPEG-4 and MPEG-7 reference software. Suggestions and recommendations have been made to MDS group to facilitate the selection of objectives (key applications in the sense of a software model architecture and not as “real word” applications as referred by MDS MPEG-21 group. Discussions will be continued next meeting when a selection of available technologies and relative applications will be clearer.

Joint Meeting ISG-Systems

Bitsream tools known as BiM are not yet ready for integration in the XM. Such tools require another stage of code verification and debugging. The Systems group was not convinced of the necessity to integrate the tools in the XM. ISG explained the relative drawback and illustrated the simple task needed for the integration. At the end a schedule was delivered specifying April for the specification and development of various modules taking into account the XM interfaces and August for the integration phase.

Joint meeting ISG Video

The update of the software according to the modifications of the FCD specifications have been planned. No new modules need to be integrated. Software verification and check by a third party has been defined.

97

Page 98: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Editing of the “The MPEG-7 Reference Software FCD”

A relevant part of the meeting was dedicated to answer to the NB comments on the MPEG-7 CD. The study document already edited during the Pisa meeting has been completed according to Japan, UK and US NB comments. Not all requests could be accomplished for the lack of stable specifications, in particular for MDS part or lack of submitted software like for bitstream systems tools.

Meeting outcomes about Reference Software development

In conclusion main achievements of the meeting concerning the Reference Software development are:

The update of Work schedules for the XM integration (video tools, audio tools and DS) including the new steps “code update” according to FCD, “code verification”, “code documentation”

The promotion of the Study of the MPEG-7 Reference Software CD to FCD, including additions from NB comments and new sections containing the description of the XM software architecture

Reference hardware description for MPEG-4

The comments on the Call issued at the Pisa meeting have been reviewed. According to the discussion the call has been revised and reissued including improvements in the text describing the advantages of the VHDL code submitters, more detailed description of the objectives of phase 1 and 1 and a precise calendar for PDTR, DTR and TR for phases 1 and 2. It was decided to wait to define phase 3 since methodology and tool associated to this activity will certainly change in the next few years. As action point it was decided to send the approved revised call to a list of possible company and university that could be interested by the activity.

MPEG-4 levels definition and VCV efficiency

The contribution M7028 presented in a joint Requirement-video and ISG meeting reported the results of the implementation of the VCV buffer for various sequences. The results show clearly what has been forecasted in the last years by the preliminary analysis of the ISG group on the definition of levels using a VCV buffer that consider al macroblocks as being equal in complexity. Although the limitation appears already for the “simple” profile (the decoder is overdimensioned in computational resources for the video content that is compliant with the VCV limitation) it becomes serious for profiles including several objects that contain a relevant percentage of transparent and skipped macroblocks. A high number of transparent and skipped macroblock overfill the buffer easily (thus the associated sequence is not compliant with the profile@level under consideration, while in reality the decoder is far below the critical threshold considering the available computational resources. The fact that a weighted sum (with transparent and skipped macroblocks having a weight much lower than one) should be adopted for the VCV parameter limitation is evident. The problem is what to do for new definitions of levels and what to do for the existing definitions. For new definition it was agreed that a weighted sum should be adopted. The next necessary step is to agree on the weights setting. For existing definition it would be desirable to change as well, but there is the possibility that existing decoder based on hardware resources that cannot be shared for different macroblock types could become not compliant anymore with the new definition. In fact the number of transparent and skipped macroblocks could exceed the one set by the old definition. Existing decoders based on software computational resources should remain compatible and would work at better level. of efficiencies.

98

Page 99: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

A resolution in agreement with the requirement group asking comments from companies and NB has been issued.

Complexity evaluation criteria for Digital Cinema proposals.

A joint meeting with the Digital Cinema subgroup was held. Suggestions and criteria for useful complexity analysis to be included to the documentation that must be included with the proposal submission have been defined.

99

Page 100: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

Annex 12Liaison report

Source: Barry Haskell

The Liaison Group considered the following Singapore input documents

Doc # Title

m7090 IEC CDV 62028-1 Methods of Measurement for Digital TV Receivers

m6961 IEC CDV 61937-7: Interface for non-linear PCM encoded audio bitstreams applying IEC 60958 -- Part 7: Non-linear PCM bitstreams according to the ATRAC and ATRAC2/3 formats [IEC 100/227/CDV]

m6962 IEC CDV 61937-6: Interface for non-linear PCM encoded audio bitstreams applying IEC 60958 -- Part 6: Non-linear PCM bitstreams according to the MPEG2 AAC formats [IEC 100/228/CDV]

m6937 Liaison Statement from 3GPP TSG-SA WG4 about the registration of codepoints for non-ISO codecs for use with MP4 file formats

m6956 USNB Contribution: Proposed Liaison letter on the participation of the American Society of Cinematographers (ASC) in the upcoming MPEG Digital Cinema compression testing

m7007 TV-Anytime Rights Management and Protection Requirements

m7017 Liaison Statement from NATO on IPMP Requirements for Digital Cinema

m7076 Web3D-MPEG request to put documents on the Web3D-MPEG Working Group site

m7077 Web3D-MPEG Interoperability and Conformance Testing

Mizer email on SMPTE and Content Protection and Management issues

Harrison email on SMPTE Digital Cinema Security Report

m7080 Report of Liaison between MPEG-7 and XML Schema

m7001 Liaison Statement from CEN to WG 11 on International Standard Identifiers for Use in the Music, Film, Video, Sound Recording and Industries: Joint Response to the MPEG Call for Proposals for Digital Item Identification and DescriptionATSC email on standards activity in the area of metadata for advanced Electronic Program Guide (EPG)

m7140 ATSC Request for Proposals - Metadata for Advanced EPG Functionality [T3S8 Adv EPG RFP.pdf ]

m7084 Liaison Statement from CEN on "Frameworks, architectures and models for electronic commerce"

m7133 Liaison Statement from ISO TC 46/SC 9 to WG 11 on MPEG-21 Projects Concerning Digital Item Identification [ISO TC 46/SC 9 N 303]Dawson email on possible MPA liaison with MPEG

SC29 email on various liaison loose ends

100

Page 101: INTERNATIONAL ORGANISATION FOR · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N3956

The following resolutions were approved by the Liaisons group:

Title of Outgoing Liaison Document

N4056 Call for Viewer Participation {Directors Guild of America}

N4084 Organizations in liaison with MPEG and corresponding liaison representatives

N4114 Request for Establishment of a Liaison Between WG11 and UMTSF ICTG [re: Niels Rump]

N4115 Liaison Statement to ATSC T3/S8 on Request for Proposals for Potential Revisions to ATSC Standards in the Area of Metadata for Advanced EPG Functionality [re: m7140]

N4116 Liaison Statement to Web3D-MPEG request to put documents on the Web3D-MPEG Working Group site [re: m7076]

N4117 Liaison Statement regarding Web3D-MPEG Interoperability and Conformance Testing [re: m7077]

N4118 Liaison Statement regarding Liaison Statement from ISO TC 46/SC 9 to WG11 on MPEG-21 Projects Concerning Digital Item Identification [ISO TC46/SC 9 N 303] [re: S4091]

N4119 Liaison Statement to IEC TC-100 on current Committee Draft ballots [re: m7090 , m6961, m6962]

N4120 Liaison Statement to CEN/ISSS Secretariat regarding draft CWA on "Frameworks, architectures and models for electronic commerce" [re: m7084]

N4121 Liaison Statement regarding Liaison Statement from CEN to WG 11 on International Standard Identifiers for Use in the Music, Film, Video, SoundRecording and Industries: Joint Response to the MPEG Call for Proposals for Digital Item Identification and Description [re: S4090]

N4122 Liaison Statement regarding Digital Rights Standards work in the Internet Research Task Force [re: 10003]

N4123 Liaison Statement to 3GPP regarding registration of codepoints for non-ISO codecs for use with MP4 file format [re: m6937]

N4124 Liaison Response to USNB Contribution: Proposed Liaison letter on the participation of the American Society of Cinematographers (ASC) in the upcoming MPEG Digital Cinema compression testing [re: m6956]

N4125 Liaison Statement to TV-Anytime Rights Management and Protection Requirements [re: m7007]

N4126 Liaison Statement to Liaison Statement from NATO on IPMP Requirements for Digital Cinema [re: m7017]

N4128 Liaison to JPEG

N4129 Liaison to IETF

N4130 Call for Viewer Participation {Academy of Motion Pictures Arts and Sciences}

N4131 Call for Viewer Participation {International Alliance of Theatrical Stage Employees, Moving Pictures Technicians, Artists and Allied Crafts of the United States, its Territories and Canada}

N4132 Call for Viewer Participation {International Teleproductions Society}

N4133 Call for Viewer Participation {National Association of Theatre Owners}N4134 Call for Viewer Participation {American Society of Cinematographers}N4085 Disposition of National Body Comments

101