Download ppt - By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 1 L3 Overview L3 Standards Overview By Mike Rubinfeld Chairman, INCITS/L3 (MPEG & JPEG) NIST, Gaithersburg,

By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 1

L3 Overview

L3 Standards OverviewBy

Mike Rubinfeld

Chairman, INCITS/L3 (MPEG & JPEG)

NIST, Gaithersburg, Maryland

Phone: (301) 975-3064

Email: [email protected]


L3 Overview

Why Standards Are Needed

• Provide well-constructed tool sets for developers

• Provide solutions for complex systems

• Promote fair competition

• Preserve intellectual property rights

• Provide migration path for future systems

• Provide optimum interoperability


L3 Overview

L3 Standards Acronyms• Moving Pictures Experts Group (MPEG)• Joint Photographic Experts Group (JPEG)• International Standards Organization (ISO)• International Electro-technical Committee (IEC)• American National Standards Institute (ANSI)• International Committee for IT Standards (NCITS)• Joint Technical Committee 1 (JCT1)• Standards Committee 29 (SC29)• Working Group 1 (WG01)• Working Group 11 (WG11)


L3 Overview

MPEG Standards Process

• Designation for MPEG international standards committee:– ISO/IEC/JTC1/SC29/WG11 (MPEG)

• Designation for MPEG standards committee in the US:– ANSI/NCITS/L3/L3.1 (US MPEG Delegation)


L3 Overview

• Designation for JPEG international standards committee:– ISO/IEC/JTC1/SC29/WG01 (JPEG)

• Designation for JPEG standards committee in the US:– ANSI/INCITS/L3/L3.2 (US JPEG Delegation)

MPEG Standards ProcessJPEG Standards Process


L3 Overview

Current MPEG Standards• MPEG-1 (ISO/IEC 11172 in 5 parts)

– A standard for storage and retrieval of moving pictures and audio on storage media

• MPEG-2 (ISO/IEC 13818 in 9 parts)– A standard for digital television

• MPEG-4 (ISO/IEC 14496 (Version 1, 1999), since July 1993– A standard for multimedia applications in an object oriented way

• MPEG-7 (ISO/IEC 15938 Winter 2001)– A content representation standard for multimedia search and retrieval

• MPEG-21 (ISO/IEC 18034)– a standard for multimedia models and frameworks


L3 Overview

MPEG Organization• Requirements

• Systems

• Video

• Audio

• SNHC (Synthetic – Natural Hybrid Coding)

• MDS (MPEG-7 only) (Multimedia Description Structures)

• Test

• Implementation

• Liaison

• HoD (Heads of Delegations)

• Administrative


L3 Overview

MPEG Design • Addresses Interoperability

• Addresses Transport Independence

• Compression and Transmission of Rich Media

• Addresses Interactivity

• Addresses Scalability

• Incorporates Profiles


L3 Overview

MPEG Fields of Use

• Digital Television

• Interactive graphics (synthetic content)

• Interactive multimedia

• Distribution of and access to content

• Integration of production and distribution


L3 Overview

MPEG Scope & Features

• For Authors – enables production of content

• For Network Service Providers – offers transparent information

• For End Users – Level of interaction with content

• Represents visual and audiovisual content as “media objects”


L3 Overview

Scope & Features - Continued• Standardized way to describe composition

of objects• Create compound media objects• The formation of audiovisual scenes• Multiplex and synchronize the data

associated with media objects for transportation over network channels

• Interact with the audiovisual scene generated at the receiver’s end


L3 Overview

Coding of Media Objects• Still images (e.g., as a fixed background)• Video objects (e.g., a talking person without the

background)• Audio objects (e.g., the voice associated with that

person)• Natural and synthetic content types• 2 or 3-dimensional• Descriptive elements allowing the handling of

objects in an audiovisual scene


L3 Overview

Composition of Media Objects

• Primitive media objects – most elemental form

• Compound media objects – grouping of primitives together – e.g., talking person and associated voice

• Allows construction of complex scenes


L3 Overview

Standardized Scene Description• Allows the placement of media objects anywhere in a

given coordinate system

• Apply transforms to change geometrical or acoustical appearance of a media object

• Group primitive media objects in order to form compound media objects

• Apply streamed data to media objects in order to modify their attributes

• Change, interactively, the user’s viewing and listening points anywhere in the scene


L3 Overview

Interaction with Media Objects

• Change viewing/listening points within a scene• Drag objects within a scene to a different position• Trigger a cascade of events by clicking on a particular

object• Select a desired language amongst multiple language

tracks• Trigger more comlex kinds of behavior


L3 Overview

Intellectual Property Identification

• Identify IP associated with media objects

• Storing unique identifiers issued by international numbering systems

• Standardized interface integrated into the systems layer – controlling access to IP


L3 Overview

Audio Attributes• Speech signals• Synthesized speech• General audio signals• Synthesized audio• Bounded-complexity Synthetic Audio• Dynamic functionality

– Speech change– Pitch change– Bit rate scalability– Bandwidth scalability– Encoder and decoder complexity scalability– Audio effects, mixing, reverberation, spacialization, etc.


L3 Overview

Visual Attributes• Coding of still images and video sequences• Formats supported• Compression efficiency• Content-based functionalities• Scalability of textures, images and video• Shape and alpha channel coding• Error resilience• Face animation


L3 Overview

MPEG Textual Format Languages• Extensible MPEG-4 Textual Format (XMT)• Extensible 3D (X3D) – Web 3D Consortium• Synchronized Multimedia Integration Language (SMIL) –

W3C Consortium• Virtual Reality Multimedia Language (VRML)• Scalable Vector Graphics (SVG)• XMT Framework – two levels

– XMT-A Format – XML-based version of MPEG-4 content

– XMT-Omega – high level abstraction of MPEG-4 features based on the W3C SMIL


L3 Overview

MPEG Textual Format Interfaces

XMT

MPEG-4 Representation(e.g. mp4 file)

SMIL

MPEG-7

SVG

Parse

Compile

SMIL Player

VRML Browser

MPEG-4Player X3D

Figure - the eXtensible MPEG-4 Textual format


L3 Overview

MPEG-4 Industry Forum (M4IF)

• Not-for-profit organization to further the adoption of the MPEG-4 standard

• Promoting use of MPEG-4

• Single point of information

• Distribution of MPEG-4 tools

• Initial membership fee - $2,000/year

• Home page: http://www.m4if.org


L3 Overview

MPEG-7 Industry Alliance

• Not-for-profit organization to further the adoption of the MPEG-7 standard

• Promoting use of MPEG-7

• Single point of information

• Distribution of MPEG-7 tools

• Initial membership fee - $2,000/year


L3 Overview

JPEG Standardization Activities

• JPEG, JPEG/LS (ISO/IEC 10918) - maintenance• JBIG (ISO/IEC 14492) - maintenance• JPEG 2000 Part 1 – final standard (ISO/IEC 15444)• JPEG 2000 Parts 2 – final draft standard• JPEG 2000 Parts 3, 4, 5, and 6 in development


L3 Overview

NIST Activities in JPEG & MPEG• NIST is host and Webmaster for WG11, WG1

and L3 (MPEG & JPEG) online data sites storing and providing accessibility to thousands of committee documents

• Provide leadership for the direction of the standardization process with respect to MPEG and JPEG


L3 Overview

Thank youfor

Your Attention