MP22 Standardisation RoadmapRob Koenen, TNO, rob.koenen@tno.nl

Principal Consultant, TNOCo-chair MPEG-I activity

Co-chair, MPEG Roadmap activity

Third Mini-Workshop on Immersive Live Experience (ILE)Holiday Inn Macao Cotai Central, Macao,

24 October 2017, ITU-T SG16 meeting

For an explanation of the (many) acronyms in this presentation, see

https://mpeg.chiariglione.org/docs/mpeg-strategic-standardisation-roadmap

24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)

Why a Standardisation Roadmap?

• MPEG has created, and is still producing, media standards that enable huge markets to flourish

• MPEG works on requirements from industry• Many industries represented in MPEG, but not all of

MPEG’s customers can or need to participate in the process

• MPEG wants to inform its customers about its long-term plans (~ 5 years out)

• … and collect feedback and requirements from these customers

• … including in this session

24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)

What is in the Roadmap

• Our roadmap is a short document.

• It briefly outlines MPEG’s most important standards

24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)

1990 2000 20101995 2005 2015

MP3MPEG-2 Video & Systems AVC HEVC

MP4 FF MMTDASH

AAC

InternetAudio

Digital Television

Music Distribution

Media Storage and Streaming

UHD & ImmersiveServices

New Forms of Digital Television

Unified MediaStreaming

OFF

HD DistributionMobile Video

Custom Fonts on Web & DigiPub

MPEG-4 Video

MLAF

Second Screen

3D Audio

MPEG Standards

24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE) ‹#›

What is in the Roadmap

• Our roadmap is a short document.

• It briefly outlines MPEG’s most important standards

• It then gives an overview of MPEG’s activities

24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)

MPEG-1,2,4,H,I

MPEG-7

MPEG-21

MPEG-A

MPEG-B,C,D, DASH

MPEG-E,M

MPEG-U,V

MPEG’s Areas of Activity

Compression of video, audioand 3DG

Description of video, audio and multimedia for content search

Technologies for content e-commerce

Multimedia Application Formats (combinationsof content formats)

Systems, video, audio and transport

Multimedia Platform

Technologies

Device and application interfaces

24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)

What is in the Roadmap

• Our roadmap is a short document.

• It briefly outlines MPEG’s most important standards

• … it then gives an overview of MPEG’s activities

• … and then an overview of all MPEG’s standards

24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)

1990 2000 20101995 2005 2015

Video

Video

AVC HEVCSPVideo ASP

SystemsPS/TS DASH

MMT

MP4 FF TT

Media-related

MPEG-V

CDVS

DID

CEL/MCOCENC

UD

MDS

AudioMP3 AAC 3D AudioSurround

SAOC

USAC

DRC

MP1 L2

Colourcoding

MPEG-1 MPEG-2 MPEG-4 MPEG-7

MPEG-A MPEG-B MPEG-H

MPEG-21

MPEG-C MPEG-D

GraphicsBIFS AFX ARAFOFF

24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)

Significant Developments Shape MPEG’s Roadmap

• The relentless increase of IP-distributed and Mobile media

• Higher quality

• More immersion media (UHD, VR, AR)

• The Internet of Media Things & Wearables

• Cloud-based media processing, storage and delivery

24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)

2018 2020Jan2017

2019 2021

Internet Video Coding

IoMT

Media Orchestration

CMAF

CDVA (Video Analysis)

New codec with Lightfield

New & ImmersiveVideo Codec

Audio Wave Field Coding

AR/VR Audio extensions

Point CloudCompression

HDRTR

HDRTR 2

Omnidirectional Media Format

OMAF v2

GenomeCompression

Cloud-BasedMedia Processing

Coding

2022

Systems and Tools

Immersive Media AF

Augmented Media AF

2018 2020Jan2017

2019 2021

Internet Video Coding

Omnidirectional Media Format

IoMT

Media Orchestration

HDRTR

Audio Wave Field Coding

CMAF

New codec with Lightfield

CDVA (Video Analysis)

New & ImmersiveVideo Coding

AR/VR Audio extensions

Point CloudCompression

HDRTR 2

OMAF v2

GenomeCompression

Network-DistributedVideo Coding

Coding

2022

Systems and Tools

Immersive Media AF

Augmented Media AF

Cross-platform Media Distribution

2018 2020Jan2017

2019 2021

Internet Video Coding

Omnidirectional Media Format

IoMT

Media Orchestration

HDRTR

Audio Wave Field Coding

CMAF

New codec with Lightfield

CDVA (Video Analysis)

New & ImmersiveVideo Coding

AR/VR Audio extensions

Point CloudCompression

HDRTR 2

OMAF v2

GenomeCompression

Network-DistributedVideo Coding

Coding

2022

Systems and Tools

Immersive Media AF

Augmented Media AF

Cross-platform Media Distribution

VR360, on-demand and live (3 DoF)

2018 2020Jan2017

2019 2021

Internet Video Coding

Omnidirectional Media Format

IoMT

Media Orchestration

HDRTR

Audio Wave Field Coding

CMAF

New codec with Lightfield

CDVA (Video Analysis)

New & ImmersiveVideo Coding

AR/VR Audio extensions

Point CloudCompression

HDRTR 2

OMAF v2

GenomeCompression

Network-DistributedVideo Coding

Coding

2022

Systems and Tools

Immersive Media AF

Augmented Media AF

Cross-platform Media Distribution

VR360, on-demand and live (3 DoF)

Immersive Media with 6 Degrees of Freedom

Combining Natural and Synthetic content

MPEG-I

New MPEG project: ISO/IEC 23090 – Coded representation of immersive media5 parts currently planned 1. Architectures2. Omnidirectional Media AF3. New & Immersive Video Coding4. New & Immersive Audio Coding5. Point Cloud CodingFurther considering:6. Metadata for Immersive Services and Applications7. Metrics for Immersive Services and Applications

24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)