PUBLIC

JC BODET AND DENNIS THOMPSON

OCT 6, 2016

AMF-AUT-T2348

ETHERNET AVB

PUBLIC 1

AVB OVERVIEW

PUBLIC 2

Audio Video Bridging (AVB)

Definition

• Set of standards, protocols and technologies for the transport of time sensitive streams (audio, video and control) in bridged LANs

Purpose

• Replace existing analog and multi-standard digitized stream transport with a commonly deployed technology, offering:− Bounded and low transport latency

− Reliable delivery (with guaranteed bandwidth and network resources)

− Time synchronization

Advantages

• Can replace complex and costly wiring with a single and existing technology: Ethernet

• Based on open Standards

• Coexists with legacy IP data traffic

• Self-managed

PUBLIC 3

AVB Standards

IEEE Standards (https://www.ieee.org)

• 802.1BA-2011 AVB (Audio Video Bridging)

• 802.1AS-2011 gPTP (Generalized Time Precision Protocol)

• 802.1Qat-2010 SRP (Stream Reservation Protocol)

• 802.1Qav-2009 FQTSS (Forwarding and Queuing of Time Sensitive Streams)

• 1722-2011 & 1722a AVTP + MAAP (Audio Video Transport Protocol, MAC Address Acquisition

Protocol)

• 1722.1-2013 AVDECC (Audio Video Discovery, Enumeration, Connection Management and Control)

PUBLIC 4

AVB Standards

AVnu Alliance (https://www.avnu.org)

• Community promoting AVB/TSN technologies in an interoperable ecosystem

• Certification program

• Market specific workgroups

− Automotive

− Professional Audio/Video

− Consumer Electronics

− Industrial

• Automotive profile

PUBLIC 5

IEEE 802.1AS - gPTP

Generalized Precision Time Protocol

• Provides time synchronization across bridged LAN networks

− Within 1us peak to peak for 7 hops

• Based on IEEE 1588-2008 PTPv2

• gPTP domain with several interconnected time aware systems (end stations and bridges) synchronized to a grandmaster clock

• Best Master Clock Algorithm (BMCA)

− Network is able to select best source of timing (based on ANNOUNCE messages)

• Propagation delay measurement between peers of a point-to-point link

− Media dependent (802.3 -> Pdelay Requests/Responses)

• Propagation of Synchronization messages

− Bridges update SYNC messages based on peer delay measurements and own delay (residence time)

PUBLIC 6

IEEE 802.1Qat - SRP

Stream Reservation Protocol

• Provides reservation of bandwidth and resources along the network path between Talker and Listener(s)

− Bounded maximum latency

− Reliable delivery (if reservation is successful)

• Two traffic classes

− Identified by VLAN priority and ID

− Class A (2ms transit time, 125us observation interval)

− Class B (50ms transit time, 250us observation interval)

• Talkers declare available streams and their properties

• Listeners declare their intention to receive a stream

• Bridges adjust/merge/propagate declarations

− Possibly changing Talker/Listener declarations if reservation fails

PUBLIC 7

IEEE 1722 - AVTP

Audio Video Transport Protocol

• Defines transport protocol for Audio & Video

− Layer 2 protocol over 802.3, 802.11, …

− Data, control and timing

• Several media formats supported (based on IEC 61883)

− Raw audio (IEC-61883-6)

− MPEG2-TS (IEC-61883-4)

− …

• AVTP presentation time

− Based on gPTP

− Used to synchronize presentation time (across several Listeners)

− Used to recover media clock

PUBLIC 8

IEEE 1722a – AVTP (cont’)

Audio Video Transport Protocol

• New backwards compatible revision

• Several new/native media formats introduced

− AVTP audio format (AAF, Raw audio, Int, Float, 16/24/32bit, 8-192 KHz, …)

− Compressed Video format (H264, MJPEG, JPEG2000)

− SDI Video format, Raw Video format

• Improved distribution of clock timing (not limited to media clock)

− Dedicated clock reference format (CRF) stream

− Several timestamps per packet

• AVTP control format

• Encrypted data transport encapsulation

• Encrypted/Authenticated control transport encapsulation

PUBLIC 9

1722.1 - AVDECC

Audio Video Discovery Enumeration Connection management and Control

• Provides the ability to discover devices on the LAN, enumerate their properties, manage their connections and control them

• Talker/Listener/Controller Entities

• Formal/Full description of Entity capabilities (Entity model):

− Descriptor based

− Stream inputs/outputs

− Analog/Digital Audio/Video inputs/outputs

− Media formats (sample rates, channels, aspect ratio, frame sizes, codecs, …)

− Clock domains

− Signal routing

• Talker/Listeners Advertise their presence and answer to commands

• Controllers Discover/enumerate Talker/Listeners and issue commands

PUBLIC 10

Avnu Automotive Profile

Objectives

• Reduced start up time

• Reduced transport overhead

• Reduced end station load

gPTP

• No BMCA, fixed port role, fixed grandmaster, stored delay measurements

SRP

• Fixed configuration

• New traffic classes: C (15ms transit time, 1.333us observation interval), D (15ms transit time, 1.451us)

AVTP

• Reduced number of supported formats (AAF, Compressed Video, IEC 61883-6)

AVDECC

• Not used

PUBLIC 11

AVB USE CASES

PUBLIC 12

AVB Network

AVB Streaming

• Talker end stations

• Listener end stations

• Talker & Listener end stations

• AV Bridges

Media Clock Domain(s)

• Media Clock Master

• Media Clock Slave(s)

gPTP Domain

• gPTP Master

• gPTP Slave(s)

SRP Domain(s)

AVB Domains (gPTP ∩ SRP)

PUBLIC 13

AVB Network Streaming

Talker end station AV BridgeListener end

station

AV Bridge AV Bridge Talker end stationTalker end station

Listener end

station

Listener end

station

Talker & Listener

end station

PUBLIC 14

AVB Network gPTP Domain

gPTP Master AV Bridge gPTP Slave

AV Bridge AV Bridge gPTP SlavegPTP Slave

gPTP Slave gPTP SlavegPTP Slave

PUBLIC 15

AVB Network Media Clock Domain

Media clock

slaveAV Bridge

Media clock

slave

AV Bridge AV BridgeMedia clock

slave

Media clock

Master

Media clock

slave

Media clock

slave

Media clock

slave

PUBLIC 16

AVB Network Automotive Application

Talker Left Mirror

CameraAV Bridge

Talker Right

Mirror Camera

Listener RSEListener RSE

Talker Rear View

Camera

Talker & Listener

Head Unit

PUBLIC 17

AVB Network Pro Audio Application

AV BridgeListener

Loudspeaker

Listener

Loudspeaker

Talker & Listener

Mixing table

Talker & Listener

Mic & Monitor

AV Bridge

AV Bridge

AV Bridge

Listener

Loudspeaker

Listener

Loudspeaker

Talker & Listener

Mic & Monitor

Talker & Listener

Mic & Monitor

Listener

Recording

PUBLIC 18

NXP

AVB SOFTWARE

STACK

PUBLIC 19

NXP AVB Software Stack

Multi-platform

• Runs on complete NXP SoC family: i.MX6, i.MX8

• OS/Hardware independent core code, greatly reducing re-development cost

• Platform abstraction layer

Scalable

• Allows usage of subsets of the AVB stack to meet specific market needs

• Offers variety of performance/cost levels according to the platform

AVB Hardware Assist

• Able to run both on platforms with standard Ethernet IP or with Ethernet AVB IP

PUBLIC 20

AVB Stack Diagram

All AVB components provided

Available for Endpoint and Bridge stations

Control application

IEEE 1722

AVTP

Media

IEEE802.1Qat

SRP

Bandwidth

Reservation

Ethernet IEEE 802.3 MAC

IEEE802.1Qav FQTSS

Queuing & Shaping

IEEE 1722

MAAP

IEEE 1722.1

AVDECC

AVB Management

& Control

IEEE 802.1AS

gPTP

Timing &

SynchronizationTCP/IP

stack

Streamer

DMA I/O

Audio/Video

Driver

Control API

Media API

Operating

System Media

Clock

Recovery

Productized component

IEEE 1722 AVTP Control

OS

Ab

str

act

HW

Ab

str

act

Media Application

AVB API to customized Media Applications

Demo integration with ALSA & gstreamer

PUBLIC 21

AVB Platforms

• Primary target: i.MX 6Quad/Dual/Solo/SoloX, i.MX 8, running Linux OS

• For secondary targets (SoCs and OSs)

− Mix of Linux OS, and other RTOS (FreeRTOS)

i.MX 6 Series i.MX 6SoloXi.MX 6QP,

ULKinetisMCU

ARMCortex-A9

ARMCortex-A9

ARM Cortex-M4

ARM Cortex-A9

ARM Cortex-Mx

Linux X X X

RTOS X X

Priorities:

1. i.MX 6 family (ARM Cortex-A9) on Linux OS for Automotive

2. i.MX 6SoloX (ARM Cortex-M4) on RTOS for Industrial/Prosumer Audio

3. Kinetis MCU (ARM Cortex-M4) on RTOS for Automotive Amplifier

PUBLIC 22

NXP AVB Development Hardware

• SABRE Automotive Infotainment Rev2 CPU Card with

i.MX 6Quad

• Flexible Ethernet Expansion Card with options for:

• Gb PHY (same PHY as on current SABRE hardware

for software compatibility)

• 10/100 BroadR-Reach PHY (NXP TJA1100)

• 10/100 BroadR-Reach 5-port switch (SJA1105T)

Automotive Hardware for

True Automotive AVB Development

PUBLIC 23

Introducing Ethernet: NXP Provides Auto-Native Portfolio Flexible,

Scalable Solution

Dual-OABR PHY

Dual-OABR PHY

e.g. MPC574xC/D/G

TJA1100 100MBPS PHY • Open Alliance BroadR-Reach Compliant

• Fully automotive qualified

• Robust automotive grade EMC and ESD

• Minimal external component count

• Enhanced Power Management to save battery life

• In Production

Dual-PHY • Single chip dual Broad-R-Rach PHY

• Enables better scalability

• Coming Soon

SJA1105 FIVE-PORT

SWITCH• Layer 2 Store and Forward Switch,

• Supports AVB, TSN and

Deterministic Ethernet

• Up to 1-Gb network speed,

• MII/RMII/RGMII Interface

• Port Mirroring and VLAN

support (IEEE 802.1Q

and IEEE 802.1P)

• In Production

802.1Q + AVB

802.1Q + AVB + TSN

SJA1105T

SJA1105

AVB SW

AUTOSAR Capability

Host Processor(i.MX, MPC574x, S32x)

PUBLIC 24

NXP

AVB END-TO-END

SOLUTION

PUBLIC 25

Head Unit Media Serveri.MX 6Quad / Linux

Ethernet IEEE 100Base-T1

- Movie: AVTP IEC 61883-4 (MPEG2-TS AAC / H.264)

- Camera: AVTP Compressed Video (MJPEG)

- SR Class A (2 ms AVB latency)

- gPTP Time Synchronization, Media Clock Recovery

- SRP Stream Reservation, AVDECC Talker, Listener, Control

SD Flash

Rear Seat Entertainmenti.MX 6Quad / Linux

Rear View CameraQoriva MPC5604

Instrument Clusteri.MX 6Quad / Linux

AVB Audio/Video Demo on NXP Platforms

Ethernet AVB SwitchSJA1105T / TJA1100

PUBLIC 26

Running AVB Demo

PUBLIC 27

Running AVB Demo

SJA1105

Automotive

Ethernet AVB Switch

TJA1100

Automotive BroadR-Reach

Ethernet PHYs

PUBLIC 28

Running AVB Demo

Full HD display

1920x1080

MPC5604EKIT

Video capture

1280x800, 30 fps

SABRE-AI i.MX 6Quad

Head Unit

SABRE-AI i.MX 6Quad

Instrument Cluster

SABRE-AI i.MX 6Quad

Rear Seat Entertainment

PUBLIC 29

Running AVB Demo

Video capture / playout

latency (~83 ms)

Audio / Video synchronization

local & remote

PUBLIC 30

AVB STACK

ROADMAP & LICENSING

PUBLIC 31

AVB Stack Roadmap

Color Legend

Released

Committed

Roadmap Date

Original Release

Major Release

Version/Beta

Service Pack

2016 1Q

March 2016

• Device/OS support

− i.MX 6Q/DL/S

− Linux 3.14 + RT

• Features

− AVTP A/V packetizer (61883-6, 61883-4,

MJPEG)

− FQTSS Class A, B, BE

− Media Clock Recovery & Capture (SW)

− gPTP, SRP, AVDECC

− AVB API

• Evaluation Package

− A/V talker/listener multi endpoints

− Integration w/ ALSA & gstreamer

• Development Package

− Yocto meta layer distribution

AVB 1.0

• AVB 1.1 (Sept 2016)

− AVTP AAF format, CRF stream

− SRP Application Interface

− i.MX 6SoloX

− Linux 4.1.15

− SJA1105 Switch integration (EAR)

• AVB 1.2 (Dec 2016)

− Preparation for Avnu Certification

− AVTP ACF format

− Multi SR Class A/B/C

− i.MX 6QP

− Surround cameras demo

− SJA1105 Switch integration (1.0)

• New Device/OS

− i.MX 6UL, i.MX 8

− Kinetis: K6x, K7x (2016)

− FreeRTOS

− Integrity

• New Features

− AVTP CVF format, MAAP

− Other AVTP formats for A/V

− IEEE 1733 transport

• New Demo Application

− Audio amplifier on Kinetis (Cortex

M4/RTOS)

AVBAVB 2.0

2017

AVB 1.x

Q2–Q4 2016

Color Legend

Released

Committed

Roadmap Date

Original Release

Major Release

Version/Beta

Service Pack

2016 4Q 2Q1Q

March 2016

• Device/OS support

− i.MX 6Q/DL/S

− Linux 3.14 + RT

• Features

− AVTP A/V packetizer (61883-6, 61883-4,

MJPEG)

− FQTSS Class A, B, BE

− Media Clock Recovery & Capture (SW)

− gPTP, SRP, AVDECC

− AVB API

• Evaluation Package

− A/V talker/listener multi endpoints

− Integration w/ ALSA & gstreamer

• Development Package

− Yocto meta layer distribution

AVB 1.0

• AVB 1.1 (Dec 2016)

− AVTP AAF format, CRF stream

− SRP Application Interface

− i.MX 6SoloX, i.MX 6QP

− Linux 4.1.15

− SJA1105 Switch integration

− AVnu Certification

• AVB 1.2 (March 2017)

− AVTP ACF format

− AVTP CVF format, MAAP

− Multi SR Class A/B/C

− i.MX7, i.MX 8

− Surround cameras demo

• New Device/OS

− i.MX 6UL

− Kinetis: K6x, K7x (2016)

− FreeRTOS

• New Features

− Other AVTP formats for A/V

− IEEE 1733 transport

• New Demo Application

− Audio amplifier on Kinetis (Cortex

M4/RTOS)

AVBAVB 2.0AVB 1.x

Dec 2016 – March 2017

2017 1Q

PUBLIC 32

Licensing Options

• Definitions:

− Customer Target Project: one customer project for one customer specific product. For example a Head Unit for a specific car model. The project will be identified in the license agreement.

− Customer Target Product Line: several customer projects in the same line of customer products. For example a Head Unit platform targeted for multiple carmodels/OEMs.

− NXP Target Product: one specific product in the NXP product portfolio. For example the i.MX6SX.

− NXP Product Family: a family of package/memory/IP blocks. For example, a product family is Vybrid, or i.MX6, or Kinetis K series.

License Description Support &

Maintenance

Upgrade options

Evaluation Binary version of the product, running on NXP reference HW only, for

a limited time, for evaluation purposes.

Limited to the replication of the

evaluation setup.

To any other license.

Development license,

limited support

Provides all necessary elements to start developing, on any supported

NXP silicon and OS. Limited deployment – not suitable for production.

50h support, 1 year

maintenance.

To any production license.

Development license, 6

months unlimited support

Provides all necessary elements to start developing, on any supported

NXP silicon and OS. Limited deployment – not suitable for production.

6 months of support, and 1 year

of maintenance.

To any production license.

Single Product License One Customer Target Project on one NXP Target Product. Closes

down the OS/SoC/IP combination.

1 year support and maintenance,

20% of the license price after.

To any higher priced production license.

Additional OS/SoC at a discount.

Product Line License One Customer Target Product Line on one NXP Product Family: OS

fixed, SoC/IP varies in the same family.

1 year support and maintenance,

20% of the license price after.

To any higher priced production license.

Additional OS/SoC at a discount.

Multi-Product Line

License

Multiple Customer Projects/Products on one NXP Product Family: OS

fixed, SoC/IP varies in the same family.

1 year support and maintenance,

20% of the license price after.

Additional OS/SoC at a discount.

Volume License Prepaid per unit License. Commercial support only. Free

maintenance.

N/A

PUBLIC 33

Product Support

Domain experts answering your questions

Support (where included, as per the License type)• Is provided in a private and managed portal, by domain knowledgeable engineers

• Delivered on NXP reference HW for the respective SW product, as answers to specific

customer questions.

• Counts towards the support hours:

• Specific questions on the licensed product, related to behavior, correct utilization of

APIs, integration topics, etc.

• The replication and investigation of issues reported by the customer. If a product bug

is discovered as a result of the investigation, the actual implementation of the bug fix

in the product will not be counted.

Annual commercial support subscriptions:• Useful when support is not included in the license, or the included package is exhausted.

• 50 / 100 / 200 hour options

• Flexibility: Customize the support package to meet your platform needs

Professional services:• Useful when you need domain knowledgeable engineers actively involved in your project.

• Typically helps with porting/integration/customization/specific use-case optimization.

• Leverage regional teams: EMEA, Americas, Asia.

Private and timely responses to accelerate your time to market

PUBLIC 34

Product Maintenance

Maintenance (where included, as per the License type):• While under maintenance for the licensed product, the customer will be notified of, and will

receive access free of charge, to:

• Minor version upgrades

• Hot patches

• Will not be included in the yearly maintenance:

• Major version upgrades

• Support for new NXP SoCs/devices/OSs, past those covered by the initial license.

New major version details:• The major version of the product is indicated by the first digit of the product version

number. For example, for the a product such as AVB v1.0.0, the major version is “1”.

• A new major version for a product is introduced when:

• Significant new functionality is introduced.

• Support for product line generations is added, or removed.

• Support for OSs is added, or removed.

• The architecture of the product is significantly changed.

• Significant API and product framework changes are introduced

PUBLIC 36

ATTRIBUTION STATEMENT

NXP, the NXP logo, NXP SECURE CONNECTIONS FOR A SMARTER WORLD, CoolFlux, EMBRACE, GREENCHIP, HITAG, I2C BUS, ICODE, JCOP, LIFE VIBES, MIFARE, MIFARE Classic, MIFARE

DESFire, MIFARE Plus, MIFARE FleX, MANTIS, MIFARE ULTRALIGHT, MIFARE4MOBILE, MIGLO, NTAG, ROADLINK, SMARTLX, SMARTMX, STARPLUG, TOPFET, TrenchMOS, UCODE, Freescale,

the Freescale logo, AltiVec, C 5, CodeTEST, CodeWarrior, ColdFire, ColdFire+, C Ware, the Energy Efficient Solutions logo, Kinetis, Layerscape, MagniV, mobileGT, PEG, PowerQUICC, Processor Expert,

QorIQ, QorIQ Qonverge, Ready Play, SafeAssure, the SafeAssure logo, StarCore, Symphony, VortiQa, Vybrid, Airfast, BeeKit, BeeStack, CoreNet, Flexis, MXC, Platform in a Package, QUICC Engine,

SMARTMOS, Tower, TurboLink, and UMEMS are trademarks of NXP B.V. All other product or service names are the property of their respective owners. ARM, AMBA, ARM Powered, Artisan, Cortex,

Jazelle, Keil, SecurCore, Thumb, TrustZone, and μVision are registered trademarks of ARM Limited (or its subsidiaries) in the EU and/or elsewhere. ARM7, ARM9, ARM11, big.LITTLE, CoreLink,

CoreSight, DesignStart, Mali, mbed, NEON, POP, Sensinode, Socrates, ULINK and Versatile are trademarks of ARM Limited (or its subsidiaries) in the EU and/or elsewhere. All rights reserved. Oracle and

Java are registered trademarks of Oracle and/or its affiliates. The Power Architecture and Power.org word marks and the Power and Power.org logos and related marks are trademarks and service marks

licensed by Power.org. © 2015–2016 NXP B.V.