View
11
Download
0
Category
Preview:
Citation preview
Where are my Closed Captions? Managing and Monitoring
Ancillary Data
Sara Kudrle Miranda Technologies
A BELDEN Brand
Wild West of Files Anatomy Lesson
Manage The Chaos
Wrap It Up The Poor Cousin
What We Can Do Now
Ingest and Quality Control
Playout and Graphics
Publishing for On Demand
Editing and Content Prep
Live Production
Media Management and Storage
Automation
Linear Channels
Pre- Produced Content and Ads
WAN Non Linear Delivery WAN
Typical Television Broadcast Facility and Workflow
Broadcast Facilities Have Been Stream / SDI Centric
Ingest and Quality Control
Playout and Graphics
Non Linear Publishing
Editing and Content Prep
Live Production
Media Management and Storage
Automation
Linear Channels
Pre- Produced Content and Ads
WAN
Linear Feeds
Tape (Linear Medium)
Linear Streams
Isolated Islands of IT / File Based Infrastructure
Broadcast Industry Specific SDI Infrastructure
Non Linear Delivery WAN
Today Facilities Becoming Increasingly “File Based”
Ingest and Quality Control
Playout and Graphics
Non Linear Publishing
Editing and Content Prep
Live Production
Media Management and Storage
Automation
Editing and Content Prep
Live Production
Linear Channels
Pre- Produced Content and Ads
WAN
Tape (Linear Medium) Non Linear
Delivery WAN
Media Files
Media Files
Linear Feeds
Linear Streams
Isolated Islands of IT / File Based Infrastructure
Broadcast Industry Specific SDI Infrastructure
Broadcast Industry Specific SDI Infrastructure
IT / File Base Infrastructure
It Was So Easy in the Good Old Days
Video: Location Fixed, Format Specified (SMPTE-292M / 274M …) Audio: 16 Channel, Location Fixed in ANC Data Space (SMPTE-299M) Timecode: Location Fixed in ANC (SMPTE-291M) Captions: Location Fixed in ANC (SMPTE-299M) AFD: Location Fixed in ANC (SMPTE-2016M) Dolby Metadata: Location Fixed in ANC (SMPTE-2020M)
HD-SDI
Perhaps Too Easy?
Essence Descriptors: • SOM: HH:MM:SS:FF • EOM: HH:MM:SS:FF
• Audio 1, 2:e Dolby E Descriptive Metadata:
• Title • Episode
• Creation Date
THESE DATA?
HD-SDI
Contrasting the good ‘ol days versus today
• File wrapper format “standards” that are too loose and interpreted in too many different ways (e.g. MXF)
WAN Files
• Missing / misplaced meta data
SDI
• “Iron Clad” tape formats • “Cast in stone” device
interconnect (SMPTE SDI) with precise
• No provisions for descriptive meta data
Then (the good ‘ol days)
Today (the wild west)
The Early Days of File Based Same Vendor Provides Ingest and Playout
SDI
SDI
SDI
Third party media server
Homogeneous Environment ONE Common File Format
INGEST PLAYOUT
STORE
Today’s Reality – The Wild West of Files
SDI
Third party media server
INGEST
PLAYOUT
STORE
Networked VTRS
WAN File Delivery Service
IMX
LXF
?XF Ethernet /
IP Network
MXF Flv A
Most File Formats are Not
Interoperable
IMX LXF ?XF MXF Flv X X X X
Wild West of Files Anatomy Lesson
Manage The Chaos
Wrap It Up The Poor Cousin
What We Can Do Now
Anatomy of a Media File
Wrapper
Codec
Essence
Anatomy of a Media File
Ties Essence together & describes it • Structural metadata such as SOM, EOM,
Duration, types of media included in file, etc. • Descriptive metadata such as creation date, usage
rules, key words • Time References and Index
• Video (typically compressed) • Multiple Audio (often compressed) • Ancillary Data (e.g. Captions, AFD, …)
“Essence”:The actual media which includes:
Wrapper:
Media File
Two Storage Approaches
Wrapper
Descriptive Metadata
Timecode / index
Video Essence
Audio Essence(s) Audio Essence(s)
Ancillary Data Essence
Method 1: Embedded Essence
Examples: • MXF XDCAM • GXF • LXF
One File
Structural Metadata
Method 2: Reference Files / External Essence
Wrapper
Descriptive Metadata
Timecode / index
Video Essence
Audio Essence(s) Audio Essence(s)
Ancillary Data Essence
Structural Metadata
Main File
Multiple “Referenced” Files
Examples: • Omneon MOV • MXF P2 • MXF AS-02
Two Storage Approaches
Wrapper
Descriptive Metadata
Timecode / index
Video Essence
Audio Essence(s) Audio Essence(s)
Ancillary Data Essence
Method 1: Embedded Essence
Examples: • MXF XDCAM • GXF • LXF
One File
Structural Metadata
Method 2: Reference Files / External Essence
Wrapper
Descriptive Metadata
Timecode / index
Video Essence
Audio Essence(s) Audio Essence(s)
Ancillary Data Essence
Structural Metadata
Main File
Multiple “Referenced” Files
Examples: • Omneon MOV • MXF P2 • MXF AS-02
Benefit: one file includes everything, easier media management
Benefit: Additional essences can be more quickly added after the fact (e.g multiple languages audio and captions)
Wild West of Files Anatomy Lesson
Manage The Chaos
Wrap It Up The Poor Cousin
What We Can Do Now
Popular Wrapper Formats
Vendor Specific Wrappers Associated with Camera and VTR Formats
Vendor Specific Server Formats
Generic Industry Wrappers
.MOV
P2 MXF (Panasonic)
Wrappers Originating in PC/Multi-Media
MXF OP1a
MXF-AS-XX
GXF (Grass Valley)
LXF (Harris)
IMX/XDCAM MXF (Sony)
.AVI
MPEG TS File
Television Distribution format
Key Features of Popular Media Wrappers
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2 MXF
Avid MXF
(OP Atom)
MXF AS-02
Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Popular Wrapper Formats
Key Features of Popular Media Wrappers
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2 MXF
Avid MXF
(OP Atom)
MXF AS-02
Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Key Features / Functionality
Key Features of Popular Media Wrappers
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2 MXF
Avid MXF
(OP Atom)
MXF AS-02
Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Not Supported
(Bad)
Strongly Supported (Very Good)
Partially Supported
Key Features of Popular Media Wrappers
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2
MXF
Avid MXF
(OP Atom)
MXF AS-02
Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Observation 1: There are a lot of wrapper formats and they are obviously very different
Observation 2: No ONE wrapper format supports all the identified functionality
Key Features of Popular Media Wrappers
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2
MXF
Avid MXF
(OP Atom)
MXF AS-02
Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Observation 3: There are a couple clear “bad choices”
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2
MXF
Avid MXF
(OP Atom)
MXF AS-02
Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Observation 4: At first glance MXF appears promising but in reality has turned out to have major interoperability issues
Key Features of Popular Media Wrappers
Key Features of Popular Media Wrappers
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2
MXF
Avid MXF
(OP Atom)
MXF AS-02
Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Observation 5: Hard-core constraints (Tape Fmt Heritage), Clearly Documented, No Ambiguity Reasonable bit rate (HD at 50 Mbps), Wide NLE and Server Support IMX / XDCAM MXF has turned out to be a very popular Generic File Format
Wrapper Divergence!
Why MXF Cannot Solve All The Issues
More Specific More constraints Better Generic MXF
LXF Leitch Harris
GXF Grass Valley
IMX/XDCAM MXF Sony
Vendor Specific Variants
Generic Variants
• Far too loose & flexible
• Subject to broad interpretation
• No hard reference
• Vendor specific • Some published • Some proprietary • Overly constrained • Harder to Extend • No reference
implementation
AS-02 Versioning
AMWA Application Specifications
AS-03 Program Delivery
AS-10 Production AS-12
Ad Delivery
AS-11 Contribution
• Constraints on MXF for different Applications
• Industry Standard ?
AMWA MXF AS-XX Application Specifications • Defined by AMWA (Advanced Media Workflow Association)
• AS-XX MXF Specifications Define a set of rules / constraints on MXF to suit a particular use
• Defines MXF use for different situations / applications • Shims constrain further to meet needs of a user
MXF
Constrained Parameters, and Values
Available Codecs
Constraints on Codecs and
Bit-rate ranges
AS-XX - Application Specification User A SHIM User B SHIM
AS-XX Format Summary
Number Application Domain Essences CODECs
HD Bit Rates (Mbps)
Meta Data
AS-02 Versioning External Not Specified Depends on Codec
AS-03 Program Delivery
Embedded MPEG2, H.264 LGOP
5-50 Mb/s
AS-10 Production (e.g. Sony XDCAM MXF)
Embedded MPEG-2 MP@HL, MPEG-2 422P@HL MPEG-2 MP@H14 LGOP
Depends on Codec
AS-11 Contribution Embedded AVC Intra 100 Mbps
AS-12 Ad Delivery Embedded MPEG2, H.264 LGOP
5-50 Mb/s
PGMX_HDVideo.mxf -
AS02_clips
PGMX_Audio_English.mxf PGMX_Audio_Spanish.mxf
PGMX - PGMX_English.mxf
Media
PGMX_Spanish.mxf
-
PGMX_ANC_English.mxf PGMX_ANC_Spanish.mxf Extra
• Defined by users (AMWA members)
• Places constraints on MXF for versioning of synchronized essences
• Allows any number of audio and caption tracks to be added and chosen at playout time
MXF AS-02
MXF AS-03
• Optimized for the delivery of finished programs • Carries built-in metadata relevant to playout:
– House ID, ISAN, Ad ID/ISCI or UUID – Slate Title – Series Code and Episode number – SOM/EOM – AFD Code, V-Chip Rating, Nielsen Stream ID
MXF AS-02 to AS-03 Re-Wrapping
• Going from AS-02 to AS-03 is a simple re-wrap operation
• Think of AS-03 as a flattened, single language version of AS-02
PGMX_English_AS-03.mxf
PGMX_HDVideo.mxf -
AS02_clips
PGMX_Audio_English.mxf PGMX_Audio_Spanish.mxf
PGMX - PGMX_English.mxf
Media
PGMX_Spanish.mxf
-
PGMX_ANC_English.mxf PGMX_ANC_Spanish.mxf Extra
AS-03
Different AS-XX Specifications for Different Apps
AS-12 Ad Delivery
Regional Playout Facility Central Broadcaster / Playout Content Creation
AS-02 Versioning
AS-10 End to End ( Acquisition – Production – Playout)
AS-11 Contribution
Aquisition Post Contribution Playout Preparation Distribution
AS-03 Program Delivery
Packaging of multiple versions of same program Multiple Languages, Multiple Editorial Versions
Delivery of finished programs. Single File, single audio language, constrained codecs
Delivery of finished Commercials. Identical to AS-03 but with Advertising specific Meta Data
Enable Interoperation and an end to end workflow without transcoding. Specifies Long GOP MPEG2 codec at a decent bit rate Designed as extension to SMPTE RDD 9 and is used by IMX & XDCAM-HD
Vendor-neutral file format for the delivery of finished program material. Similar to AS-03 but features higher bit rate AVC-Intra video and uncompressed Audio
Different AS-XX Specifications for Different Apps
AS-12 Ad Delivery
Regional Playout Facility
Central Broadcaster / Playout
Content Creation
AS-02 Versioning
AS-10 Production using Long GOP Codec (e.g. XDCAM)
AS-11 Contribution
Aquisition Post Contribution Playout Preparation Distribution
AS-03 Program Delivery
Delivery of finished programs. Single audio language, constrained codecs
= User A SHIM User B SHIM Observation : Even within versions, AMWA has specified that “An Application Specification can be further constrained to meet the needs of a user through use of a SHIM”
In other words, they are different
• Constraints on MXF for different Application
• Industry Standard ? More
Specific Better
MXF
LXF Leitch/Harri
s
GXF Grass Valley
IMX/XDCAM MXF Sony
Vendor Specific Variants
Generic Variants
AS-02 Versioning
AMWA Application Specifications
AS-03 Program Delivery
AS-10 Production AS-12
Ad Delivery
AS-11 Contributio
n
Why MXF Cannot Solve All The Issues
Wild West of Files Anatomy Lesson
Manage The Chaos
Wrap It Up The Poor Cousin
What We Can Do Now
MPEG2 TS
MOV/ MP4 AVI
GXF or
LXF
Gen MXF
IMX/ XDCAM
MXF
P2 MXF
Avid MXF
(OP Atom)
MXF AS-02 / AS-03
Timecode *** *** *** *** *** *** ***
Captions *** ** *** *** ** ** ***
AFD *** *** *** ** ** ***
Dolby Metadata
*** *** *** ** ** ***
V-chip *** *** *** ** ** ***
Ad Insertion Triggers
*** *** *** ** ** ***
Ancillary Data Support by Wrapper
Ancillary Data Four main ways to carry Ancillary data in files
In the VBI portion of video (IMX only) In the MPEG GOP Header (limited) In the wrapper (limited) As a s436m payload
ANC Data In Legacy File Formats Was Inconsistent and Incomplete
HANC Audio T/C
VANC AFD, Dolby, CC, VCHIP, SCTE Triggers, Private Data
Active Video
File Wrapper
Video Essence
Audio Essence (s)
Some ANC in Codec Header
Some ANC in Wrapper Meta
SDI
Time Code
And / Or
Some, Not All
Some ANC in VBI (SD only)
Legacy File Formats
Ancillary Data
Dolby Metadata
SCTE-104 Ad Triggers
Broadcast Flag
OP47 Teletext
Private Data
$
XDS V-Chip WSS AFD
Timecode Closed Captions
VBI (IMX Only)
Ancillary Data
Dolby Metadata
SCTE-104 Ad Triggers
Broadcast Flag
OP47 Teletext
Private Data
$
XDS V-Chip WSS AFD
Timecode Closed Captions
VBI (IMX Only) Codec Header
Ancillary Data
Dolby Metadata
SCTE-104 Ad Triggers
Broadcast Flag
OP47 Teletext
Private Data
$
XDS V-Chip WSS AFD
Timecode Closed Captions
VBI (IMX Only) Codec Header
Wrapper Metadata
Ancillary Data
Dolby Metadata
SCTE-104 Ad Triggers
Broadcast Flag
OP47 Teletext
Private Data
$
XDS V-Chip WSS AFD
Timecode Closed Captions
Dolby Metadata
SCTE-104 Ad Triggers
Broadcast Flag
OP47 Teletext
Private Data
$
VBI (IMX Only) Codec Header
Wrapper Metadata
Key ANC Data not Captured
Ancillary Data
XDS V-Chip WSS AFD
Timecode Closed Captions
ANC Data In Legacy File Formats Was Inconsistent and Incomplete
HANC Audio T/C
VANC Various ANC Data
Active Video
Original Source Video Legacy File Formats
File Wrapper
Video Essence
Audio Essence (s) Time Code
Playback Video
Ingest HANC Audio T/C
VANC Various ANC Data
Active Video
Playback
Missing ANC Data
Can’t Easily Add or Modify ANC Data to File
Original ANC Data Subset of
ANC Data
Wild West of Files Anatomy Lesson
Manage The Chaos
Wrap It Up The Poor Cousin
What We Can Do Now
SMPTE To the Rescue
SMPTE 436M: MXF Mappings for
VBI Lines and Ancillary Data Packets
Codec Header
Wrapper Metadata
SMPTE 436m
Key ANC Data NOW Captured
Ancillary Data
XDS V-Chip WSS AFD
Timecode Closed Captions
Dolby Metadata
SCTE-104 Ad Triggers
Broadcast Flag
OP47 Teletext
Private Data
$
Wrapper
Video Essence
Audio Essence
SMPTE 436 ANC Essence CC
AFD DOLBY SCTE Propri
Frame Accurate Index DID ANC
Data Line Num H C
S
MXF File with 436M Essence
CC AFD
DOLBY SCTE Propri
CC AFD
DOLBY SCTE Propri
CC AFD
DOLBY SCTE Propri
Typical SMPTE 436 Packet
SMPTE 436 Dramatically Improves ANC Carriage
SMPTE 436 Dramatically Improves ANC Carriage
HANC Audio T/C
VANC AFD, Dolby, CC, VCHIP, SCTE Triggers, Special Data
Active Video
SMPTE 436 ANC Essence
SDI MXF File with 436M Essence
File Wrapper
Video Essence
Audio Essence (s) Time Code
ALL ANC
HANC Audio T/C
VANC DID tagged streams
Active Video
VANC Audio T/C
VANC DID tagged streams
Active Video SMPTE 436 ANC Essence
MXF File with 436M Essence
File Wrapper
Video Essence
Audio Essence (s)
Time Code
Original Source Video Playback Video
Ingest Playback
Add and Modify ANC Easily
Original ANC Data
Original ANC Data Augmented ANC Data
Original ANC Data Augmented ANC Data
SMPTE 436 Dramatically Improves ANC Carriage
Ancillary Data Using SMPTE 436M
Standardized by SMPTE in 2006 Can carry any DID/SDID (i.e. future-proof) Carried as a separate essence payload in MXF
Can be embedded or referenced Easy to re-wrap Easy to Add / Modify
Supported in MXF and AS-N Application Specifications Now being added to SMPTE RDD9 for AS-10 / IMX/XD-CAM
SMPTE-436M Ancillary Data
Carriage in Files
It solves the biggest file interoperability problems we have experienced
The most important thing to happen to File Based since the folder was invented
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2
MXF
Avid MXF
(OP Atom) MXF
AS-02 Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Key Features of Popular Media Wrappers
ANC Carriage had been weakness of IMX/XDCAM MXF
Now with inclusion of SMPTE 436M ANC Carriage becomes supported
436M
Contrasting the good ol’ days versus today
• File format standards that are interpreted in too many different ways (e.g. MXF)
WAN Files
• Multiple Codec formats??? • Multiple file wrapper formats • Missing / misplaced
meta data
SDI
• “Iron Clad” tape formats • “Cast in stone” device to
device interconnect (SMPTE SDI)
Then (the good ol’ days)
Today (the wild west)
Incompatible wrappers
Inconsistent, non-extendable ANC data carriage
Improved file Interoperability
SMPTE 436M
AS-XX Specifications AMWA
What We Can Do Now
Wild West of Files Anatomy Lesson
Manage The Chaos
Wrap It Up The Poor Cousin
In an Ideal World…..
SMPTE 436 ANC Essence
MXF File with 436M Essence
File Wrapper
Video Essence
Audio Essence (s)
Time Code
There would be one wrapper to wrap them all!
And All Sources Would Be Wrapped The Same
Third party media server
INGEST
PLAYOUT
STORE
Networked VTRS
WAN File Delivery Service
Ethernet / IP Network
MXF
MXF
MXF
MXF
And It Would Be Simple to Find Your Data – Especially Captions
SMPTE 436 ANC Essence
MXF File with 436M Essence
File Wrapper
Video Essence
Audio Essence (s)
Time Code
Here is Your Data – AND YOUR CAPTIONS!
The Reality….
SDI
Third party media server
INGEST
PLAYOUT
STORE
Networked VTRS
WAN File Delivery Service
IMX
LXF
?XF Ethernet /
IP Network
MXF Flv A
What Can You Do?
1.Have a Playout System that can handle ALL Types of File Formats
2.Normalize ALL Files at Ingest to One File Format
Option 1: Playout System The SKILLED factory approach
IMX
LXF
?XF
MXF Flv A
MOV
AVI
GXF
GXF LXF IMX MOV MXF Flv A ?XF AVI
Option 2: Normalize Files The UN-SKILLED factory approach
IMX
LXF
?XF
MXF Flv A
MOV
AVI
GXF
MXF MXF MXF MXF MXF MXF
Anything That Can Be Done in SDI Needs to Happen in Files
SD Source HD Source 608
708
Need to be able to Analyze More Than the Essence
File Processing Factory
Graphics Up/Down/X Convert
Video Decode
Video Encode
Loudness Measure / Adjust
Up/Down Mix
Audio Decode
Audio Encode
V-chip AFD CC, Subtitles
Dolby Metadata
Audio Mapping File
un- wrap
File wrap
Nielsen Watermark
MPEG Stitching / ReMuxing
Need to be able to Preview and Manage Offline
• Metadata viewing / editing • Media preview
Monitor The Results
FRE ITA ENG DVB Subtitles
PGM Les Expos sont de retour avec une avance de 9 a 1
Expo sono tornati con un vantaggio di 9-1
ITA FRE
Missing Captions / Subtitles
COM
What Can I Do? S436m
Get Involved!
Vendor Validation Ask for it!
Comments or Questions?
Sara.Kudrle@miranda.com
Recommended