Embed Size (px)
Citation preview
Slide1
Fraunhofer Digital Cinema
Cross M
edia Form
at WorkflowforProduction,
Postproductionand Archiving
HeikoSparenberg,
Siegfried Foessel
Fraunhofer Institute for Integrated C
ircu
its
Am W
olfsm
antel3
3, 91058 Erlangen, Germ
any
www.iis.fraunhofer.de
www.dcinema.fraunhofer.de
www.w
mp-baye
rn.de
Slide2
Contents
1.Motivation
2.Production System Overview
3.Ingest Process
4.Using the Production System
5.Benefits
6.Fraunhofer IIS Developments
Slide3
Project: Tools forMedia Production
Slide4
Cinema Chain: Film and Digital
Digital
Postproduction
Digitizing
Exposure
to film
Secondaryuse
DVD
Production
Postproduction
Playback
Film-Camera
Conventional
Postproduction
Conventional
Projection
Archives
Digital
Camera
Digitale
Projection
Slide5
Goals
•Deliver data for different form
ats on demand
•No need for proxies
•No exposure back on film -data should stay digital
•Quick search in metadata
•Limitations for different user groups
•Open interfaces
Slide6
StorageSystem
Content Storage
User Rights
Metadata
ContentAcquisition
Creation
Postproduction
Ingest&
Administration
Metadata &
Transcoding
DCinema
HDTV
Mobil TV
Slide9
JPEG2000: LayeredSchemeCompression
Sca
lab
le B
itstr
ea
m
En
co
din
g
Slide10
Benefitsof JPEG2000 Standard
ContentStorage
4K
Co
nte
nt
2K
Co
nte
nt
Slide12
StorageSystem
Content Storage
User Rights
Metadata
System overview
ContentAcquisition
Creation
Postproduction
Ingest&
Administration
Metadata &
Transcoding
Slide13
StorageSystem
Content Storage
User Rights
Metadata
System overview: StorageSystem
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide14
StorageSystem
•Separate storage for
-Content (video and audio)
-Metadata
-Management data (user rights, content relation)
StorageSystem
Content Storage
User Rights
Metadata
Slide15
StorageSystem
Content Storage
User Rights
Metadata
System overview
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide16
ContentAcquisition
Creation
StorageSystem
Content Storage
User Rights
Metadata
System overview: ContentCreation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide17
ContentCreation/Acquisition
•Different form
ats from filmset
-Scanned film
-Digital data
•Not in scope of this project
-We expect digital data
ContentAcquisition
Creation
Slide18
StorageSystem
Content Storage
User Rights
Metadata
System overview
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide19
StorageSystem
Content Storage
User Rights
Metadata
System overview: Ingest& Adminstration
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide20
Ingest& Administration •Convert material from set to lossless JPEG2000
•Extract metadata from material header
•Store metadata in database
•Administrate
-User rights
-Access to content
-Quality and resolution right to content
•Add and remove
-User, groups, projects…
•Automatic metadata enrichment
Ingest&
Administration
Slide21
Face Detection
•Detect faces inside video content
•Detect mood
-Angry, happy, sad, surprised
•Detect gender
•Use this inform
ation to find certain content in
production system later
Ingest&
Administration
Slide22
Face Detection
Ingest&
Administration
Slide23
StorageSystem
Content Storage
User Rights
Metadata
System overview
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide24
StorageSystem
Content Storage
User Rights
Metadata
System overview: Postproduction
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide25
Postproduction
•Create sequences from source material
•Non destructive colorgrading for different purposes
-Cinema
-Broadcast
-Mobile TV
-Archive
•Add masks and filters
•Enrich descriptive metadata
•Combine audio and video
Postproduction
Slide26
StorageSystem
Content Storage
User Rights
Metadata
System overview
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide27
StorageSystem
Content Storage
User Rights
Metadata
System overview: Metadata & Transcoding
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide28
Metadata & Transcoding
•Gateway to other applications
•Deliver metadata in certain form
ats
-e.g. Broadcast Metadata Form
at (BMF)
•Transcodecontent to different destination form
ats
-H.264 for broadcast or
-DCI compliant J2K for DCinemadistribution
•Automatic audio downmixfrom 5.1 to stereo
•Wrappvideo, audio and metadata into destination
packet form
at like DCP or MXF
Metadata &
Transcoding
Slide29
StorageSystem
Content Storage
User Rights
Metadata
System overview
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide30
Ingestand Postproduction
StorageSystem
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide31
Ingestand Postproduction
RAW
D20
DPX
JPEG2000
StorageSystem
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide32
Ingestand Postproduction
RAW
D20
DPX
JPEG2000
Connect
StorageSystem
Content Storage
User Rights
Metadata
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide33
Ingestand Postproduction
StorageSystem
Content Storage
User Rights
Metadata
JPEG2000
RAW
D20
DPX
JPEG2000
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide34
Ingestand Postproduction
StorageSystem
Content Storage
User Rights
Metadata
e.g. Titel, Faces
RAW
D20
DPX
JPEG2000
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide35
Ingestand Postproduction
StorageSystem
Content Storage
User Rights
Metadata
perm
it/denyaccessto content
RAW
D20
DPX
JPEG2000
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide36
StorageSystem
Ingestand Postproduction
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide37
Connect
Ingestand Postproduction
StorageSystem
Content Storage
User Rights
Metadata
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide38
SearchContent
StorageSystem
Content Storage
User Rights
Metadata
Ingestand Postproduction
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide39
Non destructiveworkon content
StorageSystem
Content Storage
User Rights
Metadata
Ingestand Postproduction
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide40
Addmetadata
StorageSystem
Content Storage
User Rights
Metadata
Ingestand Postproduction
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Metadata &
Transcoding
Slide41
Metadata &
Transcoding
Client
Distributor
Archives
Editor
ContentAcquisition
Creation
UsingtheProductionSystem
StorageSystem
Ingest&
Administration
Postproduction
Slide42
UsingtheProductionSystem
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Client
Distributor
Archives
Editor
Connect
Connect
StorageSystem
Content Storage
User Rights
Metadata
Metadata &
Transcoding
Slide43
Metadata &
Transcoding
StorageSystem
Content Storage
User Rights
Metadata
UsingtheProductionSystem
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Client
Distributor
Archives
Editor
SearchContent
Metadata
Slide44
StorageSystem
Content Storage
User Rights
Metadata
UsingtheProductionSystem
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Client
Distributor
Archives
Editor
Pre
vie
w
Metadata &
Transcoding
Slide45
Metadata &
Transcoding
StorageSystem
Content Storage
User Rights
Metadata
UsingtheProductionSystem
ContentAcquisition
Creation
Ingest&
Administration
Postproduction
Client
Distributor
Archives
Editor
RequestContent
GeneratedContent
Slide46
Conclusion/ Benefits
•No proxies for certain output form
ats
•Full non destructive workflow
•Generate content on demand
•Usage of JPEG2000 results in
-Less storage needs
-Less storage costs
-Less bandwidth needs
•Data will stay digital
Slide47
Test Productionin Progress
•First test production with Distributed Production
System in progress
•Work on film set finished yet
•Currently testing software modules for ingest and
transcoding
•2nd test production will be started in summer 2008
Slide49
Combination of analog and digital technology:
Combination of analog and digital technology:
Combination of analog and digital technology:
Combination of analog and digital technology:
-Rotating mirror shutter
-Optical view finder
-Use of one CMOS image sensor with 35mm-film
form
at allows
use of 35mm lenses and enables film look
-Resolution of 2880 by 2160 Pixel equivalent to RGB
2k camera
-Digital processing inside the camera
-Variable Output form
ats, variable Speed
-Digital Outputs (single/dual HDSDI)
-HD-and Data-M
ode
-Electronic developed for ARRI CinetechnikGmbH by
Fraunhofer IIS
D20 -Digital FilmstyleCamera
ARRI D20
ARRI D20
Slide50
D20 -Mobile field recorder from IIS
�HDD-based (optional Flash-based)
Storage,
portable 8kg
�Storage capacity >1,0 TeraByte
�Storage and Playback of Sequences up to DC2048x1080
and HTDV 1920x1080, RGB 12 Bit
�Uncompressed (or lossless/near lossless J2K-compression)
�IT interfaces: 2 GBitFC, FW
Megacine
Megacine
Slide51
DCP Authoring
JPEG2000-Codestream-Viewer
ScaleabilityControls
DCP Essence
Navigation Controls
Timeline
MXF
CPL
PKL
Slide52
DCP Validation
DCP-Content
PKL
CPL
MXF
J2K-Codestream
CodestreamValidation
Preview
ViewerControls
Slide53
JPEG2000 –Form
at support
Plugindevelopment for postproduction software
-Software based
-Available for
-IridasSpeedgrade
-IridasFramecycler
-Digital Fusion 4
-Digital Fusion 5
Slide54
Visitusat NAB ´08
•Center Hall Booth C10919A/B
Center Hall Booth C10919A/B
Center Hall Booth C10919A/B
Center Hall Booth C10919A/B
•www.wmp-bayern.de
Slide63
Thankyou
foryourattention
