CineGrid for Digital Cinema and Beyond

Tom DeFanti Research Scientist

California Institute for Telecommunications and Information TechnologyUniversity of California, San Diego

Distinguished Professor Emeritus of Computer ScienceUniversity of Illinois at Chicago

The CineGridThe CineGrid Initiative Initiative

• CineGrid is an initiative to provide media professionals access to global cyber-infrastructure capable of carrying ultra-high performance digital media using the photonic networks, middleware, transport protocols and collaboration tools originally developed for scientific research, visualization, and Grid computing.

• In the process, “learn by doing,” train the next generation, and cultivate global inter-disciplinary communities to help advance the state of the art

• CineGrid is people, facilities, networks and a not-for-profit organization

Economic Impact of Cinema in California Economic Impact of Cinema in California Major Employment from Movie Industry in California by County Major Employment from Movie Industry in California by County

In 2004, more than 236 new movies were produced in the State of California.

In 2005 movie production provided employment for over 245,000 Californians, with an associated payroll of more than $17 billion.

Typical big movies each spend more than $60 million on production, have a long-term $200 million economic impact, create more than 900 full-time jobs, and yield $11 million in state sales taxes and income taxes when fully made in California.

http://www.google.com/maps?q=http://research.calit2.net/a2i/ca.kmz

CENIC Already Connects CENIC Already Connects California Schools and Research LabsCalifornia Schools and Research Labs

Calit2UCI

USC

SFSU

Calit2UCSD

• Systems developed for CineGrid can be applied to scientific visualization and distance learning in many fields• Useful information exchange between communities looking at “extreme” digital media problems from different perspectives• CineGrid demonstrations will focus developers, driving a virtuous cycle of “learning by doing”

The CineGrid Node at UCSD/Calit2The CineGrid Node at UCSD/Calit2

200 Seats, 8.2 Sound, Sony SXRD 4K projector, SGI Prism w/21TB, 10GE connectivity, NTT JPEG 2000 codecs

The CineGrid Node at The CineGrid Node at Keio University, Tokyo JapanKeio University, Tokyo Japan

SXRD-105 4K Projector

Imagica 4K Imagica 4K Film ScannerFilm Scanner

Sony 4K Projectors Olympus4K Cameras

NTT JPEG2000 Codec

SAGE OptIPortal Software: SAGE OptIPortal Software: 10 Wireless Laptop Users All Pushing Their Desktops to the EVL 10 Wireless Laptop Users All Pushing Their Desktops to the EVL

OptIPortal--Goal is a Distributed Gigapixel in 2007OptIPortal--Goal is a Distributed Gigapixel in 2007

Source: Luc Renambot, EVL

A possible model for 4K workflow?

Los Angeles

Seattle

CineGrid Cisco 650610GigE Cisco NLR Wave1& 10 GigE CENIC WavesIEEAF Wave via PNWGP/TLEXCAVEwave (CENIC and NLR via PNWGP)

CineGrid InfrastructureCineGrid Infrastructure

Sunnyvale

CalIT2San Diego

Cisco is building two 10 GigE "Cisco Waves” on NLR on the West Coast and switches for access points in San Diego, Los Angeles,

Sunnyvale, & Seattle for CineGrid

CENIC is making available persistent 1 GigE access ports in San Diego, Los Angeles,

Sunnyvale, & San Francisco for CineGrid and the fiber for 2x10GigE between UCSD and LA

Via GLIF, CineGrid extends to Japan via Seattle & Chicago; to Canada via Seattle & Chicago;

to Europe via Chicago & Amsterdam.Further extension likely to China, Korea, Singapore,

India, New Zealand, Australia, others.

Tokyo

Chicago

Toronto

JGN2 CA*net4

CineGrid DriversCineGrid Drivers

• High-performance media is historically driven by three markets– 1) Entertainment, media, art and culture– 2) Science, medicine, education and research– 3) Military, intelligence, security and police

• All three are in digital convergence and all need: – Fast networking with similar profiles– Access shared instruments, specialized computers and massive storage – Collaboration tools for distributed, remote teams– Robust security to protect intellectual property– Upgraded systems to allow higher quality, greater speed, more distributed

applications– A next generation of trained professionals

CineGrid Target ApplicationsCineGrid Target Applications

• Store-and-forward secure content delivery• Streaming secure content transmission • Pre-production collaborative design & planning• Studio and remote production of sound and picture• Digital dailies, interactive viewing & mark-up• Distributed post production of audio/video• Digital film scanning and restoration• Digital media archiving• Remote calibration and quality control of audio/video• Education of next generation professionals

These and other CineGrid applications will challenge the engineering of networked systems at every level

DCI Digital Cinema SpecificationDCI Digital Cinema Specification20052005

“DIGITAL CINEMA INITIATIVES (DCI) ANNOUNCES FINAL OVERALL SYSTEM REQUIREMENTS AND SPECIFICATIONS FOR DIGITAL CINEMA

Agreement Gives Manufacturers of Digital Projectors and Theater Equipment One Universal Standard in Creating the Next Generation of Cinemas (Hollywood, CA - July 27, 2005)

Digital Cinema Initiatives, LLC (DCI) is a joint venture of Disney, Fox, Paramount, Sony Pictures Entertainment, Universal and Warner Bros. Studios. DCI's primary purpose is to establish and document voluntary specifications for an open architecture for digital cinema that ensures a uniform and high level of technical performance, reliability and quality control.”

• Image format: 2048x1080 (2K) and 4096x2160 (4K) • Color: 12-bits/color, 4:4:4, SMPTE XYZ• Frame rate: 24fps or 48fps for stereo• Compression: JPEG 2000 up to maximum of 250 Mbps for distribution• Encryption: AES 128 for Digital Cinema Package; SHA-2 (256bit) for Key• Watermarking: invisible injection of time/screen ID in projected image

More: TV and Motion Picture Bit RatesMore: TV and Motion Picture Bit Rates(Data from Laurin Herr, Pacific Interface, Inc.)(Data from Laurin Herr, Pacific Interface, Inc.)

Format frame

size in pixels

Mpixels

per frame

frame

rate

Mpixels

per second

frame

aspect ratio

color

encoding

bits per

pixel

frame

rate

uncompressed

bit rate

compressed

bit rate

720p/ 24 1280x72

0

0.92 24 22.1 16x9 =

1.77

YPbPr

4: 2: 2

8 or 10 24 1.5 Gbps (HD-SDI

aka "single link" aka SMPTE 292M)

DVCPRO HD @

100 Mbps

1080p/ 24 1920x1080

2.1 24 50.4 16x9 = 1.77

YPbPr 4: 2: 2

8 or 10 24 1.5 Gbps (HD-SDI aka "single link"

aka SMPTE 292M)

HDCAM @ 140 Mbps

1080p/ 24 1920x10

80

2.1 24 50.4 16x9 =

1.77

RGB 4: 4: 4 8 or 10 24 3.0 Gbps (so-called

"dual link" = 2 x HD-SDI)

HDCAM SR @

440 Mbps (Cameron's

format for Batt le Angels)

2K 2048x1080

2.2 24 53.1 1.896 SMPTE XYZ 4: 4: 4

12 24 1.9 Gbps, but using dual link interface

= 3.0 Gbps

J PEG 2000 @ 125-250 Mbps

4K 4096x2160

8.8 24 212.3 1.896 SMPTE XYZ 4: 4: 4

12 24 7.6 Gbps, but using 4x single link

interface = 6.0 Gbps; or 4x dual

link = 12.0 Gbps

J PEG 200 @ 200 - 400 Mbps

4K Open EXR 4096x21

60

8.8 24 212.3 1.896 RGBA

4: 4: 4: 4

16 24 13.6 Gbps LZW or other

lossless only(post

production format proposed

by ILM/ Pixar)

DCI DIGITAL CINEMA

DIGITAL CINEMA POST PRODUCTION

HD INSTEAD OF FILM

Test your existing network connection to Calit2, for example.

Use IPERF several times to test UDP and TCP performance.

If performance is sub-gigabit/s, use NLR and CENIC, for example, to connect to Calit2.

Engineering CineGrid Example

You

Create a new vlan for your local network

This will bypass local firewalls, expose local switches’ capabilities, motivate new fiber/copper runs, allow fat UDP

Remember, GigE is more than most campuses or businesses connect to the outside.

Engineering CineGrid: 2

You

Either extend this new vlan to Calit2 or route this local vlan to a shared vlan with Calit2.

This obviously takes great cooperation among the institutions and circuit owners.

CineGrid is ALL about arranging cooperation.

Engineering CineGrid: 3

You

Ensure all vlans support Maximum Transmission Unit (mtu) of 9216 (“jumbo frame enabled”).

Ensure all physical interfaces have mtu 9216 support as well.

Engineering CineGrid: 4

You

Set up at least one IP interface to the vlan.

Test the end-to-end connection again with IPERF.

IP interface

Engineering CineGrid: 5

You

Send / receive content

IP interface

Engineering CineGrid: Finale

Source: Brian Dunne, Calit2 You

CineGrid.org Starting in 2007CineGrid.org Starting in 2007

• CineGrid will be established as a non-profit international membership organization administratively based in California, starting early 2007.

• To support members’ research, CineGrid will organize network testbeds prepared to host a variety of experimental digital media projects designed to require very high bandwidth with appropriate security safeguards between a limited number of “trusted” users and systems around the globe.

• CineGrid will periodically organize inter-disciplinary workshops and demonstrations to share results and identify new avenues of research. Education and training of next-generation media professionals is our explicit goal.

Thank You Very Much!Thank You Very Much!

• Our planning, research, and education efforts are made possible, in major part, by

funding from:

– US National Science Foundation (NSF) awards ANI-0225642, EIA-0115809, and

SCI-0441094

– State of California, Calit2 UCSD Division

– State of Illinois I-WIRE Program, and major UIC cost sharing

• Argonne National Laboratory and Northwestern University for StarLight and I-WIRE

networking and management

• National Lambda Rail, Pacific Wave and CENIC

• NTT Network Innovations Lab

• Cisco Systems, Inc.

• Pacific Interface, Inc.

CineGrid NetworkingCineGrid NetworkingAs Prototyped by the OptIPuter ProjectAs Prototyped by the OptIPuter Project

• 4K JPEG2000 compressed video is 500Mb/s—peaks to a gigabit/s• Uncompressed needs 6Gb/s or more• Most campus networks use 10-100Mb/s lans to labs. Some have 1Gb/s.• Most campus networks have 155Mb/s, 622Mb/s or 1Gb/s connections

– Internet connectivity is usually 10s to 100s of Mb/s– Internet2 connectivity is usually 100s of Mb/s to 1Gb/s– A few campuses have 10Gb/s connectivity to Internet2 and/or NLR

• Future connections will widely support 10Gb/s, but not today• However, bandwidth is not the only issue

– Need to use protocols that handle the bandwidth (UDP, not TCP)– It’s rude to use large-flow UDP on shared networks– Firewalls are a problem; large-flows are often shut down – Need fiber/copper to the end device(s) from the campus main switch

• So, at this point, we use virtual local area network (vlan) “layer2” tech– Arguably not scalable, but works, controllable by GMPLS– MPLS has been shown to work as well (with big core routers)