Building CineGrid on GLIF

Tom DeFanti Research Scientist

California Institute for Telecommunications and Information TechnologyUniversity of California, San Diego

Distinguished Professor Emeritus of Computer ScienceUniversity of Illinois at Chicago

Laurin HerrPacific Interface, Inc.

Digital Movies and Beyond

4K x 24

2K x 24

HD2 x 30

HD x 24 - 60

HDV x 24 - 60

4K2 x 24/30

2K2 x 24

8K x 60

Consumer HD

HDTV

Stereo HD

Digital Cinema

Stereo 4K

8K (projector)

25 Mbps

100 Mbps - 1.5 Gbps

200 Mbps - 3 Gbps

250 Mbps - 7.6 Gbps

500 Mbps - 15.2 Gbps

1 - 24 Gbps

Tiled Displays10 - 100’s Gbps 10s to 100’s of Megapixels

Source: Laurin Herr

Economic Impact of Cinema in California Major Employment from Movie Industry in California by County

In 2005, movie production provided employment for over 245,000 Californians, with an associated payroll of more than $17 billion

A 2-hour movie digitally scanned and compressed at 500Mb/s takes 450 GBytes

Hollywood alone makes 250 movies a year

http://www.google.com/maps?q=http://research.calit2.net/a2i/ca.kmz

Source: Laurin Herr and Jerry Sheehan

CiscoWave: New Capacity for CineGrid Members

CiscoWave core PoP

10GE waves on NLR and CENIC (LA to SD)

Equinix818 W. 7th St.Los Angeles

PacificWave1000 Denny Way(Westin Bldg.)Seattle

Level31360 Kifer Rd.Sunnyvale

StarLightNorthwestern UnivChicago

Calit2San Diego

McLean

CENIC Wave Cisco has built 10 GigE waves on NLR and installed big 6506 switches for access points in

San Diego, Los Angeles, Sunnyvale, Seattle, Chicago and McLean for CineGrid MembersSome of these points are also GLIF GOLEs

Source: John (JJ) Jamison

What is CineGrid?

CineGrid is a non-profit international membership organization established in 2007 based on collaborative efforts, since iGrid 2002 in Amsterdam, of leaders in the fields of advanced networking and digital media technology from Japan, America, Canada, and Europe.

CineGrid is building an interdisciplinary community for the research, development, and demonstration of networked collaborative tools to enable the production, use, and exchange of very high-quality digital media over photonic networks.

CineGrid is built on GLIF links by GLIF members.

CineGrid organizes major demonstrations with many GLIF users.

Historic Convergence Motivates CineGrid

• State of the art of visualization is always driven by three communities– Entertainment, media, art and culture– Science, medicine, education and research– Military, intelligence, security and police

• All three communities are converting to digital media with converging requirements

– Fast networking with similar profiles– Access shared instruments, specialized computers and massive storage – Collaboration tools for distributed, remote teams– Robust security for their intellectual property– Upgraded systems to allow higher visual quality, greater speed, more

distributed applications– A next generation of trained professionals

CineGrid Founding Members

• Keio University DMC• Lucasfilm Ltd. • NTT Network Innovation Laboratories • Pacific Interface Inc.• Ryerson University/Rogers Communications Centre• San Francisco State University/INGI• Sony Electronics America • University of Amsterdam • University of California San Diego/Calit2/CRCA• University of Illinois Chicago/EVL • University of Illinois at Urbana-Champaign/NCSA• University of Southern California/School of Cinematic Arts• University of Washington/Research ChannelThe Founding Members of CineGrid are an extraordinary mix of media

arts schools, research universities, and scientific laboratories connected by 1GE and 10GE networks used for research and

education

CineGrid Institutional Members

• California Academy of Sciences• Dark Strand• JVC America• Louisiana State University CCT• Nortel Networks• Renaissance Computing Institute (RENCI)• Sharp Labs USA• Sharp Corporation• Tohoku University/Kawamata Laboratory• Waag Society

CineGrid members operate their own digital media facilities and cyberinfrastructure for digital cinema and HDTV production, post-

production, distribution and exhibition distributed on a global scale, as well as for telepresence, distance learning and scientific

visualization.

CineGrid Network / Exchange Members

• CANARIE• CENIC• CESNET• Cisco Systems• CzechLight• Japan Gigabit Network 2• National LambdaRail• NetherLight• PacificWave• Pacific North West GigaPOP• StarLight • SURFnet• WIDE

CineGrid Network/Exchange Members are GLIF Members too

CineGrid Members’ Research

• Live performance streaming/video conferencing in 4K and HD with multi-channel sound, point-to-point, one-to-many, and many-to-one

• Remote recording of uncompressed 4K camera output in real-time• Stereoscopic motion pictures - acquisition, computer generation and display

• Networked multi-channel audio solutions with low latency, accurate sync• Remote collaboration workflows and interactive creative tools

• Use of dynamic optical networks• Collaboration on tiled displays to 100s of megapixels

• Digital archiving, long-term preservation, and secure distribution• Digital media format conversion, compression and enhancement• Digital film restoration using distributed cluster computing resources

• Training and methodologies for next generation media professionals

Digital Cinema at Calit2 200 seats 1GE to every seat 4K 10000-lumen Sony SXRD 10.2 sound 10GE networking to the

projector servers: NTT JPEG2000 Zaxel Zaxstar Dell/Nvidia graphics

CineGrid Node at Keio University/DMC, Tokyo

SXRD-105 4K Projector

Imagica 4K Imagica 4K Film ScannerFilm Scanner

Sony 4K Projectors Olympus4K Cameras

NTT JPEG2000 Codec

Presentation in 4KPresentation in 4K

• Sony’s SXRD 4K projector (5000 or 10000 lumens)– R for Digital Cinema HD-SDI inputs, S for DVI inputs

• JVC’s 4K projector (3500 lumens)– Good for rear projection--see it at SC07

• Chimei’s Quad-HD LCD panels– Toshiba, Astro Design, Barco(?),others

• Sharp’s DCI 4K LCD displays– DCI Cinema Specification (10-bit color, etc.)

• OptIPortal Tiled-display for more than 4K

Source: Dr. Ohta, Keio University

Shooting 4K: Digital Motion Picture CamerasShooting 4K: Digital Motion Picture Cameras

• Olympus OctaVision (Quad-HD: 3840 x 2160) – Developed 5 years ago

– Real-time transmission of quad-HD

• Dalsa Origin II– Cinema lens is available

– De-Bayering is necessary

• REDQuickTime˛ Ç∆

TIFFÅià≥èkǻǵÅj êLí£ÉvÉçÉOÉâÉÄǙDZÇÃÉsÉNÉ`ÉÉÇ å©ÇÈÇΩÇflÇ…ÇÕïKóvÇ≈Ç∑ÅB

Source: Dr. Ohta, Keio University

Coming: Sony 4K Camera

Live 4K Video via JPEG2000 (Sender)Live 4K Video via JPEG2000 (Sender)

4K motion picture camera

4 x HD-SDI

ADAT (to HDSP 9652)

4K JPEG2000 Encoder

HD-SDISW

1-10 Gb/s

JPEG2000 Board

Only way to do this today

Source: Dr. Ohta, Keio University

Live 4K Video via JPEG2000 (Receiver)

ADAT from HDSP 9652

4K JPEG2000 Decoder

JPEG2000 Board

1-10 Gb/s

4K Auditorium

4K Projector

Source: Dr. Ohta, Keio University

Everyday 4K Pre-encoded File StreamingEveryday 4K Pre-encoded File Streaming

1Gb/s E

ADAT form HDSP 9652Encoded File

WAV File

Streaming ServerStreaming Server 4K JPEG2000 Decoder

Source: Dr. Ohta, Keio University

Shooting Scene in MilanShooting Scene in Milan

3840x216024Psf

10bit UDR

HD-SDI

3840x216024Psf

10bit lin

3840x216029.97 Psf10bit lin

File naming & Numbering

HD CRTHD CRT

Rec. 709 D65 G2.2

Optical Fiber(up to 300 meters)

4K HDDRecorder Portable

4K HDDRecorder Portable

HD CRTHD CRT

Rec. 709 D65 G2.2

ConverterConverter

BNC carries HD-SDI 10-bit 4:2:2 single-link SMPTE 292MOptical fiber carries: 4 HD-SDI

Back Up

17” LCD17” LCD

Rec. 709 D65 G2.2

WFMWFM

OlympusOctavision

Camera

OlympusOctavision

Camera

WFMWFM

DuomoDuomo CSCCSC

RAID5 4K HDD Recorder

Station

4K HDD Recorder

Station

RAID5OlympusRecorderOlympusRecorder

Production Workflow Recording(Olympus OctaVision Case)

Source: Dr. Ohta, Keio University

HD CRTHD CRT

DSMDSM

DCDM

DCDM

Screen(SXRD)Screen(SXRD)

Rec. 709 D65 G2.2 Rec. 709 D65 G2.6

XSANXSAN Quantel iQ(Pablo)

Quantel iQ(Pablo)

3840x216024Psf

16bit Tiff

4096x216024Psf

16bit Tiff

GbE

4096x216024Psf

10bit DPX lin

DoremiEncoderDoremiEncoder

HDSDI

4096x216024Psf

12bit jpeg2000 lin

DCICompliant

Server

DCICompliant

Server

Finishing (Titling etc.)

4K Rendering

Offline & Online Editing

16bit

Tiff

16bit

Tiff

Final Cut ProFinal Cut Pro

Offline Editing (rough)

Resize 4K to 1280x720

Select and Delete Images

Import Selected images

Digital Color Grading

RomeRomeMilanoMilanoScreeningScreening

DCPDCP

Exchange Format ?

Post Production Workflow Example

Source: Dr. Ohta, Keio University

4K Pure Cinema Joint Field Trial 2005WB-NTT-TOHO via CineGrid

NTT GemNet21 Gbps

Seattle 　

Los Angeles

Japan 　 US 　

Tokyo 　

Osaka 　Distribution

center1（ＮＴＴ West ）

Theater C（ Toho ）

ＮＴＴ’ sFiber

network

CineGrid 1 Gbps

GDMX* （ WBEI ）

GDMX* （ WBEI ）

NTT’sFiber

network

Yokosuka 　

Theater A（ Toho ）

Theater B （ Toho ）

Compression,Encryption, File wrapping

1 Gbps1 Gbps

Key cente

rKey management

* Global Digital Media Xchange

Distributioncenter 2(NTT) Dubbing

, Subtitling

1 Gbps

DaibaRoppongiTakatsuki

Studio 　　　　（ WBEI ）

Studio 　　　　（ WBEI ）

BurbankColor adjust, Quality control

CineGrid@AES October 2006

Keio DMCTokyo

CineGrid International

Networks

LDAC Premiere Theater

UCSD San Diego USC LA

SyncNTT JPEG2000 Servers

Sony 4K

Audio

CineGrid CaliforniaNetworks

ProTools Audio Server

Yamaha Mixers

Sync

DVTS Sony DV

NTT JPEG2000

CODEC and Server

Olympus 4KCamera

CineGrid @ AES 2006Keio Wagner Society String Ensemble

Holland Fest (6/20-22/07) on CineGrid

• “ERA LA NOTTE” Star soprano Anna Maria Antonacci sang solo madrigals from the Italian baroque in the setting of a theatrical concert (http://www.hollandfestival.nl/#festival/voorstelling/9043 )

• 4K transmission– JPEG2000 Compressed (500Mb/s) via

IRNC/C(ON)2/CAVEwave to Calit2 on Wednesday

– Uncompressed via IRNC/JGN2 to Keio on Friday (8bGb/s)

• DVCPRO-HD transmission– Compressed (135MB/s) via

IRNC/C(ON)2/CAVEwave to Calit2 on Thursday

– Replicated and sent to USC, UW, UIC, Ryerson, (Stockholm), Barcelona, (Prague) as 135Mb/s streams, decoded by PCs

• All done with vlans set up in a week or so

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Swimming Fiber the Last 500m to the Muziekgebouw

Photo: Ronald van der Pol

HD-SDI

HD-SDI

AJA

GE

2x GE

GE

10 GE

10 GE

PC with iHDTV

PC with iHDTV

Remote baselight console

Baselight output

SONY SXRD projector

Baselight

C7604

e300

DVCPRO HDCameraVideoconf input

HD-SDI

starlight

Pow er Cal l IR LAN

Qvidium gateway

Pow er Cal l IR LAN

Qvidium gateway

PC with Qvidium SW

PC with Qvidium SW

Videoconferenceoutput

Videoconferenceoutput

DVCPRO HDCameraVideoconf input

GE

HD-SDI2x GE

GE

GEGE

i-Link

i-Link

COLOR CORRECTION SETUP – GLIF Demo

Summary: CineGrid on GLIF

• A new goal for GOLEs: global access to cinema production & post production– Geographic location need no longer be a barrier to your customers

creating with the highest media production quality– You can bring your local talent and facilities to distant places– You can show support for your projects nationally and

internationally– You will point to increased revenue and employment growth in

your media industries working with world-wide collaborators, as well as observable bandwidth utilization of GLIF-style networks

Thank You Very Much!

• Our planning, research, and education efforts are made

possible, in major part, by funding from:

– US National Science Foundation (NSF) awards ANI-0225642, EIA-

0115809, and SCI-0441094

– State of California, Calit2 UCSD Division

– State of Illinois I-WIRE Program, and major UIC cost sharing

• Argonne National Laboratory and Northwestern University for

StarLight networking and management

• National Lambda Rail, Pacific Wave and CENIC

• NTT Network Innovations Lab

• Cisco Systems, Inc.

• Pacific Interface, Inc.