16
Scaling-Up the BIRN “Building on the BIRN” Workshop National Institutes of Health Bethesda, MD March 22, 2004 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technologies Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD

Scaling-Up the BIRN

  • Upload
    zeke

  • View
    33

  • Download
    0

Embed Size (px)

DESCRIPTION

Scaling-Up the BIRN. “Building on the BIRN” Workshop National Institutes of Health Bethesda, MD March 22, 2004. Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technologies Harry E. Gruber Professor, Dept. of Computer Science and Engineering - PowerPoint PPT Presentation

Citation preview

Page 1: Scaling-Up the BIRN

Scaling-Up the BIRN

“Building on the BIRN” Workshop

National Institutes of Health

Bethesda, MD

March 22, 2004

Dr. Larry Smarr

Director, California Institute for Telecommunications and Information Technologies

Harry E. Gruber Professor,

Dept. of Computer Science and Engineering

Jacobs School of Engineering, UCSD

Page 2: Scaling-Up the BIRN

BIRN is a BISTI Leadership Project for the National Institutes of Health

• Biomedical Information Science and Technology Initiative – BISTI Report to NIH Director: June 1999

• Interdisciplinary Teams– Collaborating to Develop Mathematical Models, Write Software and

Adapt Systems• Cooperation with Computer Science in:

– Algorithm, Software, Database and System Development• Improved Access to Computing

– Shared PC Clusters in Biomedical Laboratories to High-Performance Systems in National Centers

• Workforce Development to Encompasses Every Level– Technician to Ph.D.

• New Centers for Research and Teaching – People Competent in Biomedicine and Computation & Mathematics

www.nih.gov/about/director/060399.htm

Botstein-Smarr Report June 1999

Page 3: Scaling-Up the BIRN

Cal-(IT)2--An Integrated Approach the Future of the Internet

www.calit2.net

220 UC San Diego & UC Irvine FacultyWorking in Multidisciplinary Teams

With Students, Industry, and the Community

BIRN Driven

Page 4: Scaling-Up the BIRN

BIRN Cyberinfrastrucure Must Evolve Riding Multiple Exponentials

Scientific American, January 2001

Number of Years0 1 2 3 4 5

Pe

rfo

rma

nc

e p

er

Do

llar

Sp

en

t

Data Storage(bits per square inch)

(Doubling time 12 Months)

Optical Fiber(bits per second)

(Doubling time 9 Months)

Silicon Computer Chips(Number of Transistors)

(Doubling time 18 Months)

Page 5: Scaling-Up the BIRN

Data Intensive e-Science Will Require Common Cross-Agency Cyberinfrastructure

Page 6: Scaling-Up the BIRN

The OptIPuter Project – Removing Bandwidth as an Obstacle In Data Intensive Sciences

• NSF Large Information Technology Research Proposal– Cal-(IT)2 and UIC Lead Campuses—Larry Smarr PI

– Co-PIs Mark Ellisman, Phil Papadopoulos, Tom DeFanti, Jason Leigh – USC, SDSU, NW, Texas A&M, Univ. Amsterdam Partnering Campuses

• Industrial Partners– IBM, Sun, Telcordia/SAIC, Chiaro Networks, Calient, Glimmerglass

• $13.5 Million Over Five Years• Optical IP Streams From Lab Clusters to Large Data Objects NIH Biomedical Informatics NSF EarthScope

and ORION

http://ncmir.ucsd.edu/gallery.html

siovizcenter.ucsd.edu/library/gallery/shoot1/index.shtml

Research Network

Page 7: Scaling-Up the BIRN

What is the OptIPuter?Next Generation Cyberinfrastructure

• Applications Drivers Interactive Large Data Objects

• OptIPuter Nodes Scalable PC Cluster LambdaGrid “Browser”

• IP over Lambda Connectivity Predictable Network

• Open Source LambdaGrid Middleware Can Reserve Network

• Data Retrieval and Mining Global Virtual Disk Drives

• High Def Visualization, Collaboration “UltraReality TV”

Page 8: Scaling-Up the BIRN

See Nov 2003 CACM For Articles on OptIPuter Technologies

BIRN

Page 9: Scaling-Up the BIRN

OptIPuter Driver: On-Line Microscopes CreatingVery Large Biological Montage Images

• 2-Photon Laser Confocal Microscope– High Speed On-line

Capability

• Montage Image Sizes Exceed 16x Highest Resolution Monitors– ~150 Million Pixels!

• Use Graphics Cluster with Multiple GigEs to Drive Tiled Displays

Source: David Lee, NCMIR, UCSD

IBM 9M Pixels

Page 10: Scaling-Up the BIRN

Ultra-Resolution Displays Driven by Graphics Clusters Scaling to 100 Million Pixels

• JuxtaView (UIC EVL) on Tiled LCD GeoWall2– Digital Montage Viewer – 8000x3600 Pixel

Resolution~30M Pixels Now– Building a 75M Pixel Wall

• Display Is Powered By: – 16 PCs with Graphics Cards– 2 Gigabit Networking per PC

• Linked by Dedicated Multi-Gigabit Light Pipes– Research on Adding Stereo

HD Collaboration

Source: Jason Leigh, EVL, UIC; USGS EROS

Brain Microscopy

Page 11: Scaling-Up the BIRN

Exploring High Performance LambdaGrid Collaboration

Falko Kuester, Cal-(IT)2@UCI, Collaboration Laboratory with Smart Boards and

Optically Connected Large ScreensWith UCI Potkin and UCSD Ellisman

BIRN Laboratories

Page 12: Scaling-Up the BIRN

Cyberinfrastructure in Design Phase--

Fiber Optic CablesSatelliteWireless

OptIPuter Driver: Gigabit Fibers on the Ocean FloorNSF’s ORION-Ocean Research Interactive Ocean Network

www.neptune.washington.edu

Based on BIRN Cyberinfrastructure

Page 13: Scaling-Up the BIRN

½ Mile

SIO

SDSC

CRCA

Phys. Sci -Keck

SOM

JSOE Preuss

6th College

SDSCAnnex

Node M

Earth Sciences

SDSC

Medicine

Engineering High School

To CENIC

Collocation

Source: Phil Papadopoulos, SDSC; Greg Hidley, Cal-(IT)2

The UCSD OptIPuter DeploymentUCSD is Prototyping

a Campus-Scale OptIPuter

SDSC Annex

JuniperT320

0.320 TbpsBackplaneBandwidth

20X

ChiaroEstara

6.4 TbpsBackplaneBandwidth

Dedicated Fibers Between Sites Link

Linux Clusters

NCMIR and BIRN CC

Page 14: Scaling-Up the BIRN

14

The 30-Year Old TCP/IP Model of Sharing the Internet Has Its Penalties

Shared Internet2 Speed Limit~50 Mbps

On a 10,000 MbpsBackbone!

(½ of 1% Efficiency)

Similar Results for BIRN

Page 15: Scaling-Up the BIRN

The OptIPuter Will Become aNational-Scale Collaboratory in 2004

Source: Tom West, CEO, NLR

Chicago OptIPuter

StarLightNU, UIC

SoCalOptIPuter

USC, UCI UCSD, SDSU

“National Lambda Rail” PartnershipServes Very High-End Experimental and Research Applications

4 x 10Gb Wavelengths Initially Capable of 40 x 10Gb wavelengths at Buildout

NASA Ames

NASA Goddard

NEPTUNE

In Discussion

Paves the Wayfor “BIRN II”

Page 16: Scaling-Up the BIRN

OptIPuter Infrastructure Is International: Global Lambda Integrated Facility: GLIF

DWDM SURFnet

10 Gbit/s

SURFnet10 Gbit/s

SURFnet10 Gbit/s

IEEAF10 Gbit/s

DwingelooASTRON/JIVE

DwingelooASTRON/JIVE

PragueCzechLight

PragueCzechLight

2.5 Gbit/s

NSF10 Gbit/s

StockholmNorthernLight

StockholmNorthernLight

CA*net4

2.5 Gbit/s

New YorkMANLANNew YorkMANLAN

TokyoWIDETokyoWIDE

10 Gbit/s

10 Gbit/s

10 Gbit/s

10 Gbit/sIEEAF

10 Gbit/s

10 Gbit/s

10 Gbit/s

2.5 Gbit/s

2.5 Gbit/s

TokyoAPANTokyoAPAN

AmsterdamNetherLightAmsterdamNetherLight

GenevaCERN

GenevaCERN

LondonUKLightLondonUKLight

ChicagoStarLightChicagoStarLight

Source: Kees Neggers, SURFnet