HENP HENP Networks and Grids for Networks and Grids for Global Virtual Organizations Global Virtual Organizations

Harvey B. NewmanHarvey B. Newman California Institute of TechnologyCalifornia Institute of TechnologyTIP2004, Internet2 HENP WG SessionTIP2004, Internet2 HENP WG Session

January 25, 2004January 25, 2004

The Challenges of Next Generation Science in the Information Age

The Challenges of Next Generation Science in the Information Age

Flagship Applications Flagship Applications High Energy & Nuclear Physics, AstroPhysics Sky Surveys:High Energy & Nuclear Physics, AstroPhysics Sky Surveys:

TByte to PByte “block” transfers at 1-10+ Gbps TByte to PByte “block” transfers at 1-10+ Gbps eVLBI:eVLBI: Many real time data streams at 1-10 Gbps Many real time data streams at 1-10 Gbps BioInformatics, Clinical Imaging:BioInformatics, Clinical Imaging: GByte images on demand GByte images on demand

HEP Data Example: HEP Data Example: From Petabytes in 2003, ~100 Petabytes by 2007-8, From Petabytes in 2003, ~100 Petabytes by 2007-8,

to ~1 Exabyte by ~2013-5. to ~1 Exabyte by ~2013-5. Provide results with rapid turnaround, coordinating Provide results with rapid turnaround, coordinating

large but limited computing and data handling resources,large but limited computing and data handling resources,over networks of varying capability in different world regionsover networks of varying capability in different world regions

Advanced integrated applications, such as Data Grids, Advanced integrated applications, such as Data Grids, rely on seamless operation of our LANs and WANsrely on seamless operation of our LANs and WANs With reliable, quantifiable high performanceWith reliable, quantifiable high performance

Petabytes of complex data explored and analyzed by Petabytes of complex data explored and analyzed by 1000s of globally dispersed scientists, in hundreds of teams1000s of globally dispersed scientists, in hundreds of teams

First Beams: April 2007Physics Runs: from Summer 2007

TOTEM pp, general purpose; HI

pp, general purpose; HI

LHCb: B-physics

ALICE : HI

pp s =14 TeV L=1034 cm-2 s-1

27 km Tunnel in Switzerland & France

Large Hadron Collider (LHC) CERN, Geneva: 2007 Start

Large Hadron Collider (LHC) CERN, Geneva: 2007 Start

CMS

ATLASAtlas

Four LHC Experiments: The Four LHC Experiments: The Petabyte to Exabyte Petabyte to Exabyte

ChallengeChallengeATLAS, CMS, ALICE, LHCBATLAS, CMS, ALICE, LHCB

Higgs + New particles; Quark-Gluon Plasma; CP ViolationHiggs + New particles; Quark-Gluon Plasma; CP Violation

Tens of PB 2008; To 1 EB by ~2015Tens of PB 2008; To 1 EB by ~2015 Hundreds of TFlops To PetaFlops Hundreds of TFlops To PetaFlops

6000+ Physicists & Engineers; 60+ Countries;

250 Institutions

All charged tracks with pt > 2 GeV

Reconstructed tracks with pt > 25 GeV

(+30 minimum bias events)

109 events/sec, selectivity: 1 in 1013 (1 person in a thousand world populations)

LHC: Higgs Decay into 4 muons (Tracker only); 1000X LEP Data Rate

LHC: Higgs Decay into 4 muons (Tracker only); 1000X LEP Data Rate

LHC Data Grid Hierarchy:Developed at Caltech

LHC Data Grid Hierarchy:Developed at Caltech

Tier 1

Tier2 Center

Online System

CERN Center PBs of Disk;

Tape Robot

FNAL CenterIN2P3 Center INFN Center RAL Center

InstituteInstituteInstituteInstitute

Workstations

~100-1500 MBytes/sec

2.5-10 Gbps

0.1 to 10 GbpsTens of Petabytes by 2007-8.An Exabyte ~5-7 Years later.Physics data cache

~PByte/sec

~10 Gbps

Tier2 CenterTier2 CenterTier2 Center

~2.5-10 Gbps

Tier 0 +1

Tier 3

Tier 4

Tier2 Center Tier 2

Experiment

CERN/Outside Resource Ratio ~1:2Tier0/( Tier1)/( Tier2) ~1:1:1

Emerging Vision: A Richly Structured, Global Dynamic System

Bandwidth Growth of Int’l HENP Bandwidth Growth of Int’l HENP Networks (US-CERN Example)Networks (US-CERN Example)

Bandwidth Growth of Int’l HENP Bandwidth Growth of Int’l HENP Networks (US-CERN Example)Networks (US-CERN Example)

Rate of Progress >> Moore’s Law. Rate of Progress >> Moore’s Law. (US-CERN Example)(US-CERN Example) 9.6 kbps Analog9.6 kbps Analog (1985) (1985) 64-256 kbps Digital (1989 - 1994) [X 7 – 27]64-256 kbps Digital (1989 - 1994) [X 7 – 27] 1.5 Mbps Shared (1990-3; IBM) [X 160]1.5 Mbps Shared (1990-3; IBM) [X 160] 2 -4 Mbps2 -4 Mbps (1996-1998) [X 200-400] (1996-1998) [X 200-400] 12-20 Mbps (1999-2000) [X 1.2k-2k]12-20 Mbps (1999-2000) [X 1.2k-2k] 155-310 Mbps155-310 Mbps (2001-2) [X 16k – 32k] (2001-2) [X 16k – 32k] 622 Mbps622 Mbps (2002-3) [X 65k] (2002-3) [X 65k] 2.5 Gbps 2.5 Gbps (2003-4) [X 250k] (2003-4) [X 250k] 10 Gbps 10 Gbps (2005) [X 1M] (2005) [X 1M]

A factor of ~1M over a period of 1985-2005 A factor of ~1M over a period of 1985-2005 (a factor of ~5k during 1995-2005)(a factor of ~5k during 1995-2005)

HENP has become a leading applications driver, HENP has become a leading applications driver, and also a co-developer of global networks; and also a co-developer of global networks;

* 9/01 105 Mbps 30 Streams: SLAC-IN2P3; 102 Mbps 1 Stream CIT-CERN9/01 105 Mbps 30 Streams: SLAC-IN2P3; 102 Mbps 1 Stream CIT-CERN 5/20/02 450-600 Mbps SLAC-Manchester on OC12 with ~100 Streams5/20/02 450-600 Mbps SLAC-Manchester on OC12 with ~100 Streams 6/1/02 290 Mbps Chicago-CERN One Stream on OC12 6/1/02 290 Mbps Chicago-CERN One Stream on OC12 9/02 9/02 850, 1350, 1900 Mbps Chicago-CERN 1,2,3 GbE Streams, 2.5G Link850, 1350, 1900 Mbps Chicago-CERN 1,2,3 GbE Streams, 2.5G Link 11/02 [LSR] 930 Mbps in 1 Stream California-CERN, and California-AMS 11/02 [LSR] 930 Mbps in 1 Stream California-CERN, and California-AMS FAST TCP 9.4 Gbps in 10 Flows California-Chicago FAST TCP 9.4 Gbps in 10 Flows California-Chicago 2/03 [LSR] 2.38 Gbps in 1 Stream California-Geneva (99% Link Utilization)2/03 [LSR] 2.38 Gbps in 1 Stream California-Geneva (99% Link Utilization) 5/03 [LSR] 0.94 Gbps IPv6 in 1 Stream Chicago- Geneva5/03 [LSR] 0.94 Gbps IPv6 in 1 Stream Chicago- Geneva TW & SC2003: 5.65 Gbps (IPv4), 4.0 Gbps (IPv6) in 1 Stream Over 11,000 km TW & SC2003: 5.65 Gbps (IPv4), 4.0 Gbps (IPv6) in 1 Stream Over 11,000 km

HEP is Learning How to Use Gbps Networks Fully: Factor of ~50 Gain in Max. Sustained TCP Thruput

in 2 Years, On Some US+Transoceanic Routes

HEP is Learning How to Use Gbps Networks Fully: Factor of ~50 Gain in Max. Sustained TCP Thruput

in 2 Years, On Some US+Transoceanic Routes

FAST TCP: Baltimore/Sunnyvale

1 flow 2 flows 7 flows 9 flows 10 flows

Average utilization

95%

92%

90%

90%

88%

Measurements 11/02 Std Packet Size Utilization averaged

over > 1hr 4000 km Path

Fast convergence to equilibriumFast convergence to equilibrium RTT estimation: fine-grain timerRTT estimation: fine-grain timer Delay monitoring in equilibriumDelay monitoring in equilibrium Pacing: reducing burstinessPacing: reducing burstiness

Fair SharingFair SharingFast RecoveryFast Recovery

8.6 Gbps;8.6 Gbps;21.6 TB 21.6 TB

in 6 Hoursin 6 Hours

9G

10G

Fall 2003: Transatlantic Ultraspeed TCP TranfersFall 2003: Transatlantic Ultraspeed TCP TranfersThroughput Achieved: X50 in 2 yearsThroughput Achieved: X50 in 2 years

Juniper, HP

Level(3)Telehous

e

Terabyte Transfers by the Caltech-CERN Team: Nov 18: 4.00 Gbps IPv6 Geneva-Phoenix (11.5 kkm) Oct 15: 5.64 Gbps IPv4 Palexpo-L.A. (10.9 kkm)

Across Abilene (Internet2) Chicago-LA, Sharing with normal network traffic

Peaceful Coexistence with a Joint Internet2-Telecom World VRVS Videoconference

Nov 19: 23+ Gbps TCP: Caltech, Nov 19: 23+ Gbps TCP: Caltech, SLAC, CERN, LANL, UvA, ManchesterSLAC, CERN, LANL, UvA, Manchester

HENP Major Links: Bandwidth Roadmap (Scenario) in Gbps

HENP Major Links: Bandwidth Roadmap (Scenario) in Gbps

Year Production Experimental Remarks

2001 0.155 0.622-2.5 SONET/SDH

2002 0.622 2.5 SONET/SDH DWDM; GigE Integ.

2003 2.5 10 DWDM; 1 + 10 GigE Integration

2005 10 2-4 X 10 Switch; Provisioning

2007 2-4 X 10 ~10 X 10; 40 Gbps

1st Gen. Grids

2009 ~10 X 10 or 1-2 X 40

~5 X 40 or ~20-50 X 10

40 Gbps Switching

2011 ~5 X 40 or

~20 X 10

~25 X 40 or ~100 X 10

2nd Gen Grids Terabit Networks

2013 ~Terabit ~MultiTbps ~Fill One Fiber

Continuing the Trend: ~1000 Times Bandwidth Growth Per Decade;We are Rapidly Learning to Use Multi-Gbps Networks Dynamically

HENP Lambda Grids:Fibers for Physics

HENP Lambda Grids:Fibers for Physics

Problem: Extract “Small” Data Subsets of 1 to 100 Terabytes Problem: Extract “Small” Data Subsets of 1 to 100 Terabytes from 1 to 1000 Petabyte Data Storesfrom 1 to 1000 Petabyte Data Stores

Survivability of the HENP Global Grid System, with Survivability of the HENP Global Grid System, with hundreds of such transactions per day (circa 2007)hundreds of such transactions per day (circa 2007)requires that each transaction be completed in a requires that each transaction be completed in a relatively short time. relatively short time.

Example: Take 800 secs to complete the transaction. ThenExample: Take 800 secs to complete the transaction. Then Transaction Size (TB)Transaction Size (TB) Net Throughput (Gbps)Net Throughput (Gbps) 1 101 10 10 10010 100 100 1000 (Capacity of 100 1000 (Capacity of

Fiber Today) Fiber Today) Summary: Providing Switching of 10 Gbps wavelengthsSummary: Providing Switching of 10 Gbps wavelengths

within ~2-4 years; and Terabit Switching within 5-8 years within ~2-4 years; and Terabit Switching within 5-8 years would enable “Petascale Grids with Terabyte transactions”,would enable “Petascale Grids with Terabyte transactions”,to fully realize the discovery potential of major HENP programs, to fully realize the discovery potential of major HENP programs, as well as other data-intensive research.as well as other data-intensive research.

National Light Rail FootprintNational Light Rail Footprint

15808 Terminal, Regen or OADM siteFiber route

NLRStarting Up NowInitially 4 10 Gb

WavelengthsFuture: to 40 10Gb Waves

Transition beginning now to optical, multi-wavelength R&E networks. Also Note: XWIN (Germany); IEEAF/GEO plan for dark fiber in Europe

PITPIT

PORPOR

FREFRE

RALRAL

WALWAL

NASNASPHOPHO

OLGOLGATLATL

CHICHI

CLECLE

KANKAN

OGDOGDSACSAC BOSBOSNYCNYC

WDCWDC

STRSTR

DALDAL

DENDEN

LAXLAX

SVLSVL

SEASEA

SDGSDG

JACJAC

GLIF network 1Q2004:“Global Lambda Integrated Facility”

GLIF network 1Q2004:“Global Lambda Integrated Facility”

DWDM DWDM SURFnet SURFnet

lambda service pathlambda service path

IP service pathIP service path

10 Gbit/s10 Gbit/s

SURFnetSURFnet10 Gbit/s10 Gbit/s

SURFnetSURFnet10 Gbit/s10 Gbit/s

IEEAFIEEAF10 Gbit/s10 Gbit/s

DwingelooDwingelooASTRON/JIVEASTRON/JIVE

DwingelooDwingelooASTRON/JIVEASTRON/JIVE

PraguePragueCzechLightCzechLight

PraguePragueCzechLightCzechLight

2.5 Gbit/s2.5 Gbit/s

NSFNSF10 Gbit/s10 Gbit/s

LondonLondonUKLightUKLightLondonLondonUKLightUKLight

StockholmStockholmNorthernLightNorthernLight

StockholmStockholmNorthernLightNorthernLight

2.5 Gbit/s 2.5 Gbit/s

New YorkNew YorkMANLANMANLANNew YorkNew YorkMANLANMANLAN

TokyoTokyoWIDEWIDETokyoTokyoWIDEWIDE

10 10 Gbit/s Gbit/s

1010Gbit/sGbit/s

10 Gbit/s10 Gbit/s(2/29 ?)(2/29 ?)

2x10 2x10 Gbit/sGbit/s

IEEAFIEEAF10 10

Gbit/sGbit/s

2x10 2x10 Gbit/sGbit/s

10 Gbit/s10 Gbit/s

2.5 Gbit/s 2.5 Gbit/s

2.5 Gbit/s2.5 Gbit/sTokyoTokyoAPANAPANTokyoTokyoAPANAPAN

GenevaGenevaCERNCERN

GenevaGenevaCERNCERN

ChicagoChicagoChicagoChicago AmsterdamAmsterdamAmsterdamAmsterdam

(2/29 )(2/29 )

Aarnet: SXTransport Project in 2004Aarnet: SXTransport Project in 2004 Connect Major Australian Universities to 10 Gbps BackboneConnect Major Australian Universities to 10 Gbps Backbone Two 10 Gbps Research Links to the USTwo 10 Gbps Research Links to the US Aarnet/USLIC Collaboration on Net R&D Starting NowAarnet/USLIC Collaboration on Net R&D Starting Now

GLORIAD: Global Optical Ring (US-Ru-Cn)GLORIAD: Global Optical Ring (US-Ru-Cn)““Little Gloriad” (OC3) Launched January 12; to OC192 in 2004Little Gloriad” (OC3) Launched January 12; to OC192 in 2004

Germany: 2003, 2004, 2005Germany: 2003, 2004, 2005

GWIN Connects 550 Universities, Labs, Other InstitutionsGWIN Connects 550 Universities, Labs, Other Institutions

GWIN: Q4/03GWIN: Q4/03 GWIN: Q4/04GWIN: Q4/04PlanPlan

XWIN: Q4/05XWIN: Q4/05((Dark Fiber Option)Dark Fiber Option)

The original Computational and Data Grid concepts are The original Computational and Data Grid concepts are largely stateless, open systems: known to be scalable largely stateless, open systems: known to be scalable

Analogous to the WebAnalogous to the WebThe classical Grid architecture has a number of implicit The classical Grid architecture has a number of implicit

assumptionsassumptions The ability to locate and schedule suitable resources,The ability to locate and schedule suitable resources,

within a tolerably short time (i.e. resource richness) within a tolerably short time (i.e. resource richness) Short transactions with relatively simple failure modesShort transactions with relatively simple failure modes

HENP Grids are HENP Grids are Data Intensive & Resource-ConstrainedData Intensive & Resource-Constrained 1000s of users competing for resources at 100s of sites1000s of users competing for resources at 100s of sites Resource usage governed by local and global policiesResource usage governed by local and global policies Long transactions; some long queuesLong transactions; some long queues

HENP HENP Stateful, End-to-end Monitored and Tracked ParadigmStateful, End-to-end Monitored and Tracked Paradigm Adopted in OGSA, Now WS Resource FrameworkAdopted in OGSA, Now WS Resource Framework

Classical, HENP Data Grids, and Classical, HENP Data Grids, and Now Service-Oriented GridsNow Service-Oriented Grids

19Caltech GAE Team

The Grid Analysis Environment (GAE)The Grid Analysis Environment (GAE)

The GAE: key to “success” or “failure” for physics & Grids in the LHC era:The GAE: key to “success” or “failure” for physics & Grids in the LHC era: 100s - 1000s of tasks, with a wide range of computing, data 100s - 1000s of tasks, with a wide range of computing, data

and network resource requirements, and priorities and network resource requirements, and priorities

The Move to OGSA and then The Move to OGSA and then Managed Integration SystemsManaged Integration Systems

Incr

ease

d f

un

ctio

nal

ity,

stan

dar

diz

atio

n

Time

Customsolutions

Open GridServices Arch

GGF: OGSI, …(+ OASIS, W3C)

Multiple implementations,including Globus Toolkit

Web services + …

Globus Toolkit

Defacto standardsGGF: GridFTP, GSI

X.509,LDAP,FTP, …

App-specificServices~Integrated Systems~Integrated Systems

Stateful; ManagedWeb Serv

Resrc Framwk

Managing Global Systems: Dynamic Managing Global Systems: Dynamic Scalable Services ArchitectureScalable Services Architecture

MonALISA: http://monalisa.cacr.caltech.edu

““Station Server” Services-enginesStation Server” Services-engines at sites host “Dynamic Services” at sites host “Dynamic Services” Auto-discovering, CollaborativeAuto-discovering, Collaborative Scalable to thousands of Scalable to thousands of

service-Instances service-Instances Servers interconnect dynamically; Servers interconnect dynamically;

form a robust fabric form a robust fabric Service Agents: Goal-Oriented, Service Agents: Goal-Oriented,

Autonomous, Adaptive Autonomous, Adaptive Adaptable to Web services: Adaptable to Web services:

many platforms & working many platforms & working environments (also mobile)environments (also mobile)

StationStationServerServer

StationStationServerServer

StationStationServerServer

LookupLookupServiceService

LookupLookupServiceService

Proxy ExchangeProxy Exchange

Registration

Registration

Service Listener

Service Listener

Lookup Lookup Discovery Discovery

ServiceService

Remote Notification

Remote Notification

Dynamic Distributed Services Dynamic Distributed Services Architecture (DDSA)Architecture (DDSA)

Caltech/UPB (Romania)/NUST (Pakistan) Collaboration

See http://monalisa.cacr.caltech.edu http://diamonds.cacr.caltech.edu

23Caltech GAE Team

GAE ArchitectureGAE Architecture Analysis Clients talk

standard protocols to the “Grid Services Web Server”, a.k.a. the Clarens data/services portal.

Simple Web service API allows Analysis Clients (simple or complex) to operate in this architecture.

Typical clients: ROOT, Web Browser, IGUANA, COJAC

The Clarens portal hides the complexity of the Grid Services from the client, but can expose it in as much detail as req’d for e.g. monitoring.

Key features: Global Scheduler, Catalogs, Monitoring, and Grid-wide Execution service.

SchedulerCatalogs

Analysis Client

Grid ServicesWeb Server

ExecutionPriority

Manager

Grid WideExecutionService

DataManagement

Fully-ConcretePlanner

Fully-AbstractPlanner

Analysis Client

AnalysisClient

Virtual Data

Replica

ApplicationsMonitoring

Partially-AbstractPlanner

Metadata

HTTP, SOAP, XML/RPC

24Caltech GAE Team

GAE ArchitectureGAE Architecture

The GAE, based on Clarens and Web services, easily allows a “Peer-to-Peer” configuration to be built, with associated robustness and scalability features.

Flexible: allows easy creation, use and management of highly complex VO structures.

A typical Peer-to-Peer scheme would involve the Clarens servers acting as “Global Peers,” that broker GAE client requests among all the Clarens servers available worldwide.

“Structured Peer-to-Peer”

Integrated hybrid experimental network, leveraging Transatlantic Integrated hybrid experimental network, leveraging Transatlantic R&D network partnerships; packet-switched + dynamic optical paths R&D network partnerships; packet-switched + dynamic optical paths 10 GbE across US and the Atlantic: NLR, DataTAG, TransLight, 10 GbE across US and the Atlantic: NLR, DataTAG, TransLight,

NetherLight, UKLight, etc.; Extensions to Japan, Taiwan, BrazilNetherLight, UKLight, etc.; Extensions to Japan, Taiwan, Brazil End-to-end monitoring; Realtime tracking and optimization; End-to-end monitoring; Realtime tracking and optimization;

Dynamic bandwidth provisioningDynamic bandwidth provisioning Agent-based services spanning all layers of the system, from the Agent-based services spanning all layers of the system, from the

optical cross-connects to the applications.optical cross-connects to the applications.

National Lambda RailNational Lambda Rail

UltraLight Collaboration:UltraLight Collaboration:http://ultralight.caltech.eduhttp://ultralight.caltech.edu

Caltech, UF, FIU, UMich, SLAC,FNAL,MIT/Haystack,CERN, UERJ(Rio), NLR, CENIC, UCAID,Translight, UKLight, Netherlight, UvA, UCLondon, KEK, Taiwan

Cisco, Level(3)

Flagship Applications(HENP, VLBI, Oncology, …)

Grid/Storage Management

Network Protocols &Bandwidth Management

En

d-t

o-e

nd

Mo

nit

ori

ng

Inte

llig

en

t A

ge

nts

En

d-t

o-e

nd

Mo

nit

ori

ng

Inte

llig

en

t A

ge

nts

Application Frameworks

Distributed CPU & Storage

Network Fabric

Grid Middleware

Flagship Applications(HENP, VLBI, Oncology, …)

Grid/Storage Management

Network Protocols &Bandwidth Management

En

d-t

o-e

nd

Mo

nit

ori

ng

Inte

llig

en

t A

ge

nts

En

d-t

o-e

nd

Mo

nit

ori

ng

Inte

llig

en

t A

ge

nts

Application Frameworks

Distributed CPU & Storage

Network Fabric

Grid Middleware

PITPIT

PORPOR

FREFRE

RALRAL

WALWAL

NASNASPHOPHO

OLGOLG ATLATL

CHICHICLECLE

KANKAN

OGDOGDSACSAC NYCNYC

WDCWDC

STRSTR

DALDAL

DENDEN

LAXLAX

SVLSVL

SEASEA

SDGSDG

JACJAC

ICFA Standing Committee on Interregional Connectivity (SCIC)

ICFA Standing Committee on Interregional Connectivity (SCIC)

Created by ICFA in July 1998 in Vancouver ; Following ICFA-NTFCreated by ICFA in July 1998 in Vancouver ; Following ICFA-NTF CHARGE: CHARGE: Make recommendations to ICFA concerning the connectivity between Make recommendations to ICFA concerning the connectivity between

the Americasthe Americas, Asia and Europe (and network requirements of HENP), Asia and Europe (and network requirements of HENP) As part of the process of developing theseAs part of the process of developing these

recommendations, the committee should recommendations, the committee should Monitor traffic Monitor traffic Keep track of technology developmentsKeep track of technology developments Periodically review forecasts of future Periodically review forecasts of future

bandwidth needs, and bandwidth needs, and Provide early warning of potential problemsProvide early warning of potential problems

Create subcommittees when necessary to meet the chargeCreate subcommittees when necessary to meet the charge The chair of the committee should report to ICFA once perThe chair of the committee should report to ICFA once per

year, at its joint meeting with laboratory directors (Today)year, at its joint meeting with laboratory directors (Today) Representatives: Major labs, ECFA, ACFA, NA Users, S. AmericaRepresentatives: Major labs, ECFA, ACFA, NA Users, S. America

ICFA SCIC in 2002-2004A Period of Intense Activity ICFA SCIC in 2002-2004A Period of Intense Activity

Strong Focus on the Digital Divide ContinuingStrong Focus on the Digital Divide Continuing

Five Reports; Presented to ICFA 2003Five Reports; Presented to ICFA 2003See See http://cern.ch/icfa-scichttp://cern.ch/icfa-scic

Main Report: “Networking for HENP” Main Report: “Networking for HENP” [H. Newman et al.] [H. Newman et al.] Monitoring WG ReportMonitoring WG Report [L. Cottrell] [L. Cottrell] Advanced Technologies WG ReportAdvanced Technologies WG Report [R. Hughes-Jones, [R. Hughes-Jones,

O. Martin et al.] O. Martin et al.]Digital Divide Report Digital Divide Report [A. Santoro et al.][A. Santoro et al.]Digital Divide in Russia ReportDigital Divide in Russia Report [V. Ilyin][V. Ilyin]

2004 Reports in Progress; Short Reports on Nat’l and 2004 Reports in Progress; Short Reports on Nat’l and Regional Network Infrastructures and Initiatives.Regional Network Infrastructures and Initiatives.

Presentation to ICFA February 13, 2004Presentation to ICFA February 13, 2004

SCIC Report 2003 General ConclusionsSCIC Report 2003

General ConclusionsThe scale and capability of networks, their pervasiveness The scale and capability of networks, their pervasiveness

and range of applications in everyday life, and HENP’s and range of applications in everyday life, and HENP’s dependence on networks for its research, are all dependence on networks for its research, are all increasing rapidly. increasing rapidly.

However, as the pace of network advances continues to However, as the pace of network advances continues to accelerate, the gap between the economically “favored” accelerate, the gap between the economically “favored” regions and the rest of the world is in danger of widening. regions and the rest of the world is in danger of widening.

We must therefore workWe must therefore work to Close the Digital Divideto Close the Digital Divide To make Physicists from All World Regions Full Partners To make Physicists from All World Regions Full Partners

in Their Experiments; and in the Process of Discoveryin Their Experiments; and in the Process of Discovery This is essential for the health of our global This is essential for the health of our global

experimental collaborations, our plans for future experimental collaborations, our plans for future projects, and our field.projects, and our field.

Work on the Digital Divide:Several Perspectives

Work on the Digital Divide:Several Perspectives

Work on Policies and/or Pricing: pk, in, br, cn, SE Europe, …Work on Policies and/or Pricing: pk, in, br, cn, SE Europe, … Share Information: Comparative Performance and Pricing Share Information: Comparative Performance and Pricing Find Ways to work with vendors, NRENs, and/or Gov’tsFind Ways to work with vendors, NRENs, and/or Gov’ts Exploit Model Cases: e.g. Poland, Slovakia, Czech RepublicExploit Model Cases: e.g. Poland, Slovakia, Czech Republic

Inter-Regional Projects Inter-Regional Projects South America: CHEPREO (US-Brazil); EU @LIS ProjectSouth America: CHEPREO (US-Brazil); EU @LIS Project GLORIAD, Russia-China-US Optical RingGLORIAD, Russia-China-US Optical Ring Virtual SILK Highway Project (DESY): FSU satellite linksVirtual SILK Highway Project (DESY): FSU satellite links

Help with Modernizing the Infrastructure Help with Modernizing the Infrastructure Design, Commissioning, DevelopmentDesign, Commissioning, Development Provide Tools for Effective Use: Monitoring, CollaborationProvide Tools for Effective Use: Monitoring, Collaboration

Workshops and Tutorials/Training SessionsWorkshops and Tutorials/Training Sessions For Example: Digital Divide and HEPGrid Workshop,For Example: Digital Divide and HEPGrid Workshop,

UERJ Rio, February 2004UERJ Rio, February 2004 Participate in Standards Development; Open ToolsParticipate in Standards Development; Open Tools

Advanced TCP stacks; Grid systemsAdvanced TCP stacks; Grid systems

ICTP 2nd Open Round Table on Developing Countries Access to Scientific Information ICTP 2nd Open Round Table on Developing Countries Access to Scientific Information

STATEMENTSTATEMENT: AFFORDABLE: AFFORDABLE ACCESS TO THE INTERNET ACCESS TO THE INTERNETFOR RESEARCH AND LEARNINGFOR RESEARCH AND LEARNING

““Scholars from across the world meeting at the Abdus Salam International Centre for Scholars from across the world meeting at the Abdus Salam International Centre for Theoretical Physics (ICTP) in Trieste [10/2003] were concerned to learn of the barrier to Theoretical Physics (ICTP) in Trieste [10/2003] were concerned to learn of the barrier to education and research caused by the high cost of Internet access in many countries. education and research caused by the high cost of Internet access in many countries. The Internet enables the use of content which is vital for individuals and for institutions The Internet enables the use of content which is vital for individuals and for institutions engaged in teaching, learning and research. In many countries use of the Internet is severely engaged in teaching, learning and research. In many countries use of the Internet is severely restricted by the high telecommunications cost, leading to inequality in realising the benefits of restricted by the high telecommunications cost, leading to inequality in realising the benefits of education and research.education and research. Research staff and students in countries with liberal Research staff and students in countries with liberal telecommunications policies favouring educational use are gaining social and economic telecommunications policies favouring educational use are gaining social and economic advantage over countries with restrictive, high-cost policies. The potential benefits of access to advantage over countries with restrictive, high-cost policies. The potential benefits of access to the Internet are not available to all. the Internet are not available to all. The signatories to this message invite scholars in every country to join them in The signatories to this message invite scholars in every country to join them in expressing concern to governments and research funding agencies at the effect of high expressing concern to governments and research funding agencies at the effect of high telecommunications costs upon individuals and institutions undertaking teaching, learning and telecommunications costs upon individuals and institutions undertaking teaching, learning and research. The situation in many countries could be improved through educational discounts on research. The situation in many countries could be improved through educational discounts on normal telecommunications costs, or through the lifting of monopolies. It is for each country to normal telecommunications costs, or through the lifting of monopolies. It is for each country to determine its own telecommunications policies but the need for low-cost access to the Internet determine its own telecommunications policies but the need for low-cost access to the Internet for educational purposes is a need which is common to the whole of humankind.”for educational purposes is a need which is common to the whole of humankind.”

History - Throughput Quality Improvements from US

Bandwidth of TCP < MSS/(RTT*Sqrt(Loss)) (1)

(1) Macroscopic Behavior of the TCP Congestion Avoidance Algorithm1) Macroscopic Behavior of the TCP Congestion Avoidance Algorithm, Matthis, , Matthis, Semke, Mahdavi, Ott, Computer Communication Review 27(3), July 1997Semke, Mahdavi, Ott, Computer Communication Review 27(3), July 1997

60% annual improvement Factor ~100/10 yr

Progress: but the Digital Divide

is Being Maintained

1.5-8 Year Lag

S.E. Europe, Russia: Catching Up Lat Am., MidEast, China, Africa: Keeping Up India: Falling Behind

Current State – June 2003 (Max. Throughput in Mbps)Current State – June 2003 (Max. Throughput in Mbps)

Within region performance improving: Within region performance improving: E.g. Ca/US-NA, Hu-SE Eu, Eu-Eu, Jp-E Asia, Au-Au, Ru-RuE.g. Ca/US-NA, Hu-SE Eu, Eu-Eu, Jp-E Asia, Au-Au, Ru-Ru

Africa, Caucasus, Central & S. Asia all badAfrica, Caucasus, Central & S. Asia all bad

Bad < 200kbits/s < DSL Acceptable > 200, < 1000kbits/s

Good > 1000kbits/s

DAI: State of the WorldDAI: State of the World

Digital Access Index Top TenDigital Access Index Top Ten

DAI: State of the WorldDAI: State of the World

APAN Link Information 2004.1.05 sec@apan.netCountries Network Bandwidth(Mbps) AUP/Remark

AU-US AARNet 310 to 2 X 10 Gbps R&E + CommodityCN-HK CERNET/HARNET 2 R&ECN-HK CSTNET 155 R&ECN-JP CERNET 10 R&ECN-JP CERNET 45 Native IPv6CN-UK CERNET 45 R&ECN-US CERNET 10 Research CN-US CERNET 200 R&ECN-US CSTNET 155 R&EHK-US HARNET 45 R&EHK-TW HARNET/TANET 10 R&EJP-ID AI3(ITB) 2/1.5 R&EJP-KR APII 2Gbps R&EJP-MY AI3(USM) 1.5/0.5 R&EJP-PH AI3(ASTI) 1.5/0.5 R&EJP-PH MAFFIN 2 Research JP-SG AI3(SICU) 1.5/0.5 R&EJP-TH AI3(AIT) 1.5/0.5 R&EJP-TH SINET(ThaiSarn) 2 R&EJP-US TransPac 5 Gbps R&EJP-VN AI3(IOIT) 1.5/0.5 R&E

APAN Link Information 2004.1.05 sec@apan.net

Countries Network Bandwidth(Mbps) AUP/Remark

KR-FR KOREN/RENATER 34 Research (TEIN)

KR-SG APII 8 R&E

KR-US KOREN/KREONet2 155 R&E

LK-JP LEARN 3 R&E

MY-SG NRG/SICU 2 Experiment (Down)

SG-US SingaREN 90 R&E

TH-US Uninet 155 R&E

TW-HK ASNET/TANET2 155 R&E

TW-JP ASNET/TANET2 155 R&E

TW-US ASNET/TANET2 5 Gbps R&E

(TW)-US-UK ASNET/TANET2 155 R&E

Non APAN Links

Countries Network Bandwidth(Mbps) AUP

IN-US/UK ERNET 16 R&E

(JP)-US-EU SINET 155 R&E / No Transit

JP-US SINET 5 Gbps R&E / No Transit

Brazil: RNP in Early 2004Brazil: RNP in Early 2004

International Connectivity Costs in the Different European Market Segments

Market segment

Number of Countries

Cost Range

Liberal Market with transparent pricing

8 1-1.4

Liberal Market with less transparent pricing structure

7 1.8-3.3

Emerging Market without transparent pricing

3 7.5-7.8

Traditional Monopolist market

9 18-39

Dai Davies SERENATE Workshop Feb. 2003

Virtual Silk Highway:Virtual Silk Highway:The Silk CountriesThe Silk Countries

Virtual SILK HighwayVirtual SILK HighwayArchitectural OverviewArchitectural Overview

Hub Earth Station at DESY with access to the European NRENs and the Internet via GEANT– Providing International Internet access directly

National Earth Station at each Partner site– Operated by DESY, providing international access – Additional earth stations from other sources – none yet– SCPC up-link, common down-link, using DVB

Routers for each Partner site– Linked on one side to the Satellite Channel– On the other side to the NREN

Bandwidth Plan – as of 3/03Bandwidth Plan – as of 3/03

From To MHz DVBMbps

SCPC Mbps

$K

08/02 11/02 2.9 3.1 0.77 20

12/02 05/03 5.4 6.9 2.40 92

06/03 11/03 7.5 9.5 3.32 136

12/03 05/04 9.4 12 4.10 175

06/04 11/04 12 16 4.90 220

12/04 07/05 15 19 6.50 379

      1022 

Progress in Slovakia 2002-2004(January 2004)

Progress in Slovakia 2002-2004(January 2004)

VRVS on WindowsVRVS on WindowsVRVS (Version 3)VRVS (Version 3)Meeting in 8 Time Meeting in 8 Time

ZonesZones

80+ Reflectors80+ Reflectors24.5k hosts worldwide24.5k hosts worldwideUsers in 99 CountriesUsers in 99 Countries

SERENATE is the name of a series of strategic studies into the future of research and education networking in Europe,

addressing the local (campus networks), national (national research & education networks), European and intercontinental levels. The SERENATE studies bring together the research and

education networks of Europe, national governments and funding bodies, the European Commission, traditional and "alternative" network operators, equipment manufacturers,

and the scientific and education community as the users of networks and services.

Study into European Research and Education Networking as Targeted

by eEurope

www.serenate.org

Summary and Conclusions by D.O. Williams, CERN

Optics and Fibres[Message to NRENs; or Nat’l Initiatives]

If there is one single technical lesson from SERENATE it is that transmission is moving from the electrical domain to optical.

The more you look at underlying costs the more you see the need for users to get access to fibre.

When there’s good competition users can still lease traditional communications services (bandwidth) on an annual basis. But: Without enough competition prices go through the roof.

A significant “divide” exists inside Europe – with the worst countries [Macedonia, B-H, Albania, etc.] 1000s of times worse off than the best. Also many of the 10 new EU members are ~5X worse off than the 15 present members.

Our best advice has to be “if you’re in a mess, you must get access to fibre”.

Also try to lobby politicians to introduce real competition. In Serbia – still a full telecoms monopoly – the two ministers talked and

the research community was given a fibre pair all around Serbia !

NEWS: Bulletin: ONE TWOWELCOME BULLETIN General InformationRegistrationTravel Information Hotel RegistrationParticipant List How to Get UERJ/Hotel Computer AccountsUseful Phone Numbers ProgramContact us: Secretariat Chairmen

 CLAF  CNPQ  FAPERJ        UERJ

SPONSORS

HEPGRID and Digital Divide Workshop

UERJ, Rio de Janeiro, Feb. 16-20 2004

Theme: Global Collaborations, Grids and Their Relationship to the Digital

DivideICFA, understanding the vital role of these issues for our field’s future, commissioned the Standing

Committee on Inter-regional Connectivity (SCIC) in 1998, to survey and monitor the state of the

networks used by our field, and identify problems. For the past three years the SCIC has focused on

understanding and seeking the means of reducing or eliminating the Digital Divide, and proposed in ICFA that these issues, as they affect our field of

High Energy Physics, be brought to our community for discussion. This led to ICFA’s approval, in July

2003, of the Digital Divide and HEP Grid Workshop. 

More Information: http://www.uerj.br/lishep2004

Networks, Grids and HENPNetworks, Grids and HENP Network backbones and major links used by HENP experimentsNetwork backbones and major links used by HENP experiments

are advancing rapidly are advancing rapidly To the 10 G range in < 2 years; much faster than Moore’s LawTo the 10 G range in < 2 years; much faster than Moore’s Law Continuing a trend: a factor ~1000 improvement per decade; Continuing a trend: a factor ~1000 improvement per decade;

a new DOE and HENP Roadmap a new DOE and HENP Roadmap Transition to a community-owned and operated infrastructureTransition to a community-owned and operated infrastructure

for research and education is beginning with (NLR, USAWaves) for research and education is beginning with (NLR, USAWaves) HENP is learning to use long distance 10 Gbps networks effectively HENP is learning to use long distance 10 Gbps networks effectively

2002-2003 Developments: to 5+ Gbps flows over 11,000 km2002-2003 Developments: to 5+ Gbps flows over 11,000 km Removing Regional, Last Mile, Local Bottlenecks and Removing Regional, Last Mile, Local Bottlenecks and

Compromises in Network Quality are nowCompromises in Network Quality are now On the critical path, in all world regionsOn the critical path, in all world regions

Digital Divide: Network improvements are especially neededDigital Divide: Network improvements are especially neededin SE Europe, So. America; SE Asia, and Africain SE Europe, So. America; SE Asia, and Africa

Work in Concert with Internet2, Terena, APAN, AMPATH; Work in Concert with Internet2, Terena, APAN, AMPATH; DataTAG, the Grid projects and the Global Grid Forum DataTAG, the Grid projects and the Global Grid Forum

Computing Model Progress CMS Internal Review of Software and Computing

Some Extra Slides Some Extra Slides

FollowFollow

ICFA and International Networking ICFA and International Networking

ICFA Statement on Communications in Int’l HEPICFA Statement on Communications in Int’l HEPCollaborations of October 17, 1996Collaborations of October 17, 1996 See See http://www.fnal.gov/directorate/icfa/icfa_communicaes.htmlhttp://www.fnal.gov/directorate/icfa/icfa_communicaes.html

““ICFA urges that all countries and institutions wishing ICFA urges that all countries and institutions wishing to participate even more effectively and fully in to participate even more effectively and fully in international HEP Collaborations should:international HEP Collaborations should: Review their operating methods to ensure they Review their operating methods to ensure they

are fully adapted to remote participation are fully adapted to remote participation Strive to provide the necessary communications Strive to provide the necessary communications

facilities and adequate international bandwidth” facilities and adequate international bandwidth”

NREN Core Network Size (Mbps-km):http://www.terena.nl/compendium/2002

NREN Core Network Size (Mbps-km):http://www.terena.nl/compendium/2002

Logarithmic Scale

1k

100k

100

100M

10M

1M

10kRo

It

PlGrIr

Ukr

Hu Cz

Es

Nl

Fi

Ch

Lagging

In Transition

Leading

Advanced

Network Readiness Index:How Ready to Use Modern ICTs [*]?

Network Readiness Index:How Ready to Use Modern ICTs [*]?

NetworkReadiness

Index

Environment

Readiness

Usage

Market

Infrastructure

Political/Regulatory

Individual Readiness

Gov’t Readiness

Business Readiness

Individual Usage

Gov’t Usage

Business Usage

(FI)

(FI)

(SG)

(US)(IC)

(SG)

(US)

(SG)

(US)

(FI)

(FI)

(DE)

(KR)

( ): Which Country is First

From the 2002-2003 Global InformationTechnology Report. See http://www.weforum.org

PINGER History – Loss Quality

Fewer sites have very poor to dreadful performance

More have good performance(< 1% Loss)

BUT <20% of the world’sBUT <20% of the world’spopulation has Good orpopulation has Good orAcceptable performanceAcceptable performance

Throughput vs Net Readiness Index Throughput vs Net Readiness Index NRI from Center for Int’l Development, Harvard NRI from Center for Int’l Development, Harvard http://www.cid.harvard.edu/cr/pdf/gitrr2002_ch02.pdfhttp://www.cid.harvard.edu/cr/pdf/gitrr2002_ch02.pdf

Improved correlation (0.21 Improved correlation (0.21 0.41) by Using derived throughput ~0.41) by Using derived throughput ~ MSS / (RTT * sqrt(loss)); fit an exponential MSS / (RTT * sqrt(loss)); fit an exponential

Interesting Outliers: Slovakia, Hungary, Portugal. LithuaniaInteresting Outliers: Slovakia, Hungary, Portugal. Lithuania

Intern

et for all fo

cusA

&R

focus

NRI TopsNRI TopsFinland Finland 5.925.92US US 5.795.79SingaporeSingapore 5.745.74Sweden Sweden 5.585.58Iceland Iceland 5.515.51Canada Canada 5.445.44UKUK 5.355.35Denmark Denmark 5.335.33TaiwanTaiwan 5.315.31GermanyGermany 5.295.29Netherlnd Netherlnd 5.285.28Israel Israel 5.225.22Switz’land Switz’land 5.185.18Korea Korea 5.105.10

UltraLight UltraLight

http://ultralight.caltech.edu Serving the major LHC experiments; developments Serving the major LHC experiments; developments broadly applicable to other data-intensive programs broadly applicable to other data-intensive programs ““Hybrid” packet-switched and circuit-switched, Hybrid” packet-switched and circuit-switched,

dynamically managed optical networkdynamically managed optical network Global services for system managementGlobal services for system management Trans-US wavelength riding on NLR: LA-SNV-CHI-JAXTrans-US wavelength riding on NLR: LA-SNV-CHI-JAX Leveraging advanced research & production networksLeveraging advanced research & production networks

USLIC/DataTAG, SURFnet/NLlight, UKLight, USLIC/DataTAG, SURFnet/NLlight, UKLight, Abilene, CA*net4 Abilene, CA*net4

Dark fiber to CIT, SLAC, FNAL, UMich; Florida Light RailDark fiber to CIT, SLAC, FNAL, UMich; Florida Light Rail Intercont’l extensions: Rio de Janeiro, Tokyo, TaiwanIntercont’l extensions: Rio de Janeiro, Tokyo, Taiwan

Flagship Applications with a diverse traffic mixFlagship Applications with a diverse traffic mix HENP: TByte to PByte “block” data transfers at 1-10+ HENP: TByte to PByte “block” data transfers at 1-10+

GbpsGbps eVLBI: Real time data streams at 1 to several GbpseVLBI: Real time data streams at 1 to several Gbps

By I. Legrand (Caltech) et al. Monitors Clusters, Networks Agent-based Dynamic

information / resource discovery mechanisms

Implemented in Java/Jini; SNMP WDSL / SOAP with UDDI

Global System Optimizations > 100 Sites and Growing Being deployed in Abilene;

through the Internet2 E2EPi MonALISA (Java) 3D Interface

MonaLisa: A Globally Scalable Grid Monitoring System

PingER BenefitsPingER Benefits

Measures analyzes & reports round-trip Measures analyzes & reports round-trip times, losses, availability, throughput ...times, losses, availability, throughput ...

Covers 75+ countries (99% of Internet Covers 75+ countries (99% of Internet connected population)connected population)

Low impact on network << 100bits/s, Low impact on network << 100bits/s, important for many DD sitesimportant for many DD sites

Uses ubiquitous ping, no special host, or Uses ubiquitous ping, no special host, or software to install/configure at remote software to install/configure at remote sitessites

Provides Provides quantitativequantitative historical (> 8yrs) and historical (> 8yrs) and near real-time informationnear real-time information

How bad is performance to various How bad is performance to various regions, rank countries?regions, rank countries?

Trends: who is catching up, falling Trends: who is catching up, falling behind, is progress being made?behind, is progress being made?

Compare vs. economic, development Compare vs. economic, development indicators etc.indicators etc.

Useful Useful for troubleshooting, setting for troubleshooting, setting expectations; presenting to policy makers, expectations; presenting to policy makers, funding bodiesfunding bodies

Used to monitorOnly 1 host

Countries MonitoredCountries Monitored

CountryCountryHoHostssts CountryCountry

HoHostssts CountryCountry HostsHosts CountryCountry HostsHosts

ArgentinaArgentina 66 EstoniaEstonia 11 LatviaLatvia 11 SlovakiaSlovakia 22

ArmeniaArmenia 22 FinlandFinland 11 LithuaniaLithuania 11 SloveniaSlovenia 11

AustraliaAustralia 44 FranceFrance 1111 MacedoniaMacedonia 22 S AfricaS Africa 33

AustriaAustria 22 GeorgiaGeorgia 11 MalaysiaMalaysia 33 SpainSpain 66

AzerbaijanAzerbaijan 22 GermanyGermany 1313 MexicoMexico 55 SwedenSweden 44

BangladeshBangladesh 11 GhanaGhana 11 MoldovaMoldova 22 SwitzerlandSwitzerland 88

BelarusBelarus 22 GreeceGreece 11 MongoliaMongolia 11 TaiwanTaiwan 11

BelgiumBelgium 33 GuatemalaGuatemala 22 NetherlandsNetherlands 1212 ThailandThailand 11

BrazilBrazil 2121 HungaryHungary 55 New-ZealandNew-Zealand 44 TurkeyTurkey 22

BulgariaBulgaria 11 IcelandIceland 33 NigeriaNigeria 11 UgandaUganda 11

CanadaCanada 1111 IndiaIndia 1010 NorwayNorway 22 UkraineUkraine 22

ChileChile 44 IndonesiaIndonesia 33 PakistanPakistan 11 UKUK 3636

ChinaChina 66 IranIran 44 PeruPeru 11 USUS 208208

ColombiaColombia 44 IrelandIreland 22 PolandPoland 44 UruguayUruguay 33

Costa-RicaCosta-Rica 11 IsraelIsrael 55 PortugalPortugal 22 UzbekistanUzbekistan 22

CroatiaCroatia 55 ItalyItaly 1313 RomaniaRomania 11 VenezuelaVenezuela 22

CubaCuba 22 JapanJapan 1111 RussiaRussia 1212 Vietnam Vietnam 11

Czech-RepCzech-Rep 33 JordanJordan 11 Saudi ArabiaSaudi Arabia 11 AlbaniaAlbania 00

DenmarkDenmark 11 KazakhstanKazakhstan 22Serbia & Serbia & MontenegroMontenegro 22 PhilippinesPhilippines 00

EgyptEgypt 11 KoreaKorea 22 SingaporeSingapore 11      

Need > 1 host to reduce anomalies

PingER SummaryPingER Summary

Performance is improving all overPerformance is improving all over Performance to developed countries are orders of Performance to developed countries are orders of

magnitude better than to developing countries magnitude better than to developing countries Poorer regions 5-10 years behindPoorer regions 5-10 years behind Poorest regions Africa, Caucasus, Central & S. AsiaPoorest regions Africa, Caucasus, Central & S. Asia Some regions are:Some regions are:

Catching up: Catching up: SE Europe, RussiaSE Europe, RussiaKeeping up:Keeping up: Latin America, Mid East, Latin America, Mid East, China China Falling further behind:Falling further behind: E.g, India, AfricaE.g, India, Africa

User Requirements

In ALL countries and in ALL disciplines researchers are eagerly anticipating improved networking tools. There is no divide on the demand-side. Sciences, such as particle physics, which make heavy use of advanced networking, must help to break down any divide on the supply-side, or else declare themselves elitist and irrelevant to researchers in essentially all developing countries.

Connectivity pricing and competition

In some locations the price of connectivity is (really) unreasonably high

Linked (obviously) to how competitive the market is Strong competition on routes between various key

European cities, and between major national centres Less competition effectively none as you move to

countries with de facto monopoly or simply to parts of countries where operators see little reason to invest.

While some expensive routes are where you would expect, others are much more surprising (at first sight), like Canterbury and Lancaster (UK) and parts of Brittany (F)

Understanding transmission costs and DIY solutions

Own trenching only makes sense in very special cases. Say 1-30 km. Even then look for partners.

Maybe useful (as a threat) over longer distances in countries with crazy pricing

Now possible to lease (short- or long-term) fibres on many routes in Europe [0.5 to 2 KEuro/km Typ.]

Transmission costs jump at ~200 km [below which you can operate with “Nothing In Line” (NIL), above which you need amplifiers] and ~800 km [above which you need signal regenerators]

Possibly leading to some new approaches in GEANT-2 implementation

AN INTERESTING STUDY AN INTERESTING STUDY MADE BY FUNDAÇÃO GETULIO MADE BY FUNDAÇÃO GETULIO

VARGAS - BRAZIL.;VARGAS - BRAZIL.;REPORTED by A. Santoro (UERJ)REPORTED by A. Santoro (UERJ)

July 11 SCIC MeetingJuly 11 SCIC Meeting

Digital InclusionDigital Inclusion

0,00 0,00 0,000,00Computer InternetComputer Internet

Until 2001, only 12,46% of Brazilians had Access to a PC and 8,31% to Internet

With a Very Non-Uniform Distribution.

For Example: Concentration in Parts of Rio de Janeiro

% Having :PC - Internet - % Total Pop.

BRAZIL: Access to a PC, and to the Internet Vs. Yrs. of StudyBRAZIL: Access to a PC, and to the Internet Vs. Yrs. of Study

0 YEARS TO 4 YEARS 4 TO 8 YEARS 8 TO 12 YEARS MORE THAN 12 YEARS

~1/3 of those with Access to a PC and to the Internet is concentrated in the hands of the 6% of the population who

graduated from high school

Jensen, ICTP

Typ. 0-7 bpsPer Person

Limited by many externalsystemic

factors: Electricity;

Import Duties;Education; Trade

restrictions

Jensen, ICTP

Progress in Africa ?

DAI: State of the WorldDAI: State of the World

DAI: State of the WorldDAI: State of the World

DAI: State of the WorldDAI: State of the World

California Institute of Technology

Application Empowerment of Global Systems: Key Role of HENP

Application Empowerment of Global Systems: Key Role of HENP

Effective use of networks is vital for the existence Effective use of networks is vital for the existence and daily operation of Global Collaborationsand daily operation of Global Collaborations

Physicists today face the greatest challenges in terms of Physicists today face the greatest challenges in terms of Data intensiveness; volume and complexityData intensiveness; volume and complexity Distributed computation and storage resourcesDistributed computation and storage resources Global dispersion of many cooperating research teams Global dispersion of many cooperating research teams

Physicists and computer scientists have become Physicists and computer scientists have become leading co-developers of networks and global systems leading co-developers of networks and global systems Building on a tradition of building next-generation systemsBuilding on a tradition of building next-generation systems

that harness new technologies in the service of science that harness new technologies in the service of science Mission OrientationMission Orientation

Tackle the hardest problems, to enable the science, maintaining a Tackle the hardest problems, to enable the science, maintaining a years-long commitmentyears-long commitment

Broad Applicability to Other Fields of Research, SocietyBroad Applicability to Other Fields of Research, Society

Scaling to Handle Thousands of Simultaneous RequestsScaling to Handle Thousands of Simultaneous Requests Including the Network as a Dynamic, Managed ResourceIncluding the Network as a Dynamic, Managed Resource

Co-Scheduled with Computing and StorageCo-Scheduled with Computing and Storage Maintaining a Maintaining a Global ViewGlobal View of Resources and System State of Resources and System State

End-to-end MonitoringEnd-to-end Monitoring Adaptive Learning: New paradigms for optimization, Adaptive Learning: New paradigms for optimization,

problem resolution problem resolution Balancing Policy Against Moment-to-moment Capability Balancing Policy Against Moment-to-moment Capability

High Levels of Usage of Limited Resources Versus High Levels of Usage of Limited Resources Versus Better Turnaround Times for Priority TasksBetter Turnaround Times for Priority Tasks

Strategic Workflow Planning; Strategic RecoveryStrategic Workflow Planning; Strategic Recovery An Integrated User Environment An Integrated User Environment

User-Grid Interactions; Progressive AutomationUser-Grid Interactions; Progressive Automation Emerging Strategies and GuidelinesEmerging Strategies and Guidelines

Next Generation Grid Challenges: Next Generation Grid Challenges: Workflow Management & OptimizationWorkflow Management & Optimization

Grid Enabled Analysis: View Grid Enabled Analysis: View of a Collaborative Desktop of a Collaborative Desktop

PDAPDAROOTROOT

ClarensClarensClarensClarens

External Services

MonaLisaMonaLisaBrowserBrowserIguanaIguana

VO

ManagementAuthentication Authorization Logging Key Escrow

File Access

Shell

Storage Resource

Broker

CMS ORCA/COBRA

Cluster Schedulers

ATLAS DIAL

Griphyn VDT

MonaLisa Monitoring

Building the GAE is the “Acid Test” for Grids; and isBuilding the GAE is the “Acid Test” for Grids; and iscrucial for next-generation experiments at the LHCcrucial for next-generation experiments at the LHC Large, Diverse, Distributed Community of usersLarge, Diverse, Distributed Community of users Support hundreds to thousands of analysis tasks,Support hundreds to thousands of analysis tasks,

shared among dozens of sites shared among dozens of sites Widely varying task requirements and prioritiesWidely varying task requirements and priorities Need Priority Schemes, robust authentication and SecurityNeed Priority Schemes, robust authentication and Security

Relevant to the future needs of research and industryRelevant to the future needs of research and industry

Current ProblemsCurrent Problems

Siting of the Earth Station - UzbekistanAUPs – ArmeniaLicence - ArmeniaExistence of NREN – TurkmenistanShortage of Bandwidth – GeorgiaNumber of Earth Stations – KazakhstanMarginal transmitters – putting in amplifiers

Scaling to Handle Thousands of Simultaneous RequestsScaling to Handle Thousands of Simultaneous Requests Including the Network as a Dynamic, Managed ResourceIncluding the Network as a Dynamic, Managed Resource

Co-Scheduled with Computing and StorageCo-Scheduled with Computing and Storage Maintaining a Maintaining a Global ViewGlobal View of Resources and System State of Resources and System State

End-to-end MonitoringEnd-to-end Monitoring Adaptive Learning: New paradigms for optimization, Adaptive Learning: New paradigms for optimization,

problem resolution problem resolution Balancing Policy Against Moment-to-moment Capability Balancing Policy Against Moment-to-moment Capability

High Levels of Usage of Limited Resources Versus High Levels of Usage of Limited Resources Versus Better Turnaround Times for Priority TasksBetter Turnaround Times for Priority Tasks

Strategic Workflow Planning; Strategic RecoveryStrategic Workflow Planning; Strategic Recovery An Integrated User Environment An Integrated User Environment

User-Grid Interactions; Progressive AutomationUser-Grid Interactions; Progressive Automation Emerging Strategies and GuidelinesEmerging Strategies and Guidelines

Next Generation Grid Challenges: Next Generation Grid Challenges: Workflow Management & OptimizationWorkflow Management & Optimization

Abilene - Upgrade Completed!

SC2003 Bandwidth Challenge

Seattle

Portland

D enverSan Francisco

San Diego Phoenix

Santa Theresa

Las Vegas

Kansas City

Dallas

A ustin

Fort W orth

St. Louis

Nashville

Washington D.C.Baltim ore

Boston

Buffalo

Toronto

Montreal

Louisville

Cincinnati

Detroit

Richm ondNorfolk

New YorkW eehawkenStamford

Houston

Om aha

MinneapolisGreen Bay

Milwaukee

C hicago

San Antonio

Sacramento

Los Angeles

New Orleans

Tam pa

Miami

AtlantaBirmingham

Memphis

Raleigh

Durham

Charlotte

Orlando

San Luis Obispo

San Jose

PhiladelphiaW ilmington

ClevelandS alt Lake City

H artford

Jacksonville

OaklandIndianapolis

Mobile

Pittsburgh

Irvine

Syracuse

Colum bus

Newark

Tulsa

Oklahoma City

A lbany

W hite Plains

Available fiber topology

Leading & Emerging Regional Optical Initiatives

California (CALREN) Colorado (FRGP/BRAN) Connecticut (Connecticut Education Network) Florida (Florida LambdaRail) Indiana (I-LIGHT) Illinois (I-WIRE) Maryland, D.C. & northern Virginia (MAX) Michigan Minnesota New York + New England region (NEREN) North Carolina (NC LambdaRail) Ohio (Third Frontier Network) Oregon Rhode Island (OSHEAN) SURA Crossroads (southeastern U.S.) Texas Utah Wisconsin