Embed Size (px)
Citation preview
U n i v e r s i t y o f I l l i n o i s a t C h i c a g o
S T A R T A P L o g i c a l M a p
E S n e t
N R E N
C A * n e t I I
A P A N
N I S ND R E N A b i l e n e v B N S
W i s c o n s i n@ M a d i s o n W i s c o n s i n
@ M i l w a u k e e
F N A L
A N LU I C
C h i c a g o
N o r t h w e s t e r n
N o t r e D a m e
M i n n e s o t a
I o w a
I o w a S t a t e
R E N A T E R 2
N O R D U n e t
S U R F n e t
C E R N
I U C C
M I R n e t
M i c h i g a n
M e r i t
M i c h i g a nS t a t e
S T A R T A PM R E N
N G I X - CA A D S N A P
S i n g A R E N
O h i o S t a t e
N C S A &U I U C
S I N E T
D S - 3O C - 3O C - 1 2
A A D S P o r t S p e e d
T A N e t 2
Internet2 QBone InitiativeBuild interdomain testbed infrastructure
Experiment and improve understanding of DiffServIncrementally improve testbed
Support intradomain & interdomain deploymentLead and follow IETF standards work
Some parts of DiffServ architecture ready; others far from itOur experience will inform standards process
Openness of R&E community gives us an edgeUsers will tolerate the flakiness of an experimental infrastructureEngineers will share experience and measurement dataQBone as “infrastructure that only a graduate student could love”
QBone Architecture (10km view)
IETF “Diff” (EF PHB) + QBone “Serv” (QPS)QBone Premium Service
Idea: converge on Jacobson’s VLL “Premium” serviceWell-defined SLS:
Peak rate (R) & “Service MTU” (M) implying a token bucket meterNear-zero lossLow jitter
Delay variation due to queuing effects should be no greater than the packet transmission time of a M sized packetAll bets are off if the reserved interdomain route flaps
Plus important value-adds:Integrated measurement/dissemination infrastructureExperimentation with pre-standards inter-domain bandwidth brokering and signaling
STARTAP Architecture Diagram
Ethernet
Various SpeedsOC3c
Ameritech NAP Ascend 5XX ATM switches
U.S. and InternationalNetwork Connections
ooo
6TAP Router (IPv6)
Cisco 7200
STAR TAP Router (IPv4)Cisco 7505
DSCisco 7507
NLANRAMP
NLANRWeb Cache
Star TapGeneral Purpose
UNIX Host
NLANROC3MON
TransPAC STAR TAP Cisco LS1010 ATM switch
STARTAP Simplified
AADS
STARTAP
IPV4 IPV6 IPV4DS
JP
SingARENAbileneESnet
IPV4DS
IPV4DS
Argonne
IPV4DS
APAN
KR
1 M
bps
1 Mbps
Mar ‘00
STARTAP- IP DiffSrv Router
One stop shopping for STARTAP DS routes
STARTAP DS Router is AUP free
STARTAP DS Router will run experimental Cisco IOS
Setting up Bandwidth Broker/Resource Manager
DS ComponentsExpedited Forwarding Cisco model
Ingress (classify, mark, police) CAREgress (bandwidth allocation) WFQ
Committed Access Rate Traffic ConditionerMeter, mark and police (drop)
Queueing WFQ PQ
GARA Bandwidth BrokerAdmission controlResource managementRouter configuration
Traffic Shaping (GTS, DTS)
DOE EMERGE Testbed
www.evl.uic.edu/cavern/EMERGE
ArgonneDS Boundary
Node
ArgonneDS Boundary
Node
iCAIRDS Boundary
Node
iCAIRDS Boundary
Node
UIC/EVLDS Boundary
Node
UIC/EVLDS Boundary
Node
ArgonneDS Interior
Node
ArgonneDS Interior
Node
ArgonneDS Interior
Node
ArgonneDS Interior
Node
GARAResourceManager
GARAClientAPI
WisconsinDS Boundary
Node
WisconsinDS Boundary
Node
NCSA/UIUCDS Boundary
Node*
NCSA/UIUCDS Boundary
Node*
UChicagoDS Boundary
Node
UChicagoDS Boundary
Node
EMERGE/MRENDS Region
GARAClientAPI
admission control,manage resources,configure devices
AbileneDS Boundary
Node
AbileneDS Boundary
Node
ESnetDS Boundary
Node
ESnetDS Boundary
Node
police
mark
StarTAPDS Boundary
Node
StarTAPDS Boundary
Node
Layer 2 ATMmostly UBR PVCs
Globus Grid Services Package
Deploy standard infrastructure across participating sitesProvide maximum capabilities to applications
Increase what can be “taken for granted” when developing applications
Reduce deployment burden at sites
Services includeAuthentication
Resource discovery
Resource management (Globus Architecture for Reservation and Allocation – GARA)
Instrumentation (netlogger)
Globus Architecture for Reservation and Allocation
(GARA)Three important contributions:
Support for Advance Reservations Uniform treatment of underlying resources
Network, disk, CPU etc…Currently supported:
Differentiated Services, DPSS, and DSRT
Layered architecture enables generic co-reservation agents
User is able to select API best suitable for his need
GARA Basics—ReservationsThere is a generic “reservation”, which has several properties:
Start Time (“now” or future) and Duration Resource type/Underlying resource identifierResource-specific (bandwidth, % CPU…)
All reservations are treated uniformly:Create/Modify (Given properties)
=> Returns Reservation Handle
DestroyMonitor (Callbacks or Polling)
End-to-End Network Reservations
Algorithm for a single network reservation
Discover which gatekeepers/resource managers need to be contacted (MDS)Make reservation at each one.
User process Workstation
Resource Manager Resource Manager
MDSEnd-to-End Co-Reservation Agent
GARA featuresReservation-Subtypes
low-latencyUsed to support jitter sensitive applications using the same EF aggregate behavior as high-throughput TCP applicationsBased on traffic shaping and Priority-QueuingCurrently being evaluated
backgroundUsed to support bulk transfers, including deadline support. Takes at least the amount of premium traffic required to fulfill the deadline; more if not used actively
Monitoring of the network edgesProvides feedback to applications when they send too fast
Basic Experiment IGoal: Proof of Premium Quality for TCP flows
Run modified ttcp with different traffic and reservation profiles; gather receiver bound statisticsCreate congestion using gen_send/recv
Stable Long Term TCP Traffic(Attempted Rate: 6000KB/s, Buffer size: 2000000 bytes)
2000
3000
4000
5000
6000
7000
8000
9000
1 7 13 19 25 31 37 43 49 55 61 67 73 79 85 91 97Time
Ac
tua
l R
ate
(K
bs
)
Rate
Limit
Basic Experiment IIUse tcpdump and tcptrace understand the behavior Use netlogger_enabled ttcp_gara and gen_recv to publish data into MDS. “Real Time Visualization of rtt”
Basic Experiment IIIGoal: Demonstrate Premium Quality for UDP flows
Run mgen/drec with different traffic and reservation profiles; gather receiver bound statisticsCreate congestion using gen_send/recv
Basic Experiment IV
Goal: Proof Premium Quality for UDP flows sharing one EF aggregate
Run mgen/drec with different traffic and reservation profiles; gather receiver bound statisticsRun high-throughput ttcp using a correct reservationCreate congestion using gen_send/recv
Testing Perform local ANL/GARNET tests Each EMERGE site provides a test machine (Linux
RH6.1) Phase 1- measure baseline end-to-end BE performance
(desire 100 Mbps ~ achieving 70-80 Mbps)Phase 2- measure single stream end-to-end Premium service
Need better measurement tools and techniques
Phase 3- measure application end-to-end performancePhase 4- measure multiple stream end-to-end Premium servicePhase 5- evaluate a MPLS label-switched router as a Diffserv router
References
www.globus.orgwww.globus.org/qoswww.internet2.edu/qos
