Embed Size (px)
Citation preview
Large File Transfer on 20,000 km- Between Korea and Switzerland -
2004.8.26
Yusung Kim, Daewon Kim, Joonbok Lee, Kilnam [email protected]
The 3rd International HEP DataGrid Workshop
Korea Advanced Institute ofScience and Technology
Content
1. Objective2. Factors Affecting Performance3. Experiment Overview 4. Experiment on 20,000 km between Korea and Switzerland 5. Experiment on 10,000 km between Korea and USA6. Experiment Result Summary7. Issues8. Further Work9. ConclusionAppendix
1. Objective
• To obtain maximum throughput on 20,000 km between Korea and Switzerland
2. Factors Affecting Performance
1) Distance 2) Number of Streams 3) Transport Protocol 4) Routing 5) Server
– CPU, RAM, OS (Linux,…)
3. Experiment Overview
Distance20,000 km
Korea – Switzerland10,000 km
Korea – USA
Organization KAIST – CERN KAIST – Caltech
RTT (hop count) 360 ms (5 hops) 203 ms (7 hops)
Effective Bandwidth 622 Mbps 622 Mbps
Transport Protocols TCP Reno, FAST TCP, BIC TCP
Number of Streams from 1 to 100 streams
4. Experiment on 20,000 km between Korea and Switzerland
Organization KAIST – CERN
RTT (hop count) 360 ms (5 hops)
Experiment Period
2004.7.13 ~ 2004.7.25
- 5 trials, each trial for 1 hour
2004.8.20 ~ 2004.8.25
- 5 trials, each trial for 30 min
Effective Bandwidth 622 Mbps
Transport Protocols TCP Reno, FAST TCP, BIC TCP
Number of Streams from 1 to 100 streams
4.1 Network Diagram : 20,000 km between Korea and Switzerland
1 G
10 G
622M
Edoardo Martelli / CERN
SwitzerlandUSA/Canada
CA*net 4
host
3Com 4924
host
KREONET
Korea
1GbE
1GbE
1GbE
1 GbE
OC 192
KAIST StarLight
1 GbE
DataTag / CERN
2 x 1GbE
Cisco 7609
GSR 12406 ONS 15454
Daejeon
ONS 15454
Seattle
2 x OC 12ONS 15454
Chicago
1GbE 1GbE
Starlight Force10
Juniper T320 Juniper T320
10 GbE
Cisco 7609
100
101
102
0
100
200
300
400
500
600
4.2 Experiment results on 20,000 km between Korea and Switzerland
BIC TCP FAST TCPTCP Reno
number of streams
thro
ughp
ut (
Mbp
s)
RTT : 360 ms (5hops)
Effective Bandwidth : 622 Mbps
5. Experiment on 10,000 km between Korea and USA
Organization KAIST – Caltech
RTT (hop count) 203 ms (7 hops)
Experiment Period2004.8.20 ~ 2004.8.25
5 trials, each trial for 30 min
Effective Bandwidth 622 Mbps
Transport Protocols TCP Reno, FAST TCP, BIC TCP
Number of Streams from 1 to 100 streams
5.1 Network Diagram : 10,000 km between Korea and USA
Yang Xia / Caltech
host
Daejeon, KoreaKREONET
Seattle, US
3com 4924
KAIST Caltech
1 G
10 G 622 Mbps
2 x OC 122 x 1GbE
1GbE
1GbE
1GbE
1 GbE
PNG
OC 192
Cisco7606 host
GSR 12406
Cisco 7609
Abilene
LA CENIC
OC 192
OC 192
ONS 15454 ONS 15454
Foundry BigIron 400
ONS 15454
ONS 15454
5.2 Experiment results on 10,000 km between Korea and USA
100
101
102
0
100
200
300
400
500
600
BIC TCPFAST TCPTCP Reno
number of streams
thro
ughp
ut (
Mbp
s)
RTT : 203 ms (7hops)
Effective Bandwidth: 622 Mbps
TCP Reno by SLAC*
•10,000 km between Stanford Linear Accelerator Center (SLAC) and CERN, RTT 170 ms, 622 Mbps (see Appendix A)
5.3 Result comparison : 20,000 km, 10,000 km, and 200km
100
101
102
0
10
20
30
40
50
60
70
80
90
100
20,000 km : Korea – Switzerland10,000 km : Korea – USA200 km : Korea – Korea
number of streams
Lin
k ut
iliz
atio
n (%
)
Distance Organization RTT (hop count) Bandwidth TCP
20,000 km KAIST – CERN 360 ms (5hops) 622 Mbps
BIC TCP10,000 km KAIST – Caltech 170 ms (7hops) 622 Mbps
200 km KAIST – Kyungpook Univ. 2.7 ms (2hops) 1 Gbps
6. Experiment Result Summary
Maximum Throughput
TCP Reno FAST TCP BIC TCP
20,000km between Korea and Switzerland
( 360ms, 5 hpos, 622 Mbps)
385 Mbps (62%) at 100 streams
380 Mbps (61%) at 100 streams
532 Mbps (86%) at 100 streams
• BIC TCP performed better than others.
7. Issues
1) Lambda Networking can support higher throughput on high speed and long latency network?
2) We need to analyze TCP behavior including window sizemanagement on TCP Reno, FAST TCP, and BIC TCP.
3) Some multiple streams showed lower throughput thanthose with smaller number of streams.(specially on 10,000 km)
8. Further Work• Large File Transfer experiment with 10 Gbps
on 20,000 km in late 2004 or early 2005
9. Conclusion
• We experimented large file transfer on 20,000km with 3 kinds of transport protocols.
• BIC TCP performed better than others.
• We need a further investigation of the multiple stream performance.
Appendix A. 10,000 km experiment between SLAC and CERN on 2003.10.23
• RTT : 170 ms• Effective Bandwidth : 622 Mbps• Each transfer for 20 min
TCP RenoTCP Reno 16 streams
FAST TCP BIC TCP
Throughput278 Mbps
(45%)433 Mbps
(70%)
317 Mbps
(51%)
338 Mbps
(54%)
[http://www-iepm.slac.stanford.edu/bw/tcp-eval/cern/index.html]
* SLAC : Stanford Linear Accelerator Center, http://www.slac.stanford.edu/* CERN : Conseil Européen pour la Recherche Nucléaire, http://www.cern.ch/
B. 10Gbps experiment on 10,000 km between Caltech and CERN
on 2004.5.6
[http://ultralight.caltech.edu/lsr-winhec/]
• 10959 km (172 ms)• 7Gbps: transferred 860 GB in 16 min• Using 8 streams
C. End host configuration
KAISTKyungpook
Univ.Caltech CERN
CPUIntel Xeon
2.8 GHzAMD dual
2.1 GHzIntel Xeon dual
2.8 GHzIntel Xeon dual
2.4 GHz
RAM 2 G 2 G 2 G 2 G
Network Interface card
Gigabit Ethernet Gigabit Ethernet Gigabit Ethernet Gigabit Ethernet
OSLinux Redhat 9.0
(kernel 2.4.20)
Transport Protocol
TCP Reno, FAST TCP, BIC TCP
Application Iperf 1.7.0
D. Experiment on 200km between KAIST and Kyungpook Univ.
Period2004.8.21 ~ 2004.8.23
5 trials, each trial for 30 min
RTT (hop count) 2.7 ms (2 hops)
Bandwidth 1 Gbps
Transport Protocols TCP Reno, FAST TCP, BIC TCP
Number of Streams from 1 to 100 streams
D.1. Network Diagram: KAIST - Kyungpook Univ.
3Com 4924
KAIST
2.5 G1GbE
1GbE
KREONET
1GbE
Kyungpook Univ.
host
hostCisco 7609 Cisco 7507
Daejeon Daegu
10
010
110
2500
600
700
800
900
1000
D.2 Experiment results on 200km between KAIST and Kyungpook Univ.
BIC TCPFAST TCPTCP Reno
number of streams
thro
ughp
ut (
Mbp
s)
RTT : 2.7 ms (2 hops)1 Gbps link
