51
Taming Anycast in a Wild Internet Stephen McQuistin University of Glasgow Verizon Digital Media Services Sree Priyanka Uppu Marcel Flores Verizon Digital Media Services

Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Taming Anycast in a Wild Internet

Stephen McQuistinUniversity of GlasgowVerizon Digital Media Services

Sree Priyanka UppuMarcel Flores Verizon Digital Media Services

Page 2: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

2

192.0.2.0/24192.0.2.0/24

San Jose, CA Denver, CO

Page 3: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

3

Page 4: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

4

Performance is impacted by taking longer routes to a farther site

35ms

36ms

45ms

Page 5: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

IP anycast

AS A AS A

5

Site 1 Site 2

Page 6: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

IP anycast

Peer X

Transit Z

AS A AS A

Site 1 Site 2

6

Page 7: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

IP anycast

AS BPeer X

Transit Z

AS A AS A

Site 1 Site 2

7

Page 8: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

IP anycast

AS BPeer X

Transit Z

AS A AS A

Site 1 Site 2

8

Desirable route/site is via Z to Site 2

Page 9: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

IP anycast

AS BPeer X

Transit Z

AS A AS A

Site 1 Site 2

9

… but AS B takes route through X to Site 1

Page 10: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

IP anycast

AS BPeer X

Transit Z

AS A AS A

Site 1 Site 2

Opaque, upstream provider policies determine end-user performance

10

Page 11: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

How do anycast operators influenceinbound routing?

Page 12: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Example

12

• Impact of adding a new peer is significant: two thirds of affected ASes see RTTs more than half

Page 13: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Announcement configurations

13

Site 1 Site 2 Site 3 Site 4 Site 5 …

Transit B

Transit C

Transit D

Peer E

Peer F

Peer G

Page 14: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Announcement configurations

14

Site 1 Site 2 Site 3 Site 4 Site 5 …

Transit B

Transit C

Transit D

Peer E

Peer F

Peer G

Page 15: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Announcement configurations

15

Site 1 Site 2 Site 3 Site 4 Site 5 …

Transit B

Transit C

Transit D

Peer E

Peer F

Peer G

Many-provider networks have a larger announcement configuration space

Page 16: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Many-provider networks

16

Page 17: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Many-provider networks

17

DNS root servers

Page 18: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Many-provider networks

18

A large commercial CDN

Page 19: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Many-provider networks

19

A large DNS provider

Page 20: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Many-provider networks

20

Page 21: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Many-provider networks

21

Few providers

Page 22: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Many-provider networks

22

Many providers

Page 23: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Many-provider networks

23

Page 24: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Many-provider networks

24

Many-provider networks generally have lower hegemony

Page 25: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Many-provider networks

25

Many-provider networks use a diversity of provider networks

Page 26: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

What are the potential network impacts of altering announcement configurations?

Page 27: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Network impacts

27

AS A

192.0.2.0/24

TransitB

TransitC Transit

D

Control configuration: announcements to a limited set of

transit providers

Page 28: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Network impacts

28

AS A

198.51.100.0/24

TransitB

TransitC Transit

D

Experimental configuration: announcements to a limited set of transit providers and to nearly all

other providers

Peer E

Peer F

Peer G

Page 29: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Grouping vantage points

29

• Measurements taken from RIPE Atlas probes

• We don't want to rely on results from individual probes

• Group together, first by AS, then by geolocation

• More grouping functions evaluated in the paper

Control Experimental

Page 30: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Round-trip time impacts

30

�1.00 �0.75 �0.50 �0.25 0.00 0.25 0.50 0.75 1.00Relative Change

0.0

0.2

0.4

0.6

0.8

1.0

CD

F of

Gro

ups

Page 31: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

�1.00 �0.75 �0.50 �0.25 0.00 0.25 0.50 0.75 1.00Relative Change

0.0

0.2

0.4

0.6

0.8

1.0

CD

F of

Gro

ups

Round-trip time impacts

31

Performance improves for 60% of groups

Page 32: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

�1.00 �0.75 �0.50 �0.25 0.00 0.25 0.50 0.75 1.00Relative Change

0.0

0.2

0.4

0.6

0.8

1.0

CD

F of

Gro

ups

Round-trip time impacts

32

.. and degrades for 40% of groups

Page 33: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Catchment shift impacts

33

Page 34: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Catchment shift impacts

34

Majority of differences (and the greatest changes) come from groups that shift catchment

Page 35: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Catchment shift impacts

35

In the paper, we further explore performance impacts in terms of

paths taken and inbound providers

Page 36: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Who should we announce to for optimal performance?

Page 37: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

DailyCatch

37

AS A

192.0.2.0/24

TransitB

TransitC Transit

D

Control configuration

AS A

198.51.100.0/24

TransitB

TransitC Transit

DPeer E

Peer F

Peer G

Experimental configuration

Page 38: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

DailyCatch

38

AS A

192.0.2.0/24

TransitB

TransitC Transit

D

Control configuration

AS A

198.51.100.0/24

TransitB

TransitC Transit

DPeer E

Peer F

Peer G

Experimental configuration

Page 39: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

DailyCatch

39

AS A

192.0.2.0/24

TransitB

TransitC Transit

D

Control configuration

AS A

198.51.100.0/24

TransitB

TransitC Transit

DPeer E

Peer F

Peer G

Experimental configuration

Snapshot A Snapshot B

Page 40: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

DailyCatch

40

AS A

192.0.2.0/24

TransitB

TransitC Transit

D

Control configuration

AS A

198.51.100.0/24

TransitB

TransitC Transit

DPeer E

Peer F

Peer G

Experimental configuration

Snapshot A Snapshot B

Output: a net score and group-level scores

Page 41: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Scoring & Comparison

41

1 Take two snapshots

Control

Experiment

traceroute

Page 42: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Scoring & Comparison

42

2 For each group, assign a score, by passing the change in RTT through a logistic function

Control

Experiment

traceroute

Page 43: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Scoring & Comparison

43

3 Weight each group score by the volume of traffic it represents

Control

Experiment

traceroute

Page 44: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Scoring & Comparison

44

4 Sum for the overall score

Control

Experiment

traceroute ∑

Page 45: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

45

Under the control configuration, probes are routed to San Jose

35ms

36ms

45ms

Page 46: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

46

Under the experimental configuration, probes are routed to Denver

35ms → 21ms

36ms → 21ms

45ms → 20ms

Page 47: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Mixed impacts in North America

47

Page 48: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Mixed impacts in North America

48

Group size doesn’t correlate with observed RTT

Page 49: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Mixed impacts in North America

49

RTT changes are not uniform within a single AS

Page 50: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Mixed impacts in North America

50

More results and case studiesin the paper

Page 51: Taming Anycast in a Wild Internet - SIGCOMM · 2019. 11. 11. · Taming Anycast in a Wild Internet 51 • Anycast networks with many providers interact with the Internet in an observably

Taming Anycast in a Wild Internet

51

• Anycast networks with many providers interact with the Internet in an observably different way than those with few providers

• This provides a configuration space of where and to who anycast announcements are given

• Announcement configurations can have significant network impacts

• DailyCatch enables a systematic, active measurement approach to configuration management