Surge 2014 - Kris Beevers - Data Driven DNS

DATA DRIVEN DNSTraffic Management for Distributed Applications

Kris Beevers@beevek

TRAFFIC MANAGEMENT

DATA DRIVEN DNS @nsoneinc

MULTIPLE OPTIONS FOR SERVICING A USER:2 or more servers... datacenters... CDNs

TRAFFIC MANAGEMENT

DATA DRIVEN DNS @nsoneinc

MULTIPLE OPTIONS FOR SERVICING A USER:2 or more servers... datacenters... CDNs

GOAL: SEND USER TO THE “BEST” OPTION

TRAFFIC MANAGEMENT

DATA DRIVEN DNS @nsoneinc

MULTIPLE OPTIONS FOR SERVICING A USER:2 or more servers... datacenters... CDNs

GOAL: SEND USER TO THE “BEST” OPTION

“BEST”:Fastest / most responsiveUpCheapest… any biz objective, really

TRAFFIC MANAGEMENT

DATA DRIVEN DNS @nsoneinc

MULTIPLE OPTIONS FOR SERVICING A USER:2 or more servers... datacenters... CDNs

GOAL: SEND USER TO THE “BEST” OPTION

“BEST”:Fastest / most responsiveUpCheapest… any biz objective, really

(of course, there’s more to “traffic management”)TRAFFIC MANAGEMENT

DATA DRIVEN DNS @nsoneinc

DNS IS BORING.

DATA DRIVEN DNS @nsoneinc

DNS IS BORING.

DATA DRIVEN DNS @nsoneinc

DNS IS BORING.

BUT

DISTRIBUTED APPLICATIONS ARE EASIER THAN EVER.(traffic management is more important than ever)

DATA DRIVEN DNS @nsoneinc

DNS IS BORING.

BUT

DISTRIBUTED APPLICATIONS ARE EASIER THAN EVER.(traffic management is more important than ever)

SO

DNS IS KIND OF EXCITING AGAIN. YAY.(because dns lookup is a decent time to make traffic management decisions)

DATA DRIVEN DNS @nsoneinc

WHY IS DNS LOOKUP A GOOD TIME TODO TRAFFIC MANAGEMENT?

DATA DRIVEN DNS @nsoneinc

WHY IS DNS LOOKUP A GOOD TIME TODO TRAFFIC MANAGEMENT?

DATA DRIVEN DNS @nsoneinc

1. APP ENTRYPOINT

WHY IS DNS LOOKUP A GOOD TIME TODO TRAFFIC MANAGEMENT?

1. APP ENTRYPOINT2. REALTIME STATE

Your systems The network Etc.

DATA DRIVEN DNS @nsoneinc

WHY IS DNS LOOKUP A GOOD TIME TODO TRAFFIC MANAGEMENT?

1. APP ENTRYPOINT2. REALTIME STATE3. HIGH FREQUENCY

Get to make “decisions” often

Can have impact faster than TTL in some key scenarios (load shedding)

DATA DRIVEN DNS @nsoneinc

WHY IS DNS LOOKUP A GOOD TIME TODO TRAFFIC MANAGEMENT?

1. APP ENTRYPOINT2. REALTIME STATE3. HIGH FREQUENCY4. GRANULAR

Per resolver Or per /24 (edns-client-subnet)

DATA DRIVEN DNS @nsoneinc

WHY IS DNS LOOKUP A GOOD TIME TODO TRAFFIC MANAGEMENT?

1. APP ENTRYPOINT2. REALTIME STATE3. HIGH FREQUENCY4. GRANULAR5. LOW LATENCY

Anycasting: decisions at the edge Caching: reuse decisions

DATA DRIVEN DNS @nsoneinc

DATA DRIVEN DNS @nsoneinc

TRADITIONALDNS STATE

DATA DRIVEN DNS @nsoneinc

DATA DRIVEN DNS @nsoneinc

WHAT DOES IT MEAN TO DODATA DRIVEN TRAFFIC MANAGEMENT?

DATA DRIVEN DNS @nsoneinc

UNDERSTAND WHAT WE’RETRYING TO OPTIMIZE

DATA DRIVEN DNS @nsoneinc

UNDERSTAND WHAT WE’RETRYING TO OPTIMIZE

response timesthroughputinfrastructure loadcost…

DATA DRIVEN DNS @nsoneinc

UNDERSTAND WHAT WE’RETRYING TO OPTIMIZE

response timesthroughputinfrastructure loadcost…

MAKE ROUTING DECISIONS USINGFIRST ORDER INFORMATION

DATA DRIVEN DNS @nsoneinc

UNDERSTAND WHAT WE’RETRYING TO OPTIMIZE

response timesthroughputinfrastructure loadcost…

MAKE ROUTING DECISIONS USINGFIRST ORDER INFORMATION

eyeball metricsapplication load metrics$/usage metricsaccurate geo/network/resolver data...

DATA DRIVENDNS STATE

CONFIGURATIONSTATIC & DYNAMIC

LIVE METRICSDATA FEEDS

DATA DRIVEN DNS @nsoneinc

DATA DRIVEN DNS @nsoneinc

WHAT DOES THIS LOOK LIKE IN PRACTICE?

DATA DRIVEN DNS @nsoneinc

APP

DATASOURCES

application metricsperfload...

DATA DRIVEN DNS @nsoneinc

APP

MONITORING

DATASOURCES

server, system, networkupnessperf/QoS...

DATA DRIVEN DNS @nsoneinc

APP

MONITORING

TOOLS

DATASOURCES

portals/manualbiz logic/automation...

DATA DRIVEN DNS @nsoneinc

APP

MONITORING

TOOLS

GATHERERS

DATASOURCES

routing/network metricsgeoip intelligenceresolver modeling & intelligenceeyeball metrics / RUM...

DATA DRIVEN DNS @nsoneinc

APP

MONITORING

TOOLS

GATHERERS

INGEST

DATASOURCES

DATA DRIVEN DNS @nsoneinc

APP

MONITORING

TOOLS

GATHERERS

INGEST

COMPILECLASSIFY

NORMALIZEAGGREGATE

...

DATASOURCES

DATA DRIVEN DNS @nsoneinc

APP

MONITORING

TOOLS

GATHERERS

INGEST PUBLISH

COMPILECLASSIFY

NORMALIZEAGGREGATE

...

DNSEDGES

DATASOURCES

DATA DRIVEN DNS @nsoneinc

APP

MONITORING

TOOLS

GATHERERS

INGEST PUBLISH

COMPILECLASSIFY

NORMALIZEAGGREGATE

...

DNSEDGES

QUERIES

DATASOURCES

TRAFFIC MANAGEMENT PATTERNS

DATA DRIVEN DNS @nsoneinc

TRAFFIC MANAGEMENT PATTERNS

DATA DRIVEN DNS @nsoneinc

GEO

TRAFFIC MANAGEMENT PATTERNS

DATA DRIVEN DNS @nsoneinc

GEO

TARGETING + FENCING

TRAFFIC MANAGEMENT PATTERNS

DATA DRIVEN DNS @nsoneinc

GEO +WEIGHTING

TRAFFIC MANAGEMENT PATTERNS

DATA DRIVEN DNS @nsoneinc

GEO +WEIGHTING +STICKINESS

TRAFFIC MANAGEMENT PATTERNS

DATA DRIVEN DNS @nsoneinc

GEO +WEIGHTING +STICKINESS +FAILOVER

TRAFFIC MANAGEMENT PATTERNS

DATA DRIVEN DNS @nsoneinc

GEO +WEIGHTING +STICKINESS +FAILOVER

CAN’T LOSE A SINGLE REQUEST?

ANYCAST.

TRAFFIC MANAGEMENT PATTERNS

DATA DRIVEN DNS @nsoneinc

GEO +WEIGHTING +STICKINESS +FAILOVER +LOAD SHEDDING

TRAFFIC MANAGEMENT PATTERNS

DATA DRIVEN DNS @nsoneinc

GEO +WEIGHTING +STICKINESS +FAILOVER +LOAD SHEDDING

COMMIT MANAGEMENTIP PREFIX FENCINGASN FENCINGPRIORITIZATIONRANDOMIZATION...

TRAFFIC MANAGEMENT PATTERNS

DATA DRIVEN DNS @nsoneinc

GEO +WEIGHTING +STICKINESS +FAILOVER +LOAD SHEDDING

COMMIT MANAGEMENTIP PREFIX FENCINGASN FENCINGPRIORITIZATIONRANDOMIZATION…

STATIC CONFIG +INFRASTRUCTURE INTELLIGENCE

TRAFFIC MANAGEMENT PATTERNS

DATA DRIVEN DNS @nsoneinc

METRICS ROUTING +WEIGHTING +STICKINESS +FAILOVER +LOAD SHEDDING

COMMIT MANAGEMENTIP PREFIX FENCINGASN FENCINGPRIORITIZATIONRANDOMIZATION…

STATIC CONFIG +INFRASTRUCTURE INTELLIGENCE +EYEBALL INTELLIGENCE

DATA DRIVEN DNS @nsoneinc

WHAT MATTERS MORE IN DYNAMIC DNS?HOW FAST YOU SPIT OUT AN ANSWER?

OR THAT IT’S THE RIGHT ANSWER?

DATA DRIVEN DNS @nsoneinc

WHAT MATTERS MORE IN DYNAMIC DNS?HOW FAST YOU SPIT OUT AN ANSWER?

OR THAT IT’S THE RIGHT ANSWER?

90-98% OF DNS QUERIES AREANSWERED FROM CACHE

(for high volume records)

DATA DRIVEN DNS @nsoneinc

WHAT MATTERS MORE IN DYNAMIC DNS?HOW FAST YOU SPIT OUT AN ANSWER?

OR THAT IT’S THE RIGHT ANSWER?

90-98% OF DNS QUERIES AREANSWERED FROM CACHE

(for high volume records)

YOU’D BETTER MAKE SURE THE

RIGHT ANSWER IS CACHED

DATA DRIVEN DNS @nsoneinc

DATA DRIVEN DNS @nsoneinc

ANYCASTING: More POPs is better, right?

40+

50+

?

<1010+15+

30+15+20+

DATA DRIVEN DNS @nsoneinc

EDNS-CLIENT-SUBNET

DATA DRIVEN DNS @nsoneinc

EDNS-CLIENT-SUBNETA.B.C.D: (xyz.com?) -> 8.8.8.8: (xyz.com? + A.B.C.0/24) -> dns3.p07.nsone.net

DATA DRIVEN DNS @nsoneinc

EDNS-CLIENT-SUBNETA.B.C.D: (xyz.com?) -> 8.8.8.8: (xyz.com? + A.B.C.0/24) -> dns3.p07.nsone.net

THANK YOU!

Kris Beevers

kbeevers@nsone.net@nsoneinc

DATA DRIVEN DNS @nsoneinc

WHERE ARE THE RESOLVERS?24h, sample ~0.5% NSONE queries CC /32s >10Q

US 95k 12k

BR 9k 1.3k

GB 7k 900

RU 6k 1.4k

JP 6k 800

CA 6k 800

DE 5k 600

CN 3k 700

AU 3k 400