©2015 Apigee Corp. All Rights Reserved. 1

ARE YOUR MICROSERVICES

©2015 Apigee Corp. All Rights Reserved.

First a Story……

2

©2015 Apigee Corp. All Rights Reserved.

Microservices on the Internet

3

©2015 Apigee Corp. All Rights Reserved. 4

?

©2015 Apigee Corp. All Rights Reserved. 5

Amazon Internal Datacenter circa 2008

©2015 Apigee Corp. All Rights Reserved.

SOLUTION :

Zero-Trust Microservices

6

©2015 Apigee Corp. All Rights Reserved.

5 steps to make this better

NO CODE CHANGES NECESSARY !!

7

©2015 Apigee Corp. All Rights Reserved.

Step 1: Setting up a Pass-Through proxies

8

API Gateway

Microservice

Microservice

©2015 Apigee Corp. All Rights Reserved.

Step 2: Stay on the lookout

9

©2015 Apigee Corp. All Rights Reserved.

Step 3: Protect your backend

10

= BAD

©2015 Apigee Corp. All Rights Reserved.

Micro-circle of doom

11

Spike in Traffic

100% CPU Utilization

Poor response time

Users Press Refresh /Retry Logic

©2015 Apigee Corp. All Rights Reserved.

Spike Arrest Filtering

12

Spike Arrest Filter

©2015 Apigee Corp. All Rights Reserved.

Step 4: Catch bad API bots

13

©2015 Apigee Corp. All Rights Reserved.

Solution = Machine Learning + Crowdsourcing

14

Company 1Microservice

sCompany 2Microservice

s

Traffic Analytics with Machine Learning

©2015 Apigee Corp. All Rights Reserved.

Step 5 – Cache it Don’t Waste it

15

©2015 Apigee Corp. All Rights Reserved.

Joint probability governs microservice behavior

16

# of App Server calls3

Availability:97%

Assume each service has 99% availability

©2015 Apigee Corp. All Rights Reserved.

Caching the Edge = Instant Cost Reduction & Availability

17

Cache# of App Server calls

1.5 vs 3

Availability:98.5% vs 97%

50% Cache hit rate

©2015 Apigee Corp. All Rights Reserved.

Cache Analytics

18

©2015 Apigee Corp. All Rights Reserved.

Caching all layers = Instant Cost Reduction & Availability

19

Cache

# of App Server calls1 vs 3

Availability:99.25% vs 97%

50% Cache hit rate Cache

Cache

©2015 Apigee Corp. All Rights Reserved.

Recap of Benefits

1. Proxy with no code changes2. Find easy opportunities to improve

performance3. Guard against traffic spikes4. Guard against bots5. Cache to improve availability + costs

20

©2015 Apigee Corp. All Rights Reserved. 21

COME BY APIGEE BOOTH TO LEARN MORE