40
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Innovation at Amazon Life of a Code Change in a Tier-1 service MADHUSUDAN SHEKAR | PRINCIPAL EVANGELIST

Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Innovation at AmazonLife of a Code Change in a Tier-1 service

M A D H U S U D A N S H E K A R | P R I N C I PA L E V A N G E L I S T

Page 2: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Why do you care?

Page 3: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

To PRODUCTION!

Page 4: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

I t i s rather impress ive…

50M Deployments in a year

10’s of thousands of builders.

That comes to more than a software deployment every second

Page 5: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Much of what enables Amazon i s in our tool ing , and we’re re leas ing most of i t to AWS customers .

You can bu i ld a developer exper ience SUPERIOR to Amazon.

Page 6: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

The rest of the ta lk :

1. Technical and cultural landscape at Amazon2. Tooling Philosophy3. Code review, build, and the pre-mortem4. Pipelining and deployment5. Managing infrastructure, and auditing6. Final thoughts + Q&A

Page 7: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Our Growth F ly Wheel

Page 8: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Innovat ion Equat ion

Page 9: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon’s Ser v ice Or iented Arch i tecture

8 Engineers is still the average sized team at Amazon.

Page 10: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

DevOps and Ownersh ip

1. A federation of startups2. Everyone owns the product end to end

Page 11: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

Architecture

Page 12: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z
Page 13: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

Almost Everything is Service

Page 14: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

Manageable components

Page 15: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Let ’s Meet Our Hero….

hello world.

Page 16: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

My one s l ide on the loca l development process

Yeee Ha

• Agile… ish?• “The Process” will ensure you

don’t cut corners.• Iterate as quickly as you can.• Your host is a service.

Page 17: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

The rest of the ta lk :

1. Technical and cultural landscape at Amazon2. Tooling Philosophy3. Code review, build, and the pre-mortem4. Pipelining and deployment5. Managing infrastructure, and auditing6. Final thoughts + Q&A

Page 18: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Building Blocks

Key Ca l louts

Fund Winners

Marketplace

Page 19: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Our Antagonist

It’s me, THE PROCESS.

Page 20: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

A change i s born.

• Replication• Access Control• Code Search on Commit• AWS CodeCommit gives you a lot

of these same advantages (BTW)

Page 21: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

The rest of the ta lk :

1. Technical and cultural landscape at Amazon2. Tooling Philosophy3. Code review, build, and the pre-mortem4. Pipelining and deployment5. Managing infrastructure, and auditing6. Final thoughts + Q&A

Page 22: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

CodeReview and Pu l l Request

Does this thing make me

look fat?

• The last step before “the process” takes over.

• Teams can block commits to mainline via a variety of rules.

• You find very little branching strategy at Amazon.

Page 23: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

The Bu i ld

Global Dependency Closure

Unit Testing

Static Analysis

Bad Software Blocked

Page 24: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Beg in with the Pre-Mortem

Page 25: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

The rest of the ta lk :

1. Technical and cultural landscape at Amazon2. Tooling Philosophy3. Code review, build, and the pre-mortem4. Pipelining and deployment5. Managing infrastructure, and auditing6. Final thoughts + Q&A

Page 26: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Part 2 – The Journey

TestIntegration

ProductionUgh Oh.

Page 27: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

18 Regions + 1 Local Region

54 Availability Zones

100+ Edge locations

Did I mention we also deploy for Amazon?

Page 28: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Re lease Automat ion

This is going to be a long road trip.

It’s beautiful.

Page 29: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Global Andon Cords

Manual Approval Time Windows Test Tasks

Re lease Pr imit ives

Attribution and Roles

Neat.

Page 30: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Changing Software

Auto-Rollback

Page 31: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Changing Software

Incremental Release

Page 32: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Changing Software

Health Tracking

Page 33: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Changing Software

Change Providence

Page 34: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Changing Software

Auto-Rollback Incremental Release

Change ProvidenceHealth Tracking

I don’t feel trusted.

You’re not!

Page 35: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

The rest of the ta lk :

1. Technical and cultural landscape at Amazon2. Tooling Philosophy3. Code review, build, and the pre-mortem4. Pipelining and deployment5. Managing infrastructure, and auditing6. Final thoughts + Q&A

Page 36: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

In f rastructure Automat ion

• 1-Day region builds• Infra and OS pipelined

like software• Lock in best practices

with our own templating engine

Page 37: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

I f A l l Goes Wel l…

I Made it!

Page 38: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Aud i t ing and Reduc ing R isk

My job is never done.

Page 39: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

The rest of the ta lk :

1. Technical and cultural landscape at Amazon2. Tooling Philosophy3. Code review, build, and the pre-mortem4. Pipelining and deployment5. Managing infrastructure, and auditing6. Final thoughts + Q&A

Page 40: Innovation at Amazon Madhusudhan Sekar - Accenture · Innovation at Amazon_Madhusudhan Sekar Created Date: 20180622060409Z

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

• Amazon standardizes a ton of the software development process via common platforms.

• We encourage an open internal marketplace for extending that platform, and fund winners.

• We ship so much because we continually ship everything to production, not because we go crazy fast.

• Amazon is doubling down on it’s AWS tools to run it’s own business.

Key Enablers to Our Success