83
Patrick Chanezon Director Enterprise Evangelism Microsoft [email protected] @chanezon NATO IST Symposium, May 2013 Cloud is such stuff as dreams are made on Sunday, May 12, 13

NATO IST Symposium 2013

Embed Size (px)

DESCRIPTION

Overview of the Cloud stack: infrastructure, platforms, software, development

Citation preview

Page 1: NATO IST Symposium 2013

Patrick ChanezonDirector Enterprise [email protected]@chanezon NATO IST Symposium, May 2013

Cloud is such stuff as dreams are made on

Sunday, May 12, 13

Page 2: NATO IST Symposium 2013

French

Polyglot

Server Side

San Francisco

Developer Relations

@chanezon

Sunday, May 12, 13

Page 3: NATO IST Symposium 2013

P@ & Military Software

Sunday, May 12, 13

Page 4: NATO IST Symposium 2013

Dreams Of my childhood

4

Sunday, May 12, 13

Page 5: NATO IST Symposium 2013

Accelerando / Singularity, in a Galaxy far far away

§ Even if we automate ourselves out of a job every 10 years

§ ...I don’t think the singularity is near!

5

Sunday, May 12, 13

Page 6: NATO IST Symposium 2013

Moore's Law is for Hardware Only

§ Does not apply to software

§ Productivity gains not keeping up with hardware and bandwidth

§ Writing software is hard, painful, and still very much a craft

6

Sunday, May 12, 13

Page 7: NATO IST Symposium 2013

Moore's Law’s free lunch is over

§ Herb Sutter, Welcome to the Junglehttp://herbsutter.com/welcome-to-the-jungle/

7

Sunday, May 12, 13

Page 8: NATO IST Symposium 2013

Predictions

“The future is already here — it's just not very evenly distributed” William Gibson

8

Sunday, May 12, 13

Page 9: NATO IST Symposium 2013

Architecture Changes: 60’s Mainframe

Sunday, May 12, 13

Page 10: NATO IST Symposium 2013

Architecture Changes: 80’s Client-Server

Sunday, May 12, 13

Page 11: NATO IST Symposium 2013

Architecture Changes: 90’s Web

Sunday, May 12, 13

Page 12: NATO IST Symposium 2013

Architecture Changes: 2010’s Cloud, HTML5, Mobile

Sunday, May 12, 13

Page 13: NATO IST Symposium 2013

Back to Client Server: Groovy Baby!

13

Sunday, May 12, 13

Page 14: NATO IST Symposium 2013

What is Cloud Computing?

14

Cloud According to my daughter Eliette

Sunday, May 12, 13

Page 15: NATO IST Symposium 2013

Cloud Stack - Classic Pyramid

15

Platform As A Service

Infrastructure As A Service

SoftwareAs A Service

Sunday, May 12, 13

Page 16: NATO IST Symposium 2013

Cloud Stack - By Number

16

Platform As A Service

InfrastructureAs A Service

SoftwareAs A Service

Sunday, May 12, 13

Page 17: NATO IST Symposium 2013

Cloud Stack - By Value

17

InfrastructureAs A Service

SoftwareAs A Service

Platform As A Service

Sunday, May 12, 13

Page 18: NATO IST Symposium 2013

Cloud Stack - Neutral

18

Platform As A Service

Infrastructure As A Service

SoftwareAs A Service

Sunday, May 12, 13

Page 19: NATO IST Symposium 2013

Crossing the Chasm

§ Build the whole product

§ Cloud getting mainstream: Apple iCloud

§ Opportunities and risks

§ Ecosystems, various platforms

19

Picture from Wikimedia Foundation http://en.wikipedia.org/wiki/File:Technology-Adoption-Lifecycle.png

Sunday, May 12, 13

Page 20: NATO IST Symposium 2013

Cloud Stack - History

§ What does cloud mean, 4 main angles• Software 1994 Netscape

• Infrastructure 2002 Amazon AWS

• Platform 2008 Google

• Development now!

20

§ Industrialization of hardware and software infrastructurelike electricity beginning of 20th century

§ But software development itself is moving towards craftmanship

Sunday, May 12, 13

Page 21: NATO IST Symposium 2013

Cloud started at Consumer websites solving their needs

• Google, Amazon, Yahoo, Facebook, Twitter

• Large Data Sets

• Storage Capacity growing faster than Moore’s Law

• Fast Networks

• Horizontal -> Vertical scalability

• Open Source Software

• Virtualization

• Cloud is a productization of these infrastructures

• Public Clouds Services: Google, Amazon

• Open Source Software: Hadoop, Eucalyptus, Ubuntu, Cloud Foundry

Sunday, May 12, 13

Page 22: NATO IST Symposium 2013

Google research papers: good predictor of where BigData is going

• Horizontal scalability 2004: Map/Reduce (Hadoop)

• NoSQL 2006: Bigtable (Mongo, Cassandra, HBase, Riak)

• Real Time analytics 2010: Dremel, BigQuery (Impala)

• Horizontally Scalable SQL 2012: Spanner/ Amazon Redshift

Sunday, May 12, 13

Page 23: NATO IST Symposium 2013

23

Infrastructure

Sunday, May 12, 13

Page 24: NATO IST Symposium 2013

IaaS/Virtualization getting mainstream

§ AWS, Azure, Google, Joyent, Rackspace,...

§ Open Source projects: OpenStack,CloudStack, Eucalyptus

§ Automation: Chef, Juju

§ Standardization?

§ Inside the Firewall, Virtualization: VMware, Microsoft HyperV, Xen, KVM

§ 50% of workloads are virtualized

§ Easy to provision, manage instance...BUT

§ Still need to manage backups, software stacks, monitor, upgrades

§ Devops: cultural movement, dev and ops working hand in hand, sharing tools and processes

24

Sunday, May 12, 13

Page 25: NATO IST Symposium 2013

With Infrastructure, you still need to build your own platform

§ Need to build a distributed platform on top of you infrastructure

§ Story of the AWS meltdown from last summer• http://blog.reddit.com/2011/03/why-reddit-was-down-for-6-of-last-24.html

• http://www.readwriteweb.com/cloud/2010/12/chaos-monkey-how-netflix-uses.php

• http://news.ycombinator.com/item?id=2477296

• http://stu.mp/2011/04/the-cloud-is-not-a-silver-bullet.html

§ Twilio, Smugmug, SimpleGeo survived it because they built their own distributed platform on top of IaaS

§ Enterprise customers want to consider Infrastructure like CDNs• Multi Cloud usage

• Based on Open Source de facto standards, or full standards whenever that happens

25

Sunday, May 12, 13

Page 26: NATO IST Symposium 2013

26

Platforms

Sunday, May 12, 13

Page 27: NATO IST Symposium 2013

Platforms

§ Raise the Unit of currency to be application & services instead of infrastructure

§ Google App Engine, Microsoft Windows Azure, Cloud Foundry, SalesForce Heroku, Stax (Cloudbees), Amazon elastic beanstalk, Red Hat OpenShift, AppFog

§ Single or a few languages, services

§ Start of Multi language Polyglot platforms

§ Enabler for Agile Developers -> Create Business value faster

§ Lack of standards: risk, vendor lock-in

§ Enterprise needs:•Control, customizability

•Private/Hybrid Cloud: Azure/Windows Server, Cloud Foundry Bosh, Red Hat Openshift

•Avoid lock-in27

Sunday, May 12, 13

Page 28: NATO IST Symposium 2013

Agile Development Processes

Sunday, May 12, 13

Page 29: NATO IST Symposium 2013

Agility as a survival skill

§ Consumer software is becoming like fashion•Phone apps, social apps, short lifetime, fast lifecycles

•Ab testing

§ Clay shirky situational apps

§ Kent Beck, Usenix 2011 Talk, “Software G-Forces”change in software process when frequency grows

§ Cloud Platforms enables an Agile culture, driver for innovation•Scalability is built in the platforms

•Can iterate faster

•Focus on design

§ Cloud Platforms lets developers focus on driving business value

29

Sunday, May 12, 13

Page 30: NATO IST Symposium 2013

Cloud Foundry: The Open PaaS

30

Clou

d Pr

ovide

r Int

erfa

ce

Application Service Private Clouds

PublicCloud

MicroCloud

Data Services

Other Services

Msg Services

vFabric Postgres

vFabric RabbitMQTM

• Open Source: Apache 2 Licensed

• multi language/frameworks

• multi services

• multi cloud

Sunday, May 12, 13

Page 31: NATO IST Symposium 2013

Windows Azure

flexible open solid

Sunday, May 12, 13

Page 32: NATO IST Symposium 2013

Sunday, May 12, 13

Page 33: NATO IST Symposium 2013

Global Footprin

Sunday, May 12, 13

Page 34: NATO IST Symposium 2013

Sunday, May 12, 13

Page 35: NATO IST Symposium 2013

ß Windows Server and Linux

Sunday, May 12, 13

Page 36: NATO IST Symposium 2013

ß Windows Server and Linux

ß Flexible Workload Support

Sunday, May 12, 13

Page 37: NATO IST Symposium 2013

Virtual Machinesß Windows Server and

Linuxß Flexible Workload

Supportß Virtual Private Networking

Sunday, May 12, 13

Page 38: NATO IST Symposium 2013

virtual machine portability

Sunday, May 12, 13

Page 39: NATO IST Symposium 2013

Sunday, May 12, 13

Page 40: NATO IST Symposium 2013

Windows Azure

Your Data Center

Sunday, May 12, 13

Page 41: NATO IST Symposium 2013

Windows Azure

Your Data Center

Sunday, May 12, 13

Page 42: NATO IST Symposium 2013

Windows Azure

Your Data Center

Sunday, May 12, 13

Page 43: NATO IST Symposium 2013

Your Data Center

Windows Azure

Sunday, May 12, 13

Page 44: NATO IST Symposium 2013

Your Data Center

Windows Azure Other Service Providers

Sunday, May 12, 13

Page 45: NATO IST Symposium 2013

Your Data Center

Windows Azure Other Service Providers

Sunday, May 12, 13

Page 46: NATO IST Symposium 2013

Your Data Center

Windows Azure

Sunday, May 12, 13

Page 47: NATO IST Symposium 2013

Your Data Center

Windows Azure Other Service Providers

Sunday, May 12, 13

Page 48: NATO IST Symposium 2013

Your Data Center

Windows Azure Other Service Providers

no lock-inSunday, May 12, 13

Page 49: NATO IST Symposium 2013

Sunday, May 12, 13

Page 50: NATO IST Symposium 2013

ß Build with ASP.NET, Node.js or PHP

Sunday, May 12, 13

Page 51: NATO IST Symposium 2013

ß Build with ASP.NET, Node.js or PHP

ß Deploy in seconds with FTP, Git or TFS

Sunday, May 12, 13

Page 52: NATO IST Symposium 2013

Web Sites ß Build with ASP.NET,

Node.js or PHPß Deploy in seconds with

FTP, Git or TFS ß Start for free, scale up as

your traffic grows

Sunday, May 12, 13

Page 53: NATO IST Symposium 2013

Sunday, May 12, 13

Page 54: NATO IST Symposium 2013

ß Easily build cloud back-ends

Sunday, May 12, 13

Page 55: NATO IST Symposium 2013

ß Easily build cloud back-endsß Data, identity, push

notifications, background jobs

Sunday, May 12, 13

Page 56: NATO IST Symposium 2013

Mobile Servicesß Easily build cloud back-endsß Data, identity, push

notifications, background jobsß Windows 8, Windows Phone,

iOS, Android, HTML5

Sunday, May 12, 13

Page 57: NATO IST Symposium 2013

Sunday, May 12, 13

Page 58: NATO IST Symposium 2013

Data ID  Services

Sunday, May 12, 13

Page 59: NATO IST Symposium 2013

Data ID  Services

Sunday, May 12, 13

Page 60: NATO IST Symposium 2013

Data ID  Services

Custom Script(s)<//>

Sunday, May 12, 13

Page 61: NATO IST Symposium 2013

Data ID  Services

Custom Script(s)<//>

Sunday, May 12, 13

Page 62: NATO IST Symposium 2013

Sunday, May 12, 13

Page 63: NATO IST Symposium 2013

ß Build infinitely scalable apps and services

Sunday, May 12, 13

Page 64: NATO IST Symposium 2013

ß Build infinitely scalable apps and services

ß Support rich multi-tier architectures

Sunday, May 12, 13

Page 65: NATO IST Symposium 2013

Cloud Servicesß Build infinitely scalable

apps and servicesß Support rich multi-tier

architecturesß Automated application

management

Sunday, May 12, 13

Page 66: NATO IST Symposium 2013

Multiple Services

storagebig data

caching

CDN

database

identity

media

messaging

networking

trafficcloud

services

Sunday, May 12, 13

Page 67: NATO IST Symposium 2013

Multiple Services

storagebig data

caching

CDN

database

identity

media

messaging

networking

trafficcloud

services

Sunday, May 12, 13

Page 68: NATO IST Symposium 2013

Multiple Languages

à http://www.windowsazure.com/en-us/develop/overview/

Sunday, May 12, 13

Page 69: NATO IST Symposium 2013

open source

à http://github.com/windowsazure

Sunday, May 12, 13

Page 70: NATO IST Symposium 2013

Software: Apps Marketplaces

45

VMware Horizon App Manager

Sunday, May 12, 13

Page 71: NATO IST Symposium 2013

BigData Platforms: Hadoop

§ Apache Hadoop, open source version of Google MapReduce, GFS...

§ Cloudera, many others, space heating up

§ EMC, HortonWorks distros

§ Google Bigquery

§ Be your own bitch, today, Cloudera distro

46

Sunday, May 12, 13

Page 72: NATO IST Symposium 2013

Services

§ Services

§ Apis, apigee, mashery

§ Telephony, Twilio

§ Geo

§ Social

§ Visualization

47

Sunday, May 12, 13

Page 73: NATO IST Symposium 2013

Development

§ Final frontier, happening now

§ Not whole product yet

§ Source: Google code, Github

§ Dev: Cloud9, Exo, Orion

§ Higher level case tools, Wavemaker, Orangescape, Runmyprocess

§ Build: Jenkins, Cloudbees, OpenShift

§ Test: feature of cloud platforms

§ Community Stackoverflow, Github

48

Sunday, May 12, 13

Page 74: NATO IST Symposium 2013

49

Lessons for Developers

Sunday, May 12, 13

Page 75: NATO IST Symposium 2013

Predictions

§ Software is becoming like fashion, design rules

§ Welcome to Babel, use the best tool for the job, embrace multiple language & heterogeneity

§ Our jobs will change, build yourself out of your current job

§ Sysadmin jobs will morph to hybrid cloud admins

§ Many opportunities open when you embrace change

50

Sunday, May 12, 13

Page 76: NATO IST Symposium 2013

Things to Forget

§ First normal form

§ Waterfall model

§ Single server deployment

§ Single language skill

51

Sunday, May 12, 13

Page 77: NATO IST Symposium 2013

Things to Learn

• Agile, API Design

• UI Design, Javacript, HTML5, CSS3

• A/B Testing

• Open Source, Open Standards

• Architecture, Distributed Computing (CAP theorem, 8 fallacies)

• Cloud Platforms and APIs

• Multiple types of languages (imperative, object, functional, logic)

• Learn to live in a box (embrace platform limitations) to think outside the box

52

Sunday, May 12, 13

Page 78: NATO IST Symposium 2013

What it means for you

§ Build On the shoulders of giants

§ Take risks, to innovate

§ Learn everyday, try different things

§ learn an api or framework / month

§ Learn a language / year

§ Be fast and agile

§ Make money

§ Social and app stores

53

Sunday, May 12, 13

Page 79: NATO IST Symposium 2013

Such stuff as dreams are made on

§ Like a kid on a candy store: there's never been a better time to be a software developer!

§ Welcome to the Cloud: embrace change and reinvent yourselves

§ “The future is already there, not evenly distributed” Gibson

§ We Developers, invent the future today

54

Sunday, May 12, 13

Page 80: NATO IST Symposium 2013

Thank You!@WindowsAzure

@chanezon

Website : www.windowsazure.com/

t

t

Sunday, May 12, 13

Page 81: NATO IST Symposium 2013

Books / Articles

§ Nick Carr, The Big Switch

§ Eric Raymond, The Art of Unix Programming

§ Weinberg, Psychology of Computer Programming

§ Wes python book

§ Mark html5 book

§ Kent Beck XP

§ Hunt, Thomas, The Pragmatic Programmer

§ Ade Oshineye, Apprenticeship Patterns

§ Matt Cutt's Ignite Talk IO 2011, Trying different things

§ Josh Bloch talk about api design

§ Larry and Sergey, Anatomy of a Search Engine

§ Rob Pike, The Practice of Programming

56

Sunday, May 12, 13

Page 82: NATO IST Symposium 2013

Papers / Talks

§ Simon Wardley, Oscon 09 “Cloud - Why IT Matters”

§ Tim O’Reilly article on internet os

§ Peter Deutsch’s 8 Fallacies of Distributed Computing

§ Brewer’s CAP Theorem

§ Gregor Hohpe’s Starbucks Does Not Use Two-Phase Commit

§ Herb Sutter, Welcome to the Junglehttp://herbsutter.com/welcome-to-the-jungle/

§ Stuff I tag http://www.delicious.com/chanezon/

§ More specifically http://www.delicious.com/chanezon/cloudfoundry

§ My previous Talks http://www.slideshare.net/chanezon

§ My list of favorite books http://www.chanezon.com/pat/soft_books.html

57

Sunday, May 12, 13

Page 83: NATO IST Symposium 2013

Acknowledgement

§ Drawings from my daughters Eliette

58

Sunday, May 12, 13