MLW 2014 Lightning Talk - To The Cloud in a Few Clicks

Preview:

DESCRIPTION

A quick overview on how to get started using MarkLogic “In The Cloud”. This talk will discuss various strategies for deployment on Amazon EC2 including common mistakes, recommended guidelines and an overview of AWS MarketPlace and Managed Clusters.

Citation preview

© COPYRIGHT 2013 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.

To the Cloud in a Few Clicks Presented by: David A. Lee, Lead Engineer, dlee@marklogic.com MarkLogic Managed Clusters on AWS

Cloud Ready

Amazon EC2

© COPYRIGHT 2013 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 2

www.mlapp.com

Auto scaling Group

Availability Zone #1

Security Group

Root Volume

Data Volume

EC2 Instance

MarkLogic

Auto scaling Group

Availability Zone #2

Security Group

Root Volume

Data Volume

EC2 Instance

MarkLogic

Auto scaling Group

Availability Zone #3

Security Group

Root Volume

Data Volume

EC2 Instance

MarkLogic

Region

Elastic Load Balancing

IAM

Role

Enterprise MarkLogic HA architecture on AWS

© COPYRIGHT 2013 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 3

MarkLogic on AWS

Launch from Marketplace directly Easiest but least flexibility – not for production

Use Marketplace AMI Customize and launch any way you want

Install from scratch (roll your own) Most difficult and error prone of all methods

Cloud Formation Managed Clusters

Deployment Options

© COPYRIGHT 2013 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 4

Cloud Formation

Recommended by AWS for ALL deployments (one to a million) Your entire stack is defined in a JSON document AWS manages workflow

Resource creation and dependency Error handling Rollback and recovery Dynamic update of configuration

Reliably reproduce reusable deployments Edit like Text, Manage like Code

YOU CANNOT RELIABLY REPRODUCE A MANUAL PROCESS

AWS CloudFormation

© COPYRIGHT 2013 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 5

Managed Clusters

Manages entire stack and lifecycle from 1 many nodes AutoScaling & Load Balancer for Elasticity and HA IAM Support (No AWS credentials on server) Manages formation and reformation of Clusters Manages EBS volumes for you

Initial creation Adding / subtracting / reattaching

Cloud Formation or your own processes

Not just for clusters or big enterprises !

© COPYRIGHT 2013 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 6

MarkLogic sample Cloud Formation Templates Documents and Implements recommended AWS and MarkLogic architecture

Great place to start on the right track Not only for clusters (great for 1 server to 100)

Start as-is then customize and extend MarketPlace AMI or roll your own AMI.

Invoke with AWS Console, CLI or native APIs IAM Roles for security Multi zone clusters for HA Pause and Restart entire cluster to save $$$ Easiest and most reliable way of deploying on AWS

© COPYRIGHT 2013 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 7

Managed Clusters with Cloud Formation

http://developer.marklogic.com/products/aws#clusters

© COPYRIGHT 2013 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 8

© COPYRIGHT 2013 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 9

© COPYRIGHT 2013 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 10

© COPYRIGHT 2013 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 11

www.mlapp.com

Auto scaling Group

Availability Zone #1

Security Group

Root Volume

Data Volume

EC2 Instance

MarkLogic

Auto scaling Group

Availability Zone #2

Security Group

Root Volume

Data Volume

EC2 Instance

MarkLogic

Auto scaling Group

Availability Zone #3

Security Group

Root Volume

Data Volume

EC2 Instance

MarkLogic

Region

Elastic Load Balancing

IAM

Role

Enterprise MarkLogic HA architecture on AWS

© COPYRIGHT 2013 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 12

Auto Scaling

ML Cluster CF Stack

Launch Config

Root Volume Data

Volume

Elastic Load

Balancing

IAM Profile Instances

Databases Amazon

SimpleDB

Security Groups

Resources created, configured, and managed