Introduction to Google Compute Engine

Getting Started with Google's Infrastructure

!!!!+ColinSu

Developer Expert, Google Cloud Platform

A Tour of Google Compute Engine

Google Cloud Platform

Slides are available on slideshare.net

goo.gl/ARRyaq

https://www.slideshare.net/secret/4BwdXGrfn9NNZ6

http://goo.gl/ARRyaq


OverviewGoogle Cloud Platform


The best way how Google share their

+ Cloud Infrastructure

+ Cloud Knowledge

+ Cloud Engineers

Your own data center, with minimum cost as possible as it could be

What is Google Cloud Platform


You will be using Google's InfrastructureVirtual MachinesNetworkingStorage

And be placed in a safe placeGoogle's Data Center

And Google will do those for youScaling Migrating Maintenance Take over anything you don't wanna do

Powered by Google


Google Cloud Family


Manage all API services on Google Cloud (e.g. Translation API, Prediction API, Maps API...)

Compose equivalent commands for:Command-line tools (Google Cloud SDK)RESTful API

Dashboard for monitoring all resources on Google Cloud Platform

Cloud Developer Console


Install/uninstall/upgrade all command-line tools related to Google Cloud Platform

Notification for new release of any Cloud SDK component

Automatization

Google Cloud SDK


StorageStorage Services in Google Cloud Platform


It's MySQL, but managed by Google

Relational Data Storage on Google Cloud

Use Cases

+ LAMP Applications

+ Google App Engine

Cloud SQL


Non-relational database (NoSQL)

Schema-less data

Use Cases

+ Highly scalable application

Cloud Datastore


ProtectedYour data is protected at multiple physical locations

Strong, configurable securityOAuth or simple access control on your data

Multiple usages

+ Serve static objects directly

+ Use with other Google Cloud products (Bridge)

Cloud Storage


Google Compute Engine Infrastructure-as-a-Service in Google Cloud Platform


Google has resources

+ CPU Cores

+ Memory

+ Networking

+ Persistency (Disks, Snapshot, Cloud Storage...)

+ Well-trained engineering monkeys

You have business and be busy

Infrastucture-as-a-Service


High-performance virtual machinesfrom micro-VM to large instance

Powered by Google's global networkyou could build a large cluster with strong and consistent bandwidth, provided by Google

Load Balancingspread incoming traffic across instances

Fast Bullet Reloadingquick deployment of large VMscommand-line interfaceweb-based console

Highly securedAll data written to disk in Compute Engine will be encrypted by high-class encryption algorithm

Google Compute Engine


KVM-based Virtual machines

Fast booting timeroutinely takes less than 30 secs

Various OS support

Various machine types

Instances on GCE

http://gce-demos.appspot.com


Operating Systems


Operating Systems


Operating Systems

Limited Preview


Operating Systems

Limited Preview


a unit of CPU capacity used to describe the compute power of instance types

2.75 GCEUs = 1 minimum power of 1 logical core on Sandy Bridge platform

Google Compute Engine Units (GCEUs)

=


Machine Types (Shared-Core)

f1-microShared Core

0.6 GB Memory

g1-small1 Core1.7 GB Memory

1.38 GCEUs


Machine Types (Standard)

n1-standard-nStarts from 1 Core

Start from 3.75 GB Memory

n Virtual CPUs Memory GCEUs

1 1 3.75 GB 2.752 2 7.50 GB 5.504 4 15 GB 118 8 30 GB 30

16 16 60 GB 60


Machine Types (High Memory)

n1-highmem-nStarts from 2 Core

Start from 13 GB Memory


2 2 13 GB 5.504 4 26 GB 118 8 52 GB 22

16 16 104 GB 44


Machine Types (High CPU)

n1-highcpu-nStarts from 2 Core

Start from 1.8 GB Memory


2 2 1.8 GB 5.504 4 3.6 GB 118 8 7.2 GB 22

16 16 14.4 GB 44


Regions & Zones

us-central1-aus-central1-b

europe-west1-a europe-west1-b


Regions & Zones

us-central1-aus-central1-b

europe-west1-a europe-west1-b

Singapore?

asia-east-aasia-east-b


Transparent Maintenance

Auto restart instances shutdown by system events

During transparent maintenance, you could set GCE to handle your instance in two ways:

+ Live migrate affect performance in some degreebut remain your instances online (no downtime)

+ Terminate and reboot

Live Migration


Virtual SCSI device

Block Storage

Persistent until deleted

Hot-plug to GCE instances (attach/deattach)

Persistent Disk


Primary Disk: OS boot volume

Persistent Disk Mode

GCE Virtual Machine

Root

Stateful Root Volume


Additional Disk: Read/Write Mode for user managed data volume


GCE Virtual Machine

Root

Stateful Root Volume

RW Data

Stateful Data Volume


Distribution Disk: Instant distribution of static content


GCE Virtual Machine

RO Data

Read-Only Data Volume

GCE Virtual MachineGCE Virtual Machine


Target Pools

Health Checking

Forwarding Rulesiptables for target pools

Load Balancing


CGE reserved IP for instance, won't change with the reboot of VMs

You can promote ephemeral IP to persistent IP

no DNS changing anymore

Persistent IP Addresses


Networking is first-class object on GCEwhich means you could apply/unapply it anytime easily

pre-defined networks before the first instance started

Integrated Networking


Those resources are global resources

+ Images (OS Images)

+ Snapshots

+ Network

+ Firewalls

+ Routes

And they're also first-class object in GCE

Multi-Region Resources


Scalr

Right Scale

Services Host GCE


BenchmarkHow Google Compute Engine performs?


Benchmarks - Sequential I/Ow/ a well-known and you-know competitor

http://github.com/Scalr/perf-benchmarks

http://github.com/Scalr/perf-benchmarks


Volume I/O

GCE EC2

Writes on ephemeral 175 MB/s 38-45 MB/s

Reads on ephemeral 93.3 MB/s 100-110 MB/s

Writes on persistent 84.5 MB/s 35-45 MB/s

Reads on persistent 98.9 MB/s 80-100 MB/s

http://gigaom.com/2013/03/15/by-the-numbers-how-google-compute-engine-stacks-up-to-amazon-ec2/

w/ a well-known and you-know competitor


Fast Booting Time




Network Bandwidth & Latency




Machine Types (Shared-Core) & Pricing


Machine Types (Standard) & Pricing


Machine Types (High Memory) & Pricing


Machine Types (High CPU) & Pricing


Other Pricing

https://developers.google.com/compute/pricing

https://developers.google.com/compute/pricing


Limited Preview ProjectsSealed Projects with Google Compute Engine


Create and manage a large number of homogeneous resources

Set up health checking to ensure you will have certain number of heathy instance to serve requests

config-based tool

Replica Pool Limited Preview


Replica Pool Limited Preview

Pool Resource

GCE Virtual Machine GCE Virtual MachineGCE Virtual Machine

Replica Resource

Replica Resource

Replica Resource


Replica Pool Configuration Limited Preview

{! "name": POOLNAME,! "type": "SMART_VM",! "initialNumReplicas": "3",! "template": {! "vmParams": {! "machineType": "n1-standard-1",! "baseInstanceName": "my-replica",! "disksToCreate": [{! "boot": "true",! "mode": "READ_WRITE",! "initializeParams": {! "sourceImage": IMAGE_URI,! "diskSizeGb": "100"! }! }],! "networkInterfaces": [{! "network": "default",! "accessConfigs": [{! "type": "ONE_TO_ONE_NAT",! "name": "External NAT"! }]! }]! }! }!}!


Useful Template Settings Limited Preview

"action": {! "name": "install-apache",! "commands": [! "sudo apt-get update"! "sudo apt-get install apache"! ...! ],! "envVariables: [! ...! ]!}!

"template.action": specify Linux command that will run on your instances after deployed



"baseInstanceName": "my-vm-replicas"!

"template.vmParams.baseInstanceName": The base instance name to use for these replicas



"disksToAttach": [{! "source": "full-uri-to-disk",! "mode": "read-only",! "type": "PERSISTENT",! }!]!

"template.vmParams.disksToAttach[]": Attaches persistent disks to your replicas


Health Checking Limited Preview

"healthChecks": [{! "name": "testhealth",! "path": "localhost/healthCheck"!}]!

Make sure all instance are healthy, if not, Pool will create more instances until it satisfies


Health Checking Options Limited Preview

checkIntervalSec Determines how often, in seconds, to make HTTP requests for the health check.

healthyThresholdSets the number of consecutive health check requests that must succeed before the replica is considered healthy. The default is 2 successful consecutive health checks.

timeoutSec How long to wait in seconds before claiming failures for a health check.

unhealthyThresholdThe number of consecutive health check requests that need to fail to consider the replica unhealthy.

Only a HTTP 2xx response is considered successful.


Windows Server Imageshttps://developers.google.com/compute/docs/premium-operating-systems

SSD Persistent Disks https://developers.google.com/compute/docs/disks#typeofdisks

Advanced Routinghttps://developers.google.com/compute/docs/networking#routing

Push-to-deployhttps://developers.google.com/appengine/docs/push-to-deploy

Other Limited Preview Projects

https://developers.google.com/compute/docs/premium-operating-systems

https://developers.google.com/compute/docs/disks#typeofdisks

https://developers.google.com/compute/docs/networking#routing

https://developers.google.com/appengine/docs/push-to-deploy


Technical Detail of Google Compute Enginehttp://commondatastorage.googleapis.com/io2012/presentations/live%20to%20website/313.pdf

Github Google Cloud Platform Teamhttp://googlecloudplatform.github.io/

Resources

http://commondatastorage.googleapis.com/io2012/presentations/live%20to%20website/313.pdf

http://googlecloudplatform.github.io/


EOFThanks For Listening+GDGTaipei


Questions?


Interested?Search "google cloud starter pack", use promo code: gcpteam-in

Technology

Introduction to Google Compute Engine