Update on Microsoft Technologytechnine.azurewebsites.net/wp-content/uploads/2019/03/TechNine.be... · Azure Fabric Controller Compute Networking Azure Resource Manager Storage Azure

Update on Microsoft Technology

Azure Sizing

Datacenter: Dublin, Ireland

Datacenter: Dublin, Ireland

Project Natick

https://natick.research.microsoft.com/

United States

United States

Canada

Mexico

Venezuela

Colombia

Peru

Bolivia

Brazil

Argentina

Atlanta OceanAlgeria

MaliNiger

Nigeria

Chad

Libya Egypt

Sudan

Ethiopia

Dr Congo

AngolaZambia

Nambia

South

Africa

Greenland

Svalbard

Sweden

Norway

United

Kingdom

France

PolandUkraine

Turkey

Saudi

Arabia

Iran

Kazakistan

India

Russia

China

Myanmar

(Burma)

Indian Ocean

Indonesia

Australia

Pacific Ocean

Pacific Ocean

Data centerOwned capacity

Future capacity

Leased capacity

Edge site

DCs and network sites not exhaustive

Azure inter-DC dark fiber backbone

Geos and regions

The world is divided into geographies

A region is defined by a bandwidth and latency envelope

Region 1

Region 2

100’s of km

https://docs.microsoft.com/en-us/azure/best-practices-availability-paired-regions

Availability Zones | intra-region resilienceAZs provide for HA in the face of localized DC and software failures

Customer promise: a failure in one AZ should not cause other AZs within the same region to fail

Different water, power lines, network, generators

Customers can do application-level synchronous replication between AZs

Three is enough for quorum

Regions offer multiple Availability Zones (AZs)

At least three AZs

An AZ consists of one or more datacenters

Region

Subscription 1 Subscription 2

Stamps – Fault Domains – Upgrade Domains

Azure networking

DC Hardware Services Intra-Region WAN Backbone Edge and ExpressRoute CDN Last Mile

• SmartNIC/FPGA• SONiC

• Virtual Networks• Load Balancing• VPN Services• Firewall• DDoS Protection• DNS & Traffic

Management

• DC Networks• Regional Networks• Optical Modules

• Software WAN• Subsea Cables• Terrestrial Fiber• National Clouds

• Internet Peering• ExpressRoute

• Acceleration for applications and content

• E2E monitoring (Network Watcher, Network Performance Monitoring)

Enterprise

DC/Corpnet

Consumers

Regional

Network

Microsoft

WAN

Edge

ExpressRoute

CDN

Enterprise, SMB,

mobile

Azure Region ‘A’

Azure Region ‘B’

Regional

Network

Regional

Network

Regional

Network

Internet

Exchanges

Cable

Carrier

RNG regional architecture

Microsoft

backbone

DC Region

RNG RNG

DC DC DC DC

DC DC

Region

Contiguous geographical area up to roughly 100km in diameter (2.0ms RTT)

Regional network gateway

Massively parallel, hyper scale

DC interconnect

Space and power protected

Data centers

Small, Medium, or Large (T-shirt sizes)

Only contains server racks, DC network

RNGs are sized to support growing the region by adding data centers

Azure Network Emulator

What it isContainerized router VMs linked via VXLAN tunnels to create a faithful replica of production network

“Bug compatible” emulation of production network gives network engineers realistic test environment

StatusUsed daily to de-risk major network operations

Over 12 million core-hours spent on emulation in last six months

Numerous bugs caught before hitting production network

Azure

SONiC

Virtual links

Hyperscale SDN

Management plane Create a tenant

Control planePlumb tenant ACLs to switches

Data plane Apply ACLs to flows

Switch (Host)

Management plane

Data plane

SDN

Control plane

Azure Resource Manager

Controller

Key to flexibility and scale is Host SDN Proprietary appliance

Management

Control

Data

Azure Infrastructure

Azure architecture

Hardware Manager

Resource Provider

Azure Fabric Controller

Compute Networking


Storage

Azure Portal CLI 3rd party

Au

then

ticati

on

Tele

metr

y &

In

sig

hts

RB

AC

Service Fabric AKS PaaS offeringWeb Apps

Azure Infrastructure

Hardware Manager

Azure SDN architectureAzure SDN

The basis of all NW virtualization in our datacenters

VNet

The logical network for all workloads regardless of chosen service model or application container

Decoupled

SDN allows compute to evolve and converge to a single allocator


Compute RPNetwork RP

Regional Network

Manager

Network State

Manager

Software load

balancerDirectory

Service

Compute

Controller

Azure Storage architecture

Geo replication

Storage Stamp

LB

Partition Layer

Front-Ends

DFS Layer

Intra-stamp replication

Storage Stamp

LB

Partition Layer

Front-Ends

DFS Layer

Intra-stamp replication

Request

network

resources

Inventory sync Inventory sync

RDSRNMNRPCRP USLB

CDSNSMDCM SLB

Network agent

Datacenter Manager

agent

Tenant Manager

agent

Load balancer

agent

ARM (Azure Resource Manager)

NSM pushes

CA:PA mappings

to RDSCDS pulls

from RDS

NMAgent pulls from CDS

RNM

makes

network

object

updates

RNM gets

info from

TM

SLB finds its

VIP ranges

from USLB

NSM pushes VIP

ranges to USLB

SLBHP is

configured

with SLB

endpoint

Inventory sync

Send goal

state

Send goal

state

Send goal

state

NRP is

pass-through

AllocateNtwkResources

LBProgramming

Ntwk

programming

Global

Regional

Cluster

Node

TM

Azure compute architecture

Azure Hardware

Gen 2

Processor 2 x 6 Core 2.1 GHz

Memory 32 GiB

Hard Drive 6 x 500 GB

SSD None

NIC 1 Gb/s

Gen 3


Memory 128 GiB

Hard Drive 1 x 4 TB

SSD 5 x 480 GB

NIC 10 Gb/s

Gen 4


Memory 192 GiB

Hard Drive 4 x 2 TB

SSD 4 x 480 GB

NIC 40 Gb/s

Godzilla


Memory 512 GiB

Hard Drive None

SSD 9 x 800 GB

NIC 40 Gb/s

Gen 5


Memory 256 GiB

Hard Drive None

SSD6 x 960 GB PCIe Flash and 1 x 960 GB SATA

NIC 40 Gb/s + FPGA

Beast


Memory 4096 GiB

Hard Drive None

SSD4 x 2 TB NVMe, 1 x 960 GB SATA

NIC 40 Gb/s

Gen 6

Processor2 x Skylake 24 Core 2.7GHz

Memory 768GiB DDR4

Hard Drive None

SSD4 x 960 GB M.2 SSDs and 1 x 960 GB SATA

NIC 40 Gb/s

FPGA Yes

Beast v2


Memory 12 TiB

Hard Drive None


NIC 50 Gb/s

3x

Beast

Gen 2


Memory 32 GiB


SSD None

NIC 1 Gb/s

Gen 3


Memory 128 GiB

Hard Drive 1 x 4 TB

SSD 5 x 480 GB

NIC 10 Gb/s

Gen 4


Memory 192 GiB

Hard Drive 4 x 2 TB

SSD 4 x 480 GB

NIC 40 Gb/s

Godzilla


Memory 512 GiB

Hard Drive None

SSD 9 x 800 GB

NIC 40 Gb/s

Gen 5


Memory 256 GiB

Hard Drive None


NIC 40 Gb/s + FPGA

Beast


Memory 4096 GiB

Hard Drive None


NIC 40 Gb/s

Gen 6


Memory 768GiB DDR4

Hard Drive None


NIC 40 Gb/s

FPGA Yes

Beast v2


Memory 12 TiB

Hard Drive None


NIC 50 Gb/s

3x

BeastAzure Hardware

Gen 2


Memory 32 GiB


SSD None

NIC 1 Gb/s

Gen 3


Memory 128 GiB

Hard Drive 1 x 4 TB

SSD 5 x 480 GB

NIC 10 Gb/s

Gen 4


Memory 192 GiB

Hard Drive 4 x 2 TB

SSD 4 x 480 GB

NIC 40 Gb/s

Godzilla


Memory 512 GiB

Hard Drive None

SSD 9 x 800 GB

NIC 40 Gb/s

Gen 5


Memory 256 GiB

Hard Drive None


NIC 40 Gb/s + FPGA

Beast


Memory 4096 GiB

Hard Drive None


NIC 40 Gb/s

Gen 6


Memory 768GiB DDR4

Hard Drive None


NIC 40 Gb/s

FPGA Yes

Beast v2


Memory 12 TiB

Hard Drive None


NIC 50 Gb/s

3x

BeastAzure Hardware

Azure Sphere

Processor 1 x A7 Core @ 500 MHz

Memory 4 MiB

Hard Drive BYO

SSD BYO

WiFi 2.4/5.0 GHz 802.11 b/g/n

0.00000000533

Beasts

A History of Azure VM Sizes

History of Series

A History of Azure VM Sizes

Today

Computing options for every workload

ACU per vCPU$ per kACUEverything• Created for comparing

compute performance

across VM families

• Helps to quickly identify

the VM family that meet

your performance goals

• ACUs were first defined

on the “Standard_A1”

• Small “Standard_A1”

= 100 ACU

• All other VM ACU

measurements are

referenced from this

baseline

Av2 B Fv1 Dv2 H Dv3 Ev3 Fv2 M

$ per kACU

ACU per vCPU

Azure Compute Units (ACUs)

0

50

100

150

200

250

300

350

A0 A1 - A4 A5 - A7 A1_v2 -A8_v2

A2m_v2 -A8m_v2

A8 - A11 D1 - D14 D1_v2 -D15_v2

DS1 -DS14

DS1_v2 -DS15_v2

D_v3 Ds_v3 E_v3 Es_v3 F2s_v2 -F72s_v2

F1 - F16 F1s -F16s

G1 - G5 GS1 - GS5 H L4s - L32s L8s_v2 -L80s_v2

M

ACU vs CPU

ACU \ vCPU Benchline

100 ACU/vCPU

$0.36/kACU

~21 ACU/vCPU

$0.57/kACU210 ACU/vCPU

$0.27/kACU

160 ACU/vCPU

$0.30/kACU

160 ACU/vCPU

$0.42/kACU

195 ACU/vCPU

$0.22/kACU

ACUs N/A for GPUs290 ACU/vCPU

$0.33/kACU

D15 v2

DS15 v2

E64i v3

E64is v3

D72s_v2

G5

GS5

M128s

Entry Level

1 vCPU - 128 vCPUsComputationalperformance

Azure Tiers

Standard HDD

✓ Cost effective

✓ Dev & Test

Workloads

Standard SSD

✓ Cost effective

✓ Consistent

performance

✓ Low IO

business

critical apps

Ultra SSD

✓ Sub-ms

Latency

✓ Consistent

performance

✓ Latency

sensitive top

tier apps

Premium SSD

✓ Low Latency

✓ Consistent

performance

✓ IO Intensive

business

critical apps

Resource Group

✓ Simple

✓ Highly available

& scalable

✓ Secure by default

Managed DisksPerformance Tiers

Azure Disks – Performance

Standard HDDUltra SSD Premium SSD Standard SSD

Provisioned Best effort

Project Direct Drive | Ultra SSD

Capacity up to 64* TB

Variable IOPS up to 160,000

Variable throughput up to 2000 MB/s

Low Latency

< 1msHigh throughput

up to 2000 MB/s

per disk

High IOPS

up to 160,000

IOPS per disk

Disk Provisioning Disk Provisioning

SSD Provisioning

VM/Network Provisioning Server

SSD

5k IOPS, 200MB/s 5k IOPS, 200MB/s

4k IOPS, 32MB/s

3,200 IOPS, 48MB/s

8k IOPS, 64MB/s

6,400 IOPS, 96MB/s

32k IOPS, 256MB/s

25,600 IOPS, 384MB/s

Managed

Disk

Managed

Disk

Premium Storage Caching

SLA and high availability in Azure

Single VM

VM SLA99.9%

Availability sets Availability zones Site Recovery & Region pairs

VM SLA99.95%

VM SLA99.99%

Regions

54

Region 1 Region 2

“Poor Man’s” High

Availability -Scenario

• For cases where running two VMs is just too expensive:

• Prepare 2 VMs in an availability Set

• Keep one of them turned off

• When you plan to update one of the VMs, turn on the stand-by VM

• Turn it off again when done

• Gaps:

• Time to recover

• Potential for Data loss

• Update coordination

• Value: easy and better then nothing

Reserved VM Instances (RIs)• Significantly reduce costs, with one-

year or three-year terms on Windows

and Linux virtual machines (VMs)

• Exchange or cancel your Azure RIs at

any time

• Use instance size flexibility to use RIs

across a VM groups

• Integrated recommendations in Azure

portal

Azure Hybrid BenefitWhat is Azure Hybrid Benefit?

An Azure benefit that enables customers with Windows Server Software Assurance licenses to pay the less expensive non-

Windows compute pricing when they upload and run their self-built Windows Server images on Azure

What is the Customer Value Proposition?

• Customer benefits from existing investments in Windows Server when moving to Azure

• Customer receives additional value to their Windows Server Software Assurance investment

• Azure Hybrid Benefit adds additional flexibility and value to Windows Server Standard and Datacenter

CUSTOMER’S ON-PREMISE LICENSE

LICENSE IMPACT FOR CUSTOMER WINDOWS SERVER AZURE ENABLEMENT

No licensing concurrency: a Window Server license cannot be assigned to other hardware while Azure Hybrid Benefit is being used.

Customer with Windows Server Software Assurance are entitled to:

• Two instances of 1 to 8 vCPUs or

• One instance of up to 16 vCPUs

• Stack licenses for VMs larger than 16 vCPUsLicensing concurrency: a Windows Server license can continue to be assigned both on premise and in an Azure environment at the same time.

Azure Hybrid Benefit

CUSTOMER’S ON-PREMISE LICENSE

LICENSE IMPACT FOR CUSTOMER WINDOWS SERVER AZURE ENABLEMENT

No licensing concurrency: a Window Server license cannot be assigned to other hardware while Azure Hybrid Benefit is being used.

Customer with Windows Server Software Assurance are entitled to:

• Two instances of 1 to 8 vCPUs or

• One instance of up to 16 vCPUs

• Stack licenses for VMs larger than 16 vCPUsLicensing concurrency: a Windows Server license can continue to be assigned both on premise and in an Azure environment at the same time.

What is Azure Hybrid Benefit?

An Azure benefit that enables customers with Windows Server Software Assurance licenses to pay the less expensive non-

Windows compute pricing when they upload and run their self-built Windows Server images on Azure

Documents

Update on Microsoft Technologytechnine.azurewebsites.net/wp-content/uploads/2019/03/TechNine.be... · Azure Fabric Controller Compute Networking Azure Resource Manager Storage Azure