32
Differentiated Services == Differentiated Scheduling Gary Kotton - VMware Gilad Zlotkin - Radware The role of the Nova scheduler in managing Quality of Service 1

Differentiated Services == Differentiated Scheduling

  • Upload
    ekram

  • View
    82

  • Download
    0

Embed Size (px)

DESCRIPTION

The role of the Nova scheduler in managing Quality of Service. Differentiated Services == Differentiated Scheduling. Gary Kotton - VMware Gilad Zlotkin - Radware. 1. Enterprise Ready Openstack. - PowerPoint PPT Presentation

Citation preview

Page 1: Differentiated Services  ==  Differentiated Scheduling

Differentiated Services ==

Differentiated Scheduling

Gary Kotton - VMwareGilad Zlotkin - Radware

The role of the Nova scheduler in managing Quality of Service

1

I am talking about slide 4 here-Gilad Zlotkin
We may want to talk about: "Host Capability" and "Storage proximity" as we do refer to them later in the presentation.-Gilad Zlotkin
Page 2: Differentiated Services  ==  Differentiated Scheduling

Enterprise Ready Openstack

Migrating existing mission critical and performance critical enterprise applications requires:

→ High service levels ● Availability ● Performance ● Security

→ Compliance with existing architectures ● Multi-tier● Fault tolerance models

2

Page 3: Differentiated Services  ==  Differentiated Scheduling

Service Level for Applications

• Availability Fault level Recovery Time

Fault Tolerance (FT) Compute/Network/Storage element(s) 0

High Availability (HA) Compute/Network/Storage element(s) SECs/MINs

Disaster Recovery (DR) The whole site/connectivity HOURs/DAYs

3

Page 4: Differentiated Services  ==  Differentiated Scheduling

Service Level for Applications

• Availability

• Performanceo Transaction Latency (Sec)o Transaction Load/Bandwidth (TPS)

Fault level Recovery Time

Fault Tolerance (FT) Compute/Network/Storage element(s) 0

High Availability (HA) Compute/Network/Storage element(s) SECs/MINs

Disaster Recovery (DR) The whole site/connectivity HOURs/DAYs

3

Page 5: Differentiated Services  ==  Differentiated Scheduling

Service Level for Applications

• Availability

• Performanceo Transaction Latency (Sec)o Transaction Load/Bandwidth (TPS)

• Securityo Data Privacyo Data Integrityo Denial of Service

Fault level Recovery Time

Fault Tolerance (FT) Compute/Network/Storage element(s) 0

High Availability (HA) Compute/Network/Storage element(s) SECs/MINs

Disaster Recovery (DR) The whole site/connectivity HOURs/DAYs

3

Page 6: Differentiated Services  ==  Differentiated Scheduling

Service Level for Applications

• Availability

• Performanceo Transaction Latency (Sec)o Transaction Load/Bandwidth (TPS)

• Securityo Data Privacyo Data Integrityo Denial of Service

Fault level Recovery Time

Fault Tolerance (FT) Compute/Network/Storage element(s) 0

High Availability (HA) Compute/Network/Storage element(s) SECs/MINs

Disaster Recovery (DR) The whole site/connectivity HOURs/DAYs

What all this has to do with

the Nova Scheduler?

3

Page 7: Differentiated Services  ==  Differentiated Scheduling

High Availability Models

• Availability Zone Redundancy → The “cloud” way

• Server Redundancy→ The “classic” way

• Both Server and Zone Redundancies→ The “enterprise” disaster recovery way

4

Page 8: Differentiated Services  ==  Differentiated Scheduling

Availability Zone Redundancy

WS3

DB2

LB2

WS4

Global Load Balancing

AZ1 AZ2

WS1

DB1

LB1

WS2

5

Page 9: Differentiated Services  ==  Differentiated Scheduling

Server Redundancy

WS1

DB1

LB1

WS2 WS3

LB2

DB2

6

Page 10: Differentiated Services  ==  Differentiated Scheduling

Server and Zone Redundancies

WS1

DB1

LB1

WS2 WS3

LB2

DB2

WS4

DB3

LB3

WS5 WS6

LB4

DB4

Global Load Balancing

AZ1 AZ2

7

Page 11: Differentiated Services  ==  Differentiated Scheduling

Network Availability

Controller Cluster

Transport Network Logical Network

LB1 LB2

WS1 WS3WS2

DB1 DB2

VMware’s NSX for example

8

Page 12: Differentiated Services  ==  Differentiated Scheduling

Load Balancer Availability

Radware’s Alteon Load Balancer for example

WS1

LB1

WS2 WS3

LB2

Active Standby

Persistency State Synchronization

Configuration Synchronization

Auto Failover

9

Page 13: Differentiated Services  ==  Differentiated Scheduling

Group Scheduling

• Group together VMs to provide a certain service

• Enables scheduling policies per group/sub-group

• Provides a multi-VM application designed for fault tolerance and high performance

10

Page 14: Differentiated Services  ==  Differentiated Scheduling

Example

11

Page 15: Differentiated Services  ==  Differentiated Scheduling

Example

Bad placement: if a host goes down entire service is down!

11

Page 16: Differentiated Services  ==  Differentiated Scheduling

Example

Bad placement: if a host goes down entire service is down!

Placement strategy - anti affinity: achieving fault tolerance

11

Page 17: Differentiated Services  ==  Differentiated Scheduling

Placement Strategies

• Availability - anti affinityo VM's should be placed in different 'failure domains' (e.g., on different

hosts) to ensure application fault tolerance

12

Page 18: Differentiated Services  ==  Differentiated Scheduling

Placement Strategies

• Availability - anti affinityo VM's should be placed in different 'failure domains' (e.g., on different

hosts) to ensure application fault tolerance

• Performance o Network proximity

Group members should be placed as closely as possible to one another on the network (same 'connectivity domain') to ensure low latency and high performance

12

Page 19: Differentiated Services  ==  Differentiated Scheduling

Placement Strategies

• Availability - anti affinityo VM's should be placed in different 'failure domains' (e.g., on different

hosts) to ensure application fault tolerance

• Performance o Network proximity

Group members should be placed as closely as possible to one another on the network (same 'connectivity domain') to ensure low latency and high performance

o Host Capability IO-Intensive, Network-Intensive, CPU-Intensive,...

12

Page 20: Differentiated Services  ==  Differentiated Scheduling

Placement Strategies

• Availability - anti affinityo VM's should be placed in different 'failure domains' (e.g., on different

hosts) to ensure application fault tolerance

• Performance o Network proximity

Group members should be placed as closely as possible to one another on the network (same 'connectivity domain') to ensure low latency and high performance

o Host Capability IO-Intensive, Network-Intensive, CPU-Intensive,...

o Storage Proximity

12

Page 21: Differentiated Services  ==  Differentiated Scheduling

Placement Strategies

• Availability - anti affinityo VM's should be placed in different 'failure domains' (e.g., on different

hosts) to ensure application fault tolerance

• Performance o Network proximity

Group members should be placed as closely as possible to one another on the network (same 'connectivity domain') to ensure low latency and high performance

o Host Capability IO-Intensive, Network-Intensive, CPU-Intensive,...

o Storage Proximity

• Security - Resource Isolation/Exclusivityo Host, Network, ...

12

Page 22: Differentiated Services  ==  Differentiated Scheduling

Anti Affinity

• Havana: Anti affinity per groupo nova boot --hint group=WS[:anti-affinity]

--image ws.img --flavor 2 --num 3 WSi

• “Instance Groups”o Properties:

Policies - for example anti affinity Members - the instances that are assigned to the

group Metadata - key value pairs

o Sadly did not make the Havana Releaseo Continue work in Icehouse with extended functionality

13

Page 23: Differentiated Services  ==  Differentiated Scheduling

Network Proximity (Same Rack)

14

Page 24: Differentiated Services  ==  Differentiated Scheduling

Host Capabilities

- IO intensive- CPU intensive- Network intensive

→ “Smart resource placement” - Yathi Udupi and Debo Dutta (Cisco)

→ “Host Capabilities” - Don Dugger (Intel)

15

Page 25: Differentiated Services  ==  Differentiated Scheduling

Storage Proximity

● Schedule instances to have affinity to Cinder volumes

→ “Scheduling Across Services” - Boris Pavlovic (Mirantis) and Alex Glikson (IBM)

→ “Smart resource placement” - Yathi Udupi and Debo Dutta (Cisco)

16

Page 26: Differentiated Services  ==  Differentiated Scheduling

Resource Exclusivity

• Network Isolation: Neutron, for example VMware’s NSX

• Host Allocation: enable user to have a pool of hosts for exclusive use.

→ “Private Clouds - Whole Host Allocation” - Phil Day (HP), Andrew Laski (Rackspace)

17

Page 27: Differentiated Services  ==  Differentiated Scheduling

Additional Scheduling Topics

→ “Scheduler Performance” - Boris Pavlovic (Mirantis)

→ “Methods to Improve DB Host Statistics” - Shane Wang and Lianhau Lu (Intel)

→ “Scheduler Metrics - Relationship with Ceilometer” - Paul Murray (HP)

→ “Multiple Scheduler Policies” - Alex Glikson (IBM)

18

Page 28: Differentiated Services  ==  Differentiated Scheduling

Icehouse

• Expand on “Instance Group” support• Topology of resources and relationships

between themo Debo Dutta and Yathi Udupi (Cisco)o Mike Spreitzer (IBM)o Gary Kotton (VMware)

19

Page 29: Differentiated Services  ==  Differentiated Scheduling

API - Aiming for I1

• Proposed API (Nova Extension)o id - a unique UUIDo name - human readable nameo tenant_id - the ID of the tenant that owns the groupo policies - a list of policies for the group (anti affinity,

network proximity and host capabilities)o metadata - a way to store arbitrary key value pairs

on a groupo members - UUIDs of all of the instances that are

members of the group

20

Page 30: Differentiated Services  ==  Differentiated Scheduling

Flow

• Group will be created with no memberso Group will have a policy

• Group ID will be used for schedulingo Passed as a hinto Scheduler will update members

• Pending support for group of groups

• Group membership will be removed when instance is deleted

21

Page 31: Differentiated Services  ==  Differentiated Scheduling

Summary Migrating existing mission critical and performance critical enterprise applications requires:

High service levels → Group Scheduling Policies● Availability → Anti-Affinity● Performance → Proximity / Host Capability ● Security → Resource Exclusivity

22

Page 32: Differentiated Services  ==  Differentiated Scheduling

Q&A

Thank You

Gary Kotton: [email protected] Zlotkin: [email protected]