1
Workload Domain Infrastructure VMs Cloud Foundation Infrastructure VMs vSphere Cluster + Virtual SAN 1 st Three Nodes (manually expand to 4+ nodes) Virtual Infrastructure Virtual Desktop vCenter NSX Manager vCenter NSX Manager App- Volumes View Connect App- Volumes View Connect View Compose SQL AD vCenter NSX Manager vRack-ResourcePool-Mgmt Log Insight VROPS NSX Manager LCM Repository LCM Backup VRM vCenter PSC PSC ISVM (1) ISVM (2) ISVM (3) NSX Ctrl (1) NSX Ctrl (2) NSX Ctrl (3) Virtual Distributed Switch ESXi01 ESXi02 ESXi03 vSAN Datastore VMware SDDC Manager configures the first three servers in each rack into a management domain. It is recommended that you expand the management domain to four servers to provide added redundancy and to facilitate vSAN maintenance. The management domain hosts all the VMware Cloud Foundation infrastructure components. Management Domain NSX Transport Zone Virtual Distributed Switch vSphere Cluster Virtual Infrastructure Workload Domain vCenter & NSX Manager Runs in Management Domain NSX Logical Switch Management Corporate vMotion vSAN VXLAN NSX CTL 01 NSX CTL 02 NSX CTL 03 VM VM VM VM VM VM NSX Edge vSAN External Network vCenter NSX Manager ESXi-01 ESXi-02 ESXi-03 VTEP VTEP VTEP Virtual Infrastructure Workload Domain Management Domain A VMware Cloud Foundation Virtual Infrastructure (VI) Workload Domain is a logical partition within the private cloud representing a subset of CPU, memory and storage capacity, allocated to an individual business unit or tenant that is used to deliver virtual infrastructure. Each VI workload domain implements a separate instance of the VMware SDDC software stack to include vCenter Server, ESXi, vSAN, and NSX. NSX Transport Zone Virtual Distributed Switch vSphere Cluster Virtual Desktop Infrastructure Workload Domain vCenter Server, NSX Manager, and Horizon View infrastructure components run in the management domain NSX Logical Switch Management Corporate vMotion vSAN VXLAN NSX CTL 01 NSX CTL 02 NSX CTL 03 VDI VDI VDI VDI VDI VDI NSX Edge vSAN External Network Management Domain ESXi-01 ESXi-02 ESXi-03 VTEP VTEP VTEP Virtual Desktop Infrastructure Domain App- Volumes View Connect App- Volumes View Connect View Compose SQL AD vCenter NSX Manager A VMware Cloud Foundation Virtual Desktop Infrastructure (VDI) Workload Domain is a logical partition within the private cloud representing a subset of CPU, memory and storage capacity allocated to a business unit or tenant that is used to deliver virtual desktops. Each VDI workload domain implements a separate instance of the VMware SDDC software stack to include vCenter Server, ESXi, vSAN, and NSX together with Horizon View. vSAN Ready Nodes VMware Cloud Foundation use rack mount vSAN Ready Nodes to ensure seamless compatibility and support. The configuration and assembly for each node is standardized with all components installed the same manner to eliminate system variability. vSAN enables both hybrid and all-flash architectures. SSD Read and Write Cache Capacity Caching Tier Data Persistence Tier vSAN Ready Nodes SSD SSD VMware Cloud Foundation is VMware's unified SDDC platform for the private and public clouds. VMware Cloud Foundation brings together VMware’s compute, storage, and network virtualization into a natively integrated stack, delivering enterprise-ready cloud infrastructure with unique automation and management capabilities for simplified operations that is consistent across private and public clouds. Overview Horizon vRealize VMware Cloud Foundation vSphere vSAN NSX SDDC Manager Cloud management platform Software-defined infrastructure Private cloud Public cloud Extend to virtual desktops VMware Cloud Foundation is an integrated suite of software components. These components include the unified SDDC platform, which includes VMware vSphere, vSAN and NSX, together with the VMware SDDC Manager. Optional components, such as vRealize Suite and Horizon Suite, can also be included. Software Components Horizon Suite (optional) App Volumes Horizon View Workload Domain Management Lifecycle Management Infrastructure Services VMware NSX VMware vSAN VMware vSphere Hardware Management Services vRealize Suite (optional) vRealize Automation vRealize Business vRealize Operations vRealize Log Insight VMware Cloud Foundation Add-On Components SDDC Manager A VMware Cloud Foundation private cloud deployment is comprised of between one to eight physical racks. Each rack contains between 8 to 32 vSAN Ready Nodes, one management switch, and two Top-of-Rack (ToR) switches. In multi-rack configurations, a pair of redundant spine switches are added to the second rack to provide for inter-rack connectivity. Physical Hardware Overview Top-of-Rack Switches Management Switch Virtual Infrastructure Domain Available Capacity Expand Full Rack/ Up to 32 Servers Half Rack/ 16 Servers Minimum/ 8 Servers Expand Virtual Desktop Domain Management Domain Expandable to 8 racks Add spine switches to interconnect racks Homogenous nodes within the rack May be heterogeneous across racks SDDC Manager SDDC Manager is a virtual appliance running in the management domain that provides a single point-of-control for the management and administration of Cloud Foundation. SDDC Manager interfaces with the Hardware Management Service and vCenter server to provide centralized access along with an integrated view of both the physical and virtual infrastructure. SDDC Manager is used to configure the physical servers and switches as well as create and manage workload domains, monitor the status of the Cloud Foundation environment, and perform lifecycle management tasks such as patching and upgrades. SDDC Manager (Virtual Appliance) Workflow Services Engine Logical Resource Manager vSphere vRealize Suite Horizon Suite Physical Resource Manager Hardware Management Service References Web Page: vmware.com/go/cloudfoundation Documentation: vmware.com/go/cloudfoundation-docs Hardware Management Services The Hardware Management Services (HMS) provides the necessary functions required for discovering, bootstrapping, and monitoring the hardware components in each physical rack. The HMS is accessed through the VMware SDDC Manager using available APIs. Hardware Management Services (HMS) vRealize Log Insight (Syslog Forwarding) vRealize Operations (Health Dashboards) VMware SDDC Manager (Rest API) HMS Device Plugin Server Hardware HMS Device Plugin Switch Hardware (Mgmt/ToR/Spine) HMS Device Plugin PDU Hardware Workload Performance General Workload Network Review Choose how much performance and availability you need for your workload Availability Development Development • Stripe Width 1 • Flash Reserve 0% • Object Space Reservation 40% Standard • Stripe Width 1 • Flash Reserve 0% • Object Space Reservation 70% High • Stripe Width 3 • Flash Reserve 0% • Object Space Reservation 100% Standard High Low Normal High FTT=0 FTT=1 FTT=2 Back Next Low Availability FTT=0, three hosts minimum No No Cluster Maximum Normal Availability FTT=1, three hosts minimum No Enabled, % based Admission Control Cluster Maximum High Availability FTT=2, five hosts minimum No Enabled, % based Admission Control Max hosts available in one rack Option vSAN FTT vSAN FD vSphere HA Max Size Storage Policy Cloud Foundation storage policies are set independently for each Workload Domain. Performance settings determine stripe width and thick vs. thin provisioning. Availability settings determine how many copies are stored and thus how many host failures can be tolerated in a workload domain. VMware Cloud Foundation leverages VMware vSAN to provide storage for workloads running in the private cloud. vSAN aggregates the local storage (both hybrid and all-flash configurations) from each host in the workload domain into storage pool that is shared across the cluster. Storage performance and availability characteristics are set when the workload domain is created. vSAN requires that each workload domain contains a minimum of three hosts, however four hosts are recommended to facilitate host maintenance. IP attached storage (i.e. NFS / iSCSI) Option 1: Hybrid Traditional IP Attached Storage Hyper-converged vSAN Storage with SSD and HDD Hyper-converged vSAN Storage with all SSD Option 2: All-Flash vSAN vSAN Storage Physical Network The VMware Cloud Foundation physical network design is based on a leaf-and-spine network architecture. Each rack contains a redundant pair of Top-of-Rack (ToR) switches. Each ToR switch is connected to a pair of high capacity spine switches using 40GbE uplink ports. Servers are dual-connected to each ToR switching with separate 10GbE interfaces. The ToRs in the first rack provide access to the external data center network. 40GE Links MLAG/Channel Capable Aggregate over 160GE 1GE Out-of-band 4 x 40GE Ports 48 x 10GE Ports Inter ToR connectivity For control traffic & redundancy Spine Switch ToR Switch A Data Center Network Management Switch Server 32 Server 1 ToR Switch B Other Physical Racks Spine Switch 40GE 10GE 10GE 40GE 4 5 ToR ports 1 to 32 to connect hosts ToR port 48 for Management switch ToR ports 39,40,41,42 for Interconnect 4 ToR ports 43,44,45,46 for uplink connectivity 5 ToR ports 49 and 50 spine switches ESXi Host ESXi Host ESXi Host nic0 nic0 nic0 nic0 nic0 nic0 Virtual Distributed Switch Non-routable Mgmt VLAN Public Mgmt VLAN vSAN VXLAN vMotion Data Center Services • AD / DNS / NTP Core Modules • SDDC Manager • vCenter Server & PSC Optional Modules • vRealize Log Insight • vRealize Operations • vRealize Automation • Horizon View Core Modules • NSX Manager • NSX Controllers NSX Edge(s) Logical Switch VMs syslog Corporate (External) VLAN Logical Network VMware Cloud Foundation implements a virtual network overlay that runs on top of the physical leaf-and-spine network. Physical servers are logically grouped into vSphere clusters (represented as workload domains) where a Virtual Distributed Switch is configured and port groups created. VMware NSX is also installed and a single transport zone is created. Logical switches and application virtual networks are manually created based on workload needs. vmware.com Copyright © 2016 VMware, Inc. All rights reserved. VMware Cloud Foundation 2.0 - Private Cloud Architecture

VMware Cloud Foundation 2.0 - Private Cloud Architecture · PDF fileThe management domain hosts all the VMware Cloud Foundation infrastructure components. Management ... A VMware Cloud

Embed Size (px)

Citation preview

Page 1: VMware Cloud Foundation 2.0 - Private Cloud Architecture · PDF fileThe management domain hosts all the VMware Cloud Foundation infrastructure components. Management ... A VMware Cloud

Workload Domain Infrastructure VMs

Cloud Foundation Infrastructure VMs

vSphere Cluster + Virtual SAN

1st Three Nodes(manually expand to 4+ nodes)

Virtual Infrastructure Virtual Desktop

vCenter

NSX Manager

vCenter

NSX Manager

App-Volumes

ViewConnect

App-Volumes

ViewConnect

ViewCompose

SQL AD

vCenter NSX Manager

vRack-ResourcePool-Mgmt

Log Insight VROPS NSX Manager LCM Repository LCM Backup

VRM vCenter PSC PSC ISVM (1)

ISVM (2) ISVM (3) NSX Ctrl (1) NSX Ctrl (2) NSX Ctrl (3)

Virtual Distributed Switch

ESXi01 ESXi02 ESXi03

vSAN Datastore

VMware SDDC Manager configures the first three servers in each rack into a management domain. It is recommended that you expand the management domain to four servers to provide added redundancy and to facilitate vSAN maintenance. The management domain hosts all the VMware Cloud Foundation infrastructure components.

Management Domain

NSXTransport

Zone

VirtualDistributed

Switch

vSphere Cluster

Virtual Infrastructure Workload Domain

vCenter & NSX Manager Runs in Management

Domain

NSX Logical Switch

Management

Corporate

vMotion

vSAN

VXLAN

NSX CTL 01 NSX CTL 02 NSX CTL 03

VM VM VM

VM VM VM

NSX Edge

vSAN

External Network

vCenter NSX Manager

ESXi-01 ESXi-02 ESXi-03VTEP VTEP VTEP

Virtual Infrastructure Workload Domain

Management Domain

A VMware Cloud Foundation Virtual Infrastructure (VI) Workload Domain is a logical partition within the private cloud representing a subset of CPU, memory and storage capacity, allocated to an individual business unit or tenant that is used to deliver virtual infrastructure. Each VI workload domain implements a separate instance of the VMware SDDC software

stack to include vCenter Server, ESXi, vSAN, and NSX.

NSXTransport

Zone

VirtualDistributed

Switch

vSphere Cluster

Virtual Desktop Infrastructure Workload Domain

vCenter Server, NSX Manager, and Horizon

View infrastructure components run in the

management domain

NSX Logical Switch

Management

Corporate

vMotion

vSAN

VXLAN

NSX CTL 01 NSX CTL 02 NSX CTL 03

VDI VDI VDI

VDI VDI VDI

NSX Edge

vSAN

External Network

Management Domain

ESXi-01 ESXi-02 ESXi-03VTEP VTEP VTEP

Virtual Desktop Infrastructure Domain

App-Volumes

ViewConnect

App-Volumes

ViewConnect

ViewCompose

SQL AD

vCenter NSX Manager

A VMware Cloud Foundation Virtual Desktop Infrastructure (VDI) Workload Domain is a logical partition within the private cloud representing a subset of CPU, memory and storage capacity allocated to a business unit or tenant that is used to deliver virtual desktops. Each VDI workload domain implements a separate instance of the VMware SDDC software

stack to include vCenter Server, ESXi, vSAN, and NSX together with Horizon View.

vSAN Ready NodesVMware Cloud Foundation use rack mount vSAN Ready Nodes to ensure seamless compatibility and support. The configuration and

assembly for each node is standardized with all components installed the same manner to eliminate system variability. vSAN enables both hybrid and all-flash architectures.

SSD

Read and Write Cache

Capacity

Caching Tier

DataPersistence

Tier

vSAN Ready Nodes

SSDSSD

VMware Cloud Foundation is VMware's unified SDDC platform for the private and public clouds. VMware Cloud Foundation brings together VMware’s compute, storage, and network virtualization into a natively integrated stack, delivering enterprise-ready cloud infrastructure with unique

automation and management capabilities for simplified operations that is consistent across private and public clouds.

Overview

Horizon

vRealize

VMware Cloud Foundation

vSphere vSAN NSX

SDDC Manager

Cloud management platform

Software-defined infrastructure

Private cloud Public cloud

Extend to virtual desktops

VMware Cloud Foundation is an integrated suite of software components. These components include the unified SDDC platform, which includes VMware vSphere, vSAN and NSX, together with the VMware SDDC Manager. Optional components,

such as vRealize Suite and Horizon Suite, can also be included.

Software Components

Horizon Suite (optional)

App Volumes

Horizon View

Workload Domain Management

Lifecycle ManagementInfrastructure Services

VMware NSX VMware vSANVMware vSphere

Hardware Management Services

vRealize Suite (optional)

vRealize Automation

vRealize Business

vRealize Operations

vRealize Log Insight

VMware Cloud Foundation

Add-On Components

SDDC Manager

A VMware Cloud Foundation private cloud deployment is comprised of between one to eight physical racks. Each rack contains between 8 to 32 vSAN Ready Nodes, one management switch, and two Top-of-Rack (ToR) switches. In multi-rack configurations, a pair of redundant spine switches are added to the second rack to provide for inter-rack connectivity.

Physical Hardware Overview

Top-of-Rack Switches

Management Switch

Virtual Infrastructure Domain

Available Capacity

ExpandFull Rack/Up to32 Servers

Half Rack/16 Servers

Minimum/8 Servers

Expand

Virtual Desktop Domain

Management Domain

Expandable to 8 racks

Add spine switches to interconnect racks

Homogenous nodes within the rack

May be heterogeneous across racks

SDDC ManagerSDDC Manager is a virtual appliance running in the management domain that provides a single point-of-control for the management and

administration of Cloud Foundation. SDDC Manager interfaces with the Hardware Management Service and vCenter server to provide centralized access along with an integrated view of both the physical and virtual infrastructure. SDDC Manager is used to configure the

physical servers and switches as well as create and manage workload domains, monitor the status of the Cloud Foundation environment, and perform lifecycle management tasks such as patching and upgrades.

SDDC Manager(Virtual Appliance)

Workflow Services Engine

Logical Resource Manager

vSphere vRealizeSuite

HorizonSuite

Physical Resource Manager

Hardware ManagementService

References

• Web Page: vmware.com/go/cloudfoundation • Documentation: vmware.com/go/cloudfoundation-docs

Hardware Management ServicesThe Hardware Management Services (HMS) provides the necessary functions required for discovering, bootstrapping, and monitoring the hardware components in each physical rack. The HMS is accessed through the VMware SDDC Manager using available APIs.

Hardware Management Services (HMS)vRealize Log Insight

(Syslog Forwarding)

vRealize Operations(Health Dashboards)

VMware SDDC Manager(Rest API)

HMS Device Plugin

Server Hardware

HMS Device Plugin

Switch Hardware(Mgmt/ToR/Spine)

HMS Device Plugin

PDU Hardware

Workload

Performance

General Workload Network Review

Choose how much performance and availability you need for your workload

Availability

Development

Development

• Stripe Width 1• Flash Reserve 0%• Object Space Reservation 40%

Standard

• Stripe Width 1• Flash Reserve 0%• Object Space Reservation 70%

High

• Stripe Width 3• Flash Reserve 0%• Object Space Reservation 100%

Standard High

Low Normal HighFTT=0 FTT=1 FTT=2

Back Next

Low Availability FTT=0, three hosts minimum No No Cluster Maximum

Normal Availability FTT=1, three hosts minimum No Enabled, % based

Admission Control Cluster Maximum

High Availability FTT=2, five hosts minimum No Enabled, % based

Admission ControlMax hosts available in one rack

Option vSAN FTT vSAN FD vSphere HA Max Size

Storage PolicyCloud Foundation storage policies are set independently for each Workload Domain. Performance settings determine stripe width and thick vs. thin provisioning. Availability settings determine how many copies are stored and thus how many host

failures can be tolerated in a workload domain.

VMware Cloud Foundation leverages VMware vSAN to provide storage for workloads running in the private cloud. vSAN aggregates the local storage (both hybrid and all-flash configurations) from each host in the workload domain into storage pool that is shared across the cluster. Storage performance and availability characteristics are set when the workload domain is created. vSAN requires that each workload domain contains a minimum of three hosts, however four hosts

are recommended to facilitate host maintenance.

IP attached storage (i.e. NFS / iSCSI)

Option 1: Hybrid

Traditional IP Attached Storage Hyper-converged vSAN

Storage with SSD and HDDHyper-converged vSAN

Storage with all SSD

Option 2: All-Flash

vSAN vSAN

Storage

Physical NetworkThe VMware Cloud Foundation physical network design is based on a leaf-and-spine network architecture. Each rack contains a redundant pair of Top-of-Rack (ToR) switches. Each ToR switch is connected to a pair of high capacity spine switches

using 40GbE uplink ports. Servers are dual-connected to each ToR switching with separate 10GbE interfaces. The ToRs in the first rack provide access to the external data center network.

40GE LinksMLAG/Channel CapableAggregate over 160GE

1GEOut-of-band

4 x 40GE Ports48 x 10GE Ports

Inter ToR connectivityFor control tra�c &

redundancy

Spine Switch

ToR Switch A

Data CenterNetwork

Management Switch Server 32

Server 1

ToR Switch B

Other Physical Racks

Spine Switch

40GE

10GE 10GE

40GE

4

5

ToR ports 1 to 32 to connect hosts ToR port 48 for Management switch ToR ports 39,40,41,42 for Interconnect 4 ToR ports 43,44,45,46 for uplink connectivity 5 ToR ports 49 and 50 spine switches

ESXi Host ESXi Host ESXi Host

nic0 nic0 nic0 nic0 nic0 nic0

Virtual Distributed Switch

Non-routableMgmt VLAN

Public Mgmt VLAN vSAN VXLANvMotion

Data Center Services• AD / DNS / NTP

Core Modules• SDDC Manager• vCenter Server & PSC

Optional Modules• vRealize Log Insight• vRealize Operations• vRealize Automation• Horizon View

Core Modules• NSX Manager• NSX Controllers

NSX Edge(s)

Logical Switch

VMssyslog

Corporate (External) VLAN

Logical NetworkVMware Cloud Foundation implements a virtual network overlay that runs on top of the physical leaf-and-spine network. Physical servers are logically grouped into vSphere clusters (represented as workload domains) where a Virtual Distributed

Switch is configured and port groups created. VMware NSX is also installed and a single transport zone is created. Logical switches and application virtual networks are manually created based on workload needs.

vmware.comCopyright © 2016 VMware, Inc. All rights reserved.

VMware Cloud Foundation 2.0 - Private Cloud Architecture