37
Dell EMC Unity: Using Dell EMC UnityVSA in Converged Environments Wai Yim Development Midrange & Entry Systems

Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

Embed Size (px)

Citation preview

Page 1: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

Dell EMC Unity: Using Dell EMC UnityVSA in Converged Environments Wai Yim Development Midrange & Entry Systems

Page 2: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

2

Optimized for All-Flash Performance & Simplicity

What’s New with Dell EMC Unity

4 new Broadwell based All-Flash models New 80 drive 3U enclosure 4X file power with 256TB file system Compression for file AppSync integration, snapshots & thin

clones for iCDM Dynamic Pools

Up to 40% more cores; 2X the memory

650F

550F

450F

350F

Page 3: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

Dell EMC UnityVSA Product Overview

Page 4: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

4

Reliable Block

Hypervisor

SOFTWARE DEFINED

Public Clouds Aggregated Server DAS

Multi-core Cache

Multi-core RAID

Backend Protocols

Pools

Data Services

Management

Protocols

FILE BLOCK

VSA

x86 Servers

Server SAN

VVOLS

Unisphere Mgmt

Virtual Storage Appliance Concept

Page 5: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

5

Dell EMC UnityVSA Dell EMC UnityVSA

Converged Compute/Storage

Remote & Branch Offices

Embedded

Hypervisor

CIFS NFS iSCSI

OS

APP APP

OS

COMPUTE STORAGE NODE

Cloud DR Bursting Backup Cloud File Services Archiving

Dell EMC UnityVSA Hypervisor

CIFS NFS iSCSI

OS

APP APP

OS

CLOUD DATA SERVICES

CLOUD

File as-a-service Multi-tenant VSA ROBO Converged

Infrastructure

OS

Hypervisor

… Node n Server SAN

Hypervisor

UnityVSA APP

OS UnityVSA

APP

SERVER SAN DATA SERVICES

SERVER SAN

Hypervisor

CIFS NFS iSCSI

Test/Dev Training & Demos

SINGLE NODE SERVER STORAGE

SERVER DAS (HA)

SPA SPB

Dell EMC UnityVSA Use Case and Futures

Page 6: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

6

Storage Processors (SPs) 1

vCPUs 2 (2GHz+)

Memory 12 GB

Virtual Network (vNICs)

Data

4 x 1GbE

or 4 x 10GbE

Protocols iSCSI, NFS, CIFS

Dell EMC UnityVSA Specifications

Page 7: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

7

CPU Dual-core 64-bit x86 Intel 2GHz+ Xeon E5 Series CPU or newer (SSE4.2)

Memory 16 GB for ESXi 5.5 18 GB for ESXi 6.0 20 GB for ESXi 6.5

Network Interfaces 4 x 1GbE

or 4 x 10GbE

RAID Controller • Select suitable RAID Level

• BE connectivity speed - 6Gbps • NV Cache- 512 MB (1GB recommended)

Operating System VMware ESXi 5.5+

Sample (or equivalent) Server Platforms

Dell PowerEdge R-series – R730

Cisco UCS C-Series - C22, C24, C220, C240

IBM xSeries 36xx M4 and 32xx M5 family

Lenovo ThinkServer RD Series - RD340

Sample Server Specifications

Page 8: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

8

COMMUNITY

LICENSING

4 TB

Community

Non-Production

CAPACITY

NODES

SUPPORT

USE

Free (Perpetual)

10, 25, 50 TB

1 Year Subscription

PROFESSIONAL

Single - Dual in future release

Dell EMC (Enhanced)

Production

FEATURES All

Dell EMC UnityVSA Product Offerings

Page 9: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

9

Common Code Base Feature Dell EMC UnityVSA Purpose-built

UFS64 over CIFS UFS64 over NFS

iSCSI FAST VP Tiering Capability

Asynchronous Unified Replication Unisphere HTML 5 GUI + REST API

Quality of Service Monitoring & Reporting

Thin Provisioning VVOLs CloudIQ

FAST Cache - Data at Rest Encryption -

Fiber Channel - Synchronous Replication -

Compression -

Page 10: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

10

Limit* Dell EMC UnityVSA

(based on max license)

Max # of vDisks 16

Max vDisk Size 50TB

Max # of NAS Servers 16

Max File System Size 50TB

Max # of File Systems 32

Max # of Pool LUNs 64

Max # of Snapshots 128

Max # of VVOLs 1750

*Limits are not architectural

VSA Limits

Page 11: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

11

Planning • Application coexistence – coexists with other VMs on an ESXi server

• Network storage – provides storage to apps running on any servers

• Multiple instances – >1 instances can be deployed on a single server

• Best practices – Reserve CPU and memory – Predictable backend IOPS and response time – Separate VSA root storage from virtual disks

• Server w/ 512MB raid card reference configuration sample frontend IOPS – 10,000 max 8k random read IOPS

Page 12: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

12

Monitoring and Management

• VSA management and operations – Use vSphere and vCenter for assigning CPU and memory resources,

network configuration, and virtual disk provisioning – Monitor virtual environment health through vSphere

• Dell EMC Unity management and operations – Local mgmt - Use Unisphere for Dell EMC Unity data services

management and monitoring – Federated mgmt – Use Unisphere Central for federated view of multiple

systems – CloudIQ - Use CloudIQ for cloud monitoring and analytics of virtual and

physical arrays

Page 13: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

13

Diagnostic

• Checks system for issues that could be caused by underlying issues with the hypervisor – CPU Steal – Network Latency – Disk Latency

• Reports active issues as well as issues that have been resolved

• Allows filtering by date range

• Allows use of custom thresholds

Page 14: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

14

Diagnostic

Page 15: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

15

Diagnostic: SVC_VP_Hostcheck

Example output:

Page 16: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

Dell EMC Unity Architecture

Page 17: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

17

Dell EMC UnityVSA Environment

Linux User Space

Linux Kernel Space

Hyper-visor

IP Fabric

Network

drive drive

vDiskvDisk vDisk

driveShared storage and

networks

Linux Driver Layerblkshim Para-virtual SCSI

Linux TCP/IPPV-Network

ext3Page/Buffer Cache

CSX interrupt mapping

Unified Container

UnisphereManagement

Multi-Core Cache

Storage Pool

LX-Fusion driver

Env

Multi-Core RAIDBackendFAST Cache

File Services

blkshim

Block Services

FC/iSCSIVVOL

Page 18: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

18

Native HA

• Current version works with VMware HA

• Native HA being designed – Hypervisor agnostic - targeting ESXi initially – Dual SP configuration – Uses multiple network and shared storage pings for

heartbeat – 3rd node tie breaker can be used for highest protection

Page 19: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

19

Native HA

DAS

Server

SERVER SAN

Hypervisor

DAS

Server

Hypervisor

APP

SPA SPB

Dell EMC UnityVSA

APP APP APP APP APP APP APP

HB Data Services Data Services

Tie Breaker

Page 20: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

20

Dell EMC Unity Operating Environment

SUSE/SLES Linux Kernel

IP StackblockFS database drivers

Platform Sequencer & Container Framework

Linux Services / Linux HA

Con

tain

er F

ram

ewor

k us

ing

syst

emd

CSX

Infr

astr

uctu

re

Licensingon

CLP

CLP DB

HA Policy

Controls

Logging

HA Policy

Controls

UnisphereMgmt

HA Policy

Controls

HA Policy

Controls

ESRS(CloudIQ Agent)

LOGConfig

LIC

CST

Logging Lockbox

HA Policy

Controls

config

Unified data pathCSX Container

HA Policy

Controls

New 64-bit FS

SCSI Target

Native VVOL

CMInet

StorageCluster HB

Heartbeat

Page 21: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

21

Heart Beat Protocol

SPA VM

Hypervisor

HBD0 vSwitch

SPB VM

Hypervisor

Compute networks

CMI vSwitch

CMI vSwitch

HBD0 vSwitch

HBD1 vSwitch

HBD1 vSwitch

Page 22: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

22

HB Protocol – Tie Breaker Node

Page 23: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

23

Storage HB Protocol

Page 24: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

From the Lab: Dell EMC UnityVSA on KVM

Page 25: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

25

KVM Use Case

• Same binaries, different packaging

• Same functionalities

• Provide Dell EMC Unity data services in: – Various Linux platforms

– OpenStack

– Paves the road to Public clouds

Page 26: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

26

KVM Install • Self-contain executable script

– libvirt’s virsh - minimal dependencies – Verifies that dependencies are present on server

• Collects a variety of parameters to create a libvirt XML file: – libvirt connection URL – VM name, UUID, emulator path – Path to install disk images – Network information

› bridge vs. NAT, ports, IP addresses (IPv4 and IPv6), friendly name, etc. – Whether to start automatically

• Three QCOW2 disk images are contained in script, and extracted to specified path (accessed as virtio-scsi)

Page 27: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

27

Dell EMC UnityVSA in virt-manager

Page 28: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

28

Dell EMC UnityVSA Parameters

Page 29: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

29

Adding Capacity

Page 30: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

30

Self-extracting Script

Page 31: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

31

Dell EMC Services Driving the rapid adoption and optimization of your digital technologies

CONSULTING

Harness the power of business urgency with help from our consultants

DEPLOYMENT

Accelerate technology adoption with expert deployment designed for you

MANAGED SERVICES

Gain efficiencies with our hosted cloud, managed applications, storage, archiving, and back-up

TRAINING

Develop and retain valuable IT talent through continuous learning

IT PROVEN

Learn how to invest from extreme users such as Dell IT

SUPPORT

Maximize productivity with expert support backed by proactive, predictive tools

Booth #347

Page 32: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

32

Related Sessions for SC and Dell EMC Unity Series Session Title Day/Time Dell EMC Unity & SC Series: Midrange Storage Portfolio Overview Mon @ 12:00 PM + Wed @ 01:30 PM CloudIQ: Cloud-Based Storage Analytics for Dell EMC Unity and SC Series Mon @ 04:30 PM + Wed @ 08:30 AM Dell EMC Unity All-Flash: What’s New Tue @ 03:00 PM + Wed @ 01:30 PM Dell EMC Unity: Architectural Overview Mon @ 01:30 PM + Thu @ 08:30 AM Dell EMC Unity: Best Practices For Best Performance Wed @ 08:30 AM + Thu @ 10:00 AM Dell EMC Unity: Performance Analysis Deep Dive Wed @ 03:00 PM + Thu @ 01:00 PM Dell EMC Unity: Next Generation NAS & File Capabilities Mon @ 03:00 PM + Thu @ 11:30 AM Dell EMC Unity: Data Protection & Copy Management Options Mon @ 08:30 AM + Wed @ 12:00 PM Dell EMC Unity: Virtualization & Cloud Integration Mon @ 12:00 PM Dell EMC Unity: Migration From VNX Tue @ 08:30 AM Dell EMC Unity: Using Dell EMC UnityVSA In Converged Environments Mon @ 08:30 AM Dell EMC Unity All Flash: Flash Technology Deep Dive Mon @ 08:30 AM + Thu @ 01:00 PM SC Series: What's New Mon @ 04:30 PM + Tue @ 03:00 PM SC Series: Architectural Overview Mon @ 01:30 PM + Tue @ 03:00 PM SC Series: Performance Best Practices Mon @ 04:30 PM + Thu. @ 01:00 PM SC Series: Affordable Data Mobility & Business Continuity With Multi-Array Federation Mon @ 08:30 AM + Thu @ 01:00 PM SC Series: Virtualization & Ecosystem Integrations Wed @ 03:00 PM + Thu @ 08:30 AM

Page 33: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

33

Hands on Labs for SC and Dell EMC Unity Series Self-Paced Day/Time

Dell EMC Unity CloudIQ – Event Correlation & Analytics

Monday: 8:30AM – 9:00PM

Tuesday: 7:00AM – 5:30PM

Wednesday: 7:00AM – 5:00PM

Thursday: 7:00AM – 2:00PM

Dell EMC Unity – Simplified Storage Management & Administration

Dell EMC Unity – VMware vSphere Integration

Dell EMC Unity – Configuring Snapshots & Replication

SC Series: Introduction to SC Series and Dell Storage Manager

Guided Day/Time

Dell EMC Unity CloudIQ – Event Correlation & Analytics (Registration required and limited availability)

Tuesday: 1:30PM – 2:30PM

Thursday: 8:30AM – 9:30AM

Page 34: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

34

Thank You for Attending

PLEASE TAKE A MOMENT TO • Visit the Storage & Data Protection Booth • Tweet: @DellEMCStorage

A STAR IS BORN • Shoot an in-room 10 second reference video

(where applicable)

Talk with us in the booth about the:

Modern Infrastructure Assessment &

Storage Efficiency Guarantee

SITES TO BE SEEN • Efficiency Guarantee: dellemc.com/4to1guarantee • CloudIQ: dellemc.com/cloudiq • All-Flash Storage: dellemc.com/all-flash

Page 35: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

35

Page 36: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration

36

WANT TO WIN A LEVITATING DEATH STAR SPEAKER?

• Follow @DellEMCStorage while at Dell EMC World

• 2 Winners will be chosen daily from

Monday May 8 through Thursday May 11 • All winners will be notified through

Twitter Direct Message

NO PURCHASE NECESSARY. Ends 05/11/2017. To enter and for Official Rules, visit http://thecoreblog.emc.com/dell-emc-world-follow-win-sweepstakes-2017/

Page 37: Dell EMC Unity - delltec · PDF fileESRS (CloudIQ Agent) LOG Config LIC CST Logging Lockbox HA Policy Controls config Unified data path CSX Container ... Dell EMC Unity: Migration