Emc open stack_techtalk_reference_architecture_2015

1© Copyright 2015 EMC Corporation. All rights reserved.

USING CINDER WITH EMC BLOCK STORAGE SYSTEMS: REFERENCE>ARCHITECTURESERGEY SCHINDLER @SERGEY.SCHINDLER



• Overview of the EMC Reference Architecture Program

• Cinder integration with EMC storage systems, such as VNX, XtremIO and ScaleIO

• Benefits for Admins and Operators

• Challenges and lessons learned

AGENDA


INTEGRATION – EMC & CINDER

Delivers On Speed And Space

All Flash Array

Low $ Per Transaction

Any Workload

High Capacity And

High Transaction

Use Your Hardware

Reduce Deployment

Costs

Software Defined

Efficient Management

Cinder Drivers

Core OpenStack Related Projects


REFERENCE ARCHITECTURE PROGRAM

Storage Arrays

Certified & Validated Designs

Partner Tools Integration

Cooperative Support

• Customers have a choice of OpenStack distributions • Partner with leading OpenStack distributors and service integrators.• Certified EMC OpenStack drivers on the distributions.• Integrate with partner tools to enable better manageability.• Provide Validated reference designs • Joint Service and Support

Joint Services

EMC


REFERENCE ARCHITECTURE V1.0• EMC Arrays:

– VNX, XtremIO, ScaleIO

• FC Switch:– Brocade– Cisco MDS

• Functional testing only:– Stated driver capabilities– Support for FC and iSCSI– No performance benchmarks– Covered UI, CLI and API

• Focus on best practices and “gotchas”:– Missing utils and libs– Configuration settings

Horizon CLI API


ARCHITECTURAL OVERVIEW

Cinder Client

Cinder API

Cinder Scheduler Cinder Volume Cinder BackupCinder-driver

REST

AMPQ AMPQ

Cinder-driversql

Volume Functions• Create• Extend• Delete• Attach• Detach• Volume Types

Snapshot Functions• Create• Delete• Update• Volume from Snapshot

Backup Functions• Backup• Restore• Delete

REST

NaviCLI

Cinder-driver

ScaleIO

REST GW


• Unified Block and File Storage system

• Cinder Supported Protocols – FC and iSCSI

• Supports all main volume operations.

• FAST, FastCache, FC SAN Zoning.– Vendor-specific values exposing

performance optimizations

• Integrated into OpenStack trunk

VNX

Unified Hybrid Storage for the Mid-Range

UNIFIED All mixed workloadsAll access protocols

HYBRID Optimized for

FLASHBenefits of tiered

storage

PRICE OPTIMIZEDLowest $/IO

Lowest $/GB

Technology Leadership

Multicore Optimized

Designed for Virtualization

Unified StorageFile and Block

OpenStack CinderCinder Driver

$ cinder type-create "AutoTieringVolume" $ cinder type-key "AutoTieringVolume" set storagetype:tiering=Auto fast_support=True fast_cache_enabled=True


• All Flash array ideal for High Performance

• Scale Out Architecture – Scale storage resources together with cloud

infra

• Supported Protocols:– FC and iSCSI

• Provide support for main Volume Operations

• Integrated into OpenStack trunk

XTREMIO


SCALEIO – BLOCK SERVICES• Hyper-converged, software-defined,

scale-out block storage for commodity hardware– Software runs on physical & virtual

• Four Key Components– SDC, SDS, MDM, REST GATEWAY

• Driver executes volume operations through the REST API Gateway to backend ScaleIO Components

• Support from Havana release

• Free unlimited download beginning May 29, 2015

SDC

Metadata Mgr(MDM)

Applications(NOVA)

SDS

Cinder Volume

GATEWAY

Driver

SDS SDS

Commodity Platforms


VOLUME OPERATIONS - SUMMARYVNX/VMAX/vIPR XtremIO ScaleIO

Create, Delete, Extend Volume Create, Delete, Extend Volume Create, Delete, Extend Volume

Snapshot volume , Delete snapshots Snapshot volume , Delete snapshots Snapshot volume , Delete snapshots

List volume and snapshots List volume and snapshots List volume and snapshots

Attach, Detach volume Attach, Detach volume Attach, Detach volume

Create volume from snapshot Create volume from snapshot Create volume from snapshot

Copy image to volume and volume to image



Clone Volume Clone Volume Clone Volume

Create volume with backend Create volume with backend

Migrate volume, Retype a volume

Create and Delete Consistency Groups

Create and Delete Consistency Group Snapshots

https://wiki.openstack.org/wiki/CinderSupportMatrix


• Configuration File: Cinder.confenabled_backends=XtremeIO, VNX[XtremeIO]volume_driver = cinder.volume.drivers.emc.xtremio XtremIOIscsiDriver volume_backend_name=xtremIO_40

[lVNX]storage_vnx_pool_name = Pool_01_SASvolume_driver=cinder.volume.drivers.emc.emc_cli_iscsi.EMCCLIISCSIDrivervolume_backend_name=vnx_41

• Map the backend to volume types$ cinder type-create "HighPerf”$ cinder type-key "HighPerf” volume_backend_name=xtremeIO_40

$ cinder type-create ”MedPerf”$ cinder type-key ”MedPerf” volume_backend_name=vnx_41

MULTI-BACKEND SUPPORT

Cinder-Volume

High Perf Med Perf

Cinder-driver

Cinder-driver


• Many storage utils are NOT part of the partner distro’s:– iscsi-initiator-utils, device-mapper-multipath-libs, kpartx, device-mapper-

multipath, sysfsutils, sg3_utils, libaio, numactl

• Default configuration settings often need to be changed:– iscsi multipath, use_friendly_names, etc.

• Missing Python libraries, i.e. configobj, etc.

• Partner HA deployments are unique – impact on configuration changes

LESSONS LEARNED


• OpenStack Kilo

• Additional EMC Storage Systems:– VMAX– ViPR

• Partner tools integration:– Mirantis FUEL– Canonical Juju Charms (available now)– RHEL OSP Foreman

• Additional Porjects: Manila ?

REFERENCE ARCHITECTURE V2.0


MANILA – OFFICIAL PROJECT

Low $ Per Transaction

Any Workload

Scale out File and Object System

Manilla Drivers

OpenStack Related Projects

Isilon


KILO RELEASE – EMC DRIVERS

Plugins New Features (Kilo Plugin*)

VMAX (Cinder)

• VMAX3 Support

VNX(Cinder)

• Performance Improvements for Control Plane• Refactoring Code for Robustness• LUN Count Threshold• Auto Deletion of LUN and Host Initiator

XtremIO(Cinder)

• Capacity reporting with Thin Provisioning• Manage/un-manage volumes.• Multi-cluster management support

Isilon(Manilla)

• Base driver; meets API requirements

Cinder * • Incremental backup• Backup support for encrypted volumes• Oversubscription in thin provisioning

• Enhance capabilities and support matrix every release


• EMC and the Federation demonstrate a strong commitment to the OpenStack community by contributing to a variety of OpenStack projects and integrating our best-in-class storage products with OpenStack

• Understanding of the integration workflow for Cinder with EMC storage systems

• Specific challenges using different storage protocols

• Benefits of creating heterogeneous storage environments using Cinder with EMC storage systems

TAKEWAYS


• EMC Storage Solution with Mirantis OpenStack: https://community.emc.com/docs/DOC-44819

• EMC Storage Solutions with Canonical Ubuntu OpenStack: https://community.emc.com/docs/DOC-44853

REFERENCE MATERIALS

https://community.emc.com/docs/DOC-44819






EMC AT THE SUMMIT!