1EMC CONFIDENTIAL—INTERNAL USE ONLY EMC OPENSTACK CLOUD SOLUTIONS REFERENCE ARCHITECTURE WITH REDHAT ENTERPRISE OPENSTACK PLATFORM

1EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY

EMC OPENSTACK CLOUD SOLUTIONS REFERENCE ARCHITECTURE WITH REDHAT ENTERPRISE OPENSTACK PLATFORM


IT AS A SERVICE DELIVERS BUSINESS AGILITY

IT as a ServiceBroker & Builder

New Business ModelNew Technology Architecture

New Operation models and rolesCost Efficiency

CULTURE

Open Source

AgileApps

Big Data

TECH BUSINESS

DevOpsMobile Apps

Customer Data

Speed


OPENSTACK AS AN ENABLER FOR TRANSFORMATION

Metering Engine

Service Catalog

Orchestration Engine

User Portal

Policy Engine

Dev-OpsNew Roles

AgileProcesses

New Apps

Application Fabric

Data Fabric

Lends itself nicely to3rd Platform Apps

Developer Friendly

Cloud Software Platform a

foundation for SDDC

enablement

API provide capability to

Automate Services for Cost

Effective Operations.

Need new skill sets and roles

PaaS

SOFTWARE DEFINED DCTRANSFORMATION

Service APIs


WHY OPENSTACK?

COST SAVINGSOPERATIONAL EFFICIENCY

OPEN PLATFORM

CHOICE OF TECHNOLOGY

INNOVATE AND COMPETE

source: OpenStack User Survey, 2014http://superuser.openstack.org/articles/openstack-user-survey-insights-november-2014


WHAT IS OPENSTACK?

• Flexible and modular architecture. Foundation for a Software Defined DC.

• Delivering IaaS service : compute, networking & storage services and more.

• Analogous to the Linux kernel (very tunable)

• All services are expose via API (Infra as code)


NEW USE CASESDigital ExperienceReal-time Analytics

EXISTING APPLICATION INVENTORY &

STRATEGY

APPLICATION RIGHTFIT

SOFTWARE DEFINED

DATACENTER

3RD GEN APPS AND DATA PLATFORM

Re-write / Replace

Leave in place/Retire

Refactor / Migrate

PLATFORM 2.0

PLATFORM 2.5

PLATFORM 3.0

PLATFORM 1.0


PLATFORM DEFINITION

No-SQL

Components inMonolithic Applications

Components re-architectedloosely coupled, elastic, fault

tolerant

Relational In Memory, Distributed

Kernel Virtualization Kernel Virtualization / Containers

Pla

tform

2P

latfo

rm 3


PERSONAS

Administrators responsible for managing and maintaining an IT infrastructure (in a private cloud) Years of experience with Unix and Linux systems administration. Manages IT infrastructure, hypervisors and Cloud platform. Interested in how to deal with failure (planned, unplanned), maintenance of system and utilization.

Enterprise Admin

Cloud Admin

Proficient in administering Unix and Linux systems. Competent shell and Python programmer. Early adopter of Puppet. Already using AWS for IaaS service

Dev-OpsHave been using AWS for a while. Primarily developing web applications for internal usage. API driven. Will integrate with the CI/CD tools and open to OpenSource.

Clear and efficient catalogue to manage the infra lifecycle

Need a catalogue or CLI for initial deployment rest done via API calls

Management interface for utilization, quotas etc. APIs to integrate into tools


• Currently 14 integrated projects within OpenStack

• All these projects communicate via public API’s

• Quite a few new projects focused on Mgmt and Operations

• Service have behavioral compatibility with AWS

Horizon

Dashboard

Swift

object store

Glance

image store

Nova

compute node

Cinder

volume service

Keystone

identity service

Heat

Orchestration

Celiometer telemetry service

Trove

database

Neutron

networking

S3 EC2 EBS vPC RDSAMI

IAMCloud Formation

OPENSTACK FRAMEWORK


OpenStack Drivers

Delivers On Speed And

Space

Flash Performance

Low $ Per Transaction

Any Workload

Hyper Converged, S/W Defined

Use Your Hardware

Broad Portfolio

Fit Your Environment

Evolve With Your Cloud

Reduce Deployment

Costs

File or BlockHybrid

Software Defined

Efficient Management

Isilon

Data Lake

Scale out File and Object

System

EMC INTEGRATION WITH OPENSTACK


TECHNICAL EVIDENCE SOLUTION REFERENCE ARCHITECTURE WITH REDHAT – JUNO RELEASE


EMC + REDHAT TECHNICAL EVIDENCE

Storage Arrays

Certified & Validated Designs

Partner Tools Integration

Cooperative Support

Joint Services

EMC

• Solution Focused

• Partnered with RedHat to provide Validated reference designs.

• Integrated with RedHat tool set to enable better manageability.

• Joint Service and Support


• RedHats officially supported OpenStack distribution.

• Tightly integrated with RH Linux.

• Focus on– Code maturity, stability and security– 3rd party eco-system of certified

platforms– Product documentation and

reference architecture.

• 3 year lifecycle and global support

RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM


EMC REFERENCE ARCHITECTURE WITH REDHAT OPENSTACK

Cinder Drivers

Core OpenStack & Related Projects

RedHat: OpenStack Deployment and Management


SOLUTION COMPONENTS

Capability Components SupportedHardware VNX, XTREMIO, ScaleIO Cinder Block Driver

- iSCSI, FC, SDC

Software Open Stack RH Juno Release

Software KVM Hypervisor in RHEL Kernel

Software 7.1 OS for cloud

Software Tools RH OpenStack Platform Installer

Version 1.71

Software Tools DM -Multipath 0.4.9-77.el7


LOGICAL ARCHITECTURE


• Unified Block and File Storage system

• OpenStack Cinder Support– From Grizzly– Supported drivers FC and iSCSI– Support all main volume operations

• Supports Manila (File Share Service)– Not part of reference architecture

testing.

• Versality for wide variety of use cases in OpenStack environment

VNX WITH OPENSTACK


• Block Stroage services– Cinder

• Supported Protocols tested– iSCSI and FC

• Multipathing must be installed and configured to ensure proper operations.

• Supports all main volume operations

• Integrated into OpenStack trunk

VNX : REFERENCE ARCHITECTURE

Unified Hybrid Storage for the Mid-Range

UNIFIED All mixed workloadsAll access protocols

HYBRID Optimized for

FLASHBenefits of tiered

storage

PRICE OPTIMIZEDLowest $/IO

Lowest $/GB

Technology Leadership

Multicore Optimized

Designed for Virtualization

Unified StorageFile and Block

OpenStack CinderCinder Driver


• All-Flash Array – Unique scale-out array with in-memory

data services– Up to 1,500,000 IOPs– Breakthrough workload acceleration,

consolidation, agility

• Block Storage Service Cinder Supported Protocols:

– FC and iSCSI

• Provide support for all main Volume Operations

XTREMIO : OPENSTACKA

BIL

ITY

TO

EX

EC

UTE

COMPLETENESS OF VISION


• Block Storage Cinder Support

• Supported Protocols Certified:– iSCSI, FC

• Multipathing must be installed and configured to ensure proper operations

• All main Volume Operations supported

• Juno support in OpenStack trunk

XTREMIO : REFERENCE ARCHITECTURE


• Hyperscale Converged Server SAN Solution for Commodity Platforms

– Software runs on physical & virtual

• Four Key Components– SDC, SDS, MDM, GATEWAY

• Cinder Driver executes volume operations thru the REST Gateway to backend ScaleIO Components

• Nova driver handles compute and instance volume-related operations

SCALEIO – BLOCK SERVICES

SDC

Metadata Mgr(MDM)

Applications(NOVA)

SDS

Cinder Volume

GATEWAY

Driver

SDS SDS

Commodity Platforms


• Block Storage Cinder Support

• Supported Protocols Certified:– FC, iSCSI

• All main Volume Operations supported

• Juno Support available via EMC GIT.

SCALEIO – REFERENCE ARCHITECTURE

SDC

Metadata Mgr(MDM)

Applications(NOVA)

SDS

Cinder Volume

GATEWAY

Driver

SDS

Commodity Platforms


CERTIFIED VOLUME OPERATIONSVNX Extreme IO Scale IO

Create, Delete, Extend Volume Create, Delete, Extend Volume Create, Delete, Extend Volume

Snapshot volume , Delete snapshots Snapshot volume , Delete snapshots Snapshot volume , Delete snapshots

List volume and snapshots List volume and snapshots List volume and snapshots

Attach, Detach volume Attach, Detach volume Attach, Detach volume

Create volume from snapshot Create volume from snapshot Create volume from snapshot

Copy image to volume and volume to image



Clone Volume Clone Volume Clone Volume

Create volume with backend Create volume with backend

Migrate volume, Retype a volume

Create and Delete Consistency Groups

Create and Delete Consistency Group Snapshots

https://wiki.openstack.org/wiki/CinderSupportMatrix


SOLUTION ARCHITECTURE


EMC OPENSTACK CLOUD SOLUTION CINDER FUNCTIONALITY


• Persistent block level storage devices for use with OpenStack compute instances.

• Manages the creation, attaching and detaching of the block devices to servers

• Block storage volumes are fully integrated into OpenStack Compute and the Dashboard allowing for cloud users to manage their own storage needs.

• Snapshots are supported and can be restored or used to create a new block storage volume.

CINDER – BLOCK STORAGE SERVICE


• Volumes:– Allocated block storage resources that can be attached to instances as secondary

storage or they can be used as the root store to boot instances. Volumes are persistent R/W block storage devices most commonly attached to the compute node through iSCSI.

• Snapshots :– A read-only point in time copy of a volume. The snapshot can be created from a

volume that is currently in use (through the use of --force True) or in an available state. The snapshot can then be used to create a new volume through create from snapshot.

• Backups:– An archived copy of a volume currently stored in OpenStack Object Storage (swift).

CINDER CAPABILITIES


• Attached to instances as secondary storage

• Can be used as root store to boot instances

• Persistent R/W Block storage

• Manage volume lifecycle– Create, Delete, Extend volumes– Attach/Detach Volume

• Ability to create different volume type.

Drag picture to placeholder or click icon to add

CINDER CAPABILITIES : VOLUME


• A read-only point in time copy of a volume

• Create snapshots, Delete snapshots

• Make volume out of the created Snapshots

Drag picture to placeholder or click icon to add

CINDER CAPABILITIES : SNAPSHOTS


• Backup Operations is an admin task and done via CLI today

• Backup is to Swift (Object).

• Find the volume you want to backup.

– Create backup of a volume– Make sure of backup container.– Restore the volume

CINDER CAPABILITIES - BACKUP

$ cinder backup-create “volume_id”

$ swift list

$ cinder backup-restore “BACKUP_ID”

$ cinder list


• Today in Cinder, every operation happens at the volume level. Consistency Groups (CGs) enable

– Data Protection (snapshots and backups) – Disaster Recovery (remote replication)

• Consistency Group function– Leverages volumes of same type to be part of CG so can be snapshot/backed up– Enable Cinder to leverage volume replication feature available in the storage

backends (drivers).– Orchestration layer above Cinder that understands which volumes should be grouped

together.

CONSISTENCY GROUPS


• Caveats– Allow for snapshot of multiple volumes – Make sure the “storage platform” supports consistency group (ex: VNX)– Can set Consistency groups only via CLI ; no support from Portal yet– Certain operations are not permitted if a volume is in a consistency group

• Volume Migration, Volume Re-Type, Volume deletion.• A consistency group has to deleted as whole with all volumes and same

for volume snapshots.

CONSISTENCY GROUPS


• High availability for Cinder – Deploy a Multi-Node with HA OpenStack

environment.

– Cinder services can be installed on each controller and provide high availability in case of a controller reboot or loss.

– If a controller is lost all control plane functions are lost the data plane works.

HIGH AVAILABILITY

Controller-1Controller-2

Message Q

Database

API Services

Identity

Image

Blk Storage

Dashboard


• Admins have the capability to group tenants– Using Projects– Map specific users who can access the

project.

• Quotas can be set for operational limits– Enforced per tenant (project) level

• Number of volumes• Number of volume gigabytes allowed per• Number of Block Storage snapshots allowed

PROJECTS AND QUOTAS


• Configuration File: Cinder.confenabled_backends=XtremeIO, VNX[XtremeIO]volume_driver = cinder.volume.drivers.emc.xtremio XtremIOIscsiDriver volume_backend_name=xtremIO_40

[lVNX]storage_vnx_pool_name = Pool_01_SASvolume_driver=cinder.volume.drivers.emc.emc_cli_iscsi.EMCCLIISCSIDrivervolume_backend_name=vnx_41

• Map the backend to volume types$ cinder type-create "HighPerf”$ cinder type-key "HighPerf” volume_backend_name=xtremeIO_40

$ cinder type-create ”MedPerf”$ cinder type-key ”MedPerf” volume_backend_name=vnx_41

MULTI-BACKEND SUPPORT

Cinder-Volume

High Perf Med Perf

Cinder-driver

Cinder-driver


• Log files used by Block Storage– Log file of each Block Storage service is stored in

the /var/log/cinder/ directory of the host

– Most Block Storage errors are caused by incorrect volume configurations that result in volume creation failures. To resolve failures, review logs:

• cinder-api log (/var/log/cinder/api.log)• cinder-volume log (/var/log/cinder/volume.log)

• Forward the logs to syslog server

LOGGING - CINDER

OpenStack Controller + Data Plane

Local log files

Rsyslog pull

Logstash

ElasticsSearch

Kibana

http://docs.openstack.org/openstack-ops/content/logging_monitoring.html





• Volume Stats– Health, Size, Usage.– Thresholds for alarms

• The data can be used by external systems for

– Metering/chargeback– Monitoring.

MONITORING - CEILOMETER

Notification BUS

Volume

Notification Agents Collectors

External Systems

http://docs.openstack.org/openstack-ops/content/index.html




VOLUME TYPE

$ cinder type-create "ThickVolume"$ cinder type-create "ThinVolume"$ cinder type-create "DeduplicatedVolume"$ cinder type-create "CompressedVolume"$ cinder type-key "ThickVolume" set storagetype:provisioning=thick$ cinder type-key "ThinVolume" set storagetype:provisioning=thin$ cinder type-key "DeduplicatedVolume" set storagetype:provisioning=deduplicated deduplication_support=True$ cinder type-key "CompressedVolume" set storagetype:provisioning=compressed compression_support=True

$ cinder type-create "HighPerf"$ cinder type-key "HighPerf" set storagetype:pool=Pool_02_SASFLASH volume_backend_name=vnx_41

• User wants to create a volume on a certain storage pool, a volume type with an extra spec specified the storage pool should be created first, then the user can use this volume type to create the volume.


CINDER ARCHITECTURE WALK THRUCINDER FUNCTIONALITY


CONCEPTUAL ARCHITECTURE

Glance

Cinder

Neutron

Nova

KeyStone

Horizon

Swift

Backup volumes in

HeatOrchestrate

Directs services

Metering

Celiometer

Provides Auth for

Poll Data From

Storage Lifecycle• Create Volume• Attach Volume• Snapshot Volume

13

2

4


CINDER ARCHITECTURAL OVERVIEW

Cinder Client

Cinder API

Cinder Scheduler Cinder Volume Cinder BackupCinder-driver

REST

AMPQ AMPQ

Cinder-driver

sql

Volume Functions• Create• Extend• Delete• Attach• Detach• Volume Types

Snapshot Functions• Create• Delete• Update• Volume from Snapshot

Backup Functions• Backup• Restore• Delete


• Cinder API – A WSGI app that authenticates and routes requests throughout the Block Storage

service. It supports the OpenStack APIs

• Cinder Scheduler– Schedules and routes requests to the appropriate volume service. Depending upon

THE configuration, could be simple round-robin scheduling or it can be more sophisticated through the use of the Filter Scheduler. The Filter Scheduler is the default and enables filters on things like Capacity, Availability Zone, Volume Types, and Custom filters

• Cinder Volume– Manages Block Storage devices, specifically the back-end devices themselves

• Cinder Backup– Provides a means to back up a Block Storage volume to OpenStack Object Storage.

CINDER ARCHITECTURE BUILDING BLOCKS


LOGICAL FLOW


AUTHENTICATION - KEYSTONE

• Provide credentials to authenticate to the system.

• Admin• User

• Credentials used by all services to talk to each other


SELF SERVICE PORTAL - HORIZON


VOLUME CREATION - CINDER

Group volumes based on performance

SIze

Data VolumeBoot Volume

Defaults to Nova-AZ if notspecified


VOLUME TYPES

Volume Type

Size

Availability Zone


MANAGING THE VOLUMES

Increase the volume sizeDelete the volumesCreates snapshots of volumes


LAUNCHING AN INSTANCE- NOVA

Flavor

Count

Image

• Initiate creation of an instance.

• Based on flavor• Based on number• Based on AZ


ATTACHING A VOLUME TO AN INSTANCE


SNAPSHOT

Create a volume from a snap


• EMC RedHat Reference Architecture Guide– https://www.emc.com/collateral/technical-documentation/h14174-emc-can

onical-openstack-ra.pdf

• OpenStack Configuration/Design guide – http://docs.openstack.org/juno/

• RedHat OpenStack Platform installer– https

://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux_OpenStack_Platform/6/html/Installer_and_Foreman_Guide/

REFERENCES

https://www.emc.com/collateral/technical-documentation/h14174-emc-canonical-openstack-ra.pdf

https://www.emc.com/collateral/technical-documentation/h14174-emc-canonical-openstack-ra.pdf

http://docs.openstack.org/juno/

https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux_OpenStack_Platform/6/html/Installer_and_Foreman_Guide/




Documents

1EMC CONFIDENTIAL—INTERNAL USE ONLY EMC OPENSTACK CLOUD SOLUTIONS REFERENCE ARCHITECTURE WITH REDHAT ENTERPRISE OPENSTACK PLATFORM