Primary Storage in CloudStack

Apache CloudStack is open source software designed to deploy and manage large networks of virtual machines as a highly available, highly scalable Infrastructure-as-a-Service (IaaS) cloud computing platform.

Compute, Network, Storage

Automation

What is CloudStack?

CloudStack from the top down

Primary Storage Secondary Storage

Objectives Storage for running VM disk volumes on a host

Data to be stored for future retrieval

Use Cases • Production Applications• Traditional IT Systems• Database Driven Apps• Messaging / Collaboration• Dev/Test Systems

• VM Templates• ISO Images• Disk Volume Snapshots• Backup / Archive• Image Repository

Workloads • High Change Content• Smaller, Random R/W• Higher / “Bursty” IO

• Typically More Static Content• Larger, Sequential R/W• Lower IOPS

Storage Use Cases & Workloads

• Primary Storage stores the disk volumes (both root and data disks) for all the VMs in that cluster

• Primary Storage is associated with a cluster

• A cluster can access more than one Primary Storage pool

• Primary Storage can be shared among hosts or local to a host

• Depending on hypervisor type, there are several ways to configure Primary Storage (we shall take a look at XenServer)

What is Primary Storage?

• Admin allocates space ahead of time on the storage system(Example: Create a volume on the SolidFire SAN)

• Admin defines a storage resource in the hypervisor(Example: Create a XenServer Storage Repository)

• Admin defines a storage pool in CloudStack(Example: Create Primary Storage in CloudStack for a cluster)

• Admin creates a compute offering using the Primary Storage(Example: 1 vCPU, 2 GB RAM, 50GB)

Provisioning Primary Storage Today(CloudStack Version <=4.1)

Allocate Storage on the SolidFire SAN

Define the Storage Resource in the Hypervisor

Select the type of the storage resource

Name the storage resourceResource is now available in the Hypervisor

Map the resource to the storage volume

Define a Primary Storage Pool in CloudStack

Add Primary Storage Define the Storage Pool

Primary Storage Available for Use

Create a Compute Offering in CloudStack

New Compute Offering Available

Add a Compute Offering Define the Compute Offering

A Glimpse into the Future of Primary Storage

• Fully automated provisioning through CloudPlatform / CloudStack

• Dynamic volume creation for VM root disks and additional data disks

• With SolidFire each volume receives guaranteed IOPS

Provide a way to expose vendor unique features within CloudStack

Eliminate the need for customer’s to create additional orchestration logic to provision storage

Have the ability to defer the creation of a volume until the moment the end user elects to execute a Compute or Disk Offering

My Specific Needs from the Plug-in

Creating Primary Storage with the Plug-in

--OR--

Admin Defined QoS

Customer Defined QoS

• Orchestrated through CloudStack• Administrator defined size (GBs) and QoS (IOPS)• Customers defined capacity (GBs) and QoS (IOPS)

Add Primary Storage in CloudStack

New Disk Offerings

Admin Defined QoS

Customer Defined QoS

--VS--

Admin Defined QoS

• Orchestrated through CloudStack• Based on Disk Offerings• Administrator defined QoS (IOPS)• Customers defined QoS (IOPS)

Customer Adds a Volume

Customer Defined QoS

Add a Volume to a VM

Customer Attaches the Volume to a VM

• Choose the Volume to be Attached

• Click Attach Disk

• Select the Instance

What Happens on SolidFire?

The Volume is Created on the SolidFire SAN

The Volume QoS Settings are Defined

What Happens on the Hypervisor?

The Storage Resource is Created

A CloudStack storage plug-in is divided into three components:

Provider: Logic related to the plug-in in general (ex: name of plug-in). Life Cycle: Logic related to life cycle (ex: creation) of a given storage system (ex: a single

SolidFire SAN). Driver: Logic related to creating and deleting volumes on the storage system.

Must add a dependency in the client/pom.xml file as such:

<dependency> <groupId>org.apache.cloudstack</groupId> <artifactId>cloud-plugin-storage-volume-solidfire</artifactId> <version>${project.version}</version> </dependency>

So…how do you actually make a plug-in?

Must implement the PrimaryDataStoreProvider interface

Provides CloudStack with the plug-in's name as well as the Life Cycle and Driver objects the storage system uses

Must be listed in the applicationContext.xml.in file (Spring Framework related)

A single instance of this class is created for CloudStack

About the Provider

public interface PrimaryDataStoreProvider extends DataStoreProvider {}

public interface DataStoreProvider { public static enum DataStoreProviderType { PRIMARY, IMAGE } public DataStoreLifeCycle getDataStoreLifeCycle(); public DataStoreDriver getDataStoreDriver(); public HypervisorHostListener getHostListener(); public String getName(); public boolean configure(Map<String, Object> params); public Set<DataStoreProviderType> getTypes(); }

The Provider Interface

public class SolidfirePrimaryDataStoreProvider implements PrimaryDataStoreProvider { private final String providerName = "SolidFire";

protected PrimaryDataStoreDriver driver; protected HypervisorHostListener listener; protected DataStoreLifeCycle lifecyle;

@Override public String getName() { return providerName; }

@Override public DataStoreLifeCycle getDataStoreLifeCycle() { return lifecyle; }

@Override public boolean configure(Map<String, Object> params) { lifecyle = ComponentContext.inject(SolidFirePrimaryDataStoreLifeCycle.class); driver = ComponentContext.inject(SolidfirePrimaryDataStoreDriver.class); listener = ComponentContext.inject(DefaultHostListener.class);

return true; }

Provider Implementation

Notes: client/tomcatconf/applicationContext.xml.in Each provider adds a single line. “id” is only used by Spring Framework (not by CS Management Server). Recommend just providing a descriptive name.

Example:<bean id="ClassicalPrimaryDataStoreProvider" class="org.apache.cloudstack.storage.datastore.provider.CloudStackPrimaryDataStoreProviderImpl" />

<bean id="solidFireDataStoreProvider" class="org.apache.cloudstack.storage.datastore.provider.SolidfirePrimaryDataStoreProvider" />

Provider Configuration

Must implement the PrimaryDataStoreLifeCycle interface.

Handles the creation, deletion, etc. of a storage system (ex: SAN) in CloudStack.

The initialize method of the Life Cycle object adds a row into the cloud.storage_pool table to represent a newly added storage system.

About the Life Cycle

public interface PrimaryDataStoreLifeCycle extends DataStoreLifeCycle {}

public interface DataStoreLifeCycle { public DataStore initialize(Map<String, Object> dsInfos); public boolean attachCluster(DataStore store, ClusterScope scope); public boolean attachHost(DataStore store, HostScope scope, StoragePoolInfo existingInfo); boolean attachZone(DataStore dataStore, ZoneScope scope); public boolean dettach(); public boolean unmanaged(); public boolean maintain(DataStore store); public boolean cancelMaintain(DataStore store); public boolean deleteDataStore(DataStore store);}

The Life Cycle Interface

@Override public DataStore initialize(Map<String, Object> dsInfos) { String url = (String)dsInfos.get("url"); String uuid = getUuid(); // maybe base this off of something already unique Long zoneId = (Long)dsInfos.get("zoneId"); String storagePoolName = (String) dsInfos.get("name"); String providerName = (String)dsInfos.get("providerName"); PrimaryDataStoreParameters parameters = new PrimaryDataStoreParameters();

parameters.setHost("10.10.7.1"); // really get from URL parameters.setPort(3260); // really get from URL parameters.setPath(url); parameters.setType(StoragePoolType.IscsiLUN); parameters.setUuid(uuid); parameters.setZoneId(zoneId); parameters.setName(storagePoolName); parameters.setProviderName(providerName); return dataStoreHelper.createPrimaryDataStore(parameters); }

Life Cycle Implementation

Must implement the PrimaryDataStoreDriver interface.

Your opportunity to create or delete a volume and to add a row to or delete a row from the cloud.volumes table.

A single instance of this class is responsible for creating and deleting volumes on all storage systems of the same type.

About the Driver

public interface PrimaryDataStoreDriver extends DataStoreDriver { public void takeSnapshot(SnapshotInfo snapshot, AsyncCompletionCallback<CreateCmdResult> callback); public void revertSnapshot(SnapshotInfo snapshot, AsyncCompletionCallback<CommandResult> callback);}

public interface DataStoreDriver { public String grantAccess(DataObject data, EndPoint ep); public boolean revokeAccess(DataObject data, EndPoint ep); public Set<DataObject> listObjects(DataStore store); public void createAsync(DataObject data, AsyncCompletionCallback<CreateCmdResult> callback); public void deleteAsync(DataObject data, AsyncCompletionCallback<CommandResult> callback); public void copyAsync(DataObject srcdata, DataObject destData, AsyncCompletionCallback<CopyCommandResult> callback); public boolean canCopy(DataObject srcData, DataObject destData); public void resize(DataObject data, AsyncCompletionCallback<CreateCmdResult> callback);}

The Driver Interface

public void createAsync(DataObject data, AsyncCompletionCallback<CreateCmdResult> callback) { String iqn = null;

try { VolumeInfo volumeInfo = (VolumeInfo)data;

iqn = createSolidFireVolume(volumeInfo);

VolumeVO volume = new VolumeVO(volumeInfo);

volume.setPath(iqn);

volumeDao.persist(volume); } catch (Exception e) {

s_logger.debug("Failed to create volume (Exception)", e); } CreateCmdResult result = new CreateCmdResult(iqn, errMsg == null ? data.getSize() : null);

result.setResult(errMsg);

callback.complete(result); }

Driver Implementation

Ask the CS MS to provide a list of all storage providershttp://127.0.0.1:8080/client/api?command=listStorageProviders&type=primary&response=json

Ask the CS MS to add a Primary Storage (a row in the cloud.storage_pool table) based on your plug-in (ex: make CloudStack aware of a SolidFire SAN)http://127.0.0.1:8080/client/api?command=createStoragePool&scope=zone&zoneId=a7af53b4-ec15-4afc-a9ee-8cba82b43474&name=SolidFire_831569365&url=MVIP%3A192.168.138.180%3BSVIP%3A10.10.7.1&provider=SolidFire&response=json

Ask the CS MS to provide a list of all Primary Storageshttp://127.0.0.1:8080/client/api?command=listStoragePools&response=json

API Calls

1620 Pearl Street,Boulder, Colorado 80302

Phone: 720.523.3278Email: info@solidfire.com

www.solidfire.com