24
Larry Touchette Chittur Narayankumar (Kumar) The Future Now: NetApp Clustered Storage and Flash for the Enterprise 1 NetApp Confidential - Internal Use Only

VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

  • Upload
    netapp

  • View
    1.132

  • Download
    1

Embed Size (px)

DESCRIPTION

Business drivers affect the performance expectations of enterprise applications. Data infrastructure must be flexible and agile to support these emerging performance and availability requirements. This session will show you how to build a data infrastructure using NetApp's flash and clustering technologies that is flexible enough to accommodate those changing demands. The session will cover how to combine NetApp's enterprise flash technology (including host-based flash, controller-based caching, hybrid disk shelves, and all-flash arrays) with NetApp's Clustered Data ONTAP to allow dynamic re-optimization of application performance, with an eye on how workload characteristics drive architectural decisions.

Citation preview

Page 1: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

1NetApp Confidential - Internal Use Only

Larry Touchette

Chittur Narayankumar (Kumar)

The Future Now: NetApp Clustered Storage and Flash for the Enterprise

Page 2: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

Virtual Storage Tiering

Efficient Use of Flash

Simple to install

Self Managing

Non Disruptive Operations Caching vs. Data Migration

Minimize HDD I/O’s Highly Granular Real Time Responsiveness

2NetApp Confidential - Internal Use Only

Data-driven Real-time Self-managing

Virtual Storage Tier

Intelligently place “hot” data

on the highest performing media in real time

HDD Storage

Array Flash

ServerFlash

Page 3: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

NetApp Server Cache

3

• NetApp server caching software• Software only, uses supported PCI-e or SSD• Turns server flash into cache for Data ONTAP

Flash Accel

• Validates partner hardware for use with Flash Accel• Validates partner software compatibility with ONTAP• Enables broad use case coverage

Server Caching Partner Alliance

• Resell of hardware and software products• Enables complete server caching solution purchase

from single source

Fusion-io Resale Program

Page 4: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

Data Center Architectures Transitioning

4

Storage

Servers

Apps

Network

Dedicated Infrastructure

Shared Infrastructure

Page 5: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

NetApp Flash Portfolio

5

Flash CacheFlash PoolFlash Accel

EF540FlashRayTM

Storage

Servers

Apps

Network

Dedicated Infrastructure

Shared Infrastructure

Flash Across the Entire Ecosystem

Page 6: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

NetApp Flash Portfolio

6

Flash CacheFlash PoolFlash Accel

EF540FlashRayTM

Storage

Servers

Apps

Network

Dedicated Infrastructure

Shared Infrastructure

Flash Across the Entire Ecosystem

Page 7: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

NetApp Shared Infrastructure Flash Tiers

7

App App App

Page 8: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

NetApp Shared Infrastructure Flash Tiers

8

App App App

Flash Cache

Flash AccelFusion-ioPartners R

eal Tim

e • Data D

riven

Virtual S

torage Tiering

Flash Pool

Page 9: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

NetApp Shared Infrastructure Flash Tiers

9

App App App

Flash Cache

Flash Pool

Flash AccelFusion-ioPartners R

eal Tim

e • Data D

riven

Virtual S

torage Tiering

• Dedicated Application Acceleration• Integrated with NetApp features and value

• Shared across aggregates and volumes• Dynamically allocated• Enables SAS/SATA drives in read heavy workloads

• Enables SAS/SATA drives in read and write heavy workloads

• HA Persistence, Write Caching• Dedicated per aggregate, manageable per volume

Page 10: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

Agile Data Infrastructure

Migrate individual VMs between hosts & datastores

Migrate datastores across performance tiers– Address changing performance requirements– Correct over/under provisioning issues– Change SLA’s over tenant lifecycle– Non-disruptive hardware & software refreshes

10NetApp Confidential - Internal Use Only

Agility Efficiency Non-disruptive Operations

Page 11: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

VMware vMotion & Storage vMotion

11

Page 12: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

NetApp Clustered Data ONTAP

12

Page 13: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

13NetApp Confidential - Internal Use Only

Server Caching for VMware vSphere

NetApp Flash Accel

Page 14: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

14

Server Cache for Data ONTAP

Performance of Flash, Data Management of ONTAP

Increased server utilization and throughput• CPUs spend more

time working, less time waiting on IO

• Increases server throughput by up to 80%

Improved app performance and density• Reduces app

latency up to 90%• More workload on

existing infrastructure

• Reduces demand on backend storage

Leverageshared storage• Bring server

flash under management of Data ONTAP

• Availability and reliability

• Data coherency with ONTAP

OptimizeKey Metrics

$/GB$/IOPS

Page 15: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

15

Introducing NetApp Flash Accel

Flexible Deployment Software only, compatible with server PCI-e

flash or SSD drive; choose your own flash device

Sustainable High Performance Intelligent data coherency: block-level invalidation

rather than flush entire cache Persistent cache across VM / server reboots

Extend ONTAP value into the server Mechanism for deeper ONTAP integration in the

future

Page 16: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

16

Flash Accel Architecture

3 Key Components

Flash Accel ESX Host Agent

Flash Accel Windows Agent(OS Driver and Web Service)

Flash Accel Virtual Management Appliance and VSC Plug-in

Available in VSC 4.2

Page 17: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

17

Data Coherency Implications with Caching

What is data coherency? Consistency between data

in cache and data on disk

Why is datacoherency important? Caches that don’t recognize

changes to the primary data copy (e.g. via SnapRestore®) will cause data corruption issues

010010010010101010101011010101010010100100010010

Storage ArrayPhysical Server

010010010010101010101011010101010010100100010010

Application

Cache

DataCoherency

• When does the cache invalidate data?• Is the cache a write-through or a write back cache?• Does the cache retain data across a reboot etc?

Key criteria include

Page 18: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

Flash Accel: Snapshot Coherency

18

Restore snapshot• Offline - Unmount

device and disconnect from VM

• Online – via SnapDrive

• Read metadata stored with snapshot• Compare snapshot state metadata with

current cache state metadata• Invalidate changed blocks between the

two states and rollback cache to snapshot state

• Store metadata of cache state at point-in-time along with snapshot in ONTAP

Flash Accel OperationStorage Operation

Take snapshot

NetApp Confidential – Internal Use Only

Page 19: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

19

0

1

2

3

4

5

6

7

8

9

IO/s

La

ten

cy

(m

s)

Benefits of Adding Flash Accel to Storage Cache - Preliminary

FAS Only

FAS + Storage Cache

FAS +Storage Cache + Flash Accel

Adding Flash Accel enables a much greater IO level without increasing latencySetup – FAS3270 with SATA Drives, Micron P320 PCI-e card on ESX host

1.0x 1.3x 1.9x 2.2x

FAS + Flash Accel

NetApp Confidential – Limited Use

Page 20: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

10 Mins

20NetApp Confidential - Internal Use Only

Flash Accel Demo

Page 21: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

Upcoming Flash Accel Release Content

Flash Accel 1.0 Limited Availability (currently available) Production capable administered via PVR

Targets virtualized environments with random reads (e.g. MS-SQL, Exchange)

Persistent, and ONTAP coherent cache, compatible with NetApp mgmt product

Enable, disable, and resize cache at VM and VMDK levels

Up to 2TB of cache per server, up to 32 cached VMs (no limit on total VMs)

vSphere 5.0 and Windows 2008 only

Caching of virtual disks over iSCSI, NFS, FC, FCoE. Note - No iSCSI in the VM

ONTAP 8.1+; 7-mode and c-mode; earlier platforms can be added by request

LSI Nytro, server SSD support

Flash Accel 1.1 Posted to NOW (Feb 28, 2013 FCS) Adds Micron P320 support

Flash Accel 1.2 Posted to NOW (Apr 18, 2013 FCS) Adds vSphere 5.1, full vMotion / DRS / VMware HA, iSCSI in the VM support

Adds FIO ioDrive support

21NetApp Confidential – Limited Use

Page 22: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

22NetApp Confidential - Internal Use Only

Page 23: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

23NetApp Confidential - Internal Use Only

Page 24: VMware PEX Boot Camp - The Future Now: NetApp Clustered Storage and Flash for the Enterprise

24NetApp Confidential - Internal Use Only

Complete Portfolio of Offerings for Any Workload

NetApp Flash Portfolio

Flash AccelServer Caching Partners

Flash CacheFlash PoolFlash AggregatesSSD Cache

Fas/V-SeriesE-Series

EF540FlashRay

Server Flash All Flash Array Hybrid Array Traditional Storage

Cache storage Fastest access Lowest capacity

Persistent storage Submillisecond

access Larger capacity

Intelligent caching Submillisecond access

for cached data Leverages HDD

for capacity

Persistent storage Slowest access Scalable, cost-effective

capacity