Srm suite technical presentation nrm - tim piqueur

1© Copyright 2013 EMC Corporation. All rights reserved.

EMC Storage Resource Management Suite

Technical Review

Tim Piqueur


The Challenge� Over the next decade…

– Data managed by enterprise datacenters will grow 50x

– Number of files will grow by 75x

– Number of IT professionals will grow < 1.5x

� Optimizing storage resources is essential to controlling IT costs

� Investments in Storage Resource Management help reduce these costs

Rapid data growth leads to rising storage costs while $/GB declines

Source: IDC Digital Universe Study, June 2011


What’s the impact on YOUR business?

The Impact of Application Downtime


What if you could…

Understand ALL storage relationships, dependencies and application impact?

Assure storage-related Service Levels and Chargeback?

Optimize storage investments to control costs and improve productivity?


Storage Resource Management Suite

EMC Storage Resource Management Suite

Configuration & ComplianceConfiguration & Compliance

PerformancePerformance CapacityCapacityRelationship Mapping

Relationship Mapping

EMC Storage

HostsBrocade & Cisco

Switches3rd Party Storage

PlanningScorecards

Role-based ReportingTroubleshooting

SLASituations to WatchResource / Usage

Virtual Machines

AlertingAlerting

Applications

TopologyTopology

Represents capabilities of the entire Storage Resource Management suite.


What’s Included in the SRM Suite?

� EMC ProSphere – Displays data path relationships and dependencies and analyzes performance and capacity to optimize storage resources.

� EMC Storage Configuration Advisor – Tracks configuration changes and validates compliance with design best practices and the EMC Support Matrix to eliminate configuration errors that impact service levels

� EMC Watch4net for Storage – Monitors application health and performance and provides dashboards to monitor the application to storage service levels across heterogeneous storage environments


Storage Resource Management Suite

• EMC & Third-Party Storage

– Symmetrix

– VNX Block & File

– Isilon

– VPLEX

– NetApp Filers

– IBM SVC & DS

– Hewlett Packard

• Data Path

– VMware

– HP-UX

– IBM AIX

– Linux SUSE & RHEL

– Microsoft Windows

– Sun Solaris

� SAN Switches

– Cisco

– Brocade

– McDATA

� Applications

– Oracle

– Microsoft SQL Server*

– MySQL*

– IBM DB2*

(*) Additional licenses required for application support

Supported Environments

Support specific details


Solution Enabler (SE) 7.4

SMIS 4.4

NaviSecCLI 7.3

SRM 1.1 Suite ArchitecturevApp

ProSphere 1.7

SuSE 11 ES

Virtual Machine

SCA 3.0

rPath 4

Application

W4N 6.1

Windows � SuSE 11ES

MySQLSybase 10Greenplum 4

Collection | Aggregation | Enrichment

W4N utilizes object polling mechanism marked with (*) for Symmetrix, VNX Block, SAN and Windows Hosts

Data Storage

SE* � SMISNaviSecCLI*

� SMIS

SSH �

XMLAPISNMP SMIS

SNMP* �

SMIS

SSH � SSH

Sudo �

SNMP

PowerShell* �

WinRM* � SNMP*

WMI � WS-Man

VISDK JDBC …

Symmetrix VNX Block VNX File NetApp FilerIBM DS

IBM SVC

SAN

(Cisco,

Brocade)

Unix Hosts Windows Hosts VMware Oracle

Other

Optional

Apps

Install on W4N Host


System Requirements� Total resource for SRM Suite – full scale

– 32 Virtual CPU (vCPU)

– 108 GB of memory (vMemory)

– 1.3 TB starting to 2.5 TB storage for data retention of 1 year

ComponentsvApp

Storage Manager

vAppDiscovery Engine

vAppHistorical DB

CollectorEach

CPU4

3.0 Ghz4

3.0 Ghz4

3.0 Ghz2

3.0 Ghz

Memory 12 GB 8 GB 6 GB 6 GB

Storage 230 GB 30 GB 230 GB 30 GB

ProSphere SCA W4N

Virtual Machine

4 3.0 Ghz

16 GB

50 GB

W4N UI Portal

W4N SuSE/WinHost #2 & more

43.0 Ghz

43.0 Ghz

16 GB 8GB

500 GB 64 GB


Scalability

SolutionPhysical Hosts/Host Devices

ESX Servers

VirtualMachine

EMC Arrays/# of LUNs

3rd Party Arrays

NetApp Filer

SAN Switches

SAN Ports Databases

ProSphere 1.7With 4 Collectors

2500/161k 125 2500 63/275k n/a n/a 113 8192 n/a

SCA 3.0(Virtual Machine)

800/136k 800 40/68k n/a # of 8192 SAN Ports n/a

W4Net 6.1(2-3 W4n Hosts)

2500 hosts 125 2500 63 arrays 30 30 113 8192 400


Watch4Net Logical Architecture

Collector

• Periodically starts collection

• Connects to remote systems to collect

• Filter/enrich data

• Formats data for backend

Backend

Collector3rd

Party Array

Infrastructure

Backend

• Processes data from collection

• Computes aggregates

• Database maintainer

Web Portal

• User login

• Admin management

• Generate and browse reports

Database

• Storage for Data

• Storage for metric properties

Retrieve

Send

Polled


Pick your client language and destination platform/application of choice, for example…

ProSphere Open ArchitectureOpen via REST

• HTTP-based, Stateless and Information transferred in XML

• Fully documented and supported

• Exposes all information visible through UI

• Based on EMC standards

• Hides details and differences in internal ProSphere persistence

• Can be used for a truly headless solution

Historical DatabaseHistorical DatabasePro ApplicationPro Application Discovery EngineDiscovery Engine

RDFRS RS RS

REST Services

HTTP:// POST, PUT, DELETE(future)

GET


Policy A

Policy BPolicyB

PolicyA

Rules

Rules

Rules

Rules

RulesAccess Profile

Storage Environments Discovery Policies Repository Data & Dependencies Configuration Policies

Administrative web-based interface

Access Profile

Access Profile

Access Profile

Access Profile

Discovery Changes Storage

Storage Configuration Advisor Architecture


Relationships, Dependencies & Impact

• Dynamic reporting of ALL resources and performance dependencies

RECEIVE REAL-TIME UPDATES

• Trending and threshold notifications correlated with storage metrics

ANALYZE APPLICATION PERFORMANCE

• Visualize all physical and virtual relationships from application to host and from host through storage

UNDERSTAND INTERDEPENDENCIES


Application – Storage Interdependencies

• Understand relationships and topology end-to-end across all layers

– Storage & Fabric

– Virtual Machine & Datastore

– App & Database

• Analyze infrastructure with a view into:

– Performance

– Availability

– Configuration

END-TO-END ANALYSIS


Analyze Application Storage Related Issues

• Overview of Oracle application and infrastructure uptime

– Drill into application for details and status

• Additional application report packs available:

– Microsoft SQL Server

– MySQL

– IBM DB2

– Websphere


Analyze Application Storage Related Issues

• Examine application hosts– Datastore Usage

– Disk Rate

– CPU Usage

– Memory

• Identify application host to investigate further

– Data path

– Configuration policy

– Virtual to Physical host


View End-to-End Topology for EMC Storage


Analyze Data Path & Configuration Policies

View host to storage topology details for EMC

storage

Enable analysis of host performance issues

Investigate configuration policies to determine

compliance


vCenter Servers Arrays

EMC Professional Services Can Assist to Design Your Custom Reports

Unified SLA Reports From Heterogeneous Sources

One pane of glassOne pane of glass

Host Unification (Physical Windows/Unix, Virtual)Host Unification (Physical Windows/Unix, Virtual)

Allocated StorageAllocated Storage

Capacity MetricsCapacity Metrics Performance MetricsPerformance Metrics


Launch to Element Managers for Remediation

• Launch in context to:– Symmetrix Management

Console (SMC)

– Symmetrix Performance Analyzer (SPA)

– Unisphere for VMAX

– Unisphere (for VNX)

– Brocade Top Talkers

• Real-time investigation unique to the element

– Active commands and detail information

Symmetrix Management Console

Symmetrix Performance Analyzer

Unisphere for VMAX


Assure Storage SLAs & Chargeback

• Custom thresholds and dashboards across heterogeneous storage environments

IDENTIFY SLA ISSUES

• Automatically, using the EMC Support Matrix and your own design best practices

VALIDATE CONFIGURATIONS

• See the impact of FAST on performance and chargeback based on policy

OPTIMIZE USE OF FAST VP


Performance and SLA Monitoring� Historical, real-time views, trending, and forecasting

� Correlation between performance metrics & events

� Performance analytics, with adaptive alerting


Identify SLA Issues

Identify SLAs at risk

Identify SLA issues requiring immediate investigation


Validate Storage Configurations

Determine if SLA issue is due to a configuration issue


Identify Configuration Compliance Issues

SLA issue is due to a path problem. Defined policy calls for 2 paths.


Array #2Array #1

Identify True Cost of Application Storage

Primary volume

Local copy

Remote copySnapshots

Local copy Mapped/masked

to backup server

Copy for testing new version of applicationMapped to Dev server

DR Copy. May or may not be mapped to a DR server

ApplicationCluster

BackupServer

Dev/TestServer

Total Charge Should Include All This Capacity

Primary volume

Local copy

Remote copySnapshots

Local copy

Map storage to Service Levels based on FAST

policy, etc.

Understand storage to host relationships,

including clusters, etc.

Need to handle copies correctly – should be charged to application server, not backup

server


Analyze Storage Usage for Chargeback

EMC

NetAppIBM


Optimize Resources & Productivity

• Analyze capacity trends with visibility of all replicas

IMPROVE CAPACITY PLANNING

• Analyze application performance with storage workload trends to select best storage tier

IDENTIFY APPROPRIATE TIER OF STORAGE

• Through anywhere, any-device access to comprehensive analysis

ENHANCE PRODUCTIVITY


Assure Storage SLAs

Service Level Utilization

Service Levels

Service Level storage details


Monitor Federated Tiered Storage

Encapsulated and Externally Provisioned

volumes in use

Unused Externally Provisioned volumes

Federated Tiered Storage capacity per array


Improve Capacity Planning

Show capacity used by purpose

Pools are close to running out of space


Identify Capacity Issues

Only 6 weeks to “Pool Full”

Identify what type of storage to add

Time to order more 15K drives for Hopkinton


Enhance ProductivityAnywhere, Any-Device Access to Comprehensive Analysis

Access reports on the go!

Documents

Srm suite technical presentation nrm - tim piqueur