Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and...

Preview:

Citation preview

1

Restoring Data Storage Predictability

Thoughts and Approaches on Managing Storage Performance and Capacity in 2017

Brent Phillips – Managing Director, Americas Brett Allison – Director of Technical Services

2

Agenda

• The Predictability Challenge

• Storage Background

• Storage Capacity Management

• Storage Performance Management

3

The Predictability Challenge

• What risky conditions exist right now across our entire environment? (rated metrics & exception charts for space, performance, configuration issues)

• Where do go next to see root causes? (intelligent drill downs)

• What related metrics are relevant to the context of this issue? (side-by-side mini-charts of related metrics that are clickable)

• What help is there to create a solutions? (built-in recommendations)

4

Predictability Requires Better Analytics • Lots of disparate data from:

‒ Hosts ‒ SAN Switches ‒ Storage Arrays

• Need to automatically: ‒ Normalize the data ‒ Enrich, additional calculations ‒ Correlate, interrelate ‒ Evaluate, good or bad? ‒ Easily navigate through it

IT Operations Analytics (ITOA)

"The use of mathematical algorithms and other innovations to extract

meaningful information from the sea of raw data collected

by management and monitoring technologies.”

Forrestor Research

5

Predictability Requires Better Analytics

• “..and other innovations…” ‒ Most useful ITOA innovation for storage is applying a

storage-specific type of artificial intelligence (AI).

• “Artificial intelligence is the science of making machines do things that would require intelligence if done by men” - Marvin Minsky 1968

• What could be done that there is no time to do?

• This is an example of why Applied AI is the #1 strategic technology trend according to Gartner

6

• Spend time on proactive storage management ‒ Not reactive fire fighting ‒ Not on maintaining the analytics infrastructure

• Allows for quick, easy Proof of Concept (POC)

Predictability through ITOA as a Service

© IntelliMagic 2016

7

Storage Background

9

Data Center Storage Architectures and Industry Adoption

10

11

State of Industry

State of Technology

12

State of Industry

State of Technology

13

Performance Management Characteristics Tier Purpose Performance External

Dependencies * I/O Profile Ideal

Capacity Growth

Availability

0 Flash Extremely Fast Any IOPS intensive Average High (if in enterprise storage array)

1 Enterprise Hybrid

Fast Any IOPS intensive Average High

2 Mid-range Spinning

Good Any IOPS average/Throughput

Average High

3 Nearline/NAS Medium to slow, but predicable response times

Any IOPS low intensity Medium growth

High

4 Tape/VTS Archive

Not latency sensitive, think batch/archive

Any IOPS low intensity/Occasional high throughput

High growth

Moderate

5 Cloud Slow and unpredictable

None High throughput is okay

High growth

Moderate

14

Storage Capacity Management

15

Storage Capacity Management Methodology

Collect

Report

Calculate Growth

Forecast Requirements

Make Recommendations

Identify Important Metrics

16

Technology Enhanced Storage Capacity Management Methodology

Collect

Report

Calculate Growth

Forecast Requirements

Make Recommendations

Identify Important Metrics

Automated Analysis

17

Storage Capacity Measurement (Local)

18

Storage Capacity Measurement (NAS)

19

Storage Capacity Measurement (SAN)

20

Storage Capacity Measurement (Hyper-converged)

21

Storage Capacity Measurement (Public Cloud)

22

Common Storage Capacity Forecasting Techniques

• HisS: Historical Swag or Order about the same as last year

• LRA: Linear Regression Analysis: Apply linear regression analysis to your usable capacity trend from the previous year(s). Continue growth line for some time in future.

• ABRBO: Burn rate/Burn out: Calculate average burn rate per day/month/etc. Divide capacity left by burn rate to calculate days until burn out.

• WARP: Wait and Reach out to vendor in Panic

23

Example of Burnout

24

Burn out Tabular View for Multiple Systems

25

Track Capacity By Application

26

Storage Performance Management

27

Storage Performance Management Methodology

Load

Report

Assess

Correlate

Make Recommendations

Collect

28

Technology Enhanced Storage Performance Management Methodology

Prepare

Enrich

Assess

Rate

Visualize

Correlate

Recommend

Collect

Automated Analysis

29

Storage Performance Measurements: Collect

30

Prepare: Validate, Normalize and Categorize

1. Validate 2. Normalize: EMC vs HDS

3. Categorize

31

Enrich: Add Meaning

32

Enrich: Add Meaning

33

Enrich: Add Meaning

34

Assess: Define the Criteria

1. Hardware Specific Storage System Throughput

2. Workload Dependent Storage System Response Time

35

Assess: Define the Criteria

36

Rate: Apply The Assessment Criteria

• (∑ 𝑟𝑟𝑖𝑖𝑛𝑛𝑖𝑖=1 )/n

‒ Where • r = rating at interval i • n = number of intervals

‒ Rating is always either • 0 = Value is less than warning • 1 = Value is greater than or equal to warning or less than

performance exception • 3 = Value is greater than or equal to performance exception

37

Visualize: Visualize the Rating

• How does color relate to the rating displayed? ‒ 0-.1 is Green ‒ >.1-.3 is Yellow ‒ >.3-3.0 is Red

• So out of 96 intervals: ‒ we need no more than 3 red or 9 yellow intervals to rate

green. ‒ Less than 28 yellow or 9 red intervals make the chart rated

yellow. ‒ Otherwise, the chart is rated red.

38

Correlate Configuration

39

Apply Rating to Correlation?

Port Issues

40

Application Views

41

Automated Analysis

Automatic Correlation

Application Performance

Capacity Forecasting

How Can You Restore Data Storage Predictability?

Accurately and Quickly Identify Risks

Highlight potential affected paths

Understand health of applications

Plan for demand

Challenges Benefits

42

IntelliMagic Vision Architecture

43

IntelliMagic Vision for SAN Logical Architecture

44

IntelliMagic Vision as a Service Architecture

45

Thank you

For more information, please visit

www.intellimagic.com

Contact us with any questions or feedback:

Email: info@intellimagic.com

Save the Date!

Recommended