47
© 2013 IBM Corporation Storage Performance Measurement using Tivoli Productivity Center (TPC) Kristján Hugosson Teamleder Storage ADC Datacenter & Cloud Services [ 28-05-2013, København ] [email protected] - +4530781063

Storage Performance measurement using Tivoli productivity Center

Embed Size (px)

DESCRIPTION

v/ Kristjan Hugosson, ATEA

Citation preview

Page 1: Storage Performance measurement using Tivoli productivity Center

© 2013 IBM Corporation

Storage Performance Measurement using Tivoli Productivity Center (TPC)

Kristján Hugosson

Teamleder – Storage ADC

Datacenter & Cloud Services

[ 28-05-2013, København ]

[email protected] - +4530781063

Page 2: Storage Performance measurement using Tivoli productivity Center

1

Agenda

Atea & Datacenter & Cloud Services (ADC)

Atea ADC’s Storage solutions

TPC 5.1 Performance measurements TPC Cognos reporting - New GUI

Predefined reports Basic report

Performance reporting - Legacy GUI

Are there alternatives to TPC Open source solutions (SVCMON & SVCFRONT)

Page 3: Storage Performance measurement using Tivoli productivity Center

2

What is Atea

■ Listed on the Oslo Stock Exchange

■ Total turnover of more than 20 billion. NOK.

- of which over 5.5 billion. DKK in Denmark (2011)

■ Atea is in 7 countries across the Nordic and Baltic countries

■ Supplier of IT infrastructure

■ Hosted Infrastructure services

■ Remote backup solutions

■ Supplier of hosted services ■ For small, medium and large companies in the private

and public sectors..

■ More than 5,800 employees

■ 1,500 in Denmark, spread over 6 locations

Page 4: Storage Performance measurement using Tivoli productivity Center

3

Atea Datacenter & Cloud Services (ADC)

Outsourcing – Responsible for the overall operation and maintenance of a companies IT

infrastructure. Includes Servicedesk, Netværk, Server, Storage, Change

management – based on ITIL framework

Infrastructure as-a-Service – IAAS – A platform in a virtualized environment - as a service, including servers,

network, storage and backup.

Cloud Backup – Remote backup solutions

Page 5: Storage Performance measurement using Tivoli productivity Center

4

ADC – Storage Environments

Our Storage environment can be divided into

two different categories :

Outsourcing

– (IAAS, VMware, SQL, Exchange osv.)

Backup

– (TSM & CommVault)

All storage is based Enterprise, Midrange and Entry level from IBM

Page 6: Storage Performance measurement using Tivoli productivity Center

5

IBM Storage systems - Enterprise

IBM Storage systems at Atea

Enterprise level:

2 - DS8300

4 - DS8700

5 - SVC clusters – with 24 nodes

Page 7: Storage Performance measurement using Tivoli productivity Center

6

IBM Storage systems - Midrange

IBM Storage systems at Atea

Midrange:

7 - IBM V7000 and 1 - V7000 unified

4 - IBM DS5300

4 - DCS3700

Page 8: Storage Performance measurement using Tivoli productivity Center

7

IBM Storage systems - Entry-level

IBM Storage systems at Atea

Entry level:

2 - IBM V3700

3 - IBM DS3500

Page 9: Storage Performance measurement using Tivoli productivity Center

8

Storage Capacity

Total storage capacity:

Disk Type Capacity (TB)

FC / SAS 2.500

SATA / NL-SAS 1.300

SSD 30

LTO Tapes (LTO3,4 & 5) 4.500

Page 10: Storage Performance measurement using Tivoli productivity Center

9

Storage Capacity – Growth over the past 5 years

-

500.000,00

1.000.000,00

1.500.000,00

2.000.000,00

2.500.000,00

3.000.000,00

2007 2008 2009 2010 2011 2012 2013

Antal GB

Vækst i storage kapacitet de sidste 5 år

FC/SAS

SATA/NL-SAS

Page 11: Storage Performance measurement using Tivoli productivity Center

10

Storage Capacity – next move

Upgrading 32 TSM instances to version 6.4 (7.1)

IBM FlashSystem 820 - 10TB

Page 12: Storage Performance measurement using Tivoli productivity Center

11

TPC – Performance Data

Page 13: Storage Performance measurement using Tivoli productivity Center

12

TPC at Atea

June – 2008 (IBM)

– IBM analysis of hardware installation

February 2009 - 2012 (IBM)

– IBM recommendations in relation to new hardware

(DS800 vs. DS5300)

April 2013 (Atea)

– TPC 5.1 Installation with new hardware

implementation

Page 14: Storage Performance measurement using Tivoli productivity Center

13

TPC - Login

Page 15: Storage Performance measurement using Tivoli productivity Center

14

TPC - Dashboard

Page 16: Storage Performance measurement using Tivoli productivity Center

15

TPC - Errors

Page 17: Storage Performance measurement using Tivoli productivity Center

16

TPC - Errors

Page 18: Storage Performance measurement using Tivoli productivity Center

17

TPC – Errors

Page 19: Storage Performance measurement using Tivoli productivity Center

18

TPC - Errors - Defective Disk

The error is caused by a failed 900GB SAS disk

Page 20: Storage Performance measurement using Tivoli productivity Center

19

TPC – Storage System Overview

Page 21: Storage Performance measurement using Tivoli productivity Center

20

TPC – Storage System - Internal Resources

Many options for a quick overview

– Volumes

– Pools

– Managed disks

– FC portes

– I/O groups

– Disks

Page 22: Storage Performance measurement using Tivoli productivity Center

21

TPC – Storage System Overview

Page 23: Storage Performance measurement using Tivoli productivity Center

22

TPC - Reporting

Page 24: Storage Performance measurement using Tivoli productivity Center

23

TPC - Predefined reports - Performance

Page 25: Storage Performance measurement using Tivoli productivity Center

24

TPC - Predefined reports - Storage Virtualizer

Page 26: Storage Performance measurement using Tivoli productivity Center

25

TPC - Predefined reports

Page 27: Storage Performance measurement using Tivoli productivity Center

26

TPC - Predefined reports

Page 28: Storage Performance measurement using Tivoli productivity Center

27

TPC - Storage Virtualizer - Details Report

Page 29: Storage Performance measurement using Tivoli productivity Center

28

TPC - Storage Virtualizers - Most Active Volumes

Page 30: Storage Performance measurement using Tivoli productivity Center

29

TPC - Most Active Volumes – Response time

Page 31: Storage Performance measurement using Tivoli productivity Center

30

TPC - Most Active Volumes – Response time

Page 32: Storage Performance measurement using Tivoli productivity Center

31

TPC - Most Active Volumes – I/O Rate

Page 33: Storage Performance measurement using Tivoli productivity Center

32

TPC - Most Active Volumes – Data Rate

Page 34: Storage Performance measurement using Tivoli productivity Center

33

TPC – Reports

With the Predefined reports we got – A quick overview of the system

– A bit more specific look at the performance of specific disks I/O - Latency - Data Rate

To get more specific reports – Create a basic report using - Cognos - Query Studio

• Build own specific reports

• Create templates for general reports

Hint: – The Predefined reports can be used as templates in Query Studio

Page 35: Storage Performance measurement using Tivoli productivity Center

34

TPC – Simple Report – Cognos Query Studio

Page 36: Storage Performance measurement using Tivoli productivity Center

35

TPC – Lessons Learned (so far)

Set Retention

Collect data before and after hardware/software changes

Export to CSV for later review

Start wide (sample by hour) – Get an overview of a period of time (one week)

– Drill Down

So many options – IO Rate (ops/sek)

– Datarate (MB/sek)

– Response time (ms/op)

Page 37: Storage Performance measurement using Tivoli productivity Center

36

Tools til SVC og V7000

SVCMON

– Collecting performance data from V7000 and SVC

SVCFRONT

– PHP Frontend to SVCMON

STAT

– Storage Tier Advisor Tool

Page 38: Storage Performance measurement using Tivoli productivity Center

37

SVCMON

SVCMON – SVCMON collects SVC/Storwize V7000 performance data, and generates

spread sheet files in CSV format and graph files in GIF format.

Page 39: Storage Performance measurement using Tivoli productivity Center

38

SVCFRONT

SVCFRONT – A PHP Frontend to the SVCMON script, that provides a drilldown view to your

SVC/Storwize performance data

Page 40: Storage Performance measurement using Tivoli productivity Center

39

SVCFRONT - Demo

Page 41: Storage Performance measurement using Tivoli productivity Center

40

STAT – IBM Storage Tier Advisor Tool

STAT – The IBM Storage Tier Advisor Tool predicts whether the addition of Solid

State Drive (SSD) capacity in conjunction with the Easy Tier function could benefit system performance

• Download Heat filen from SVC/V7000

• Run: “stat dpa_heat.78N2TLT-2.130523.225648.data”

Result – System Recommendation

– Storage Pool Recommendation

– _

Page 42: Storage Performance measurement using Tivoli productivity Center

41

STAT – IBM Storage Tier Advisor Tool

Page 43: Storage Performance measurement using Tivoli productivity Center

42

TPC – Volume information

Page 44: Storage Performance measurement using Tivoli productivity Center

43

TPC – Volume information

Easy Tier information

– Generic_ssd

– Generic_hdd

Data can be exported to CSV

Page 45: Storage Performance measurement using Tivoli productivity Center

44

TPC – Easy Tier oversigt (med lidt Excel)

Page 46: Storage Performance measurement using Tivoli productivity Center

45

Kristján Hugosson

[email protected] - +4530781063