Performance & Capacity Planning for SANs

  • Published on

  • View

  • Download

Embed Size (px)


<p></p> <p></p> <p>Performance And Capacity Planning Basics For Storage NetworksA Computer Measurement Group (CMG)</p> <p>10/27/08</p> <p>Performance And Capacity Planning Basics For Storage Networking</p> <p>Greg Schulz Director Storage Networking Solutions INRANGE Technologies</p> <p>1</p> <p></p> <p></p> <p>What Is CMG?This Presentation Is Being Delivered On Behalf Of The Computer Measurement Group (CMG) For Educational Purposes</p> <p>For more information about CMG, membership, conferences, and publications please see www.cmg.org10/27/08 Performance And Capacity Planning Basics For Storage Networking 2</p> <p></p> <p></p> <p>What Is CMG? Computer Measurement Group (CMG) is an International Organization with groups located throughout the United States and the World pursuing computer measurement, performance, and capacity planning activities. CMG looks at Capacity Planning and Performance Engineering and related tasks across all platforms (Mainframe, Open Systems, Servers, Workstations, Internet) and applications. CMG is a non denominational organization meaning it is not tied to any one vendor (hardware, software, network, etc) and is multi-disciplined providing a vehicle for learning about and sharing information on performance and capacity planning activities. CMG by its nature is also concerned with management software that lends itself to the overall computer measurement and performance engineering process. CMG activities include: Annual international symposium (Dallas Texas, December 7-12, 2003) Regional and international conferences, symposiums, and meetings Online newsletter (MeasureIT), Journal, Conference Proceedings and papers10/27/08 Performance And Capacity Planning Basics For Storage Networking 3</p> <p></p> <p></p> <p>Why The Concern For Capacity Planning and Performance</p> <p>Customer Survey, 2001</p> <p>10/27/08</p> <p>Performance And Capacity Planning Basics For Storage Networking</p> <p>4</p> <p></p> <p></p> <p>Can You Or Do You Need To Answer Any Of These? Do you know how many Gbyte/Tbyte/Pbyte of storage you have? Do you know how many disk storage devices and/or sub-systems you have? Do you know where the storage is located? Do you know how much of it is free, allocated, actually in use? Do you know how many switch ports you have, how many are used, ISL, un-used? Do you know when you will need to add more storage, tape, cache, ports, HBAs, etc? Do you know how utilized your storage network is in terms of: 10/27/08</p> <p>Bandwidth and throughput of servers, storage devices, switches I/Os, transactions, frames and packets being sent/received end-to-end and by component Channel delays and queuing for devices, adapters, and switches/gateways Response time and latency for the network and for storage Where the bottlenecks are, what is normal, what is abnormal? Workload profiles (reads, writes, I/O size, random, sequential, response time) How long tape mounts (real or virtual) take under different conciliations? much of it is disk, how much is tape, how many devices?Performance And Capacity Planning Basics For Storage Networking 5</p> <p></p> <p></p> <p>Getting Started - What Is It? Performance and Capacity Planning activities have occurred in the enterprise environments for S/390 Mainframes and Open Systems platforms for many years. These activities have for the most part focused on large (expensive) components including processors, memory, storage and network interconnects, and storage subsystems (disk and tape). Performance and Capacity Planning are independent yet related functions in that you can institute capacity planning in your environment without having to worry about performance engineering or vise versa not that it is a recommended practice. With the advent of lower cost processors (CPUs), memory, and storage, there is a tendency to go out and buy more. For some environments this may be applicable, however it brings with it an added management burden of more resources to see over. More recently Performance and Capacity Planning activities have focused on Internet related activities particularly response time and workload balancing. Capacity Planning, Performance, and Storage Resource Management (SRM) are related and depend upon each other. With storage and storage networking taking on a more prominent and lead role in many IT environments, more disciplined management activities are being employed to more effectively utilize IT resources particularly in tough business climates.10/27/08 Performance And Capacity Planning Basics For Storage Networking 6</p> <p></p> <p></p> <p>Why Bother With Performance and Capacity Planning? Hardware is cheap, people are not, why tie someone up doing tuning? While hardware is becoming less expensive, management (people and software is not)</p> <p> Your staff is already busy if not overworked, why give them more to do? With planning, you can utilize your resources (people, hardware, software) better</p> <p> Why not buy more and have the vendor management it for you? This may be an alternative if you can afford it from a dollar and business perspective</p> <p> Your environment is not growing so why be concerned with planning? If your environment is stable, now is a good time to institute a plan for the future</p> <p> Your environment is dynamic so why do tuning and capacity planning? During the dot-com bubble this was a common practice that lead to wild purchases and the vendors absolutely loved it! Many sites over bought at what turned out to be higher prices than now available and have excess capacity that is consuming power, cooling, and management.</p> <p> You have your vendors take care of it all so why worry about this? As part of the vendor community, can we talk. 10/27/08 Performance And Capacity Planning Basics For Storage Networking 7</p> <p></p> <p></p> <p>Getting Started - What Is It? Capacity Planning Monitor how resources are being used including trends Provides insight on how resources are being used including: Memory, CPU/Processors, I/O interfaces, Networks, Storage Devices What the past looks like, what is normal, what is expected, what is planned What is needed to support service level agreements (SLAs)</p> <p> Provides a view into the future as to when resources will be needed Can help facilitate purchasing and upgrade decisions Can help business decisions including do you have enough resources to support growth, new functions, consolidation, and mergers/acquisitions. Provides effective measurements to help manage resources better Facilitate timely decision making to support dynamic and changing environments Can be simple as tracking what you have, how it is used using a spreadsheet Can be intermediate using a combination of tools and metrics Can be advanced including modeling, sophisticated packages tightly integrated into your environment.10/27/08 Performance And Capacity Planning Basics For Storage Networking 8</p> <p></p> <p></p> <p>Getting Started - What Is It? Performance Tuning and Engineering Looks at how resources and application are performing Looks at applications and underlying infrastructure items including processors, memory, file systems, operating systems, I/O interfaces, networks,and storage. Looks at how resources are being used including activity, bottlenecks, slowdowns, and availability of resources that impact performance. Hardware, application, operating &amp; file system, database, and network focused Can be simple or advanced depending on your needs and requirements Can support and drive Service Level Agreements (SLAs) Can range from simple maintenance like defragging the disk on your laptop to advanced configuration and tuning of the entire I/O sub-system to application optimization activities.</p> <p>10/27/08</p> <p>Performance And Capacity Planning Basics For Storage Networking</p> <p>9</p> <p></p> <p></p> <p>Some Storage and Storage Networking ChallengesTB/Capacity</p> <p> Planning for Growth Capacity doubling every 18 months (Rich Media) SANs getting more complex (Similar to early Lans) Consolidation of servers, storage, SANs</p> <p>Availability</p> <p> Data Availability Network Planning More copies of data are needed (Regulatory) Increased pressure for 100% uptime DR networking costs expensive (Telco)</p> <p>$/Budgets</p> <p> Shrinking Budgets and Cost Reductions Lower management costs (Capital &amp; Operating) Optimize purchasing/Maximize Investment Reduced Headcount/Improved efficient</p> <p>Ultimately, how do you support growth, improve resiliency, while reducing costs?10/27/08 Performance And Capacity Planning Basics For Storage Networking 10</p> <p>www.inrange.comServers</p> <p></p> <p>A Unified Storage Networking EnvironmentS/390 and Open Systems Servers NFS Client Servers NAS &amp; SAN</p> <p>NAS</p> <p>SAN/DAS</p> <p>NAS</p> <p>SAN/DAS</p> <p>Capacity Security PerformanceBlock / File Replication Backup Data Sharing Consolidation</p> <p>SAN/DAS</p> <p>Archive</p> <p>Scalable Management</p> <p>Shared Storage &amp; Tape 10/27/08 Performance And Capacity Planning Basics For Storage Networking 11</p> <p></p> <p></p> <p>Capacity Planning Part Of The SNIA Shared Storage Model</p> <p>The SNIA storage modelwith Services subsystemApplicationFile/record layer File/record layer</p> <p>Interconnect Usage Interconnect Capacity Storage Usage Storage Capacity</p> <p>Storage domain</p> <p>Database (dbms)</p> <p>File system (fs)</p> <p>Block aggregation Block aggregation</p> <p>Storage devices (disks, ) Storage devices (disks, )</p> <p>Block layer layer</p> <p>53 Copyright 2001, Storage Networking Industry Association [draft SNIA TC Proposal]</p> <p>10/27/08</p> <p>Performance And Capacity Planning Basics For Storage Networking</p> <p>Discovery, monitoring Discovery, monitoring Resource mgmt, configuration Resource mgmt, configuration Security, billing Security, billing Redundancy mgmt (backup, ) Redundancy mgmt (backup, ) High availability (fail-over, ) High availability (fail-over, ) Capacity planning Capacity planning</p> <p>Services</p> <p>12</p> <p></p> <p></p> <p>Managing Storage And Storage NetworksMonitor Data Inputs Make Adjustments Collect Data Assess And Analyze</p> <p>Track Progress</p> <p>It Should Not Have To Be Complex!</p> <p>Monitor Resources</p> <p>Have A Plan, Manage And Monitor Your IT Resource Capacity And Performance With That Plan10/27/08 Performance And Capacity Planning Basics For Storage Networking 13</p> <p></p> <p></p> <p>Capacity Planning And Performance Lifecycle ModelAsset Management Regulatory Compliance New Development Application Changes Business Growth Consolidation Collect, Assess, What Changed? Positive Impact? Report, Analyze,Data Collection</p> <p>SRM</p> <p>Model, Trend, Track</p> <p>Data Reporting</p> <p>How Are Resources Being Utilized and How Effective?</p> <p>Research, Adjust, Test, ImplementTechnology Options Configuration Management Test, Simulation, Modeling Engineer Changes Change Control/Management10/27/08 Performance And Capacity Planning Basics For Storage Networking 14</p> <p></p> <p></p> <p>Capacity Planning BasicsAssessment What Do You Currently Have, How Is It Being Used Do you have detailed configurations and topology information for your environment Do you have an inventory or list of what equipment and software you have Do you have profiles or information about your workloads and what is normal Do you have any metrics or can you obtain them (sar, df, iostat, MXG, SAS, etc) Performance related includes bandwidth, I/O activity, MB/sec, I/Osec, response time Capacity related includes disk and tape space consumption, ports and HBAs used</p> <p> Do you have any reporting and trending capabilities (paper, excel, web, SAS, etc) Do you have any knowledge of business plans, growth, and activity to map to plan Do you have any business tie back information to IT resources and consumption A business transaction requires x Mbyte and y I/Os at z response time A device address can correspond to a branch office, bank teller machine, or terminal</p> <p> Do you have any Quality of Service (QoS), Rules of Thumb, or SLAs? 10/27/08</p> <p>A port can support x Tbyte of storage at y Mbyte/sec A server to storage port ratio is 6:1 assuming servers are doing 10-15MB/sec at 1Gb You need to keep x ports free, y amount of storage free for growth on demand You run servers at x% and interconnects at y% utilization, and storage z allocatedPerformance And Capacity Planning Basics For Storage Networking 15</p> <p></p> <p></p> <p>Capacity Planning BasicsAnalyze, Model, Forecast Interpret Data and Information Identify trends and patterns based upon history, present activity, and projections Understand business, applications, hardware and software activity Create supporting reports and charts showing trends and activities Track resource consumption (ports, memory, processor, storage) Track resource activity (frames/packets/Ios, queuing, delay, bandwidth) Model and forecast using tools or pencil, paper, and calculator Identify options and various alternatives to support business needs Upgrades and expansion Tuning and conservation Combination of above</p> <p> Develop plans and strategies to support business needs and available resources This is part science, part art, part intuitive (you need to understand your environment) The better the data, the better the information, the better the plan! Your chances of success are as at least as good as your local weather forecaster .</p> <p>10/27/08</p> <p>Performance And Capacity Planning Basics For Storage Networking</p> <p>16</p> <p></p> <p></p> <p>Storage Networking Focus Items Processor/Server (CPU) CPU and Memory Usage, paging, busy vs overhead vs. idle I/O bus and back plane Is there enough capacity to support the adapters I/O Adapters and channels including HBAs and NICs Are adapters busy or idle</p> <p> I/O interconnect/Channel I/O path activity How busy is the path, any congestion or queuing or channel busy I/O interconnect (switches and directors) How many ports, blocking/congestion Gateways, front end processors (FEP), bridges, and routers Usage and profile Metropolitan and Wide Area Network interfaces Bandwidth, Droop, Latency</p> <p> Storage Sub-System (Disk &amp; Tape) 10/27/08</p> <p>Cache capacity and usage Cache hits, effectiveness and utilization Device capacity and allocation How much allocated vs. used vs. available Number and type of devices How many devices, what type, size, etc Control Unit usage and activity How busy is controllers vs. devicesPerformance And Capacity Planning Basics For Storage Networking 17</p> <p></p> <p></p> <p>Capacity Planning And Performance Focal Points CPU Processing Resource Number Connection Ports Amount Of Capacity Memory Capacity Non Blocking Bandwidth Number Of Devices I/O Channel (Adapters) I/Os and Frames/ Second Type Of Devices Switch Interconnect</p> <p>LAN</p> <p>CPU Host Processor</p> <p>CPU, Memory, I/O, And Storage Activity (Idle, Overhead, Re...</p>