34
iSCSI Storage: Momentum, Deployments and Future Claude Lorenson, Ph.D. Senior Product Manager Windows Server clor @ microsoft.com Microsoft Corporation Suzanne Morgan Program Manager WDEG sumorgan @ microsoft.com Microsoft Corporation

ISCSI Storage: Momentum, Deployments and Future Claude Lorenson, Ph.D. Senior Product Manager Windows Server clor @ microsoft.com Microsoft Corporation

Embed Size (px)

Citation preview

iSCSI Storage: Momentum, Deployments and Future

Claude Lorenson, Ph.D.Senior Product ManagerWindows Serverclor @ microsoft.comMicrosoft Corporation

Suzanne Morgan Program ManagerWDEG sumorgan @ microsoft.comMicrosoft Corporation

Session OutlineSession Outline

Part 1 iSCSI Storage MomentumiSCSI definedIndustry trends Emerging iSCSI-NAS technologyPlatform Support and Architecture

Future Microsoft’s iSCSI Roadmap

Part 2 iSCSI Deployments Customers

iSCSI Case Study: Video

City of Everett: Exchange Consolidation

Partners Broadcom: iSCSI boot

EqualLogic: iSCSI SAN/NAS

iSCSI Storage MomentumPart 1

Session GoalsSession Goals

Attendees should leave this session with the following:

A better understanding iSCSI fits into the storage solution landscape

A better understanding of how iSCSI integrates into the Windows platform

A better understanding of the Windows applications that are supported on iSCSI

A better understanding of how iSCSI can benefit SMB and enterprise environments

A better understanding of customer deployments

iSCSI Defined: What Is iSCSI?iSCSI Defined: What Is iSCSI?

iSCSI = internet Small Computer System Interface An interconnect protocol that:

Is designed for storage area networks (SANs) Supports the block-based storage needs of database applications Is TCP/IP basedEstablishes and manages connections between IP-based storage devices, hosts and clientsIs based on familiar and ubiquitous open standards Provides advanced IP routing, management, and security tools

iSCSI Defined: An Alternative to FC SAN?iSCSI Defined: An Alternative to FC SAN?

A non-Fibre Channel means of deploying storage networks Low intangible costs (management, training, deployment)No inherent distance limitations on the protocolFlexible topologyEasy to use with multi-vendor storage devicesEasy to scale to large number of devices

DAS Direct Attached Storage

High TCOInflexible

NASNetwork Attached Storage

File storage traffic over LAN

SAN Storage Area Network

Optimized for block data transmissionSeparation of LAN from storage traffic

Industry Trends: What’s Driving StorageIndustry Trends: What’s Driving StorageNetwork Deployments?Network Deployments?

Escalating capacity needsFederal regulationsGrowing email databasesFile storage requirements doubling every 1-2 years

Need for flexible storage provisioning and data sharingNeed for improved data protection

2008 Open Systems External Storage

DAS17%

FAS83%2003 Open Systems

External Storage

FAS59%

DAS41%

Source: IDC, July 2004

Analyst predictions:

Industry Trends: Factors Slowing SAN AdoptionIndustry Trends: Factors Slowing SAN Adoption

Actual SAN adoption far lower than respondents hadpredicted in 2002. Why?

Perceived as too costly, even in large organizations

SMBs do not have the staff or the expertise to support a SAN

IDC: Networked Storage Opportunities, August 2004

Reasons for Not Buying a SAN

NAS preferred, 11%

SANs too complex, 14% DAS is adequate,

14%

Too few staff, 17%

SANs too expensive, 29%

Other, 5% Too little storage,

10%

Industry Trends: Desired Storage Array SolutionsIndustry Trends: Desired Storage Array Solutions

Industry Trends: iSCSI Impact on SAN PurchasesIndustry Trends: iSCSI Impact on SAN Purchases

Organizations are constrained by: Limited budgets

Hiring freezes or cutbacks

Increased storage requirements

iSCSI SANs capitalize on:Existing LAN and WAN infrastructures

Existing staff expertise

iSCSI perceptions will drive new SAN purchasesAccording to the IDC, most potential buyers believe:

It will be easy to learn iSCSI

Same staff can be used for network and storage

Allows buyers to use standard network equipment for storage network

iSCSI products are likely to cost less than FC over time

iSCSI products are likely to be less expensive to manage over time

iSCSI products will have the same or better performance as FC

IDC: Worldwide iSCSI Forecast and Analysis, 2003-2007: Storage Networks Embrace IP , September 2003

Industry Trends: SAN Adoption - Growth AreasIndustry Trends: SAN Adoption - Growth Areas

Among those involved in the purchase of SAN solutions or employed at a company using/planning to use SAN solutions (N= 332): What types of SAN technologies are currently in place at your

company and what technologies is your company planning to use 12 months from now?

Source: Infoworld Test Center Research Report - Storage 2004

9%

11%

10%

35%

14%

36%

2%

7%

7%

12%

13%

22%

49%47%

iFCP

FCIP

NDMP

4 GB Fibre Channel

Ficon/ESCON

iSCSI/Ethernet

2 GB Fibre Channel

Currently

12 Mos. FromNow

Users have pent-up demand for iSCSI/IP based storageFull range of price points and brands are required torealize potential

Industry Trends: iSCSI Market Share ForecastsIndustry Trends: iSCSI Market Share Forecasts

2008 Open Systems External Storage

DAS17%

NAS17%

iSCSI15%

SAN (FC)51%

2003 Open Systems External Storage

DAS41%

NAS12%

iSCSI0%

SAN (FC)47%

Source: IDC, July 2004

iSCSI: A disruptive technology Especially with low cost SATA disks and LAN switches

Total market for iSCSI-based disk arrays: 2003: $216 M

2007: $4.9 B

Total market for iSCSI-based switches:2003: $27.9 M

2007: $1.15 B

Industry Trends: iSCSI AwarenessIndustry Trends: iSCSI Awareness

Slowly increasing 2002: 66% of IDC survey respondents heard of iSCSI

2004: 73%

In general, awareness is higher The larger the total installed storage capacity

When there are more than 10 servers/10 IT staff

Potential buyer interest is highest in large organizationsBuyer group: mean of 273 switch ports

Non-buyer group: mean of 67 (Source: IDC Sept 2003)

Many smaller businesses deterred by high cost disk arrays($25K-$100K)

US market currently has an estimated 8% iSCSISAN installations

Currently mid-market (30-300 installed servers) leads the installations (Source: IDC, August 2004)

Industry Trends: iSCSI SAN - Growth AreasIndustry Trends: iSCSI SAN - Growth Areas

iSCSI SAN Revenue by Price Band

0

200

400

600

800

1000

Band 1 Band 2 Band 3 Band 4 Band 5 Band 6 Band 7

Disk Storage Systems Price Band

Rev

enu

es (

$M) 2004

2005

2006

2007

2008

Band 1: $1k-$4.9k

Band 2: $5k-$9.9k

Band 3: $10k-$14.9k

Band 4: $15k-$49.9k

Band 5: $50k-$149.9k

Band 6: $150k-$299.9k

Band 7: $300k-$500k

1286% CAGR

249% CAGR

175% CAGR

WINDOWS has a high attach rate in these price bands

Source: IDC Worldwide Disk Storage Systems 2004-2008 Forecast and Analysis

Industry Trends: How Will iSCSI be Used? Industry Trends: How Will iSCSI be Used?

Large enterprises with installed Fibre Channel SANs no longer resistant to iSCSI SANsNow looking for less complex solutions

Tiered storage solutions is now an enterprise goal

Seeing the value of multiple SANs

Storage Magazine survey (October 2004):

Industry Trends: iSCSI Application Preferences Industry Trends: iSCSI Application Preferences

Application Type FC iSCSI

Mission critical enterprise applications 64.6% 32.6%

ERP, CRM and other databases 64.1% 35.5%

Clustered storage 59.7% 37.2%

Rapid restoration off disk drives 59.0% 37.4%

Tier 2 enterprise applications 57.0% 39.4%

Departmental SANs 48.8% 47.9%

Web servers/web sites 47.0% 49.6%

E-mail 45.8% 51.1%

Archiving of data 44.9% 52.1%

File and Print Services 44.6% 52.4%

Off site disaster recovery 43.4% 54.0%

Backup 41.7% 54.9%

General storage 38.8% 58.0%

Remote offices 38.0% 59.2%

Low usage applications 35.7% 61.6%

Source: IDC, August 2004

Industry Trends: Analyst View of Storage MarketIndustry Trends: Analyst View of Storage Market

Enterprise Mission Critical Applications

SAN

SAN

OLTP / ERPFinancial Data

Business Critical AppsEmail & Collaboration

Departmental & Remote DatabasesDocument Imaging & Content MgtLead Mgt. & Customer Databases

Medical Data ManagementScientific Data CollectionN

AS/

SAN

NA

S/SA

N

Workgroup Applications

DA

SD

AS

Microsoft Office Apps, Dept. File Sharing

ESG Storage PyramidRange of applications that need SAN functionality

Until iSCSI, too costly

Industry Trends: Analyst View of theIndustry Trends: Analyst View of theStorage Market (con't)Storage Market (con't)

Departments

Workgroups

$50K

$20K

3TB

1TB

Mis

sion

Crit

ical

Mis

sion

Impo

rtan

t

DataCenters

FC-SAN

NAS

DAS

IP-SAN

Gartner Storage PyramidEnvironments will continueto grow CAGR 80%

A new storage pyramidby 2006

10% of the industry will be using FC-SAN

40% IP-SAN

50% DAS

Windows & iSCSI: MomentumWindows & iSCSI: Momentum

In a survey of Storage Magazine readers (October 2004), Windows was the preferred host platform choice for iSCSI SANs:

Worldwide external disk storage (terabytes sold) for iSCSI SANs

Windows Unix Linux Other Total

531 432 60 25 1048

51% 41% 6% 2% 100%

IDC, Worldwide Disk Storage Systems 2004-2008 Forecast and Analysis, August 2004

Windows & iSCSI: NAS or iSCSI?Windows & iSCSI: NAS or iSCSI? Application NAS iSCSI

Enterprise Class Database Oracle using NFS (special edition)

X (all vendors)

Small SQL Applications (see KB article) X X

Small Business Line Applications-small data transactions

X X

Microsoft Exchange 2003 (<1500 users)(requires feature pack)

X X

Microsoft Exchange 2003 (>1500 users) X

Microsoft Exchange 2000 X

Microsoft Exchange 5.5 X X

File System / Print Servers X X

Windows SharePoint Services X

Large Streaming Data Transactions X

Consolidated Storage Management X X

Consolidated Backup X X

Ease of Implementation / Administration (for single device)

X

Windows & iSCSI: Emerging iSCSI-NAS DevicesWindows & iSCSI: Emerging iSCSI-NAS Devices

Adding iSCSI capabilities to NAS devices

Key advantagesConsolidated networked storage

File, print, and application storage services on a single NAS platform

Single platform to manage, expand, protect.

Leverages well-understood Ethernet technology using low-cost components

Windows Storage Server OEMs are taking advantage of the many 3rd party targets available:

HP NAS 500s, 1200s, 1500s, 2000s

Fujitsu-Siemens FibreCAT N20i 1 TB, SATA drives

Very economical iSCSI target capabilities

Other vendors to follow soon

Windows & iSCSI: Emerging iSCSI-NASWindows & iSCSI: Emerging iSCSI-NASDevices (con't)Devices (con't)

Provide best-of-breed entry-level storage consolidationNAS traditionally for file serving to clients; application servers traditionally host storage internally (DAS)

iSCSI-NAS devices

Allow consolidatation of client and application data in a NAS storage server

Create a storage tier to serve both client and application tiers

No Fibre-Channel SAN required for block-level data

Platform Support and ArchitecturePlatform Support and Architecture

Windows & iSCSI: Application SupportWindows & iSCSI: Application Support

Exchange, SQL, and Windows SharePoint Services are supported on iSCSI SANs

Note: hardware components, including iSCSI hardware, must be logo’d in their device category

Exchange, SQL, SharePoint Services can all be installed on an iSCSI disk

For detailed information on how to configure the Microsoft iSCSI initiator with Exchange and SQL

See the iSCSI user’s guide

For more information on iSCSI support, see: 317173 – Exchange support with SANs

833770 – Support for SQL Server 2000 on iSCSI technology components

Windows & iSCSI: ArchitectureWindows & iSCSI: Architecture

Complete iSCSI architecture for Microsoft platformsWindows Server 2003 Windows Storage Server 2003 Windows 2000Windows XP

Architecture includes:iSCSI software initiator

Responsible for moving storage data over the network For use with standard NIC

Initiator Service Manages all iSCSI initiators, providing uniform storage management

Provides device discovery and management capabilities Manages security (includes iSNS client)Initiates and terminates iSCSI sessions

Management applications Command line interface (CLI)Control panel application (provides most common iSCSI operations)

Windows & iSCSI: Architecture DetailsWindows & iSCSI: Architecture Details

NIC

MultifunctionCard

iSCSI HBA

SoftwareInitiator

Bus Driver+Miniports

MiniportDriver

InitiatorService

iSNSClient

WM

I

HardwareHardwareDriversDriversManagementManagementApplicationsApplications

iSCSICLI

Security

DeviceManager

Perf.Monitor

MgmtApps

Ne

two

rkN

etw

ork

Microsoft iSCSIMicrosoft iSCSI

Microsoft WindowsMicrosoft Windows

VendorVendor

Windows & iSCSI: SecurityWindows & iSCSI: Security

Microsoft iSCSI architecture integrates security iSCSI Software Initiator uses built-in IPsec

IPsec for encryption

Internet Key Exchange (IKE)

CHAP for authentication

Microsoft iSCSI Service providesA common interface for all implementations

A security interface for management applications

Interface with Windows IPsec

Caching of keys

Wire-speed IPsec Hardware supporting this should be available in 2005

Native IPsec supportMore iSCSI targets are beginning to offer this

iSCSI Logo Program for Various TargetsiSCSI Logo Program for Various Targets

iSCSI target devicesStorage arraysBridge devicesHost Bus Adapters Media changers

Testing ProtocolThe target OS (abstracted) is tested to ensure that:

It responds correctly to SCSI an iSCSI protocol and commandsIt interoperates with the Microsoft iSCSI initiator/service

iSCSI specification compatibility/complianceCHAP Digest

SCSI complianceSBC, SMC, SPC-2 and SPC-3

Note that except for control LUNs, signing drivers for iSCSI arrays/bridges is excluded from the iSCSI logo program

As of 4/2005, over 120 iSCSI hardware targets qualified

iSCSI Futures

Windows & iSCSI: FutureWindows & iSCSI: FutureMicrosoft’s iSCSI Roadmap

Microsoft iSCSI Software Initiator v2.0 Integrate MPIO with iSCSI

Support and integration withVDS (requires VDS 1.1)

x64 support

Supportability and Deployments enhancements

Auto-discovery

Support for IPv6

Q1200Q120055

LonghorLonghornn

Storage Management Integration (next version)Integration of iSCSI & iSNS withActive Directory and Radius

Winsock Kernel Support (RDMA)

Storage Explorer User Interface

Centralized Management of iSCSI & Fibre Channel targets

Integrates the Microsoft MPIO high availability multipathing solution

Supports logo’d block storage devices

Designed to work with all SPC-2 or later compliant targets

MS MPIO DDK includes iSCSI DSM source

The iSCSI-MPIO solution enablesMultiple connections per session

Multiple load balance policies and failover policies

Persistent ISID across reboots

Portal hopping for target rediscovery

Attempt connection to alternate portals in the event of lost connection

Error Recovery Levels 1 & 2 for tapes and high availability scenarios

Windows & iSCSI: Next GenerationWindows & iSCSI: Next GenerationVersion 2.0Version 2.0

Windows & iSCSI: Next GenerationWindows & iSCSI: Next GenerationVersion 2.0 (Con't)Version 2.0 (Con't)

Provides x64 support

Enhances supportability and deploymentImproved event log messages

Eventlog using WMI

Event Tracing

Unattended Setup

Enhancements to iSCSICLI & iSCSI GUI

Auto discovery of iSNS server using DHCP

Enhancements to iSCSI WMI provider

IPv6

Windows & iSCSI: Longhorn IntegrationWindows & iSCSI: Longhorn Integration(Next Version)(Next Version)

Project Goals: Persist iSCSI security and other configuration information

Data access

Storage device management

Provide: A centralized management interface

The infrastructure to distribute configuration information securelyIntegration with Active Directory

Infrastructure to centralize secure authenticationIntegration with RADIUS

Accounting with RADIUSiSCSI login and configuration changes

High availabilityFabric management

Community ResourcesCommunity Resources

Windows Hardware & Driver Central (WHDC)www.microsoft.com/whdc/default.mspx

Technical Communitieswww.microsoft.com/communities/products/default.mspx

Non-Microsoft Community Siteswww.microsoft.com/communities/related/default.mspx

Microsoft Public Newsgroupswww.microsoft.com/communities/newsgroups

Technical Chats and Webcastswww.microsoft.com/communities/chats/default.mspx

www.microsoft.com/webcasts

Microsoft Blogswww.microsoft.com/communities/blogs