20
Created by: Philip Williams Modified Date: July 2015 OpenStack Day India 2015 Storage Infrastructure Choices for OpenStack Clouds

Storage Infrastructure Choices for OpenStack Clouds

Embed Size (px)

Citation preview

Created by: Philip Williams

Modified Date: July 2015

OpenStack Day India 2015

Storage Infrastructure Choices for OpenStack Clouds

www.rackspace.com

Considerations

�2

www.rackspace.com

Requirements

�3

• Durability– How much failure can I experience before data loss?

• Availability– How much failure can I experience before data unavailable?– For how long?

• Scalability– Capacity Today? Tomorrow? Next Year?– Hot/Cold Ratios

•Performance– Realistic expectations apply!

www.rackspace.com

What exactly are you storing?

�4

• Purpose and Value– Mission Critical, cannot run the business?– Second Class Services, just inconvenient?– Dog Pictures?– Computationally expensive to reproduce?– Already Compressed or Encrypted?

•Access Patterns– Random, Highly Transactional?– Sequential, Streaming?– Mostly Reads?– Mostly Writes?

•Does your data age?– How much of your dataset is “hot” or “cold”?

www.rackspace.com

ONE SIZE DOES NOT FIT ALL

�5

www.rackspace.com

Storage Sub-Systems

�6

www.rackspace.com

Scale-Out Object Storage

�7

• Objects replicated between nodes• Proxy Layer for load-balancing• Proven at scale, easy to grow

• Can’t mount file systems or block volumes• What if my application doesn’t “speak” Object?• Eventual Consistency

www.rackspace.com

LVM / iSCSI

�8

• Server(s) with local disks carved up by LVM– Disk redundancy built in using RAID or Volume Mirroring

• Block Vols presented over Ethernet (iSCSI)

• No node failure protection– Server fails, volumes fail

• Least Redundancy• Potential for Hot Spots• Lowest Cost*• Easy to Scale

www.rackspace.com

Dual Controller Storage Arrays

�9

• Typically Termed “Mid-Range” ~50-1000 Disks• Block Vols presented via iSCSI and FC Protocols

• Controller and Disk Redundancy• Support for aggregated Disk Pools• Support for auto-tiering of data• Snapshot/Clone Capabilities• Typically 5 9’s Availability

• Limited Scalability• Good Performance*

www.rackspace.com

Multi-Controller Storage Arrays

�10

• Typically Termed “High End” ~200 to 3000 Disks• Block Vols presented via iSCSI and FC Protocols

• Meshed Controller Subsystems• Support for large aggregated disk pools• Support for auto-tiering of data• Snapshot/Clone Capabilities• Redundant Everything

– 6 9’s and greater availability

• Better Scalability• Higher Performance*

www.rackspace.com

All Flash Arrays

�11

• Block Vols presented via iSCSI and FC Protocols

• Controller and Disk Redundancy• Inline Dedupe and Compression• Meshed Controller Subsystems• Snapshot/Clone Capabilities• Typically 5 9’s Availability

• Lower Scalability• Highest Performance*

www.rackspace.com

Scale-Out / Server SAN

�12

• Block Vols presented via iSCSI and Proprietary Protocols• Typically Commodity Hardware

– x86, 10GbE (sometimes InfiniBand)• Many nodes, 10’s to 100’s• Redundancy achieved by spreading data across nodes

– Sub-Object Replication– Erasure Coding

• Greatest Scaling• Good Performance*

www.rackspace.com

Storage Networking

�13

www.rackspace.com

Storage Networking

�14

• How do I reach my persistently stored data?

– Ethernet?– Fibre Channel?– InfiniBand?

• Any and all Fabrics must be redundant

• Use FC exclusively for Storage, but what about other services?

• Use Ethernet and share with other services?

www.rackspace.com

WHY BUILD TWO NETWORKS?

�15

www.rackspace.com �16www.rackspace.com

Ethernet

www.rackspace.com �17www.rackspace.com

Fibre Channel

www.rackspace.com

Storage Networking

�18

• Converged Ethernet– Public– Private– Management– Object Storage– File Storage– Block Storage

• One network to maintain• One set of skills required• K.I.S.S

www.rackspace.com

Questions?

�19

[email protected]

Thank You

RACKSPACE® | 1 FANATICAL PLACE, CITY OF WINDCREST | SAN ANTONIO, TX 78218US SALES: 1-800-961-2888 | US SUPPORT: 1-800-961-4454 | WWW.RACKSPACE.COM

RACKSPACE® | © RACKSPACE LTD. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN THE UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.COM