01-24-13-proven-professional-e2e-isilon-onefs-7.0

Embed Size (px)

Citation preview

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    1/42

    Copyright 2012 EMC Corporation. All rights reserved.

    EMC Isilon OneF

    Proven Professional W

    Brian CoxNick Trimbee

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    2/42

    Copyright 2012 EMC Corporation. All rights reserved.

    OneFS 7.0: Wha

    Summar

    Why OneFS

    Isilon & OneFS

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    3/42

    Copyright 2012 EMC Corporation. All rights reserved.

    0

    10

    20

    30

    40

    50

    60

    70

    80

    90

    2009 2010 2011 2012 2013 2

    Exabytes

    The Big Data Challenge

    In 2013, 80% of all storage capacity sold will be for file-Source: Scale Out Storage in the Content Driven Enterprise: Unleashing the Value of InformationAssets, IDC White Paper (2010 Enterprise Disk Storage Consumption Model), Jun

    File based: 61.8% CAGR Block based: 23.7% CAGR

    Media &Entertainment

    Design &Simulation

    FinancialServices

    Bioinformatics File Shares &

    Archives

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    4/42

    Copyright 2012 EMC Corporation. All rights reserved.

    Data intensive, HPC workflows

    Big Data Apps Need Big Data Stor

    Medical Imaging Gene Sequencing Seismic Exp

    Media & Entertainment Product DeveSatellite Images

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    5/42

    Copyright 2012 EMC Corporation. All rights reserved.

    Typical enterprise IT workloads

    Enterprise IT Needs Big Storage

    LARGE-SCALE HOME DIRECTORIES LARGE-SCALE ARCHIVES

    LARGE-SCALE VIRTUALIZATION LARGE-SCALE ANALYTICS

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    6/42 Copyright 2012 EMC Corporation. All rights reserved.

    EMC IsilonSetting the standard for scale-out NAS

    Broad adoption across many markets

    High Performance Computing (HPC): Life Sciences, Oil & Gas, E

    Design Automation, Media & Entertainment, Financial Services

    Enterprise IT: Archive, Home Directories, File Shares, Virtualizatio

    Business Analytics

    Over 3,000 global customers

    Over 50% Y/Y growth rate

    EMC #1 NAS market*

    Isilon OneFS: Seventh generation, industry-proven, innov

    scale-out operating environment

    *Source: Market Share Analysis: Network-Attached Storage/Unified Storage, Worldwide, 2011, Gartner, March 2012

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    7/42 Copyright 2012 EMC Corporation. All rights reserved.

    Isilon Scale-Out NAS Architecture

    OneFS OperatingEnvironment

    IComm

    Servers

    Client/Application Layer Ethernet Layer

    Servers

    Servers SingleFS/VolumeSMBNFS

    FTPHTTP

    HDFS

    iSCSI

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    8/42 Copyright 2012 EMC Corporation. All rights reserved.

    Isilon Core InnovationOneFS scale-out operating system

    Single File SystemSimplicity

    Leadership Efficiency

    High Performance

    Easy Growth

    Automat

    Linear S

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    9/42 Copyright 2012 EMC Corporation. All rights reserved.

    Isilon HardwareScale-out NAS product family

    Linear Scaling of Performance and

    Purpose-built for IOPS-intensive, random access,

    file-based applications

    Flexible solution for highconcurrent and sequentialthroughput applications

    Ideal for coslarge-capaci

    S-Series

    X-Series

    NL-Se

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    10/42 Copyright 2012 EMC Corporation. All rights reserved.

    More scalable than traditional storage systems

    Largest and Most Scalable File Sys

    OneFS scales from 18 TB to more than 15 PB in a ssystem, single volume

    Scales from 3 node cluster

    to 144 nodes

    Add additional capacity

    in under 60 secondswith no downtime

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    11/42 Copyright 2012 EMC Corporation. All rights reserved.

    Isilon AutoBalanceGain New Levels of Efficiency

    AutoBalance automatically movto new storage nodes while sysonline and in production

    Eliminates hot spots

    Enables unmatched storage caputilization of more than 80%

    AutoBalanceAutomated data balancing across nodescosts, complexity, and risks for scaling

    EMPTY

    EMPTY

    EMPTY

    EMPTY

    EMPTY

    FULL

    FULL

    FULL

    FULL

    BALANCED

    BALANCED

    BALANCED

    BALANCED

    BALANCED

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    12/42 Copyright 2012 EMC Corporation. All rights reserved.

    Isilon SmartPools

    Optimize Resources with Automated Ti

    Single point of management Single file system/single volume

    Multiple performance tiers

    Automatic data movement

    Policy-based tiering management

    Transparent reallocation

    Optimize storage resources

    Automatically match storageresources with data requirements

    Eliminate data migration

    S-SeriPerform

    NL-SeActive

    X-SerCollabo

    Reduced

    cost

    /TB

    Files

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    13/42 Copyright 2012 EMC Corporation. All rights reserved.

    SPECsfs2008 CIFS: aggregate vendor performance

    Worlds Fastest NAS

    ISILORECORD-BREAP E R F O R M A

    Huawei

    Symantec

    EMC

    EMC

    EMC

    NetApp

    NetApp

    NetApp

    NetApp

    Apple

    Silicon

    Graphics

    Apple

    Fujitsu

    Apple

    Fujitsu

    Siemens

    Fujitsu

    Fujitsu

    Siemens

    Fujitsu

    Siemens

    Fujitsu

    Siemens

    NSPLab

    Fujitsu

    1,600,000

    1,500,000

    1,400,000

    1,300,000

    1,200,000

    1,100,000

    1,000,000

    900,000

    800,000

    700,000

    600,000

    500,000

    400,000

    200,000300,000

    100,000

    EMCIsilon

    CIFSIO

    PS World Record

    1.6 million CIFS OPS

    126% increaseover competition

    Source: All SPEC SPECsfs2008_cifs Results Published by SPEC, October 3, 2012 (http://www.spec.org/sfs2008/results/sfs2008cifs.h

    http://www.spec.org/sfs2008/results/sfs2008cifs.htmlhttp://www.spec.org/sfs2008/results/sfs2008cifs.html
  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    14/42 Copyright 2012 EMC Corporation. All rights reserved.

    SPECsfs2008 performance test results

    Linear, Predictable Scalability

    Predictable SLAs

    7 14 28 56

    1,800,000

    1,600,000

    1,400,000

    1,200,000

    1,000,000

    800,000

    600,000

    400,000

    200,000

    FileOps/second

    CIFS NFS

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    15/42 Copyright 2012 EMC Corporation. All rights reserved.

    With N+2, N+3, andN+4 protection,data is 100% availableif multiple drives ornodes fail

    With N+1 protection,data is 100% availableeven if a single driveor node fails

    Highly resilient, clustered architecture

    Unmatched Data Protection and Ava

    100%

    100%

    100%

    100%

    100%

    100%

    100%

    100%

    FAILED

    FAILED

    And with Isilon, themore nodes in thecluster, the fasterdrive rebuild time

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    16/42

    Copyright 2012 EMC Corporation. All rights reserved.

    Single storage pool for application consolidation

    Isilon Scale-Out Innovation

    Simple to scale Manage 10s of PBs like a 1 TB drive

    Predictable performance Grows linearly

    Efficient to operate Maximize utilization to 80%+

    Automate tiering

    Highly resilient Survives multiple failures

    Enterprise proven Management and protection

    tools that customers expect

    No data migrations

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    17/42

    Copyright 2012 EMC Corporation. All rights reserved.

    OneFS 7.0: Wha

    Summar

    Why OneFS

    Isilon & OneFS

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    18/42

    Copyright 2012 EMC Corporation. All rights reserved.

    OPERATIONALSIMPLICITY

    RAPIDGROWTH

    MASCAPA

    EXTRPERFOR

    Big Data Storage World

    BIGDATA

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    19/42

    Copyright 2012 EMC Corporation. All rights reserved.

    PREDICTABLEPERFORMANCE

    INTEROPERABILITY DATA PR

    SECU

    Enterprise IT Storage World

    EnterpriseIT

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    20/42

    Copyright 2012 EMC Corporation. All rights reserved.

    Two Storage Worlds Converge

    Enterpr

    IT

    BIG

    DATA

    EnterpriseSCALE-OUT

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    21/42

    Copyright 2012 EMC Corporation. All rights reserved.

    Delivering the Best of Big Data & Enterprise IT Storage

    Introducing OneFS 7.0 OS

    Massive Capacity

    Extreme Performance

    Dat

    Predictable P

    InteOperational Simplicity

    Rapid GrowthEnterprise

    SCALE-OUT

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    22/42

    Copyright 2012 EMC Corporation. All rights reserved.

    OneFS 7.0: Wha

    Summar

    Why OneFS

    Isilon & OneFS

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    23/42

    Copyright 2012 EMC Corporation. All rights reserved.

    Robust Enterprise Security Option

    Secure Role Separatio

    Roles-based administrat Administration and data

    separated

    Secure Isolation

    Authentication Zones

    Secure WORM Data P Isilon SmartLock

    SEC 17a-4 Compliance o

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    24/42

    Copyright 2012 EMC Corporation. All rights reserved.

    Also called Access Zones

    Authentication Zones

    Associate the cluster withmultiple authenticationprovider groups

    Access Zones enable you to:

    Separate authenticationproviders into groups

    Limit data access based onaccess zone

    Perform storage consolidationwith overlapping directorystructures

    LDAP-1

    Active Directory-2LDAP-3 NIS

    NIS

    Group Database

    Finance

    Legal

    LDAP-2

    Active Directory-1

    Group Database

    SmartConnZone-1

    SmartConnecZone-2

    IT

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    25/42

    Copyright 2012 EMC Corporation. All rights reserved.

    Multiple Authentication Sources

    Authentication Zones

    Internal Company FilerConsolidation

    Multiple departments or divisions

    Multiple authentication sources

    Overlapping home directorystructures

    Departmental Isolation Secure departmental data isolation

    Multiple authentication sources

    MultipleZones

    Financ

    Executive

    SalesEn

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    26/42

    Copyright 2012 EMC Corporation. All rights reserved.

    Roles Based Administration

    Define individual roles with right privileges

    Each Role is associated with A list of users/groups

    A list of actions/privileges that the role

    is allowed

    User can be part of many different roles:

    A union of all privileges defined forthose roles is allowed for that user

    Ability to define custom roles

    RB

    (Sn

    (S

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    27/42

    Copyright 2012 EMC Corporation. All rights reserved.

    WORM Archive Protection

    OneFS SmartLock

    SmartLock provides cost-effective, efficientprotection against accidental, premature ormalicious data deletion or modification

    SmartLock now has two operational modes

    Enterprise Mode

    Compliance Mode (meets SEC 17a-4)

    Mix WORM and Non-WORM data

    Integrate with OneFS:

    Located on any storage tier

    Integrated with Isilon SyncIQ

    S-SeriesPerformance

    X-SeriesThroughput

    NL-Series

    Archive

    SmaD

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    28/42

    Copyright 2012 EMC Corporation. All rights reserved.

    New SnapshotRestore

    Fast

    Efficient

    Simple

    Lower Risk & Increased Availability for Critical Data

    Scale-Out NAS Data Protection

    ACC

    D

    VI

    EMC Confidential

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    29/42

    Copyright 2012 EMC Corporation. All rights reserved.

    Lowers Risk For Business Critical Data

    Scale-Out NAS Data Protection

    NewFast and Simple

    Failover/FailbackSIMPLE

    f

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    30/42

    Copyright 2012 EMC Corporation. All rights reserved.

    Interoperability for Operational Flexib

    Platform REST API

    Simplify management and inte Third-party application integra

    VMware integration

    VAAI: vStorage APIs for array

    VASA: vSphere APIs for storag

    Virtual Server writeable clones

    Multi-protocol support

    Integrated support for industryprotocols

    Native HDFS support

    CIFSNFS

    FTPHTTP

    HDFSfor

    Hadoop

    VAAI VASA

    OneFS API

    l f

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    31/42

    Copyright 2012 EMC Corporation. All rights reserved.

    API Architecture

    Platform API

    RBAC

    LIBISI_PAPI

    APACHE

    PAPI_D

    GConfig

    JSON

    Snapshot scheduling via REST URI:

    http://cluster:9443/1/snapshot/schedules/id_1

    Platform API

    Full RESTfu

    AutomatedManagem

    Includes estatistics aaccess

    Programmfor WebUI

    RBAC Integ

    VM I i Fil Cl

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    32/42

    Copyright 2012 EMC Corporation. All rights reserved.

    VMware Integration - File Clones

    Clones are logical copies which share blocks with original file

    Clones are fast to create and consume less space

    Either original file or clone can be further cloned at any point

    B

    102

    A

    101

    C

    103

    D

    104

    VMDK_1FILE_1FILE_1CLONE

    C1

    115

    B2

    110

    A1

    121

    VM API I t ti

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    33/42

    Copyright 2012 EMC Corporation. All rights reserved.

    VMwareAPI Integration

    VMware vSphere provides APIsand SDK to allow customers to

    enhance and extend thefunctionality of vSphere

    For storage, the following APIsare provided: VAAIVMware vSphere APIs for Array

    Integration which enables offloading ofcommon specific tasks to storage

    systems

    VASAVMware APIs for StorageAwareness enables storage systems tocommunicate the storage systemsavailable features and functionality tovSphere

    vSphere 5.0

    VAAI Block Block Zeroing Block Copying Atomic Test and Swap Thin provision stuns

    VAAI NAS

    Full Copy Extended Stats Space reservation

    NodeType

    SATA

    SATA

    SAS

    SAS

    Mixed

    Mixed

    VASA

    Integrat Insight

    capabilit

    S l O t NAS P f

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    34/42

    Copyright 2012 EMC Corporation. All rights reserved.

    Increase Productivity & Unlock New Opportunities

    Scale-Out NAS Performance

    50% Le

    724MB/sSingle Stream

    1.6Worlds

    106GB/s Concurrent

    Big DataPerformanceThroughput

    EnterPerfoRandom/

    O FS 7 0 M lti th d d IO

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    35/42

    Copyright 2012 EMC Corporation. All rights reserved.

    OneFS 7.0: Multi-threaded IO

    Dramatic increase in concurrent random write

    performance to large files. Byte-range write locking

    Improves latency.

    Boosts performance for:

    VMDK files

    HPC Checkpoint Files

    Multiple threads concurrently writing to a single

    S tP l A t ti P i i i

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    36/42

    Copyright 2012 EMC Corporation. All rights reserved.

    SmartPools Automatic Provisioning

    Automated cluster protection

    +2:1 FEC across Storage Pools

    Improved disk utilization by upto 30%

    Consistent MTTDL across all

    clusters: Capacity

    Node type

    Utilization

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    37/42

    Copyright 2012 EMC Corporation. All rights reserved.

    OneFS 7.0: Wha

    Summar

    Why OneFS

    Isilon & OneFS

    Isilon Scale Out NAS Value

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    38/42

    Copyright 2012 EMC Corporation. All rights reserved.

    Isilon Scale-Out NAS Value

    Scales to over 15 PB in a single file system

    Single file system, single volume, global namespace

    Efficient backup and recovery, reliable disaster recovery, and N+1 thru N

    More than 80% storage utilization, and automated storage tiering

    Over 100 GB/s throughput, 1.6M SPECsfs ops

    Integrated support for industry-standard protocols including NFS, SMB, HHDFS; platform REST API; VMware integration

    Roles-based administration; Authentication Zones; SEC 17a-4 compliant

    Questions and Answers

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    39/42

    Copyright 2012 EMC Corporation. All rights reserved.

    Q

    To typ e a quest ion via WebEx, cl ick on th e Q&A t

    Please select Ask: All Panelists

    to ensure your quest ions reach us. Thank you !

    R / N t St

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    40/42

    Co ri ht 2011 EMC Cor oration. All ri hts reserved.

    Resources / Next Steps Visit our website:

    http://www.emc.com/storage/isilon/isilon.htm

    Analyst Video ESG: How EMC Isilon OneFS 7.0 Addresses Big Data in the Enterprise

    Data Sheets EMC Isilon OneFS Operating System

    EMC Isilon Scale-Out Platform Overview

    EMC Isilon SmartLock

    EMC Isilon SyncIQ

    White Papers EMC Isilon OneFS A Technical Overview

    High Availability & Data Protection with EMC Isilon Scale-Out NA

    http://www.emc.com/storage/isilon/isilon.htmhttp://www.emc.com/storage/isilon/isilon-onefs-operating-system.htmhttp://www.emc.com/collateral/software/data-sheet/h10717-isilon-onefs-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10541-isilon-scale-out-storage-platform-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10718-isilon-smartlock-ds.pdfhttp://www.emc.com/collateral/hardware/data-sheet/h10586-isilon-synciq-ds.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10588-isilon-data-availability-protection-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10588-isilon-data-availability-protection-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10588-isilon-data-availability-protection-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10588-isilon-data-availability-protection-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdfhttp://www.emc.com/collateral/hardware/data-sheet/h10586-isilon-synciq-ds.pdfhttp://www.emc.com/collateral/hardware/data-sheet/h10586-isilon-synciq-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10718-isilon-smartlock-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10718-isilon-smartlock-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10541-isilon-scale-out-storage-platform-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10541-isilon-scale-out-storage-platform-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10541-isilon-scale-out-storage-platform-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10717-isilon-onefs-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10717-isilon-onefs-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10717-isilon-onefs-ds.pdfhttp://www.emc.com/collateral/software/data-sheet/h10717-isilon-onefs-ds.pdfhttp://www.emc.com/storage/isilon/isilon-onefs-operating-system.htmhttp://www.emc.com/storage/isilon/isilon-onefs-operating-system.htmhttp://www.emc.com/storage/isilon/isilon-onefs-operating-system.htmhttp://www.emc.com/storage/isilon/isilon-onefs-operating-system.htmhttp://www.emc.com/storage/isilon/isilon.htmhttp://www.emc.com/storage/isilon/isilon.htm
  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    41/42

    Co ri ht 2011 EMC Cor oration. All ri hts reserved.

    THANK YOU!

  • 8/12/2019 01-24-13-proven-professional-e2e-isilon-onefs-7.0

    42/42