of 41/41
Technical Report FlexPod Datacenter Technical Specifications Lindsey Street, Melissa Palmer, Karthick Radhakrishnan, NetApp August 2017 | TR-4036

Technical Report FlexPod Datacenter Technical … · 1 FlexPod Datacenter Architecture ... best practice data center architecture that is built on ... Cisco ACI is targeted at data

  • View
    219

  • Download
    0

Embed Size (px)

Text of Technical Report FlexPod Datacenter Technical … · 1 FlexPod Datacenter Architecture ... best...

  • Technical Report

    FlexPod Datacenter Technical Specifications Lindsey Street, Melissa Palmer, Karthick Radhakrishnan, NetApp

    August 2017 | TR-4036

  • 2 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    TABLE OF CONTENTS

    1 FlexPod Datacenter Architecture .............................................................................................. 6

    2 FlexPod Platforms ...................................................................................................................... 6

    3 FlexPod Rules ............................................................................................................................. 6

    4 Supported Versus Validated FlexPod Configurations ............................................................ 6

    5 NetApp Data ONTAP Modes of Operation................................................................................ 7

    6 Cisco Nexus Switching Modes of Operation ........................................................................... 7

    7 Minimum Hardware Requirements ........................................................................................... 7

    8 Minimum Software Requirements ............................................................................................. 8

    9 Connectivity Requirements ....................................................................................................... 8

    10 Other Requirements ................................................................................................................... 9

    11 Optional Features ....................................................................................................................... 9

    11.1 MetroCluster ........................................................................................................................................ 9

    11.2 FCP SAN Boot Through Cisco MDS .................................................................................................. 10

    11.3 FCP SAN Boot with Cisco Nexus ....................................................................................................... 11

    11.4 FCoE SAN Boot Option ..................................................................................................................... 12

    11.5 iSCSI Boot Option .............................................................................................................................. 13

    11.6 SolidFire Add On ................................................................................................................................ 14

    12 Cisco Components ................................................................................................................... 15

    12.1 Cisco UCS Fabric Interconnect Options ............................................................................................ 15

    12.2 Cisco UCS B-Series Chassis Option ................................................................................................. 16

    12.3 Cisco UCS B-Series Blade Server Options ........................................................................................ 16

    12.4 Cisco UCS C-Series Rack-Mount Server Options ............................................................................. 16

    12.5 Cisco Nexus 5000 Series Switch Options .......................................................................................... 17

    12.6 Cisco Nexus 7000 Series Switch Options .......................................................................................... 17

    12.7 Cisco Nexus 9000 Series Switch Options .......................................................................................... 18

    12.8 Cisco APIC Options ........................................................................................................................... 19

    12.9 Cisco Nexus Fabric Extender Options ............................................................................................... 19

    12.10 Cisco MDS Options ..................................................................................................................... 19

    12.11 Cisco Software Licensing Options ............................................................................................... 20

    12.12 Cisco Support Licensing Options ................................................................................................. 20

    13 NetApp Components ................................................................................................................ 21

    13.1 NetApp Storage Controller Options .................................................................................................... 21

    13.2 NetApp SolidFire Add-On Storage Controller Options ....................................................................... 21

    13.3 Cluster Interconnect Switch Options .................................................................................................. 22

  • 3 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    13.4 NetApp Ethernet Expansion Module Options ..................................................................................... 22

    13.5 NetApp Disk Shelf and Disk Drive Options ........................................................................................ 23

    13.6 NetApp Software Licensing Options .................................................................................................. 23

    13.7 NetApp Support Licensing Options .................................................................................................... 24

    14 Power and Cabling Requirements .......................................................................................... 24

    14.1 Power Requirements ......................................................................................................................... 24

    14.2 Minimum Cable Requirements ........................................................................................................... 24

    15 Technical Specifications and References .............................................................................. 26

    15.1 Cisco UCS B-Series Blade Server Chassis ....................................................................................... 26

    15.2 Cisco UCS B-Series Blade Servers ................................................................................................... 26

    15.3 Cisco UCS C-Series Rack-Mount Servers ......................................................................................... 27

    15.4 Cisco UCS VIC Adapters for Cisco UCS B-Series Blade Server ....................................................... 28

    15.5 Cisco UCS Fabric Interconnects ........................................................................................................ 29

    15.6 Cisco Nexus 5000 Series Switches ................................................................................................... 30

    15.7 Cisco Nexus 7000 Series Switches ................................................................................................... 31

    15.8 Cisco Nexus 9000 Series Switches ................................................................................................... 32

    15.9 Cisco Application Policy Infrastructure Controller .............................................................................. 33

    15.10 Cisco Nexus Fabric Extender Details .......................................................................................... 34

    15.11 Small Form Factor Pluggable Modules ........................................................................................ 34

    15.12 NetApp Storage Controllers ......................................................................................................... 35

    15.13 NetApp Ethernet Adapters ........................................................................................................... 38

    15.14 NetApp Disk Shelves ................................................................................................................... 38

    15.15 NetApp Disk Drives ..................................................................................................................... 38

    16 Legacy Equipment .................................................................................................................... 38

    Version History ............................................................................................................................... 40

    LIST OF TABLES

    Table 1) Cisco UCS fabric interconnect options. ................................................................................................... 16

    Table 2) Cisco UCS B-Series chassis option. ....................................................................................................... 16

    Table 3) Cisco UCS B-Series blade server options. .............................................................................................. 16

    Table 4) Cisco UCS C-Series rack-mount server options...................................................................................... 17

    Table 5) Cisco Nexus 5000 Series Switch options. ............................................................................................... 17

    Table 6) Cisco Nexus 7000 Series Switch options. ............................................................................................... 17

    Table 7) Cisco Nexus 9000 Series Switch options. ............................................................................................... 18

    Table 8) Cisco APIC sizes. .................................................................................................................................... 19

    Table 9) Cisco Nexus FEX options. ....................................................................................................................... 19

    Table 10) Cisco MDS switches. ............................................................................................................................. 20

  • 4 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Table 11) Cisco software licensing options. .......................................................................................................... 20

    Table 12) Cisco support licensing options. ............................................................................................................ 20

    Table 13) NetApp storage controller options. ........................................................................................................ 21

    Table 14) NetApp SolidFire storage nodes............................................................................................................ 22

    Table 15) Cluster interconnect switch options. ...................................................................................................... 22

    Table 16) Ethernet expansion module options. ..................................................................................................... 22

    Table 17) NetApp disk shelf options. ..................................................................................................................... 23

    Table 18) NetApp software licensing options. ....................................................................................................... 23

    Table 19) NetApp support licensing options. ......................................................................................................... 24

    Table 20) Minimum cable requirements. ............................................................................................................... 24

    Table 21) Cisco UCS B-Series blade server chassis options. ............................................................................... 26

    Table 22) Cisco UCS B-Series blade server M5 options. ...................................................................................... 26

    Table 23) Cisco UCS B-Series blade server M4 options. ...................................................................................... 27

    Table 24) Cisco UCS B-Series blade server datasheets. ...................................................................................... 27

    Table 25) Cisco UCS C-Series M5 rack-mount server options. ............................................................................. 27

    Table 26) Cisco UCS C-Series M4 rack-mount server options. ............................................................................. 27

    Table 27) Cisco UCS C-Series rack-mount server datasheets. ............................................................................. 28

    Table 28) Cisco UCS VIC adapters (1).................................................................................................................. 28

    Table 29) Cisco UCS VIC adapters (2).................................................................................................................. 28

    Table 30) Cisco UCS VIC adapters (3).................................................................................................................. 29

    Table 31) Cisco UCS VIC adapter datasheets. ..................................................................................................... 29

    Table 32) Cisco UCS 6300 series fabric interconnect options. .............................................................................. 29

    Table 33) Cisco UCS 6200 series fabric interconnect options. .............................................................................. 30

    Table 34) Cisco UCS fabric interconnect datasheets. ........................................................................................... 30

    Table 35) Cisco Nexus 5000 Series Switch options. ............................................................................................. 30

    Table 36) Cisco Nexus 5000 Series Switch datasheets. ....................................................................................... 31

    Table 37) Cisco Nexus 7000 Series Switch options (1). ........................................................................................ 31

    Table 38) Cisco Nexus 7000 Series Switch options (2). ........................................................................................ 31

    Table 39) Cisco Nexus 7000 Series Switch datasheets. ....................................................................................... 32

    Table 40) Cisco Nexus 9500 Series Switch options. ............................................................................................. 32

    Table 41) Cisco Nexus 9300 Series Switch options. ............................................................................................. 32

    Table 42) Cisco Nexus 9300 Series Switch options (continued). .......................................................................... 32

    Table 43) Cisco Nexus 9200 Series Switches. ...................................................................................................... 33

    Table 44) Cisco Nexus 9000 Series Switch datasheets. ....................................................................................... 33

    Table 45) Cisco APIC technical specifications. ..................................................................................................... 33

    Table 46) Cisco Nexus 9000 Series Switch datasheets. ....................................................................................... 34

    Table 47) Ethernet SFP modules. ......................................................................................................................... 34

    Table 48) FC SFP modules. .................................................................................................................................. 34

    Table 49) FAS9000 series controller options. ........................................................................................................ 35

    Table 50) FAS8000 series controller options. ........................................................................................................ 35

    Table 51) AFF A-Series controller options............................................................................................................. 36

    Table 52) FAS8200 series controller options. ........................................................................................................ 37

    Table 53) NetApp FAS2500 series storage controller options. .............................................................................. 37

  • 5 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Table 54) NetApp 10GbE adapters. ...................................................................................................................... 38

    Table 55) NetApp 40GbE adapters. ...................................................................................................................... 38

    Table 56) NetApp disk shelves. ............................................................................................................................. 38

    Table 57) Legacy equipment. ................................................................................................................................ 39

    LIST OF FIGURES

    Figure 1) FlexPod Datacenter with NetApp MetroCluster architecture. ................................................................. 10

    Figure 2) FlexPod Datacenter with FC with Cisco MDS. ....................................................................................... 11

    Figure 3) FC boot scenario. ................................................................................................................................... 12

    Figure 4) FCoE boot scenario. .............................................................................................................................. 13

    Figure 5) iSCSI boot scenario. .............................................................................................................................. 14

    Figure 6) FlexPod Datacenter with NetApp SolidFire all-flash array add-on.......................................................... 15

  • 6 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    1 FlexPod Datacenter Architecture

    FlexPod is a predesigned, best practice data center architecture that is built on the Cisco Unified

    Computing System (Cisco UCS), the Cisco Nexus family of switches, and NetApp fabric-attached

    storage (FAS) or V-Series systems.

    FlexPod is a suitable platform for running a variety of virtualization hypervisors as well as bare-metal

    operating systems and enterprise workloads. FlexPod delivers not only a baseline configuration but

    also the flexibility to be sized and optimized to accommodate many different use cases and

    requirements.

    Note: Before ordering a complete FlexPod configuration, refer to the NetApp FlexPod Solutions page for the latest version of these technical specifications.

    Note: For an overview of FlexPod reference architectures, refer to the FlexPod Solutions Guide.

    Note: For an overview of FlexPod reference architectures with Cisco Application Centric Infrastructure, refer to the FlexPod Datacenter with ACI Solutions Guide.

    2 FlexPod Platforms

    There are three FlexPod platforms:

    FlexPod Datacenter. This platform is a massively scalable virtual data center infrastructure suited for workload enterprise applications, virtualization, VDI, and public and private cloud.

    FlexPod Express. This platform is a compact converged infrastructure that is targeted for remote office and edge use cases. FlexPod Express has its own specifications, which are documented in the FlexPod Express Technical Specifications.

    FlexPod Select. This platform is a purpose-built architecture for high-performance applications, such as FlexPod Select for high-performance Oracle RAC.

    This document provides the technical specifications for the FlexPod Datacenter platform.

    3 FlexPod Rules

    The FlexPod design allows a flexible infrastructure that encompasses many different components and

    software versions.

    Use the rule sets as a guide for building or assembling a valid FlexPod configuration. The numbers

    and rules listed in this section are the minimum requirements for FlexPod; they can be expanded in

    the included product families as required for different environments and use cases.

    4 Supported Versus Validated FlexPod Configurations

    The FlexPod architecture is defined by the set of rules described in this document. The hardware

    components and software configurations must be supported by the Cisco Hardware Compatibility List

    (HCL) and the NetApp Interoperability Matrix Tool (IMT).

    Each Cisco Validated Design (CVD) or NetApp Verified Architecture (NVA) is a possible FlexPod

    configuration. Cisco and NetApp document these configuration combinations and validate them with

    extensive end-to-end testing. The FlexPod deployments that deviate from these configurations are

    fully supported if they follow the guidelines in this document and all of the components are listed as

    compatible in the Cisco HCL and NetApp IMT.

    For example, adding additional storage controllers or UCS servers and upgrading software to newer

    versions are fully supported if the software, hardware, and configurations meet the guidelines defined

    in this document.

    http://www.netapp.com/us/technology/flexpodhttp://www.netapp.com/us/system/pdf-reader.aspx?m=tr-3884.pdf&cc=ushttps://fieldportal.netapp.com/DirectLink.aspx?documentID=152761&contentID=308811https://www.netapp.com/us/media/tr-4293.pdfhttp://www.netapp.com/us/media/nva-0012-design.pdfhttp://mysupport.netapp.com/matrixhttp://mysupport.netapp.com/matrix

  • 7 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    5 NetApp Data ONTAP Modes of Operation

    The NetApp Data ONTAP software is installed on every NetApp storage system and is configured to

    operate as clustered Data ONTAP or in 7-Mode.

    FlexPod is validated with both modes of operation, with clustered Data ONTAP providing a highly

    scalable storage architecture that enables nondisruptive operations, nondisruptive upgrades, and an

    agile data infrastructure.

    For more information about ONTAP, see http://www.netapp.com/us/products/data-management-

    software/ontap.aspx.

    6 Cisco Nexus Switching Modes of Operation

    A variety of Cisco Nexus products can be used as the switching component of a given FlexPod

    deployment. Most of these options leverage the traditional Cisco Nexus OX or NX-OS software. The

    Cisco Nexus family of switches offers varying capabilities within its product lines. These capabilities

    are detailed later in this document.

    Ciscos offering in the software-defined networking space is called Application Centric Infrastructure

    (ACI). The Cisco Nexus product line that supports the ACI mode, also called fabric mode, is the 9300

    series. These switches can also be deployed in NX-OS or standalone mode.

    Cisco ACI is targeted at data center deployments that focus on the requirements of a specific

    application. Applications are instantiated through a series of profiles and contracts that allow for

    connectivity from the host or virtual machine all the way through the network to the storage.

    FlexPod is validated with both modes of operation of the Cisco Nexus switches. For more information

    about the ACI and the NX-OS modes, see the following Cisco pages:

    Cisco Application Centric Infrastructure

    Cisco NX-OS Software

    7 Minimum Hardware Requirements

    A FlexPod configuration has minimum hardware requirements including, but not limited to, switches,

    fabric interconnects, servers, and FAS controllers.

    You must use Cisco Unified Computing System (Cisco UCS) servers. Both C-Series and B-Series

    servers have been used in the validated designs. You can choose B-Series servers, which require

    chassis and blades, or the C-Series servers, which require rack-mount servers. Cisco Nexus Fabric

    Extenders (FEXs) are optional with C-Series servers.

    A FlexPod configuration has the following minimum hardware requirements:

    Two Cisco Nexus switches in a redundant configuration. This configuration can consist of two redundant switches from the Cisco Nexus 5000, 7000, or 9000 series. The two switches should be of the same model and be configured in the same mode of operation.

    Note: If you are deploying an ACI architecture, you must observe the following additional requirements:

    Deploy the Cisco Nexus 9000 series switches in a spine-leaf topology.

    Use three Cisco Application Policy Infrastructure Controllers (APICs).

    Two Cisco UCS 6100, 6200, or 6300 series fabric interconnects in a redundant configuration.

    Cisco UCS servers:

    If the solution uses B-Series servers, one Cisco UCS 5000 B-Series blade chassis plus two Cisco UCS B-Series blade servers plus two 2104, 2204, or 2208 FEX modules.

    If the solution uses C-Series servers, two Cisco UCS C-Series rack-mount servers.

    http://www.netapp.com/us/products/data-management-software/ontap.aspxhttp://www.netapp.com/us/products/data-management-software/ontap.aspxhttp://www.cisco.com/c/en/us/solutions/data-center-virtualization/application-centric-infrastructure/index.htmlhttp://www.cisco.com/c/en/us/products/ios-nx-os-software/nx-os-software/index.html

  • 8 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Note: For larger deployments of Cisco UCS C-Series rack-mount servers, a pair of 2232PP FEX modules may be desirable. However, the 2232PP is not a hardware requirement.

    Two NetApp FAS controllers in a high-availability (HA) pair configuration.

    Note: This configuration can consist of products from the NetApp FAS2000, 3000, 6000, or 8000 family of controllers.

    The HA configuration requires two redundant interfaces per controller for data access; the interfaces can be Fibre Channel over Ethernet (FCoE), Fibre Channel (FC), or 10 Gigabit Ethernet (10GbE).

    If the solution uses clustered Data ONTAP, a cluster interconnect topology approved by NetApp is required. For more information, refer to Cluster Management and Interconnect Switches.

    If the solution uses clustered Data ONTAP, at least two additional 10GbE ports per controller are required for data access.

    For clusters with two nodes, a two-node switchless cluster can be configured.

    For clusters with more than two nodes, a cluster interconnect is required.

    One NetApp disk shelf with any supported disk type.

    8 Minimum Software Requirements

    A FlexPod configuration has the following minimum software requirements:

    NetApp Data ONTAP:

    7-Mode requires Data ONTAP 7.3.5 or later, including Data ONTAP 8.x

    Clustered Data ONTAP requires Data ONTAP 8.1.1 or later

    Cisco UCS Manager 1.3 or later

    For Cisco Nexus 5000 Series Switches, Cisco NX-OS software release 5.0(3)N1(1c) or later, including NX-OS 5.1.x

    For Cisco Nexus 7000 Series Switches:

    The 4-slot chassis requires Cisco NX-OS software release 6.1(2) or later

    The 9-slot chassis requires Cisco NX-OS software release 5.2 or later

    The 10-slot chassis requires Cisco NX-OS software release 4.0 or later

    The 18-slot chassis requires Cisco NX-OS software release 4.1 or later

    For Cisco Nexus 9000 Series Switches, Cisco NX-OS software release 6.1(2) or later

    Note: The software used in a FlexPod configuration must be listed and supported in the NetApp IMT. Some features might require more recent releases of the software than the ones listed.

    9 Connectivity Requirements

    A FlexPod configuration has the following connectivity requirements:

    The port-channel ports on the NetApp storage controllers must be directly connected to the Cisco Nexus 5000, 7000, or 9000 Series Switches because the Cisco UCS fabric interconnects do not support virtual port channels (vPCs).

    vPCs are required from the Cisco Nexus 5000, 7000, or 9000 Series Switches to the NetApp storage controllers.

    The Cisco UCS fabric interconnect appliance ports are recommended only for SAN protocols (FC, FCoE, and iSCSI). FCoE port channels between the fabric interconnects and the Cisco Nexus switches are recommended for end-to-end FCoE designs.

    No additional equipment can be placed inline between the core FlexPod components.

    vPCs are required from the Cisco Nexus 5000, 7000, or 9000 Series Switches to the fabric interconnects.

    http://mysupport.netapp.com/documentation/productlibrary/index.html?productID=61470http://mysupport.netapp.com/documentation/productlibrary/index.html?productID=61470http://mysupport.netapp.com/matrix

  • 9 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    FCoE port channels are recommended for end-to-end FCoE designs.

    Jumbo frame support is recommended to be enabled throughout the environment, but not required.

    A separate 100MbE/GbE out-of-band management network is required.

    10 Other Requirements

    A FlexPod architecture has the following additional interoperability and support-related requirements:

    All hardware and software components must be listed and supported on the IMT, the Cisco UCS HCL, and the Cisco UCS Hardware and Software Interoperability Matrix.

    If V-Series components are used with Data ONTAP 7-Mode, they must be listed and supported in the V-Series/gFiler Gateway Support Matrix. In clustered Data ONTAP 8.2 and later, this feature is called NetApp FlexArray, and the compatibility information is detailed in the NetApp IMT.

    Valid support contracts are required for all equipment, including:

    SMARTnet support for Cisco equipment

    SupportEdge Premium support for NetApp equipment

    For more information, see the NetApp IMT and the V-Series/gFiler Gateway Support Matrix.

    11 Optional Features

    For FlexPod architectures, NetApp supports several optional components to further enhance FlexPod

    Datacenter architectures. Optional components are outlined in the following sections.

    11.1 MetroCluster

    FlexPod supports the NetApp MetroCluster solution for continuous availability, in either two- or four-

    node cluster configurations. MetroCluster provides synchronous replication for critical workloads. It

    requires a dual-site configuration connected with Cisco switching. The maximum supported distance

    between the sites is 300km (approximately 186 miles). Figure 1 illustrates the FlexPod Datacenter

    with NetApp MetroCluster architecture.

    For additional details and guidance, see the FlexPod Datacenter with NetApp MetroCluster

    deployment document.

    http://mysupport.netapp.com/matrixhttp://mysupport.netapp.com/matrixhttp://mysupport.netapp.com/matrixhttp://mysupport.netapp.com/NOW/knowledge/docs/V-Series/supportmatrix/http://www.netapp.com/us/media/nva-0030-deploy.pdf

  • 10 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Figure 1) FlexPod Datacenter with NetApp MetroCluster architecture.

    11.2 FCP SAN Boot Through Cisco MDS

    To provide increased scalability by using a dedicated SAN network, FlexPod supports Fibre Channel

    Protocol (FCP) through the Cisco MDS switches. The FCP SAN Boot option through Cisco MDS has

    the following licensing and hardware requirements:

    A minimum of two FC ports per NetApp storage controller; one port for each SAN fabric

    An FCP license on each NetApp storage controller

    Cisco MDS switches and firmware versions supported on NetApp IMT

    The following CVD documents for FlexPod Datacenter with FC provide additional guidance for an

    MDS-based design:

    FlexPod Datacenter with VMware vSphere 6.0 and Fibre Channel Design Guide

    FlexPod Datacenter with VMware vSphere 6.0 and Fibre Channel Deployment Guide

    Figure 2 shows the FlexPod Datacenter with MDS connectivity.

    http://mysupport.netapp.com/matrix

  • 11 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Figure 2) FlexPod Datacenter with FC with Cisco MDS.

    11.3 FCP SAN Boot with Cisco Nexus

    The classic Fibre Channel Protocol (FCP) SAN boot option has the following licensing and hardware

    requirements:

    When FC zoning is done in the Cisco Nexus 5000 Series Switch, a Storage Protocols Service Package license for the Cisco Nexus 5000 Series Switches (FC_FEATURES_PKG) is required.

    When FC zoning is done in the Cisco Nexus 5000 Series Switch, SAN links are required between the fabric interconnect and the Cisco Nexus 5000 Series Switch. For additional redundancy, SAN port channels are recommended between the links.

  • 12 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    The Cisco Nexus 5010, 5020, and 5548P model switches require a separate FC or universal port (UP) module for connectivity into the Cisco UCS fabric interconnect and into the NetApp storage controller.

    Each NetApp storage controller requires a minimum of two 2/4/8Gb FC ports for connectivity.

    Requires an FCP license on the NetApp storage controller.

    Note: The use of the Cisco Nexus 7000, or 9000 family of switches precludes the use of classic FC unless FC zoning is done in the fabric interconnect. In this case, SAN uplinks to the switch are not supported.

    Figure 3 shows an FC connectivity configuration.

    Figure 3) FC boot scenario.

    11.4 FCoE SAN Boot Option

    The FCoE SAN boot option has the following licensing and hardware requirements:

    When FC zoning is done in the switch, a Storage Protocols Service Package license for the Cisco Nexus 5000, or 7000 Series Switches (FC_FEATURES_PKG) is required.

    When FC zoning is done in the switch, FCoE uplinks are required between the fabric interconnect and the Cisco Nexus 5000 or 7000 Series Switches, and FCoE port channels are recommended between the links for additional redundancy.

    Each NetApp storage controller requires at least one dual-port unified target adapter (UTA) add-on card for FCoE connectivity unless onboard unified target adapter 2 (UTA2) ports are present.

    The option requires an FCP license on the NetApp storage controller.

    If you use the Cisco Nexus 7000 Series Switches or the Cisco Nexus 6004 switch and FC zoning is done in the switch, a line card capable of supporting FCoE is required.

    Note: The use of the Cisco Nexus 9000 Series Switches precludes the use of FCoE unless FC zoning is done in the fabric interconnect and storage is connected to the fabric interconnects with appliance ports. In this case, FCoE uplinks to the switch are not supported.

  • 13 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Figure 4 shows an FCoE boot scenario.

    Figure 4) FCoE boot scenario.

    11.5 iSCSI Boot Option

    The iSCSI boot option has the following licensing and hardware requirements:

    An iSCSI license on the NetApp storage controller is required.

    An adapter in the Cisco UCS server capable of iSCSI boot is required.

    A two-port 10Gbps Ethernet adapter on the NetApp storage controller is required.

    Figure 5 shows an Ethernet-only configuration that is booted by using iSCSI.

  • 14 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Figure 5) iSCSI boot scenario.

    11.6 SolidFire Add On

    SolidFire all-flash storage systems can be added into any existing FlexPod Datacenter environment,

    or deployed with new FlexPod Datacenter environments. It is important to note that NetApp FAS/AFF

    storage is still as part of the solution, and SolidFire does not replace NetApp FAS/AFF storage

    systems. SolidFire provides multi-tenant workloads with guaranteed performance minimum

    performance SLAs through SolidFire quality of service (QoS). SolidFire storage arrays in the Add-On

    configuration leverage the iSCSI block protocol. For more information, see the FlexPod Datacenter

    with SolidFire All-Flash Array Add-On Deployment Guide.

    http://www.netapp.com/us/media/nva-0027-deploy.pdfhttp://www.netapp.com/us/media/nva-0027-deploy.pdf

  • 15 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Figure 6) FlexPod Datacenter with NetApp SolidFire all-flash array add-on.

    12 Cisco Components

    Cisco has contributed substantially to the FlexPod design and architecture, covering both the compute

    and networking layers of the solution. This section describes the Cisco UCS and Cisco Nexus options

    that are available for FlexPod. FlexPod supports both the Cisco UCS B-Series and C-Series servers.

    12.1 Cisco UCS Fabric Interconnect Options

    Redundant fabric interconnects are required in the FlexPod architecture. When adding multiple Cisco

    UCS chassis to a pair of fabric interconnects, remember that the maximum number of chassis in an

    environment is determined by both an architectural and a port limit.

    The part numbers shown in Table 1 are for the base fabric interconnects; they do not include the

    power supply unit (PSU), small form factor pluggable plus (SFP+) modules, quad small form factor

    pluggable (QSFP+), or expansion modules.

  • 16 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Table 1) Cisco UCS fabric interconnect options.

    Cisco UCS Fabric Interconnect Part Number Technical Specifications

    Cisco UCS 6248UP UCS-FI-6248UP Cisco UCS 6200 Series Fabric Interconnect

    Cisco UCS 6296UP UCS-PSU-6296UP-AC

    Cisco UCS 6332UP UCS-FI-6332-UP Cisco UCS 6332 Fabric Interconnect

    Cisco UCS 6324 UCS-FI-6324 Cisco UCS 6324 Fabric Interconnect

    12.2 Cisco UCS B-Series Chassis Option

    To use Cisco UCS B-Series blades, you must have a Cisco UCS B-Series chassis. If you intend to

    use Cisco UCS C-Series rack-mount servers, a chassis is not required. Table 2 describes the Cisco

    UCS B-Series chassis option.

    Table 2) Cisco UCS B-Series chassis option.

    Cisco UCS Chassis Part Number Technical Specifications

    Cisco UCS 5108 N20-C6508 Cisco UCS 5100 Series Blade Server Chassis

    Each Cisco UCS 5108 blade chassis must have two Cisco UCS 2200 Series FEX adapters installed

    within it to provide redundant connectivity to the fabric interconnects. For more information about

    which combinations of fabric interconnect and Cisco UCS 5108 FEXs can be accommodated, see the

    fabric interconnect technical specifications link in Table 2.

    12.3 Cisco UCS B-Series Blade Server Options

    Cisco UCS B-Series blade servers are available in half-width and full-width varieties, with various

    CPU, memory, and I/O options. The part numbers listed in Table 3 are for the base server; they do

    not include the CPU, memory, disk drives, or mezzanine adapter cards. Multiple configuration options

    are available and supported in FlexPod.

    Table 3) Cisco UCS B-Series blade server options.

    Cisco UCS Blade Part Number Technical Specifications

    Cisco UCS B200 M5 UCSB-B200-M5 Cisco UCS B200 M5 Blade Server

    Cisco UCS B200 M4 UCSB-B200-M4 Cisco UCS B200 M4 Blade Server

    Cisco UCS B420 M4 UCSB-B420-M4 Cisco UCS B420 M4 Blade Server

    Previous generations of Cisco UCS B-Series blades can be used in the FlexPod architecture, if they

    are supported on the Cisco UCS Hardware and Software Compatibility List. The Cisco UCS B-Series

    blade servers must also have a valid Smart Net Total Care support contract.

    Note: Cisco currently is in the process of releasing Cisco UCS M5 hardware. This document will be updated as new hardware is released. Cisco UCS M5 hardware is supported on FlexPod as it becomes available on the Cisco UCS Hardware and Software Compatibility List and on the NetApp IMT.

    12.4 Cisco UCS C-Series Rack-Mount Server Options

    Cisco UCS C-Series rack-mount servers are available in one-, two-, and four-rack unit (RU) varieties,

    with various CPU, memory, and I/O options. The part numbers listed in Table 4 are for the base

    server; they do not include CPUs, memory, disk drives, PCIe cards, or the Cisco fabric extender.

    Multiple configuration options are available and supported in the FlexPod architecture.

    http://www.cisco.com/c/dam/en/us/products/collateral/servers-unified-computing/ucs-b-series-blade-servers/6200_SpecSheet.pdf?referring_site=RE&pos=1&page=http://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-6200-series-fahttp://www.cisco.com/c/dam/en/us/products/collateral/servers-unified-computing/ucs-b-series-blade-servers/6332-specsheet.pdfhttp://www.cisco.com/c/dam/en/us/products/collateral/servers-unified-computing/ucs-6300-series-fabric-interconnects/6324-spec-sheet.pdfhttp://www.cisco.com/c/en/us/products/servers-unified-computing/ucs-5100-series-blade-server-chassis/index.htmlhttp://www.cisco.com/c/en/us/products/servers-unified-computing/ucs-5100-series-blade-server-chassis/index.htmlhttps://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-b-series-blade-servers/datasheet-c78-739296.htmlhttp://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-b200-m4-blade-server/datasheet-c78-732434.htmlhttp://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-b420-m4-blade-server/datasheet-c78-734584.htmlhttps://ucshcltool.cloudapps.cisco.com/public/https://ucshcltool.cloudapps.cisco.com/public/https://mysupport.netapp.com/matrix/#welcome

  • 17 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Table 4) Cisco UCS C-Series rack-mount server options.

    Cisco UCS C-Series Rack-Mount Server

    Part Number Technical Specifications

    Cisco UCS C240 M5 UCS-C-C240-M5S Cisco UCS C240 M5 rack server

    Cisco UCS C220 M4 UCSC-C220-M4S Cisco UCS C220 M4 Rack Server

    Cisco UCS C240 M4 UCSC-C240-M4S Cisco UCS C240 M4 Rack Server

    Cisco UCS C460 M4 UCSC-C460-M4 Cisco UCS C460 M4 Rack Server

    Previous generations of Cisco UCS C-Series servers can be used in the FlexPod architecture, if they

    are supported on the Cisco UCS Hardware and Software Compatibility List. The Cisco UCS C-Series

    servers must also have a valid Smart Net Total Care support contract.

    Note: Cisco currently is in the process of releasing Cisco UCS M5 hardware. This document will be updated as new hardware is released. Cisco UCS M5 hardware is supported on FlexPod as it becomes available on the Cisco UCS Hardware and Software Compatibility List and on the NetApp IMT.

    12.5 Cisco Nexus 5000 Series Switch Options

    Redundant Cisco Nexus 5000, 7000, or 9000 Series Switches are required in the FlexPod

    architecture. The part numbers listed in Table 5 are for the Cisco Nexus 5000 series chassis; they do

    not include SFP modules, add-on FC, or Ethernet modules.

    Table 5) Cisco Nexus 5000 Series Switch options.

    Cisco Nexus 5000 Series Switch Part Number Technical Specifications

    Cisco Nexus 56128P Switch N5K-C56128P Cisco Nexus 5600 Platform Switches

    Cisco Nexus 5696Q Switch N5K-C5696Q

    Cisco Nexus 5672UP Switch N5K-C5672UP

    Cisco Nexus 5672-UP-16G Switch N5K-C5672UP-16G

    Cisco Nexus 5648Q Switch N5K-C5648Q

    Cisco Nexus 5624Q Switch N5K-C5624Q

    Cisco Nexus 5596T Switch N5K-C5596UP-FA Cisco Nexus 5548 and 5596 Switches

    Cisco Nexus 5596UP Switch N5K-C5596UP-FA

    Cisco Nexus 5548UP Switch N5K-C5548UP-FA

    12.6 Cisco Nexus 7000 Series Switch Options

    Redundant Cisco Nexus 5000, 7000, or 9000 Series Switches are required in the FlexPod

    architecture. The part numbers listed in Table 6 are for the Cisco Nexus 7000 series chassis; they do

    not include SFP modules, line cards, or power supplies, but they do include fan trays.

    Table 6) Cisco Nexus 7000 Series Switch options.

    Cisco Nexus 7000 Series Switch Part Number Technical Specifications

    Cisco Nexus 7004 N7K-C7004 Cisco Nexus 7000 4-Slot Switch

    Cisco Nexus 7009 N7K-C7009 Cisco Nexus 7000 9-Slot Switch

    Cisco Nexus 7010 N7K-C7010 Cisco Nexus 7000 10-Slot Switch

    https://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-c-series-rack-servers/datasheet-c78-739279.htmlhttp://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-c220-m4-rack-server/datasheet-c78-732386.htmlhttp://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-c240-m4-rack-server/datasheet-c78-732455.htmlhttp://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-c460-m4-rack-server/datasheet-c78-730907.htmlhttps://ucshcltool.cloudapps.cisco.com/public/https://ucshcltool.cloudapps.cisco.com/public/https://mysupport.netapp.com/matrix/#welcomehttp://www.cisco.com/c/en/us/products/collateral/switches/nexus-5000-series-switches/datasheet-c78-730760.htmlhttp://www.cisco.com/c/en/us/products/collateral/switches/nexus-5000-series-switches/data_sheet_c78-618603.htmlhttp://www.cisco.com/en/US/products/ps12735/index.htmlhttp://www.cisco.com/en/US/products/ps11565/index.htmlhttp://www.cisco.com/en/US/products/ps9512/index.html

  • 18 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Cisco Nexus 7000 Series Switch Part Number Technical Specifications

    Cisco Nexus 7018 N7K-C7018 Cisco Nexus 7000 18-Slot Switch

    Cisco Nexus 7702 N7K-C7702 Cisco Nexus 7700 2-Slot Switch

    Cisco Nexus 7706 N77-C7706 Cisco Nexus 7700 6-Slot Switch

    Cisco Nexus 7710 N77-C7710 Cisco Nexus 7700 10-Slot Switch

    Cisco Nexus 7718 N77-C7718 Cisco Nexus 7700 18-Slot Switch

    12.7 Cisco Nexus 9000 Series Switch Options

    Redundant Cisco Nexus 5000, 7000, or 9000 Series Switches are required in the FlexPod

    architecture. The part numbers listed in Table 7 are for the Cisco Nexus 9000 series chassis; they do

    not include SFP modules, or Ethernet modules.

    Table 7) Cisco Nexus 9000 Series Switch options.

    Cisco Nexus 9000 Series Switch Part Number Technical Specifications

    Cisco Nexus 9504 N9K-C9504-B2 Cisco Nexus 9000 Series Switches

    Cisco Nexus 9500 Series Switches Cisco Nexus 9508 N9K-C9508-B2

    Cisco Nexus 9516 N9K-C9516-B2

    Cisco Nexus 93180YC-EX N9K-93180YC-EX Cisco Nexus 9300 Series Switches

    Cisco Nexus 93128TX Switch N9K-C93128TX

    Cisco Nexus 93120TX Switch N9K-C93120TX

    Cisco Nexus 93108TC-EX Switch N9K-C93108TC-EX

    Cisco Nexus 9396PX Switch N9K-C9396PX

    Cisco Nexus 9372PX Switch N9K-C9372PX

    Cisco Nexus 9364C Switch N9K-C9364C

    Cisco Nexus 9348GC-FXP Switch N9K-C9348GC-FXP

    Cisco Nexus 9336PQ ACI Spine Switch

    N9K-C9336PQ

    Cisco Nexus 9332PQ N9K-C9332PQ

    Cisco Nexus 92304QC Switch N9K-C92304QC Cisco Nexus 9200 Series Switches

    Cisco Nexus 92300YC Switch N9K-C92399YC

    Cisco Nexus 92160YC-X Switch N9K-C92160YC-X

    Cisco Nexus 9272Q Switch N9K-C9172Q

    Cisco Nexus 9236C Switch N9K-9236C

    Note: Some Cisco Nexus 9000 switches have additional variants. These variants are supported as part of the FlexPod solution. For the complete list of Cisco Nexus 9000 switches, see Cisco Nexus 9000 Series Switches on the Cisco website.

    http://www.cisco.com/en/US/products/ps10098/index.htmlhttp://www.cisco.com/c/en/us/products/switches/nexus-7700-2-slot-switch/index.htmlhttp://www.cisco.com/en/US/products/ps13482/index.htmlhttp://www.cisco.com/en/US/products/ps13102/index.htmlhttp://www.cisco.com/en/US/products/ps13103/index.htmlhttp://www.cisco.com/c/en/us/products/switches/nexus-9000-series-switches/index.htmlhttp://www.cisco.com/c/en/us/products/collateral/switches/nexus-9000-series-switches/datasheet-c78-729404.htmlhttp://www.cisco.com/c/en/us/products/collateral/switches/nexus-9000-series-switches/datasheet-c78-729405.htmlhttp://www.cisco.com/c/en/us/products/collateral/switches/nexus-9000-series-switches/datasheet-c78-735989.htmlhttp://www.cisco.com/c/en/us/support/switches/nexus-9000-series-switches/tsd-products-support-series-home.htmlhttp://www.cisco.com/c/en/us/support/switches/nexus-9000-series-switches/tsd-products-support-series-home.html

  • 19 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    12.8 Cisco APIC Options

    When deploying Cisco ACI, you must configure the Cisco Application Policy Infrastructure Controller

    (APIC) in addition to the items in section 14.9, Cisco Nexus 9000 Series Switches. Table 8 lists the

    part numbers and details for the APICs.

    Table 8) Cisco APIC sizes.

    Cisco APIC Configuration Part Number Description

    Medium cluster APIC-CLUSTER-M2 Cluster of three Cisco APIC controllers with medium CPU, hard drive, and memory configurations (up to 1,000 edge ports)

    Large cluster APIC-CLUSTER-L2 Cluster of three Cisco APIC controllers with large CPU, hard drive, and memory configurations (more than 1,000 edge ports)

    Medium APIC-M2 Cisco APIC controller with medium CPU, hard drive, and memory configurations (up to 1,000 edge ports)

    Large APIC-L2 Cisco APIC controller with large CPU, hard drive, and memory configurations (more than 1,000 edge ports)

    Medium (spare) APIC-M2= Cisco APIC controller with medium CPU, hard drive, and memory configurations (up to 1,000 edge ports)

    Large (spare) APIC-L2= Cisco APIC controller with large CPU, hard drive, and memory configurations (more than 1,000 edge ports)

    For more information about the Cisco APIC sizes, see the Cisco Application Centric Infrastructure

    Datasheet.

    12.9 Cisco Nexus Fabric Extender Options

    Redundant Cisco Nexus 2000 Series rack-mount FEXs are recommended for large FlexPod

    architectures that use C-Series servers. Table 9 describes the Cisco Nexus FEX options.

    Table 9) Cisco Nexus FEX options.

    Cisco Nexus Rack-mount FEX Part Number Technical Specifications

    Cisco Nexus 2232PP N2K-C2232PP Cisco Nexus 2000 Series Fabric Extenders

    Cisco Nexus 2232TM-E N2K-C2232TM-E

    Cisco Nexus 2248TP-E N2K-C2248TP-E

    Cisco Nexus 2332TQ N2K-C2332TQ Cisco Nexus 2300 Platform Fabric Extenders

    Cisco Nexus 2348UPQ N2K-C2348UPQ

    Cisco Nexus 2348TQ-E N2K-C2348TQ-E

    Cisco Nexus 2348TQ N2K-C2348TQ

    12.10 Cisco MDS Options

    Cisco MDS switches are an optional component in the FlexPod architecture. Redundant SAN switch

    fabrics are required when implementing the Cisco MDS switch for FCP SAN. Table 10 lists the part

    numbers and details for the supported Cisco MDS switches.

    http://www.cisco.com/c/en/us/products/collateral/cloud-systems-management/application-policy-infrastructure-controller-apic/datasheet-c78-732414.htmlhttp://www.cisco.com/c/en/us/products/collateral/cloud-systems-management/application-policy-infrastructure-controller-apic/datasheet-c78-732414.htmlhttp://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps10110/data_sheet_c78-507093.htmlhttp://www.cisco.com/c/en/us/products/collateral/switches/nexus-2000-series-fabric-extenders/datasheet-c78-731663.htmlhttp://www.cisco.com/c/en/us/products/collateral/switches/nexus-2000-series-fabric-extenders/datasheet-c78-731663.html

  • 20 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Table 10) Cisco MDS switches.

    Cisco MDS 9000 Series Switch Part Number Description

    Cisco MDS 9148 DS-C9148-K9 Cisco MDS 9100 Series Switches

    Cisco MDS 9148S DS-C9148S-K9

    Cisco MDS 9250i DS-C9250I-K9 Cisco MDS 9200 Series Switches

    Cisco MDS 9396S DS-C9396S-K9 Cisco MDS 9300 Series Switches

    Cisco MDS 9706 DS-C9706

    Cisco MDS 9700 Series Switches Cisco MDS 9710 DS-C9710

    Cisco MDS 9718 DS-C9718

    12.11 Cisco Software Licensing Options

    Licenses are required to enable storage protocols on the Cisco Nexus switches. The Cisco Nexus

    5000, and 7000 series of switches all require a storage services license to enable the FC or FCoE

    protocol for SAN boot implementations. The Cisco Nexus 9000 Series Switches currently do not

    support FC or FCoE.

    Note: The required licenses and the part numbers for those licenses vary depending on the options that you select for each component of the FlexPod solution. For example, software license part numbers vary depending on the number of ports and which Cisco Nexus 5000 or 7000 Series Switches you choose. Consult your sales representative for the exact part numbers. Table 11 lists the Cisco software licensing options.

    Table 11) Cisco software licensing options.

    Cisco Software Licensing Part Number Technical Specifications

    Cisco Nexus 5500 Storage License, 8-, 48-, and 96-port

    N55-8P-SSK9/N55-48P-SSK9/N55-96P-SSK9

    Licensing Cisco NX-OS Software Features Information About Licensing

    Cisco Nexus 5010/5020 Storage Protocols License

    N5010-SSK9/N5020-SSK9

    Cisco Nexus 5600 Storage Protocols License

    N56-16p-SSK9/N5672-72P-SSK9/N56128-128P-SSK9

    Cisco Nexus 7000 Storage Enterprise License

    N7K-SAN1K9

    Cisco Nexus 9000 Enterprise Services License

    N95-LAN1K9/N93-LAN1K9

    12.12 Cisco Support Licensing Options

    Valid Smart Net Total Care support contracts are required on all Cisco equipment in the FlexPod

    architecture.

    Note: The required licenses and the part numbers for those licenses must be verified by your sales representative because they can differ for different products. Table 12 lists the Cisco support licensing options.

    Table 12) Cisco support licensing options.

    Cisco Support Licensing License Guide

    Smart Net Total Care Onsite Premium Cisco Smart Net Total Care Service

    http://www.cisco.com/c/en/us/products/storage-networking/mds-9100-series-multilayer-fabric-switches/models-listing.htmlhttp://www.cisco.com/c/en/us/products/storage-networking/mds-9200-series-multiservice-switches/models-listing.htmlhttp://www.cisco.com/c/en/us/products/storage-networking/mds-9396s-16g-multilayer-fabric-switch/index.htmlhttp://www.cisco.com/c/en/us/products/storage-networking/mds-9700-series-multilayer-directors/index.htmlhttp://www.cisco.com/c/en/us/td/docs/switches/datacenter/sw/nx-os/licensing/guide/b_Cisco_NX-OS_Licensing_Guide/b_Cisco_NX-OS_Licensing_Guide_chapter_01.htmlhttp://www.cisco.com/c/en/us/td/docs/switches/datacenter/sw/nx-os/licensing/guide/b_Cisco_NX-OS_Licensing_Guide/b_Cisco_NX-OS_Licensing_Guide_chapter_01.htmlhttp://www.cisco.com/c/en/us/products/collateral/cloud-systems-management/smart-net-total-care/datasheet-c78-735459.pdf

  • 21 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    13 NetApp Components

    NetApp storage controllers provide the storage foundation in the FlexPod architecture for both boot

    and application data storage. NetApp components include storage controllers, Ethernet expansion

    modules, disks and disk shelves, and licensing options.

    13.1 NetApp Storage Controller Options

    Redundant NetApp FAS or V-Series controllers are required in the FlexPod architecture. The

    controllers run either clustered Data ONTAP or Data ONTAP 7-Mode. When the storage controllers

    are ordered, the preferred software version can be preloaded on the controllers. For clustered Data

    ONTAP, a complete cluster is ordered; a complete cluster includes a pair of storage controllers and a

    cluster interconnect.

    The part numbers listed in Table 13 are for an empty controller. Different options and configurations

    are available depending on the selected storage platform. Consult your sales representative for

    details about these additional components.

    Note: The controllers listed in Table 13 are appropriate for use in a FlexPod Datacenter solution because their connection to the Cisco Nexus switches is seamless.

    Table 13) NetApp storage controller options.

    Storage Controller Part Number Technical Specifications

    FAS9000 FAS9000A-002 FAS9000 Series

    FAS8200 FAS8200A-002 FAS8200 Series

    FAS8080 EX Contact your NetApp sales representative for the part number.

    FAS8000 Series

    FAS8060 FAS80X0-CHASSIS-INT-R6

    FAS8040 FAS80X0-CHASSIS-INT-R6

    FAS8020 FAS8020-CHASSIS-INT-R6

    AFF8080 EX Contact your NetApp sales representative for the part numbers.

    AFF8000 Series

    AFF8060

    AFF8040

    AFF8020

    AFF A200 AFF-A200A-002 AFF A-series

    AFF A300 AFF-A300A-002

    AFF A700s AFF-A700S-002

    AFF A700 AFF-A700-002

    FAS2554 FAS2554-CHASSIS-R6 FAS2500 Series

    FAS2552 FAS2552-CHASSIS-R6

    Note: In the FAS8000 series, V-Series is now FlexArray. For more information about FlexArray, see the NetApp FlexArray Storage Virtualization Software.

    13.2 NetApp SolidFire Add-On Storage Controller Options

    NetApp SolidFire storage controllers are supported as an add on to an existing FlexPod Datacenter

    using NetApp FAS/AFF arrays. Table 14 lists the NetApp SolidFire all-flash storage systems.

    http://www.netapp.com/us/products/storage-systems/hybrid-flash-array/fas9000.aspxhttp://www.netapp.com/us/products/storage-systems/hybrid-flash-array/fas8200.aspxhttp://www.netapp.com/us/products/storage-systems/fas8000/fas8000-tech-specs.aspxhttp://www.netapp.com/us/products/storage-systems/all-flash-fas/all-flash-fas-tech-specs.aspxhttp://www.netapp.com/us/products/storage-systems/all-flash-array/aff-a-series.aspxhttp://www.netapp.com/products/storage-systems/fas2500/fas2500-tech-specs.aspxhttp://www.netapp.com/us/products/storage-systems/flexarray/index.aspx

  • 22 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Table 14) NetApp SolidFire storage nodes.

    Component SF4805 SF9605 SF19210 SF38410

    Drives (10) 480GB 2.5" SSD

    (10) 960GB 2.5" SSD

    (10)1.92 TB 2.5" SSD

    (10) 3.84TB 2.5" SSD

    System Memory / Read Cache

    128GB 256GB 384GB 768GB

    Raw Capacity 4.8TB / 4.3TiB 9.6 TB / 8.7TiB 19.2TB / 17.4TiB 38.4TB / 34.8TiB

    Effective Capacity*

    10 to 20TB / 9 to 18.1TiB

    20 to 40TB / 18.1 to 36.3TiB

    40 to 80TB / 36.3 to 72.7TiB

    8o to 160TB / 72.6 to 145.4TiB

    Performance per node

    50,000 IOPS 50,000 IOPS 100,000 IOPS 100,000 IOPS

    Networking Data (2) 10GbE iSCSI SFP+,

    Mgt (2) 1GbE RJ45

    Data (2) 10GbE iSCSI SFP+,

    Mgt (2) 1GbE RJ45

    Data (2) 10GbE iSCSI SFP+,

    Mgt (2) 1GbE RJ45

    Data (2) 10GbE iSCSI SFP+,

    Mgt (2) 1GbE RJ45

    Average Watts 130W to 230W 150W to 275W 300W to 450W 300W to 450W

    For more information about the NetApp SolidFire storage controllers, refer to the NetApp SolidFire All-

    Flash Array Technical Specifications.

    13.3 Cluster Interconnect Switch Options

    Table 15 lists the NetApp and Cisco Nexus cluster interconnect switches available for FlexPod

    architectures.

    Table 15) Cluster interconnect switch options.

    Cluster Interconnect Switch

    Part Number Technical Specifications

    NetApp CN1610 X1960-R6 NetApp Documentation: CN1610 switches

    Cisco Nexus 5596UP N5K-C5596UP-NFA Cisco Product Information: Cisco Nexus 5596UP Switch

    13.4 NetApp Ethernet Expansion Module Options

    Table 16 lists the 10GbE and FCoE adapter options for FlexPod architectures.

    Table 16) Ethernet expansion module options.

    Ethernet Expansion Module

    Part Number Technical Specifications

    NetApp X1160A X1160A-R6 Adapter Card Support for Clustered Data ONTAP 8.2

    Clustered Data ONTAP 8.3 SAN Administration Guide

    NetApp X1117A X1117A-R6

    NetApp X1139A X1139A-R6

    NetApp X1140A X1140A-R6

    NetApp X1143A X1143A-R6

    http://www.netapp.com/us/products/storage-systems/solidfire/solidfire-tech-specs.aspxhttp://www.netapp.com/us/products/storage-systems/solidfire/solidfire-tech-specs.aspxhttp://mysupport.netapp.com/documentation/docweb/index.html?productID=61472http://www.cisco.com/en/US/products/ps11577/index.htmlhttp://www.cisco.com/en/US/products/ps11577/index.htmlhttps://hwu.netapp.com/Resources/generatedPDFs/AdapterCards-8.3.2-clustered-Data-ONTAP-FAS.pdf?tag=8020https://hwu.netapp.com/Resources/generatedPDFs/AdapterCards-8.3.2-clustered-Data-ONTAP-FAS.pdf?tag=8020https://library.netapp.com/ecm/ecm_download_file/ECMP1636035https://library.netapp.com/ecm/ecm_download_file/ECMP1636035

  • 23 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    13.5 NetApp Disk Shelf and Disk Drive Options

    A minimum of one NetApp disk shelf is required for all storage controllers. V-Series controllers can

    also use third-party arrays, but their performance depends on the performance of those third-party

    drives.

    The selected NetApp shelf type determines which drive types are available within that shelf. For

    example, the DS4243 shelf supports SAS, SATA, and SSD drives, but not FC drives.

    Note: The FAS2240 is offered as a configuration that includes dual storage controllers plus disks housed within the same chassis. This configuration is offered with SATA or SAS drives; therefore, additional external disk shelves are not needed unless performance or capacity requirements dictate more spindles.

    Note: All disk shelf part numbers are for the empty shelf with two AC PSUs. Consult your sales representative for additional part numbers.

    Note: Disk drive part numbers vary according to the size and form factor of the disk that you intend to purchase. Consult your sales representative for additional part numbers.

    For more information about the supported drives, click the NetApp Hardware Universe link in Table 17 and then select Supported Drives (under the section called SpecificationsSaved Query).

    Table 17) NetApp disk shelf options.

    Disk Shelf Part Number Technical Specifications

    DS2246 X559A-R6 Disk Shelves and Storage Media

    Supported Drives on NetApp Hardware Universe

    DS4246 X24M-R6 Disk Shelves and Storage Media

    Supported Drives on NetApp Hardware Universe

    DS4486 210-05399 Disk Shelves and Storage Media

    Supported Drives on NetApp Hardware Universe

    DS224C DS224C-0-24 Disk Shelves and Storage Media

    Supported Drives on NetApp Hardware Universe

    DS212C DS212C-0-12 Disk Shelves and Storage Media

    Supported Drives on NetApp Hardware Universe

    13.6 NetApp Software Licensing Options

    Table 18 lists the NetApp software licensing options available for the FlexPod Datacenter architecture.

    NetApp software is licensed at the FAS/AFF controller level.

    Table 18) NetApp software licensing options.

    NetApp Software Licensing Part Number Technical Specifications

    SW, Complete BNDL (Controller), -C

    SW-8XXX-COMP-BNDL-C Product Library A-Z

    SW, Data ONTAP Essentials (Controller), -C

    SW-8XXX-ONTAP9-C

    http://www.netapp.com/us/products/storage-systems/disk-shelves-and-storage-media/disk-shelves-tech-specs.aspxhttp://hwu.netapp.com/Shelves/Index?queryId=1581309http://hwu.netapp.com/Shelves/Index?queryId=1581309http://www.netapp.com/us/products/storage-systems/disk-shelves-and-storage-media/disk-shelves-tech-specs.aspxhttp://hwu.netapp.com/Shelves/Index?queryId=1581319http://hwu.netapp.com/Shelves/Index?queryId=1581319http://www.netapp.com/us/products/storage-systems/disk-shelves-and-storage-media/disk-shelves-tech-specs.aspxhttp://hwu.netapp.com/Shelves/Index?queryId=1581321http://hwu.netapp.com/Shelves/Index?queryId=1581321http://www.netapp.com/us/products/storage-systems/disk-shelves-and-storage-media/disk-shelves-tech-specs.aspxhttp://hwu.netapp.com/Shelves/Index?queryId=1935351http://hwu.netapp.com/Shelves/Index?queryId=1935351http://www.netapp.com/us/products/storage-systems/disk-shelves-and-storage-media/disk-shelves-tech-specs.aspxhttp://hwu.netapp.com/Shelves/Index?queryId=1935387http://hwu.netapp.com/Shelves/Index?queryId=1935387http://mysupport.netapp.com/documentation/productsatoz/index.html

  • 24 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    13.7 NetApp Support Licensing Options

    NetApp SupportEdge premium licenses are required for the FlexPod architecture, but the part

    numbers for those licenses vary based on the options selected in the FlexPod design. For example,

    software license part numbers are different depending on which FAS controller you choose. Consult

    your sales representative for information about the exact part numbers of individual support licenses.

    Table 19 shows an example of a SupportEdge license.

    Table 19) NetApp support licensing options.

    NetApp Support Licensing Part Number Technical Specifications

    SupportEdge Premium 4 hours onsite -months: 36

    CS-O2-4HR NetApp SupportEdge

    14 Power and Cabling Requirements

    A FlexPod design has minimum power and cabling requirements.

    14.1 Power Requirements

    Power requirements for FlexPod Datacenter differ based on the location where the FlexPod

    Datacenter configuration is installed.

    For additional data about the maximum power required and other detailed power information, consult

    the technical specifications for each hardware component linked previously.

    For detailed Cisco UCS power data, see the Cisco UCS power calculator.

    For NetApp storage controller power data, see the NetApp Hardware Universe. Under platforms,

    select the storage platform that you want to use in the configuration (FAS/V-Series or All-Flash FAS).

    Select the ONTAP version and storage controller, and then click the Show Results button.

    14.2 Minimum Cable Requirements

    The number and type of cables and adapters vary per FlexPod Datacenter deployment. Cable type,

    transceiver type, and number are determined during the design process based on customer

    requirements. Table 20 lists the minimum number of cables required.

    Table 20) Minimum cable requirements.

    Hardware Model Number Cables Required

    Cisco UCS chassis Cisco UCS 5108 At least two twinax cables per Cisco UCS 2104XP/2204XP/2208XP module

    Cisco UCS fabric interconnects Cisco UCS 6248UP Two Cat5e cables for management ports

    Two Cat5e cables for the L1, L2 interconnects, per pair of fabric interconnects

    At least four twinax cables per fabric interconnect

    At least four FC cables per fabric interconnect

    Cisco UCS 6296UP

    Cisco UCS 6332-16UP

    Cisco UCS 6332 Two Cat5e cables for management ports

    Two Cat5e cables for the L1, L2 interconnects, per pair of fabric interconnects

    At least four twinax cables per fabric interconnect

    http://www.netapp.com/us/support/supportedge.htmlhttp://www.cisco.com/assets/cdc_content_elements/flash/dataCenter/cisco_ucs_power_calculator/http://hwu.netapp.com/Controller/Index?platformTypeId=6780858

  • 25 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Hardware Model Number Cables Required

    Cisco UCS 6324 Two 10/100/1000Mbps management ports

    At least two twinax cables per fabric interconnect

    Cisco Nexus 5000 and 7000 Series Switches

    Cisco Nexus 5000 Series At least two 10GbE fiber or twinax cables per switch

    At least two FC cables per switch (if FC/FCoE connectivity is required)

    Cisco Nexus 7000 Series

    Cisco Nexus 9000 Series Switches Cisco Nexus 9000 Series At least two 10GbE cables per switch

    NetApp FAS controllers FAS9000 A pair of SAS or SATA cables per storage controller

    At least two FC cables per controller, if using legacy FC

    At least two 10GbE cables per controller

    At least one GbE cable for management per controller

    If deploying clustered Data ONTAP, eight short twinax cables are required per pair of cluster interconnect switches

    FAS8200

    AFF A200

    AFF A300

    AFF A700s

    AFF A700

    FAS8080 EX

    FAS8060

    FAS8040

    FAS8020

    AFF8080 EX

    AFF8060

    AFF8040

    AFF8020

    FAS2620

    FAS2650

    FAS2520

    FAS2552

    FAS2554

    NetApp disk shelves DS212C Two SAS, SATA, or FC cables per disk shelf

    DS224C

    DS2246

    DS4246

    DS4486

  • 26 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    15 Technical Specifications and References

    Technical specifications provide details about the hardware components in a FlexPod solution, such

    as chassis, FEXs, servers, switches, controllers, and so on.

    15.1 Cisco UCS B-Series Blade Server Chassis

    The technical specifications for the Cisco UCS B-Series blade server chassis include number of rack

    units, maximum number of blades, unified fabric capability, midline I/O bandwidth per server, and

    number of I/O bays for FEXs.

    Table 21 lists the Cisco UCS B-Series blade server chassis options.

    Table 21) Cisco UCS B-Series blade server chassis options.

    Component Cisco UCS 5100 Series Blade Server Chassis

    Rack units 6

    Maximum full-width blades 4

    Maximum half-width blades 8

    Capable of unified fabric Yes

    Midplane I/O Up to 80Gbps of I/O bandwidth per server

    I/O bays for FEXs Two bays for Cisco UCS 2104XP, 2204XP, and 2208XP FEXs

    For more information, see the Cisco UCS 5100 Series blade server chassis datasheet.

    15.2 Cisco UCS B-Series Blade Servers

    The technical specifications for the Cisco UCS B-Series blade server include number of processor

    sockets, processor support, memory capacity, size, speed, SAN boot support, number of mezzanine

    adapter slots, I/O maximum throughput, form factor, and maximum number of servers per chassis.

    Table 23 and Table 23 list the Cisco UCS B-Series blade server options.

    Table 22) Cisco UCS B-Series blade server M5 options.

    Component Cisco UCS B200-M5

    Number of processor sockets 2

    Processor support Intel Xeon Scalable processors

    Memory capacity 24 DIMMs for a maximum of 3072GB

    Maximum memory size and speed 16, 32, 64 and 128GB DDR4; 2666MHz

    SAN boot support Yes

    Mezzanine I/O adapter slots 2, front and rear, including GPU support

    I/O maximum throughput 80Gbps

    Form factor Half width

    Maximum servers per chassis 8

    http://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-5100-series-blade-server-chassis/data_sheet_c78-526830.html

  • 27 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Table 23) Cisco UCS B-Series blade server M4 options.

    Component Cisco UCS B200-M4 Cisco UCS B420-M4

    Number of processor sockets 2 4

    Processor support Intel Xeon E5-2600 v3 Intel Xeon E5-4600

    Memory capacity 24 DIMMs for a maximum of 768GB 48 DIMMs for a maximum of 3TB

    Maximum memory size and speed 8, 16, and 32GB DDR4; 2133MHz 2133MHz DDR4

    SAN boot support Yes Yes

    Mezzanine I/O adapter slots 1 3

    I/O maximum throughput 80Gbps 160Gbps

    Form factor Half width Full width

    Maximum servers per chassis 8 4

    Table 24 lists additional Cisco UCS B-Series blade server options.

    Table 24) Cisco UCS B-Series blade server datasheets.

    Component Cisco UCS Datasheet

    Cisco UCS B200 M5 Cisco UCS B200 M5 blade server

    Cisco UCS B200 M4 Cisco UCS B200 M4 blade server

    Cisco UCS B420 M4 Cisco UCS B420 M4 blade server

    15.3 Cisco UCS C-Series Rack-Mount Servers

    The technical specifications for the Cisco UCS C-Series rack-mount servers include processor

    support, maximum memory capacity, number of PCIe slots, and size of the form factor.

    Table 25 and Table 26 list the Cisco UCS C-Series rack-mount server options.

    Table 25) Cisco UCS C-Series M5 rack-mount server options.

    Component Cisco UCS C240 M5

    Processor support 1 or 2 Intel Xeon Scalable processors

    Maximum memory capacity 3072GB

    PCIe slots 6

    Form factor 2 RU

    Table 26) Cisco UCS C-Series M4 rack-mount server options.

    Component Cisco UCS C220 M4 Cisco UCS C240 M4 Cisco UCS C460 M4

    Processor support 1 or 2 Intel Xeon E5-2600 V3

    1 or 2 Intel Xeon E5-2600 v3 series

    2 or 4 Intel Xeon E7-8800/4800

    Maximum memory capacity

    768GB 768GB 2TB

    PCIe slots 2 6 10

    https://www.cisco.com/c/dam/en/us/products/collateral/servers-unified-computing/ucs-b-series-blade-servers/b200m5-specsheet.pdfhttp://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-b200-m4-blade-server/datasheet-c78-732434.htmlhttp://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-b420-m4-blade-server/datasheet-c78-734584.html

  • 28 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Component Cisco UCS C220 M4 Cisco UCS C240 M4 Cisco UCS C460 M4

    Form factor 1 RU 2 RU 4 RU

    Table 27 lists the Cisco UCS C-Series rack-mount server datasheets.

    Table 27) Cisco UCS C-Series rack-mount server datasheets.

    Component Cisco UCS Datasheet

    Cisco UCS C240 M5 Cisco UCS C240 M5 rack server

    Cisco UCS C220 M4 Cisco UCS C220 M4 rack server

    Cisco UCS C240 M4 Cisco UCS C240 M4 rack server

    Cisco UCS C460 M4 Cisco UCS C460 M4 rack server

    15.4 Cisco UCS VIC Adapters for Cisco UCS B-Series Blade Server

    The technical specifications for the Cisco UCS virtual interface card (VIC) adapters for Cisco UCS B-

    Series blade servers include number of uplink ports, performance per port (IOPS), power, number of

    blade ports, hardware offload, and single root input/output virtualization (SR-IOV) support.

    All currently validated FlexPod architectures use a Cisco UCS VIC. Other adapters are supported if

    they are listed in the NetApp IMT and are compatible with your deployment of FlexPod, but they may

    not deliver all features outlined in corresponding reference architectures.

    The following tables list the Cisco VIC adapters.

    Table 28) Cisco UCS VIC adapters (1).

    Component Cisco UCS 1387 VIC

    Cisco UCS 1385 VIC

    Cisco UCS 1340 VIC

    Cisco UCS 1380 VIC

    Uplink ports 2 x 40Gbps FCoE 2 x 40Gbps FCoE Dual 4 x 10Gbps or 2 x 40Gbps FCoE

    Dual 4 x 10Gbps or 2 x 40Gbps FCoE

    Performance (per port)

    40xGbps line rate 40xGbps line rate 40xGbps line rate 40xGbps line rate

    Power 17W 14W 12W 12W

    Blade ports 256 virtual interfaces (Ethernet and FC)

    256 virtual interfaces (Ethernet and FC)

    256 virtual interfaces (8 reserved for internal use)

    256 virtual interfaces (8 reserved for internal use)

    Hardware offload FCoE FCoE FCoE FCoE

    SR-IOV support Yes Yes Yes Yes

    Table 29) Cisco UCS VIC adapters (2).

    Component Cisco UCS 1225 VIC

    Cisco UCS 1227 VIC

    Cisco UCS 1240 VIC

    Cisco UCS 1280 VIC

    Uplink ports 2 x 10Gbps FCoE 2 x 10Gbps FCoE 4 x 10Gbps FCoE 8 x 10Gbps FCoE

    Performance (per port)

    10Gbps line rate; >600,000 IOPS

    10Gbps line rate; >600,000 IOPS

    10Gbps line rate 10Gbps line rate

    Power 12W 14W 12W 12W

    https://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-c-series-rack-servers/datasheet-c78-739279.htmlhttp://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-c220-m4-rack-server/datasheet-c78-732386.htmlhttp://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-c240-m4-rack-server/datasheet-c78-732455.htmlhttp://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-c460-m4-rack-server/datasheet-c78-730907.htmlhttp://mysupport.netapp.com/matrix

  • 29 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Component Cisco UCS 1225 VIC

    Cisco UCS 1227 VIC

    Cisco UCS 1240 VIC

    Cisco UCS 1280 VIC

    Blade ports 256 virtual interfaces (Ethernet and FC)

    256 virtual interfaces (Ethernet and FC)

    256 virtual interfaces (8 reserved for internal use)

    256 virtual interfaces (8 reserved for internal use)

    Hardware offload FCoE FCoE FCoE FCoE

    SR-IOV support Yes Yes Yes Yes

    Table 30 lists additional Cisco UCS VIC adapters.

    Table 30) Cisco UCS VIC adapters (3).

    Component Cisco UCS 1285VIC

    Uplink ports 2 x 40Gbps FCoE

    Performance (per port) 10Gbps line rate; >600,000 IOPS

    Power 17W

    Blade ports 256

    Hardware offload FCoE

    SR-IOV support Yes

    Table 31 lists the Cisco UCS VIC adapter datasheets.

    Table 31) Cisco UCS VIC adapter datasheets.

    Component Cisco UCS Datasheet

    Cisco UCS 1225 VIC Cisco UCS VIC 1225

    Cisco UCS 1227 VIC Cisco UCS 1227 VIC

    Cisco UCS 1240 VIC Cisco UCS VIC 1240

    Cisco UCS 1280 VIC Cisco UCS VIC 1280

    Cisco UCS 1285 VIC Cisco UCS 1285 VIC

    Cisco UCS 1340 VIC Cisco UCS 1340 VIC

    Cisco UCS 1380 VIC Cisco UCS 1380 VIC

    Cisco UCS 1385 VIC Cisco UCS 1385 VIC

    Cisco UCS 1387 VIC Cisco UCS 1387 VIC

    15.5 Cisco UCS Fabric Interconnects

    The technical specifications for the Cisco UCS fabric interconnects include form factor size, total

    number of ports and expansion slots, and throughput capacity.

    Table 32 lists the Cisco UCS 6300 series fabric interconnect options.

    Table 32) Cisco UCS 6300 series fabric interconnect options.

    Component Cisco UCS 6332 Cisco UCS 6332-16UP Cisco UCS 6324

    Form factor 1 RU 1 RU Installed in Cisco UCS chassis

    http://www.cisco.com/en/US/products/ps12571/index.htmlhttp://www.cisco.com/c/en/us/products/collateral/interfaces-modules/unified-computing-system-adapters/datasheet-c78-732515.htmlhttp://www.cisco.com/en/US/prod/collateral/modules/ps10277/ps12377/data_sheet_c78-699459.htmlhttp://www.cisco.com/en/US/prod/collateral/ps10277/ps11551/data_sheet_c78-677682.htmlhttp://www.cisco.com/c/en/us/products/collateral/interfaces-modules/unified-computing-system-adapters/datasheet-c78-731601.pdfhttp://www.cisco.com/c/en/us/products/collateral/interfaces-modules/ucs-virtual-interface-card-1340/datasheet-c78-732517.htmlhttp://www.cisco.com/c/en/us/products/collateral/interfaces-modules/ucs-virtual-interface-card-1380/datasheet-c78-732516.htmlhttps://www.cisco.com/c/en/us/products/collateral/interfaces-modules/unified-computing-system-adapters/datasheet-c78-734727.htmlhttps://www.cisco.com/c/en/us/products/collateral/interfaces-modules/unified-computing-system-adapters/datasheet-c78-736683.html

  • 30 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Component Cisco UCS 6332 Cisco UCS 6332-16UP Cisco UCS 6324

    Number of ports 32 40 4 unified ports

    1 scalability port

    16 server ports

    Throughput 2.56Tbps 2.43Tbs 500Gbps

    Expansion slots N/A N/A N/A

    Table 33 lists the Cisco UCS 6200 series fabric interconnect options.

    Table 33) Cisco UCS 6200 series fabric interconnect options.

    Component Cisco UCS 6248UP Cisco UCS 6296UP

    Form factor 1 RU 2 RU

    Total ports 48 96

    Number of fixed SFP+ ports 32 48

    Throughput 960Gbps 1.92Tbps

    Expansion slots 1 3

    Table 34 lists the Cisco UCS fabric interconnect datasheets.

    Table 34) Cisco UCS fabric interconnect datasheets.

    Component Cisco UCS Datasheet

    Cisco UCS 6248UP Cisco UCS 6200 Series Fabric Interconnects

    Cisco UCS 6296UP Cisco UCS 6200 Series Fabric Interconnects

    Cisco UCS 6324 Cisco UCS 6324 Fabric Interconnects

    Cisco UCS 6300 Cisco UCS 6300 Fabric Interconnects

    15.6 Cisco Nexus 5000 Series Switches

    The technical specifications for the Cisco Nexus 5000 Series Switches include form factor size, total

    number of ports, and layer 3 module and daughter card support.

    Table 35 lists the Cisco Nexus 5000 Series Switch options.

    Table 35) Cisco Nexus 5000 Series Switch options.

    Component Cisco Nexus 5548UP

    Cisco Nexus 5548P

    Cisco Nexus 5596UP

    Cisco Nexus 5672UP

    Cisco Nexus 56128P

    Form factor 1 RU 1 RU 2 RU 1 RU 2 RU

    Maximum ports 48 48 96 72 128

    Fixed ports 1/10Gb and FCoE

    32 32 48 48 48

    Maximum support for FEX modules

    24 24 24 24 24

    Maximum 1/10Gb and FCoE ports

    48 48 96 72 128

    http://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-6200-series-fabric-interconnects/data_sheet_c78-675245.htmlhttp://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-6200-series-fabric-interconnects/data_sheet_c78-675245.htmlhttp://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-6300-series-fabric-interconnects/datasheet-c78-732207.htmlhttp://www.cisco.com/c/en/us/products/collateral/servers-unified-computing/ucs-6300-series-fabric-interconnects/datasheet-c78-736682.html

  • 31 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Component Cisco Nexus 5548UP

    Cisco Nexus 5548P

    Cisco Nexus 5596UP

    Cisco Nexus 5672UP

    Cisco Nexus 56128P

    Layer 3 daughter card supported

    Yes Yes No N/A N/A

    Layer 3 module supported

    No No Yes Yes Yes

    Table 36 lists the Cisco Nexus 5000 Series Switch datasheets.

    Table 36) Cisco Nexus 5000 Series Switch datasheets.

    Component Cisco Nexus Datasheet

    Cisco Nexus 5548UP Cisco Nexus 5548UP switch

    Cisco Nexus 5548P Cisco Nexus 5548P switch

    Cisco Nexus 5596UP (2U) Cisco Nexus 5596UP switch

    Cisco Nexus 56128P Cisco Nexus 56128P switch

    Cisco Nexus 5672UP Cisco Nexus 5672UP switch

    15.7 Cisco Nexus 7000 Series Switches

    The technical specifications for the Cisco Nexus 7000 Series Switches include form factor size and

    maximum number of ports.

    Table 37 lists the Cisco Nexus 7000 Series Switch options.

    Table 37) Cisco Nexus 7000 Series Switch options (1).

    Component Cisco Nexus 7004 Cisco Nexus 7009 Cisco Nexus 7010 Cisco Nexus 7018

    Form factor 7 RU 14 RU 21 RU 25 RU

    Maximum 1 or 10GbE ports

    96 336 384 768

    Maximum 40GbE ports 12 42 48 96

    Maximum 100GbE ports 4 14 16 32

    Table 38 lists the additional Cisco Nexus 7000 Series Switch options.

    Table 38) Cisco Nexus 7000 Series Switch options (2).

    Component Cisco Nexus 7702 Cisco Nexus 7706 Cisco Nexus 7710 Cisco Nexus 7718

    Form factor 2 RU 9 RU 14 RU 26 RU

    Maximum 1 or 10GbE ports

    48 192 384 768

    Maximum 40GbE ports 24 96 192 384

    Maximum 100GbE ports 12 48 96 192

    Table 39 lists the Cisco Nexus 7000 Series Switch datasheets.

    http://www.cisco.com/en/US/products/ps11681/index.htmlhttp://www.cisco.com/en/US/products/ps11215/index.htmlhttp://www.cisco.com/en/US/products/ps11577/index.htmlhttp://www.cisco.com/c/en/us/products/switches/nexus-56128p-switch/index.htmlhttp://www.cisco.com/c/en/us/products/switches/nexus-5672up-switch/index.html

  • 32 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Table 39) Cisco Nexus 7000 Series Switch datasheets.

    Component Cisco Nexus Datasheet

    Cisco Nexus 7004 Cisco Nexus 7000 Series Switches

    Cisco Nexus 7009

    Cisco Nexus 7010

    Cisco Nexus 7018

    Cisco Nexus 7702 Cisco Nexus 7700 Switches

    Cisco Nexus 7706

    Cisco Nexus 7710

    Cisco Nexus 7718

    15.8 Cisco Nexus 9000 Series Switches

    The technical specifications for the Cisco Nexus 9000 Series Switches include form factor size;

    number of supervisor, fabric module, and line card slots; and maximum number of ports.

    The following tables list the Cisco Nexus 9000 Series Switch options.

    Table 40) Cisco Nexus 9500 Series Switch options.

    Component Cisco Nexus 9504 Cisco Nexus 9508 Cisco Nexus 9516

    Form factor 7 RU 13 RU 21 RU

    Supervisor slots 2 2 2

    Fabric module slots 6 6 6

    Line card slots 4 8 16

    10GbE ports Up to 576 Up to 1,152 Up to 2,304

    40GbE ports Up to 144 Up to 288 Up to 576

    Table 41) Cisco Nexus 9300 Series Switch options.

    Component Cisco Nexus 93180YC-EX

    Cisco Nexus 93128TX

    Cisco Nexus 93120TX

    Cisco Nexus 93108TC-EX

    Form factor 1 RU 3 RU 2 2 RU

    100M/ 1GE/10 GE copper ports

    48 96 96 48

    40GbE ports 6 6 or 8 6 6

    100GbE ports 6 4 None 6

    Table 42) Cisco Nexus 9300 Series Switch options (continued).

    Component Cisco Nexus 9396PX

    Cisco Nexus 9372PX

    Cisco Nexus 9364C

    Cisco Nexus 9348GC-FXP

    Cisco Nexus 9336PQ

    Cisco Nexus 9332PQ

    Form factor 2 RU 2 RU 2 RU 2 RU 2 1 RU

    100M/1/10/25 GE ports

    48 1/10 GE 48 1/10 GE N/A N/A None None

    http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9402/ps9512/Data_Sheet_C78-437762.htmlhttp://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9402/data_sheet_c78-728187.html

  • 33 FlexPod Datacenter Technical Specifications 2017 NetApp, Inc. All rights reserved. 2016 NetApp, Inc. All rights reserved.

    Component Cisco Nexus 9396PX

    Cisco Nexus 9372PX

    Cisco Nexus 9364C

    Cisco Nexus 9348GC-FXP

    Cisco Nexus 9336PQ

    Cisco Nexus 9332P