Sun fire x2100 m2 and x2200 m2 technical presentation

Sun Fire X2100/X2200 M2 TechnicalProduct Training Presentation

SunWin Token # 478550

Ronald GrahamSystems Group Technical MarketingSun Microsystems

Sun Confidential : Sun/Partners Use Only2

Agenda

• Introduction and Positioning• Server Architecture

> Sun Fire X2200> Sun Fire X2100> Enabling Technologies

• Embedded Light Out Management • Operating Systems• System and Upgrade Options


Ultra 40Ultra 40 Ultra 20Ultra 20

Sun Fire X4150Sun Fire X4150

Sun FireSun FireX4500X4500X4540X4540

Sun FireSun FireX4200X4200X4100X4100


Sun Blade 8000Sun Blade 8000

Sun’s x64 System PortfolioSun GridSun Grid

Rack SystemRack System


NewNew Hybrid Data

Server

First & Only8-socket/16-way

AMD Server

Systems Refresh Throughout 2008

Voted“Best Enterprise

Server”InfoWorldInfoWorld

Voted“Best High Perf

Server”InfoWorldInfoWorld Sun Fire Sun Fire

X4600X4600



Sun Fire X4140Sun Fire X4140X4240X4240






Sun Fire Features SummaryFeatures Sun Fire X2100 M2 Sun Fire X2200 M2

Form Factor 1U 1U

Processor

BIOS AMI BIOS AMI BIOSMemory DIMM slots 4 DIMM slots 8 DIMM slots per CPUMemory Types DDR-2 667MHz Registered DIMMs with ECCMemory Module Sizes 512MB, 1GB, 2GB DIMMs 1GB,2GB, 4GB DIMMsMax Memory 8 GB 64 GB

HDD Controller

HDD Type 3.5-inch drives 3.5-inch drivesHDD Number 2 HDDs 2 HDDsOptical Drive DVD-ROM DVD-ROM

NIC Controller

NICs Four Gigabit Ethernet NICs Four Gigabit Ethernet NICsGraphics Controller AST2000 AST2000

Expansion Slots

Front I/O Six USB 2.0 ports Six USB 2.0 ports

Rear I/O

Power supply Single 345Watt Single 450Watt

Systems ManagementOS Support Solaris, Linux and Windows

1x Dual-Core AMD Opteron processor Model 1200 CPUw/ 1MB L2 Cache per Core

Up to 2 Dual-Core or Quad-Core AMD Opteron 2000 series processors w/ 4x 128 KB L1, 4x 512 KB L2, and 2MB or 6MB of shared L3 Cache

DDR-2 667MHz Un-bufferred DIMMs with ECC

Integrated Nvidia MCP55Serial ATA II

Integrated Nvidia MCP55Serial ATA II

Dual Integrated nVidia MCP55Broadcom BCM5715C

Dual Integrated nVidia MCP55Broadcom BCM5715C

Two PCI-E x8 Slots(or One PCI-E x16 Slot by optional Riser Q4CY06)

Two PCI-E x8 Slots(or One PCI-E x16 Slot by optional Riser Q4CY06)

Four Gigabit Ethernet ports (RJ45)One RS-232 Serial (DB9)

Four USB 2.0 ports (Type A)VGA Video port (HD15)

Four Gigabit Ethernet ports (RJ45)One RS-232 Serial (DB9)

Four USB 2.0 ports (Type A)VGA Video port (HD15)

Service Processor supporting Graphics redirection, Remote Floppy/CD/DVD, IPMI 2.0, SNMP, CLI and Web interface

Service Processor supporting Graphics redirection, Remote Floppy/CD/DVD, IPMI 2.0, SNMP, CLI and Web interface

Solaris, Linux, Windows, and VMware


Agenda



• Embedded Light Out Management • Operating Systems• System Options


One of the Industry's Fastest 2-socket Server for processing memory-intensive applications

Ideal for Web Infrastructure, HPC, Simulations, Financial Modeling

Excellent for EDA

Compute● Dual- or Quad-Core● 1 or 2 AMD Opteron™ 2000 series processors● 1U-rackmount● Up to 64GB with 16 DIMM Slots (4 GB DIMMs)

I/O● 2 x 8-lane PCI Express slots (Optional 1 x 16-Lane) ● 4 x GigE standard, USB 2.0, Video, Serial ports● DVD● Up to 2 TB of storage with 2 x SATA 3.5” disk drives

Availability● Hot-pluggable disk● RAID 0 or 1 (Optional)

Management● Embedded LOM Service Processor● Remote power on/off/status, GUI+CLI, IPMI 2.0, SNMP● Remote KVM, Floppy/CDROM

Operating Environment● Solaris, Linux, Windows, Vmware

Sun Fire X2200 M2

The 1U Server Workhorse


Sun Fire X2200 M2 System Layout


X2200 Architectural Block DiagramSATA II only

Marvell88E1121

PHY

Marvell88E1121

PHY

PCI 32bit/33MHz

USB 2.0USB 2.0

4 x USB 2.0

BCMNIC 0

nVidia NIC 1

BCMNIC 1

nVidia NIC 0

Serial

VGAVideo

Front PanelUSB Ports

UltraATA 1332 x USB 2.0

SATA II 3.0Gb/sSATA II 3.0Gb/s

Tray LoadDVD ROM

RearVGA

HD15

SerialPortDB9

RearUSB

Ports

UMPPort

SharedELOM NIC

Port

HT bus (8GB/s)

HT bus(8GB/s) DDR-2

5.3GB/s

DDR-25.3GB/s

DDR-25.3GB/s

DDR-25.3GB/s

Dual x8 PCI-E RiserorSingle x16 PCI-E Riser

MCP55MCP55

x16 PCI-E bus (4GB/s)

3.5”SATADisk Drive


8DDR-2DIMMSSlots

8DDR-2DIMMSSlots

AMD Opteron 2000Series CPU


SuperIOLegacyDevice

BIOSFLASHPROM

LPC bus

nVidiaNIC 0

nVidiaNIC 1

x4 PCI-E bus (1GB/s)FrontPanel

RearPanel


X2200 Architectural Block DiagramHBA – SATA II or SAS

Marvell88E1121

PHY

Marvell88E1121

PHY

PCI 32bit/33MHz

USB 2.0USB 2.0

4 x USB 2.0

BCMNIC 0

nVidia NIC 1

BCMNIC 1

nVidia NIC 0

Serial

VGAVideo



SATA II or SAS

SATA II or SAS

Tray LoadDVD ROM

RearVGA

HD15

SerialPortDB9

RearUSB

Ports

UMPPort

SharedELOM NIC

Port

HT bus (8GB/s)

HT bus(8GB/s) DDR-2

5.3GB/s

DDR-25.3GB/s

DDR-25.3GB/s

DDR-25.3GB/s

Single x16 PCIe RiserorDual x8 PCIe Riser

MCP55MCP55


3.5”SATA or SAS Disk Drive

3.5”SATA or SAS Disk Drive

8DDR-2DIMMSSlots

8DDR-2DIMMSSlots



SuperIOLegacyDevice

BIOSFLASHPROM

LPC bus

nVidiaNIC 0

nVidiaNIC 1

x4 PCIe bus (1GB/s)FrontPanel

RearPanel

HBA


Sun Fire X2200 M2 Internals TourPCI-ExpressRiser Area

BroadcomNICs

Power Supply

Memory/PCI FansCPU0 & 8x Memory Slots

Nvidia NICs& USB ports

Disk 0

Dual CPU/memory Blowers

CD/DVDDrive

Disk 1

Front PanelPCB

Embedded SP

Serial & Video ports

nVidia MCP55

CPU1 & 8x Memory Slots


Sun Fire X2200 M2 Motherboardx16 PCI-Express

Riser Slot

Broadcom BCM5715 NIC

CPU 0


Embedded Lights OutManager (SP)


nVidia MCP55

CPU 1,8 x Memory DIMM Sockets

CPU 1

CPU 0,8 x Memory DIMM Sockets


Sun Fire X2200 Processors

Special EditionSE

Standard Parts

High EfficientHE

TDP ACP105W137W

TDP ACP 75W 115W

TDP ACP 55W 79W

TDP ACP105W120W

TDP ACP 75W 95W

TDP ACP 55W 68W

TDP – Thermal Design Power ACP – Average CPU Power

Second Generation Third GenerationSanta Rosa Socket F Barcelona/Shanghai

Dual-Core Quad-Core


AMD Model Number Overview4 digit AMD Opteron Processor Model - 1234

Model Number communicates scalability, generation and relative performance● 1st digit communicates scalability -- represents maximum number of processors supported

● 1-socket AMD Opteron processor = 1000 Series, Model 1xxx● 2-socket AMD Opteron processor = 2000 Series, Model 2xxx● 8-socket AMD Opteron processor = 8000 Series, Model 8xxx

● 2nd digit represents the generation of AMD Opteron processor● Model 2216 is 2nd generation [DDR2, Dual-Core, Socket F (1207)] & 2-Socket capable● Model 2356 is 3rd generation [DDR2, Quad-Core, Socket F (1207)] & 2-Socket capable● Third generation includes Barcelona and Shanghai

● 3rd and 4th digits communicate relative performance within product line● For example, Model 8216 would offer

● Better performance than a Model 8212● Lower performance than a Model 8220

• Continued Drop-in Upgradeability Investment protection

• Shanghai Model numbers• 8/2376 (2.3GHz) 8/2378 (2.4GHz), • 8/2380 (2.5GHz) 8/2382 (2.6GHz)• 8/2384 (2.7GHz)


Enhancements in Shanghai

2MB of L3 cache 6MB of L3 cacheBetter performance

New in Shanghai

65nm Technology45nm Technology

Immersion LithographyBetter clock speed scaling

AMD Balanced Smart CacheAMD Smart Fetch

Allows cores to sleep whilestill providing full cache access

HyperTransport 1.0 @2GT/s (8GB/s)

HyperTransport 3.0 @4.4GT/s (17.6GB/s)

Available Spring '09 (not all platforms)

AMD CoolCore Technology Extends power savings to L3 cache(L3 powered down when not in use)

AMD-V withRapid Virtualization Indexing

Designed for 25% fast “world switch” timeEnhanced Rapid Virtualizaton Indexing

(More Virt-Phys translation held in cache)

Quad-Core AMD Opteron Features“Barcelona”

2MB of L3 cache 6MB of L3 cacheBetter performance

65nm Technology45nm Technology

Immersion LithographyBetter clock speed scaling

AMD Balanced Smart CacheAMD Smart Fetch

Allows cores to sleep whilestill providing full cache access

AMD CoolCore Technology Extends power savings to L3 cache(L3 powered down when not in use)


AMD Balanced and Smart Cache

Integrated Memory Controller

Cache

Control

512KB

Core 4

128KB

Cache

Control

512KB

Core 3

128KB

Cache

Control

512KB

Core 2

128KB

Cache

Control

512KB

Core 1

128KB

New 6MB

• Dedicated L1 AMD’s 64KB/64KB vs. Intel’s 32KB/32KB Allows 2 loads per cycle versus their one Latency 3 cycles to L1

• Dedicated L2 Dedicated cache to eliminate conflicts

common in shared caches Sized to accommodate the majority of

working sets today Latency 12 cycles to L2

• Shared L3 - New Optimized memory use and allocation for

multi-core Non-inclusive victim cache architecture Latency <38 cycles to L3

• Low latency access to external DRAM (<60ns)

• Upon a full cache miss (L1, L2 & L3) data is sub 60ns away

• All memory ranks are the same latency from the CPU


AMD Virtualization™ (AMD-V™)• Faster World Switch - A “world switch” is when CPU control passes from one Guest

OS, to the hypervisor, to another Guest OS (or back to the original one). Faster switching means the CPU can get back to work on running the virtualized application.

• Rapid Virtualization Index works by caching the address translations from Guest Virtual memory to Guest Physical memory to Host Physical memory. To translate between each of these states can require dozens of incremental translations. Shanghai improves Rapid Virtualization Indexing over Barcelona by caching more of these incremental address translation steps.

● BenefitsVirtualization at hardware level

supports more users while offering best performance

Vmware support in 3.5 Update 1Xen support today

120

VM

VM

VM

VM

VM

VM

VM

VM

VM

VM

VM

VM

Local

LocalLocal

Local

Home

Node

Home

Node

Home

Node

Home

NodeRemote

RemoteRemote


Dual Dynamic Power Management Compatibility Mode

● Today’s AMD Opteron™ processor use a unified voltage plane for the Memory Controller and Core

● Quad-Core processors can work in unified plane motherboards but they will not offer the benefits of Dual Dynamic Power Management (DDPM) described below

Dual Dynamic Power Management

● The power for the CPU and Memory Controller from independent voltage supplies, offering greater performance and better power management

● Second-Generation AMD (Rev F) Opteron processors are compatible with motherboards designed to support DDPM but they will deliver the same voltage to the CPU and Memory Controller power

Unified PowerSupply

2.0 GHz

1.6 GHz

System Request Queue

Crossbar

Hypertransport

MemoryController Memory Controller

Power

CPU Power

2.0 GHz

1.8 GHz

System Request Queue

Crossbar

Hypertransport

MemoryController

AMD-V Extended Migration• Vmware Enhanced Vmotion (EVC) support

– Version 3.5 update 2

• Better Vmotion and CPU compatibility• Vmotion technology allows users to migrate running virtual machines

between compatible physical servers with zero downtime– Automatically mask to disable features (SSE4.1)

Cache

Control

Rev ESingle-Core Dual-Core

2005 2006 2007 2008 2009 >2010

EVC support for AMD Opteron processorsstarts with Rev E for 2 Socket, 4 socket, and 8 socket Servers

Rev F

“Barcelona”

“Shanghai”

Future Processors


AMD Smart Fetch Technology

• Reducing power and increase performance> Reduces cache probes

which can increase performance for non-halted cores

> Flushes its L1 & L2 caches (to L3) and sets a flag so other cores know it doesn’t have any data that they need

IDLE MHz

75%

IDLE MHzCORE 0 CORE 1

35%

IDLE MHz

10%


0

Shanghai Quad-CoreShanghai Quad-Core

IDLE MHz

75%


35%

IDLE MHz

10%


1%

Barcelona Quad-CoreBarcelona Quad-Core

Clock can be significantly reduced but has to be ready to increase frequency in the event of a cache

request

Other cores are informed that it doesn’t

have any data.

Clock can be completely turned off


Agenda





One of the Most Energy-Efficientand Highest Performing

2-way Server at a Great Price

Ideal for Web Infrastructure, HPC, Simulations, Financial Modeling

Excellent for Life Sciences

Compute● 1-socket 2-way server (Dual Core only)● AMD Opteron™ processor Model 1200● 1U-rackmount● Up to 8 GB of memory with 4 DIMM Slots

I/O● 2 x 8-lane PCI-Express slots (1 x 16-Lane) ● 4 x GigE standard, USB 2.0, Video, Serial ports● DVD● SAS or SATA II Drives● Up to 2 TB of storage with 2 x SATA 3.5” disk drives

Availability● Hot-pluggable disk● RAID 0 or 1 (Optional)

Management● Embedded ILOM Service Processor● Remote power on/off/status, GUI+CLI, IPMI 2.0, SNMP● Remote KVM, Floppy/CDROM

Operating Environment● Solaris, Linux, Windows

Sun Fire X2100 M2

The 1U Server


Sun Fire X2100 M2 System Layout


FrontPanel

RearPanel

X2100 Architectural Block DiagramSATA II

Marvell88E1121

PHY

Marvell88E1121

PHY

PCI 32bit/33MHz

USB 2.0USB 2.0

4 x USB 2.0

BCMNIC 0

nVidia NIC 1

BCMNIC 1

nVidia NIC 0

Serial

VGAVideo



SATA II 3.0Gb/sSATA II 3.0Gb/s

Tray LoadDVD ROM

RearVGA

HD15

SerialPortDB9

RearUSB

Ports

UMPPort

SharedELOM NIC

Port

HT bus (8GB/s)

Dual x8 PCIe RiserorSingle x16 PCIe Riser

MCP55MCP55

x16 PCIe bus (4GB/s)



DDR-25.3GB/s

DDR-25.3GB/s

4DDR-2DIMMSSlots


SuperIOLegacyDevice

BIOSFLASHPROM

LPC bus

nVidiaNIC 0

nVidiaNIC 1

x4 PCIe bus (1GB/s)


FrontPanel

RearPanel

X2100 Architectural Block DiagramHBA – SATA II or SAS

Marvell88E1121

PHY

Marvell88E1121

PHY

PCI 32bit/33MHz

USB 2.0USB 2.0

4 x USB 2.0

BCMNIC 0

nVidia NIC 1

BCMNIC 1

nVidia NIC 0

Serial

VGAVideo



SATA II or SAS

SATA II or SAS

Tray LoadDVD ROM

RearVGA

HD15

SerialPortDB9

RearUSB

Ports

UMPPort

SharedELOM NIC

Port

HT bus (8GB/s)Single x16 PCIe RiserorDual x8 PCIe Riser

MCP55MCP55

x16 PCIe bus (4GB/s)

3.5”SATA orSAS Disk Drive

3.5”SATA orSAS Disk Drive

DDR-25.3GB/s

DDR-25.3GB/s

4DDR-2DIMMSSlots


SuperIOLegacyDevice

BIOSFLASHPROM

LPC bus

nVidiaNIC 0

nVidiaNIC 1

x4 PCIe bus (1GB/s)

HBA


Sun Fire X2100 M2 Internals TourPCI ExpressRiser Area

BroadcomNICs

Power Supply

PCI Fan*CPU & 4 x Memory Slots


Disk 1

CPU/memoryBlowers

CD/DVDDrive

Disk 0

Front PanelPCB

Embedded Lights Out Manager (SP)


nVidia MCP55

*Only 1x Fan for PCI Cooling in Final Design


Sun Fire X2100 M2 Motherboard Tourx16 PCI-Express

Riser Slot

Broadcom BCM5715 NIC

CPU


Embedded Lights OutManager (SP)


nVidia MCP55

4 x DIMM Sockets


Agenda





Sun Fire X2100 & X2200 M2 Product TourFront Panel

Hot Swappable Disks

Optional CD/DVD Drive

Dual USB 2.0Ports

Power ButtonSystem LED

Service/FaultLED

LocateButton/LED


Sun Fire X2100 & X2200 M2 Product TourRear Panel Dual x8 PCI-Express

Slotsor

One x16 PCI-Express Slot

VGA VideoHD15 port

Quad USB 2.0Ports

Dual nVidiaGbE ports

SystemLED

Service/FaultLED

LocateLED

Serial DB9 portDual

BroadcomGbE ports

Power Supply(X2100 has no

visible Fan)


Sun Fire X2100 & X2200 M2 Product Tour Rear Ports and Ethernet Port naming

VGA VideoHD15 port

Quad USB 2.0Ports

Dual nVidiaGbE ports

Serial DB9 port

Dual BroadcomGbE ports

OS Solaris RHEL3u8 RHEL4u4 WindowsPort 0 BGE0 Eth0 Eth2 NETPort 1 BGE1 Eth1 Eth3 NET

OS Nvidia Port 0 Nvidia Port 1Solaris Nge0 Nge1

RHEL3 u8 Eth2 Eth3RHEL4 u4 Eth0 Eth1

Windows 2K3 Net Net1

00 10

1

Lower left Broadcom port isshared with the SP via the

BCM5715 UMP port.Allows the SP to have a

separate MAC and IP addressand does not affect the main

systems use of the port.

(SP Net)


Sun Fire X2100/X2200 M2 Components Tour PCI Express Riser Card

PCI-Express riser card is toolessRiser is removed from the chassis to insert PCI cards.

A dual x8 PCIe riser is standard with optional single x16 PCIe

Riser accommodates Low Profile, Half Length cardsSun Fire X2200 takes 6.5” (160mm) long cards

Cards restricted to 25Watts TOTAL power consumption


Sun Fire X2100 & X2200 M2 Components Tour Power Supplies

Sun Fire X2200 Power Supply

Rated at 450 Watts110/220VAC Single Input Auto Ranging/Sensing

50/60HzTwo Fans

No RedundancyCRU, (Requires a Philips Screwdriver)

Sun Fire X2100 Power Supply

Rated at 340 Watts110/220VAC Single Input Auto Ranging/Sensing

50/60HzSingle Fan

No RedundancyCRU, Requires a Philips Screwdriver

Uses an adapter bracket to fit System Chassis


Sun Fire X2100 & X2200 M2 Components Tour Disk and Optical Drives

Sun Fire X2100 & X2200 M2 hard Disk Drives3.5” SATA Drives, 250GB, 500GB, 750GB, and 1 TB 7200 rpm

3.5” SAS Drives, 146GB, 300 GB 15,000 rpm3.0Gbps for SATA-II and SAS drives

Hot Plug, Easily installed from the front of the system

System requires Blanks if no drive installed in a slotNo Disks in Standard Config

Sun Fire X2100 & X2200 M2 DVD Drives

DVD ROM (Option X8082A)Conventional ATA-133 interface

No Drive in Standard Config


Buffered vs. Unbuffered DIMMsaka. Registered vs. Un-registered– Registered DIMMs have additional registers placed

between the CPUs and DIMMs• Improves signal integrity, allowing longer traces and larger,

more reliable memory subsystems• Up to 4GB per DIMM slot• 8 DIMM slots per CPU• Sun Fire X2200 M2 w/AMD Opteron 2000 Series CPU

– Unbuffered DIMMs do not have these registers• Lower cost and slightly higher performance• Up to 2GB per DIMM slot, 4 DIMM slots• Sun Fire X2100 M2 w/AMD Opteron 1200 Series CPU


Single/Dual/Quad Ranked DIMM LimitsX2200 Limitations• All DIMMS are Ranked, a Rank is a data area created

using some or all of the chips on the DIMM– All ranks are 64 bits wide(+8 bits of ECC)– DIMMS can contain one, two or four Ranks– Each Rank requires a set of control lines– Column Address Strobe (CAS) particularly

• 8 DIMM/Socket systems don't have sufficient CAS lines to satisfy QUAD ranked DIMMS in all slots

– Limits us to 4 Quad Ranked DIMMS– Currently available 4GB DIMMS are all quad ranked– 4GB DIMMS are dual ranked

• If more than 4 Dual/Quad Ranked DIMMS are populated per CPU, require clocking of the DDR2 busses are clocked down from 667 MHz to 533 MHz


Sun Fire X2100/X2200 M2 ComponentsnVidia MCP55Pro Chipset Features Used

MCP55ProMCP55Pro

• Highly integrated Single Chip Core Logic• 1GHz HyperTransport Link x16 up/down

> 8GB/s full speed transfer rates• 6 independent PCI Express Controllers

> Providing 28 PCI-Express Lanes, 20 Used.• 2 separate SATA-II controllers (1.5/3.0 Gbps)• ATA-133 controller for CD/DVD devices• Dual IEEE 802.3 MACs for 10/100/1000BASE-T• 8 USB 2.0 Ports (2 front/4 rear/2 internal SP)• PCI 33MHz/32bit bus for embedded Video device


nVidia Chipset DetailsPCI Express and PCI legacy

MCP55ProMCP55Pro

• 16 PCI Express Lanes > Depending on the Riser configuration used

> Two x8 PCIe slots (Low profile/Half length)> One x16 PCIe slot (Low profile/Half length)

• 4 PCI Express Lanes used internally for the additional Broadcom Dual Port Ethernet Controller

• One PCI 33MHz/32Bit bus dedicated to AST2000 embedded Graphics and Management device


nVidia Chipset DetailsnVidia SATA Controllers

MCP55ProMCP55Pro

• Two independent SATA-II controllers> One controller is dedicated to each drive> Each controller is capable of 1.5 or 3.0Gbps

per direction per channel> Supports Native Command Queueing> Supports Tagged Command Queueing> Supports hot plug (with OS dependencies)

> Support RAID 0 or 1 and JBOD (with OS dependencies)


nVidia SATA Drivers

MCP55ProMCP55Pro

• Solaris> Included in Solaris 10 update 3> Available as a patch for Solaris 10 06/06

• Linux> RHEL3U7 and RHEL4U3 already have nv_sata driver

> More optimized driver provided on the Tools and Drivers CD> Also available for download from nVidia.com

> SuSE 9 SP3 requires drivers from the Tools and Drivers CD• Windows 2003 Server

> Default drivers supported> Drivers provided on the Tools and Drivers CD (also from nVidia)

• VMware ESX 3.x


nVidia Chipset DetailsnVidia Network Controllers

MCP55ProMCP55Pro

• Two independent IEEE 802.3 MACs• Auto-Negotiation and Duplex settings

through an external dual port Marvell 88E1121 PHY

• Supports JUMBO frames (up to 9018 bytes)• 10/100 Mb/s Full or Half Duplex• 1000 Mb/s Full Duplex only• Supports NIC Teaming and failover (with OS

dependencies)


nVidia Network Drivers

MCP55ProMCP55Pro

• Solaris> Included in Solaris 10 update 3> Available as a patch for Update 2(06/06)

• Linux> RHEL3U7 and RHEL4U3, install from Tools and Drivers CD

> Also available for download from nVidia.com> SuSE 9 SP3 requires drivers from the Tools and Drivers CD

• Windows 2003 Server> Drivers provided on the Tools and Drivers CD

> Also available for download from nVidia• VMware ESX 3.X

> Support from VMware post GA


Agenda





Embedded LOM Service ProcessorASPEED AST2000

PCI 32bit/33MHz

USB 2.0USB 2.0

BCMNIC 1

Serial

VGAVideo

RearVGA

HD15

SerialPortDB9

UMPPort

Shared SPNIC port

MCP55MCP55

SuperIOLegacyDevice

BIOSFLASHPROM

LPC bus


• Provides all Remote Administration functionality> WebGUI> Remote RKVMS facility> CLI (DMTF SMASH CLP)> SSH or Serial access to CLI> IPMI 2.0> SNMP v1,v2c,v3

• Shares access to the systems Serial port, switch using commands and hot key sequences, > start /SP/AgentInfo/console and the key sequence 'ESC )'

• Shares access to one of the Broadcom NICs using the UMP port feature of the BCM5715 Ethernet Controller.> Has a unique MAC and IP address, different from the OS MAC and IP.

• AST2000 also provides the systems VGA video device using either the AST2000 video driver in Xorg (or the VESA driver), Windows Driver supplied on the Tools and Drivers CD


Embedded LOM Service ProcessorUMP Shared NIC

BCMNIC 1

UMPPort

Shared SPNIC port

x4 PCIe

• AST2000 shares access to the bottom Broadcom ethernet port• The BCM5715 UMP Port acts like a dedicated 10/100 MAC• Providing a Unique MAC and IP address for the UMP port• BMC connects to this UMP MAC at 100Mbps Full Duplex and can inject BMC ethernet traffic

into the main server ethernet stream.• BCM5715 filters and passes on traffic from the main ethernet PHY• Main PHY/MAC can operate at 10/100/1000 and BMC traffic is seamlessly injected

> May Cause issues with critical 'heartbeat' or NIC teaming applications, still in testing

10/10

0/100

0 MAC

Giga

bit P

HY

RXTX

UMP

10/10

0 MAC

TXRX

10/10

0 MAC

RXTX

RX Packets

InternetUMP Command

Processing BMC

TX Packets

PCIe x4 Interface

BCM5715C

UMP

Inter

face


Embedded LOM Service ProcessorInitial Setup• The SP by default 'owns' the serial port• At system power will see the SP boot• Once booted, SP presents a CLI login• Login 'root', default password is 'changeme'• Issue the 'show /SP/AgentInfo/Network' command to determine

SP IP address (DHCP or static)> By default SP will attempt to obtain a DHCP lease, if no lease

is granted after 5 seconds, SP will default to 192.168.1.2/24• Change the IP address using either

> 'set /SP/AgentInfo IpAddress=<new_iP>' for static IP or> 'set /SP/AgentInfo DhcpConfigured=enable' for DHCP IP

• IP changes occur immediately, you may need to reconnect


Embedded LOM Service ProcessorSerial Port Changes• The SP by default 'owns' the serial port• On power application to the server, the

SP can be seen booting on the serial line• Serial port can be configured to show either

the SP CLI or BIOS redirection over serial• Default is selectable from the SP CLI or through the BIOS setup

> SP CLI can be switched to the BIOS/System serial output by > 'start /SP/AgentInfo/console'> Switch back by issuing the key sequence 'ESC' then 'Shift-9'

> Enter the BIOS setup, navigate to the Advanced -> IPMI 2.0 Configuration -> External COM Port screen, change to 'BMC' or 'System'

• NOTE: SP CLI times out after 30 seconds, back to the login prompt


Embedded LOM Service ProcessorWeb GUI

• Access via HTTP via SP IP address• Auto Redirects over HTTPS• User Authenticates by Local or ADS• 8 Users/Roles definable• Requires opening of Firewall Ports

80, 443, 22, 69, for Web GUI and SSH, TFTP (firmware updates)

• RKVMS requires ports 8890, 9000, 9001, 9002, 9003

• Provides a simple GUI• Mini Snapshot of current desktop• Sun Java 1.5+ Browser plugin

required• Simple status screen• Expandable stacked buttons for

functions• Button to Launch RKVMS Java

WebStart Client

• Expand buttons to access next level of function

• Output from function displayed in lower frame

• Three buttons for > System Summary> User Control> Setup


Embedded LOM Service ProcessorWeb GUI Status Page

• Start the RKVMS with the Launch button next to the Snapshot image

• Java WebStart Applet Provides all RKVMS functions

• Requires Sun Java 1.5+ installed on Client system and Browser Plugin Installed


Embedded LOM Service ProcessorWeb GUI RKVMS – System OS booted

• Scalable/Re-sizeable Graphics window

• Up to 1600x1200 resolution

• Live interaction with system Desktop

• Mount virtual DVD/CD/Floppy devices or ISO images as USB 2.0 local devices


Embedded LOM Service ProcessorWeb GUI RKVMS - System In BIOS setup

• Remote Installation• Interact with BIOS

screens• Issue 'Special' key

sequences (Ctrl-Alt-Del, etc)

• Secure (encryption options)

• Quality/bandwidth options


Embedded LOM Service ProcessorDMTF SMASH CLI Examples

Username: rootPassword: ********

Sun(TM) Embedded Lights Out Manager

Copyright 2004-2006 Sun Microsystems, Inc.All rights reserved.

Version 0.90

Hostname: SUNSP00C09F000001

IP address: 10.6.160.113

MAC address: 00:C0:9F:00:00:01/SP ->/SP -> show

/SP Targets: AgentInfo SystemInfo User TftpUpdate

Properties:

Target Commands: show cd

/SP ->

Accessible through Serial line or via SSH to the SP IP address

Power on the system with the commandset /SP/SystemInfo/CtrlInfo PowerCtrl=on

Power the system off with the commandset /SP/SystemInfo/CtrlInfo PowerCtrl=off

Reset the system with the commandset /SP/SystemInfo/CtrlInfo PowerCtrl=reset

Rexamine and set the SP IP address..show /SP/AgentInfoset /SP/AgentInfo/ IpAddress=10.6.160.114set /SP/AgentInfo/ NetMask=255.255.252.0set /SP/AgentInfo/ Gateway=10.6.163.254


Embedded LOM Service ProcessorIPMI 2.0 and SNMP, and CLI PEF

Username: rootPassword: ********


Copyright 2004-2006 Sun Microsystems, Inc. All rights reserved.

Version 0.90

Hostname: SUNSP00C09F000001

IP address: 10.6.160.113

MAC address: 00:C0:9F:00:00:01

/SP -> show /SP/AgentInfo/SEL

/SP/AgentInfo/SEL Targets:

Properties:

Target Commands: show

Information ,2006/06/14 11:17:57 ,Processor 0 presence detected

Critical ,2006/06/14 13:52:24 ,CPU1 FAN Tach speed is too low(Value=0.000 RPM: Threshold=78.400 RPM)

Information ,2006/06/14 13:52:26 ,CPU1 FAN Tach back to normal

Critical ,2006/06/14 13:59:17 ,PCI FAN0 not present or stop

Information ,2006/06/14 13:59:20 ,PCI FAN0 back to normal

/SP ->

• Accessible one SP has an IP address• IPMI 2.0 standard reference

http://www.intel.com/design/servers/ipmi/

• IPMI management tool available from http://ipmitool.sourceforge.com/usr/sfw/bin/ipmitool

• SNMP v1, v2c and v3 supported• Sun Fire X2200 Embedded Lights-Out

Manager Administration Guidehttp://docs.sun.com Ref. # 819-6588-xx

http://ipmitool.sourceforge.com/


Embedded LOM Service ProcessorHints and Tips...

SUNSP0016365B982B login: rootPassword:login[425]: root login on `ttyS1'


Copyright 2004-2006 Sun Microsystems, Inc. All rights reserved.

Version 1.1

Hostname: SUNSP0016365B982B

IP address: 10.6.160.115

MAC address: 00:16:36:5B:98:2B

System serial number: 0624QC0017

/SP -> show

/SP Targets: AgentInfo SystemInfo User TftpUpdate

Properties:

Target Commands: show cd reset

/SP ->

Firmware is changing rapidly, make sure you have the latest version before logging bugs.

To recover a lost Embedded LOM Password.> Access the system locally with a screen and keyboard> BIOS Setup -> Advanced -> IPMI 2.0 Configuration -> Reset BMC Root

password

My local mouse is not sync'd with the remote mouse on the Remote Console window> Issue the command xset m 1 1> In the remote system desktop> Use the Ctrl-Alt-M key press to initialize the remote mouse to the top left

of the screen.


Agenda





Operating Systems• SuSE SLES 9 SP3

> 64bit supported> Default installs from media> Tools and Drivers CD

updates Video, SATA, Broadcom and nVidia NIC drivers

• Windows 2003 Server> 32 and 64bit> Installs from media> Tools and Drivers CD

updates Video, SATA and NIC drivers

• VMware 3.5> Taurus Support ONLY


Sun Fire Operating Systems

Operating System Dates/CommentsSolaris x64 10u2 and up 64-bitRed Hat Enterprise Linux 3, U8 32-bit, 64-bitRed Hat Enterprise Linux 4, U4 32-bit, 64-bitRed Hat Enterprise Linux 5 32-bit, 64-bitSUSE Linux Enterprise Server 9, SP3 (SLES 9) 64-bitSUSE Linux Enterprise Server 10 (SLES 10) 64-bitWindows Server 2003, Enterprise and Standard Editions, SP1 32-bit, 64-bit

32-bit, 64-bit64-bit

Windows Server 2008, Datacenter, Enterprise and Standard Editions VMware ESX 3.0.2 (Sun Fire X2200 M2 Dual Core only)


Sun Fire Operating SystemsQuad-Core

Operating System Dates/CommentsSolaris x64 10u5 64-bitRed Hat Enterprise Linux 4 U5 32-bit, 64-bitRed Hat Enterprise Linux 5 U1 32-bit, 64-bitSUSE Linux Enterprise Server 9, SP4 (SLES 9) 64-bitSUSE Linux Enterprise Server 10, SP1 (SLES 10) 64-bitWindows Server 2003, Enterprise and Standard Editions, SP1 32-bit, 64-bit

32-bit, 64-bit64-bit

Windows Server 2008, Datacenter, Enterprise and Standard Editions VMware ESX 3.0.2 or ESX 3.5 U1 (Sun Fire X2200 M2 Quad Core only)


Agenda





Standard ConfigurationsSun Fire X2200

A85-A-Z1RU ChassisNo AMD Opteron CPU (2 x 1207-pin L1 Sockets)4 x 10/100/1000 Base-T Ethernet PortsIntegrated 2D Graphics Controller (AST2000/VESA)

No Disk DriveNo DVDNo PCI Riser CardA85-JWZ1-H-2GB-JL8

1 x AMD Opteron 2210 (1.8GHz, Dual Core ,95 Watts)2 x 1GB DIMMS (Registered, ECC DDR2-667)I/O Riser Card with 2 x 8-Lane PCI-Express slotsA85-JFZ2-H-4GB-JL8

2 x AMD Opteron 2214 (2.2GHz, Dual Core ,95 Watts)4 x 1GB DIMMS (Registered, ECC DDR2-667)I/O Riser Card with 2 x 8-Lane PCI-Express slotsA85-JGZ2-H-8GB-JL8

Base Config

AST2000 Integrated Service Processor, IPMI2.0, WebGUI, CLI, SNMP

Entry ConfigBase Config A85-A-Z plus....

Mid ConfigBase Config A85-A-Z plus....

Performance ConfigBase Config A85-A-Z plus....


Standard ConfigurationsSun Fire X2100

Part Number DescriptionA84-GQZ1-H-4GB-JL8 Sun Fire X2100 M2 x64 Server: AMD Opteron Model 1222 dual core processor

(3.0GHz/1MB), 4x 1GB unregistered ECC DDR2-667 memory, no Serials ATA drives, no DVD, 1x PSU, Service Processor, 2x 10/100/1000 Ethernet ports, 6x USB 2.0 ports, 1x I/O riser card with 2x PCI-Express x8 slots, no power cords, order Geo-specific x-option. RoHS-5. Standard Configuration

A84-GPZ1-H-2GB-JL8 Sun Fire X2100 M2 x64 Server: AMD Opteron Model 1220 dual core processor (2.8GHz/1MB), 2x 1GB unregistered ECC DDR2-667 memory, no Serials ATA drives, no DVD, 1x PSU, Service Processor, 2x 10/100/1000 Ethernet ports, 6x USB 2.0 ports, 1x I/O riser card with 2x PCI-Express x8 slots, no power cords, order Geo-specific x-option. RoHS-5. Standard Configuration.

A84-GGZ1-H-4GB-JL8 Sun Fire X2100 M2 x64 Server: AMD Opteron Model 1218 dual core processor (2.6GHz/1MB), 4x 1GB unregistered ECC DDR2-667 memory, no Serials ATA drives, no DVD, 1x PSU, Service Processor, 2x 10/100/1000 Ethernet ports, 6x USB 2.0 ports, 1x I/O riser card with 2x PCI-Express x8 slots, no power cords, order Geo-specific x-option. RoHS-5. Standard Configuration.


Standard ConfigurationsSun Fire X2200 - Dual-Core

Part Number DescriptionHigh Performance Dual Core

A85-JGZ2-H-8GC-JL8

Sun Fire X2200 M2 x64 Server: 2x AMD Opteron Model 2218 dual core processor (2.6GHz/1MB/95W), 4x 2GB registered ECC DDR2-667 memory, No HDD, No DVD-ROM, 1x PSU, Service Processor, 4x 10/100/1000 Ethernet ports, 6x USB 2.0 ports, 1x I/O riser card with 2x PCI-Express x8 slots, no power cords, order Geo-specific x-option. RoHS-5. Standard Configuration.


Standard ConfigurationsSun Fire X2200 – Quad-Core Barcelona

Part Number DescriptionA85-FSZ1-H-4GC-JL8 Sun Fire X2200 M2 x64 Server: 1x AMD Opteron Quad Core Model

2356 quad core processor (2.3 GHz, 2MB L3 cache, 75W ACP), 2x 2GB registered ECC DDR2-667 memory, no drives, 1x PSU, Service Processor, 4x 10/100/1000 Ethernet ports, 6x USB 2.0 ports, 1x I/O riser card with 2x PCI-Express x8 slots, no power cords, order Geo-specific x-option. RoHS-5. Standard Configuration.

A85-FFZ1-H-4GC-JL8 Sun Fire X2200 M2 x64 Server: 1x AMD Opteron Quad Core Model 2354 processor (2.2 GHz, 2MB cache, 75 W ACP), 2x 2GB registered ECC DDR2-667 memory, no drives, 1x PSU, Service Processor, 4x 10/100/1000 Ethernet ports, 6x USB 2.0 ports, 1x I/O riser card with 2x PCI-Express x8 slots, no power cords, order Geo-specific x-option. RoHS-5. Standard

Quad Core HE Config A85-SUZ2-H-8GC-JL8

Sun Fire X2200 M2 x64 Server: 2x AMD Opteron Quad Core Model 2347HE processor (1.9 GHz, 2MB cache, 55 W ACP), 4x 2GB registered ECC DDR2-667 memory, no drives, 1x PSU, Service Processor, 4x 10/100/1000 Ethernet ports, 6x USB 2.0 ports, 1x I/O riser card with 2x PCI-Express x8 slots, no power cords, order Geo-specific x-option. RoHS-5. Standard


Sun Fire X2200 Standard Configurations

CPU Clock Speed DDR2 Memory Memory # of SAS HDD RAID HBA DVD-RW PSUs Part NumberSun Fire X2200 Shanghai Standard Configurations2x 2376 2.3GHz 4x 2GB -667 SR 8GB No HDD No No 1 A85-ZSZ2-H-8GC-JL82x 2384 2.7GHz 4x 2GB -667 SR 8GB No HDD No No 1 A85-ZWZ2-H-8GC-JL8

• 800MHz DIMMs being analyzed• EOL – 1GB memory support• More ATO and less standard configurations• Sun Fire X2100 will not support Shangahi


Sun Fire X2200 Upgrade to Shanghai

Upgrade OptionsCPU X-Option ATO Date

AMD Opteron 2376 (2.3GHz/512KB, 75W ACP Quad Core) X5334A 5334A Dec-2008AMD Opteron 2384 (2.7GHz/512KB, 75W ACP Quad Core) X5335A 5335A Dec-2008

New 4GB Memory X-Option ATO Date8GB DDR2-667 Registered ECC Memory (2x4GB) X4087A 4087A Dec-2008

• http://docs.sun.com/source/820-3270-12/index.html

• Download the Sun Fire X2200 M2 Server Tools and Drivers CD v2.0 (or later) ISO image

• Record Current BIOS settings (ELOM)

• Upgrade processor to Shanghai

• Is BIOS 3D08?> Then Upgrade 512K BIOS PROM to 1M> Remove the Firmware PROM and install new PROM> Special PLCC extraction tool is necessary

• Upgrade the SP/BMC Firmware with Tools and Driver CD

• Check BIOS and upgrade if necessary

• Micron memory being phased out – field notice

http://docs.sun.com/source/820-3270-12/index.html


Add-in Card Options

X-Option ATO CRS DescriptionSG-XPCIE2FC-QF4 SG-PCIE2FC-QF4SG-XPCIE1FC-QF4 SG-PCIE1FC-QF4 SG-PCIE1FC-QF4SG-XPCIE2FC-EM4 SG-PCIE2FC-EM4 SG-PCIE2FC-EM4SG-XPCIE1FC-EM4 SG-PCIE1FC-EM4 SG-PCIE1FC-EM4X7280A-2

SG-XPCIE2SCSIU320Z SG-PCIE2SCSIU320Z Sun PCI-E Ultra320 SCSI 2-port HBA. RoHS-6

X7281A-2X1106A-Z n/a X1106A-Z Single port Sun 10 Gigabit Ethernet Networking Card with fixed transceiver (Intel) X1107A-Z n/a X1107A-Z Dual port Sun 10 Gigabit Ethernet Networking Card with fixed transceiver (Intel) X1236A-Z 1236A-Z 1236A-ZSG-XPCIE4SAS3-Z SG-PCIE4SAS3-Z LSI Logic SAS3041E-R, PCI Express, 4-port 3Gb/s (SAS) HBA

SG-PCIE2FC-QF4 Sun StorEdge 4 GB Dual Port Fibre Channel PCI-Express Card (Qlogic). RoHS-6.Sun StorEdge 4 GB Single Port Fibre Channel PCI-Express Card (Qlogic). RoHS-6.Sun StorEdge 4 GB Dual Port Fibre Channel PCI-Express Card (Emulex). RoHS-6.Sun StorEdge 4 GB Single Port Fibre Channel PCI-Express Card (Emulex). RoHS-6.

7280A-2 7280A-2 Sun PCI-E Low profile Dual GigE (Copper) UTP, low profile bracket on board. Standard bracket included in X-option. ROHS-6.

SG-PCIE2SCSIU320Z 7281A-2 7281A-2 Sun PCI-E Low-Profile Dual GigE (Fiber) MMF, low profile bracket on board. Standard

bracket included in X-option. RoHS-6.

Infiniband PCI-Express Card. RoHS-6. SG-PCIE4SAS3-Z

List subject to change and not final

Sun Fire X2100/X2200 M2 TechnicalProduct Training Presentation

Ronald GrahamSystems Group Technical MarketingSun Microsystems