VMware Infrastructure Setup for Microsoft Cluster Service

8/14/2019 VMware Infrastructure Setup for Microsoft Cluster Service

1/56

Setup for Microsoft Cluster ServiceESX Server 3.0.1 and VirtualCenter 2.0.1


2/56

VMware, Inc.3145 Porter DrivePalo Alto, CA 94304www.vmware.com

2 VMware, Inc.

Setup for Microsoft Cluster Service

You can find the most up-to-date technical documentation on our Web site at

http://www.vmware.com/support/

The VMware Web site also provides the latest product updates.

If you have comments about this documentation, submit your feedback to:

[email protected]

2006-2008 VMware, Inc. All rights reserved. Protected by one or more of U.S. Patent Nos. 6,397,242,6,496,847, 6,704,925, 6,711,672, 6,725,289, 6,735,601, 6,785,886, 6,789,156, 6,795,966, 6,880,022,6,961,941, 6,961,806 and 6,944,699; patents pending.

VMware, the VMware boxes logo and design, Virtual SMP and VMotion are registered trademarks ortrademarks of VMware, Inc. in the United States and/or other jurisdictions.

All other marks and names mentioned herein may be trademarks of their respective companies.


Revision: 20060818
mailto:[email protected]:[email protected]


3/56

VMware, Inc. 3

Contents

Preface 5

Introduction 9WhatIsClustering? 9

ApplicationsThatCanUseClustering 9

ClusteringSoftware 10

ClusteringHardware 10

TraditionalClusteringandVirtualCenterClustering 10

ClusteringServicesandVirtualMachines 10

ClusteringVirtualMachinesonaSingleHost(ClusterinaBox) 11

ClusteringVirtualMachinesAcrossPhysicalHosts(ClusterAcrossBoxes) 11ClusteringMultipleVirtualMachinesAcrossMultiplePhysicalHosts 12

ClusteringPhysicalMachinesandVirtualMachines(StandbyHost) 13

Prerequisites 14

PrerequisitesforClusterinaBox 14

PrerequisitesforClusteringAcrossBoxes 15

PrerequisitesforStandbyHostClustering 15

SharedStorageSummary 16CaveatsandRestrictions 16

PotentialIssuesAfterSetup 17

AddingDisksBeforeNetworking 17

VerifyingQLogicHBASettingsforMSCS 17

ClusteringVirtualMachinesonOnePhysicalHost 19

ProcessOverview 19Task1:CreatingandCustomizingtheFirstNode 19

Task2:CreatingtheSecondNode 20

Task3:AddingStorageandConfiguringIPAddresses 20

Task4:InstallingandConfiguringMicrosoftClusterService 21

CreatingtheFirstNode 21

InstallingtheGuestOperatingSystem 22

Creatingthe

Second

Node 23

AddingHardDiskstoBothNodes 23


4/56


4 VMware, Inc.

InstallingMicrosoftClusterService 25

ClusteringVirtualMachinesAcrossPhysicalHosts 27ProcessOverview 27

Task1:CreatingandCustomizingtheFirstNode 28

Task2:CreatingandCustomizingtheSecondNode 28

Task3:AddingStorageandConfiguringIPAddresses 28

Task4:SettingUpMicrosoftClusterService 30



CreatingtheSecondNode 32

AddingHardDiskstoBothNodes 32

InstallingandRunningMicrosoftClusterService 34

RunningMicrosoftClusterService 34

ClusteringPhysicalandVirtualMachines 35ProcessOverview 35

Task1:CreatingtheFirstNode(PhysicalMachine) 36

Task2:CreatingandCustomizingtheSecondNode(VirtualMachine) 36

Task3:SettingUpMicrosoftClusterService 36

Task4:CreatingAdditionalPhysical/VirtualPairs 37


CreatingtheSecondNode 37


InstallingMicrosoftClusterService 39

RunningMicrosoftClusterService 40

UpgradingClusteredVirtualMachines 41Overview 41

UpgradingClusterinaBox 42

UpgradingCIB:SharedRDMsandBootDisksinSeparateVMFSVolumes 42

UpgradingCIB:RDMsandBootDisksinSameVMFSVolume 43

UpgradingClusterAcrossBoxes 44

UsingSharedPassthroughRDMs 44

UsingFilesinSharedVMFS2Volumes 45

UpgradingClustersUsingPhysicaltoVirtualClustering 46

SetupChecklist 47

Index 51
http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-


5/56

VMware, Inc. 5

ThisprefacedescribesthecontentsoftheSetupforMicrosoftClusterServiceandprovidespointerstoVMwaretechnicalandeducationalresources.

Thispreface

contains

the

following

topics:

AboutThisBookonpage 5

TechnicalSupportandEducationResourcesonpage 7

About This Book

Thismanual,SetupforMicrosoftClusterService,firstdiscussesthetypesofclustersyoucanimplementusingMicrosoftClusterServiceinconjunctionwithvirtualmachines.Itthengivesprerequisitesandstepbystepinstructionsforeachtypeofcluster,and

concludeswithachecklist.

Revision History

Thismanualisrevisedwitheachreleaseoftheproductorwhennecessary.Arevised

versioncancontainminorormajorchanges.Table P1providesyouwiththerevision

historyofthismanual.

Preface

Table P-1. Revision History

Revision Description

20060615 ESXServer3.0andVirtualCenter2.0versionoftheVMwareInfrastructure3SetupforMicrosoftClusterService.Thisisthefirsteditionofthismanual.

20060921 ESX

Server

3.0.1

and

VirtualCenter

2.0.1

version

of

the

VMware

Infrastructure 3SetupforMicrosoftClusterService.


6/56


6 VMware, Inc.

Intended Audience

Theinformationpresentedinthismanualiswrittenforsystemadministratorswhoare

familiarwith

both

VMware

technology

and

Microsoft

Cluster

Service.

See

VMware

InfrastructureDocumentationforinformationonVMwareInfrastructure.

Document FeedbackIfyouhavecommentsaboutthisdocumentation,submityourfeedbackto:

[email protected]

VMware Infrastructure Documentation

TheVMwareInfrastructuredocumentationconsistsofthecombinedVirtualCenterand

ESXServer

documentation

set.

Youcanaccessthemostcurrentversionsofthismanualandotherbooksbygoingto:

http://www.vmware.com/support/pubs

Conventions

Table P2illustratesthetypographicconventionsusedinthismanual.

NOTE ThisisnotaguidetousingMicrosoftClusterService.UseyourMicrosoft

documentationforinformationoninstallationandconfigurationofMicrosoftCluster

Service.

Table P-2. Conventions Used in This Manual

Style Elements

Blue(onlineonly) Crossreferencesandemailaddresses

Blueboldface(onlineonly) Links

Blackboldface Userinterfaceelementssuchasbuttonnamesandmenuitems

Monospace Commands,filenames,

directories,

and

paths

Monospace bold Userinput

Italic Documenttitles,glossaryterms,andoccasionalemphasis

Variableandparameternames
mailto:[email protected]://www.vmware.com/support/pubshttp://www.vmware.com/support/pubsmailto:[email protected]


7/56

VMware, Inc. 7

Preface

Abbreviations Used in Graphics

ThegraphicsinthismanualusetheabbreviationslistedinTable P3.

Technical Support and Education Resources

Thefollowingsectionsdescribethetechnicalsupportresourcesavailabletoyou.

Self-Service SupportUsetheVMwareTechnologyNetwork(VMTN)forselfhelptoolsandtechnical

information:

Productinformationhttp://www.vmware.com/products/

Technologyinformationhttp://www.vmware.com/vcommunity/technology

Documentationhttp://www.vmware.com/support/pubs

VMTNKnowledgeBasehttp://www.vmware.com/support/kb

Discussionforumshttp://www.vmware.com/community

Usergroupshttp://www.vmware.com/vcommunity/usergroups.html

FormoreinformationabouttheVMwareTechnologyNetwork,goto

http://www.vmtn.net.

Table P-3. Abbreviations

Abbreviation Description

VC VirtualCenter

VI VirtualInfrastructureClient

server VirtualCenterServer

database VirtualCenterdatabase

hostn VirtualCentermanagedhosts

VM# Virtualmachinesonamanagedhost

user# Userwithaccesspermissions

dsk# Storagediskforthemanagedhost

datastore Storageforthemanagedhost

SAN Storageareanetworktypedatastoresharedbetweenmanagedhosts

tmplt Template
http://www.vmware.com/products/http://www.vmware.com/vcommunity/technologyhttp://www.vmware.com/support/pubshttp://www.vmware.com/support/kbhttp://www.vmware.com/communityhttp://www.vmware.com/vcommunity/usergroups.htmlhttp://www.vmware.com/vcommunityhttp://www.vmware.com/vcommunityhttp://www.vmware.com/vcommunity/usergroups.htmlhttp://www.vmware.com/communityhttp://www.vmware.com/support/kbhttp://www.vmware.com/support/pubshttp://www.vmware.com/vcommunity/technologyhttp://www.vmware.com/products/


8/56


8 VMware, Inc.

Online and Telephone Support

Useonlinesupporttosubmittechnicalsupportrequests,viewyourproductand

contractinformation,

and

register

your

products.

Go

to

http://www.vmware.com/support .

Customerswithappropriatesupportcontractsshouldusetelephonesupportforthe

fastestresponseonpriority1issues.Goto

http://www.vmware.com/support/phone_support.html .

Support Offerings

FindouthowVMwaresupportofferingscanhelpmeetyourbusinessneeds.Goto

http://www.vmware.com/support/services.

VMware Education Services

VMwarecoursesofferextensivehandsonlabs,casestudyexamples,andcourse

materialsdesignedtobeusedasonthejobreferencetools.Formoreinformationabout

VMwareEducation

Services,

go

to

http://mylearn1.vmware.com/mgrreg/index.cfm.
http://www.vmware.com/supporthttp://www.vmware.com/support/phone_support.htmlhttp://www.vmware.com/support/serviceshttp://mylearn1.vmware.com/mgrreg/index.cfmhttp://mylearn1.vmware.com/mgrreg/index.cfmhttp://mylearn1.vmware.com/mgrreg/index.cfmhttp://www.vmware.com/support/serviceshttp://www.vmware.com/support/phone_support.htmlhttp://www.vmware.com/support


9/56

VMware, Inc. 9

Thischapterintroducesclusteringanddiscussesthedifferenttypesofclustersinthe

followingsections:

What

Is

Clustering?

on

page 9 ClusteringServicesandVirtualMachinesonpage 10

Prerequisitesonpage 14

CaveatsandRestrictionsonpage 16

AddingDisksBeforeNetworking(SEEUPDATE)onpage 17

VerifyingQLogic

HBA

Settings

for

MSCS

on

page 17

What Is Clustering?

Administratorsclustermachinestoprovideservicesviaagroupofservers,withthe

goalofachievinghighavailability,scalability,orboth.

Forexample,assumeasinglenodeservesadatabase.Ifthatnodecrashes,the

clusteringsoftware

restarts

the

database

on

another

node.

The

database

application

knowshowtorecoverfromacrash,andnearcontinuousavailabilityisachieved.

Applications That Can Use Clustering

Totakeadvantageofclusteringservices,applicationsneedtobeclusteringaware.With

aclusteringawareapplication,userscancontinuetheirtasksseamlesslyevenifthe

applicationismovedtoadifferenthost.Thisispossible:

Withstatelessapplications,suchasWebserversandVPNservers.

Introduction

1


10/56


10 VMware, Inc.

Withapplicationsthathavebuiltinrecoveryfeatures,suchasdatabaseservers,

mailservers,andfileservers.

Clustering Software

Severaldifferentcompaniessupplyclusteringsoftwarethatcanbeusedinconjunction

withvirtualmachines.However,VMwaretestsclusteringwithMicrosoftCluster

Service,andonlyMicrosoftClusterServiceissupported.

MicrosoftClusterService(MSCS)providesfailoversupportforapplicationssuchas

databases,fileservers,andmailservers.

Clustering Hardware

Atypicalclusteringsetupincludes:

Disksthataresharedbetweennodes.

Shareddisksareneededforapplicationsthatusedynamicdata,suchasmail

serversordatabaseservers.Theshareddisksmustbeonastorageareanetwork

(SAN)usingFibreChannel(FC).

Extranetworkconnectivitybetweennodesformonitoringheartbeatstatus.

Traditional Clustering and VirtualCenter Clustering

Thisdocumentdiscussestraditionalclustering(hotstandby)usingMicrosoftCluster

Service.VMwarealsosupportsacoldstandbyclusteringsolutionusingVMwareHA

inconjunctionwithVirtualCenterclusters.

VMwareHAfunctionality,aswellasthedifferencesbetweenthetwoapproaches,is

discussedintheVirtualCenterResourceManagementGuide.

Clustering Services and Virtual Machines

Useofclusteringservicesinvirtualmachinesprovideshighavailabilitywithless

hardware(suchasmachinesandnetworkadapters).

Severalscenariosarepossibleforclusteringinvirtualmachines:

ClusteringVirtual

Machines

on

aSingle

Host

(Cluster

in

aBox)

NOTE Clusteringservicesareoftenusedinconjunctionwithloadbalancingsoftware,suchas

MicrosoftNetworkLoadBalancing.BecauseVMwaredoesnotperformtestingusing

thatproduct,thisguidedoesnotincludecorrespondingprocedures.


11/56

VMware, Inc. 11

Chapter 1 Introduction

ClusteringVirtualMachinesAcrossPhysicalHosts(ClusterAcrossBoxes)on

page 11

ClusteringPhysical

Machines

and

Virtual

Machines

(Standby

Host)

on

page 13

Clustering Virtual Machines on a Single Host (Cluster in a Box)

Aclusterinaboxconsistsoftwoclusteringvirtualmachinesonasinglephysical

machine.AclusterinaboxsupportstwovirtualmachinesonthesameESXServerhost

connectedtothesamestorage(eitherlocalorremote).

Thisscenariosupportssimpleclusteringfordealingwithsoftwareoradministration

errors,aswellasfailuresintheguestoperatingsystem.Itcannotprotectyouincaseof

hardwarefailures.Itcanalsobeusefulfortestingcrosshostclusteringbefore

distributingthevirtualmachinesacrossmultiplehosts.

Figure 1-1. Cluster in a Box

Figure 11showsatwonodeclusteronasinglephysicalmachine;eachnodeisrunning

clusteringsoftware.

Chapter 2,ClusteringVirtualMachinesonOnePhysicalHost,discusseshowtoset

upaclusterinaboxusingMicrosoftClusterService.

Clustering Virtual Machines Across Physical Hosts (ClusterAcross Boxes)

Aclusteracrossboxesconsistsofvirtualmachinesondifferentphysicalmachines.In

thisscenario,

the

storage

is

on

ashared

physical

device,

so

both

virtual

machines

can

physical machine

storage

virtual machineNode2


clustersoftware

clustersoftware


12/56


12 VMware, Inc.

accessthedata.IfeitherthevirtualmachineorthephysicalmachineonNode1becomes

unavailable,thedataisstillavailablefromthevirtualmachineonNode2.

Usingthis

type

of

cluster,

you

can

deal

with

the

hardware

failure

on

the

physical

machine.

Figure 1-2. Cluster Across Boxes

Figure 12showsatwonodeclusterusingtwophysicalmachines;eachnodeisrunning

clusteringsoftware.

Chapter 3,ClusteringVirtualMachinesAcrossPhysicalHosts,discusseshowtoset

up

a

cluster

across

boxes

using

Microsoft

Cluster

Service.

Clustering Multiple Virtual Machines Across Multiple Physical Hosts

Youcanexpandtheclusteracrossboxesmodelandplacemultiplevirtualmachineson

multiplephysicalmachines.Forexample,youcanconsolidatefourclustersoftwo

physicalmachineseachtotwophysicalmachineswithfourvirtualmachineseach.This

setupprotectsyoufrombothhardwareandsoftwarefailures.Atthesametime,this

setupresultsinsignificanthardwarecostsavings.

physical machine physical machine

storage



clustersoftware

clustersoftware


13/56

VMware, Inc. 13


Figure 1-3. Clustering Multiple Virtual Machines Across Hosts

Figure 13showshowfourtwonodeclusterscanbemovedfromeightphysical

machinestotwo.

Clustering Physical Machines and Virtual Machines (StandbyHost)

Forasimpleclusteringsolutionwithlowhardwarerequirements,youmightchooseto

have

one

standby

host.

In

that

case,

set

up

your

system

to

have

a

virtual

machine

correspondingtoeachphysicalmachineonthestandbyhost.Incaseofhardware

failureinoneofthephysicalmachines,thevirtualmachineonthestandbyhostcantake

overforthatphysicalhost.

physicalmachine

physicalmachine

VM1

VM3

VM5

VM7

VM2

VM4

VM6

VM8

1

3

5

7

2

4

6

8


14/56


14 VMware, Inc.

Figure 1-4. Clustering Physical and Virtual Machines

Figure 14showsastandbyhostusingthreevirtualmachinesonasinglephysical

machine.Allvirtualmachinesarerunningclusteringsoftware.

Prerequisites

Using

Microsoft

Cluster

Service

in

any

of

the

scenarios

discussed

above

requires

careful

preparation.ThissectionliststheprerequisitesfortheESXServerhostandthevirtual

machine.Foradditionalsoftwareprerequisiteinformation,seetheMicrosoftdocument

at

http://www.microsoft.com/downloads/details.aspx?FamilyID=96f76ed7963443009

15989638f4b4ef7&displaylang=en#EIAA

Appendix A,SetupChecklist,summarizesprerequisitesfordifferenttypesof

clusters.

Prerequisites for Cluster in a Box

Tosetupaclusterinabox,youmusthave:

AnESXServerhostwithtwophysicalnetworkadapters:onefortheservice

consoleandoneforcommunicationbetweenthetwovirtualmachinesandthe

clientsoftheclusteredapplications.

AccesstoSANstorage(recommended)ortoasharedlocaldisk.

physicalmachine

clustersoftware

clustersoftware

virtual

machinecluster

software

virtualmachine

clustersoftware

virtualmachine

clustersoftware

clustersoftware


15/56

VMware, Inc. 15


AlocalSCSIcontroller.

Youcansetupsharedstorageforaclusterinaboxusingeitheravirtualdiskora

remoteLUN

using

raw

device

mapping

(RDM)

in

virtual

compatibility

mode

(nonpassthroughRDM).

Whenyousetupthevirtualmachine,youneedtoconfigure:

Twovirtualnetworkadapters.

Atleasttwovirtualharddisksthataresharedamongthetwovirtualmachines

(onequorumdiskandonedatadisk).Whenyoucreatetheharddisksasdescribed

inthis

document,

the

system

automatically

creates

the

associated

virtual

SCSI

controllers.

Prerequisites for Clustering Across Boxes

Theprerequisitesforclusteringacrossboxesaresimilartothoseforclusterinabox,

withtheseexceptions:

On

each

ESX

Server

host,

you

need

at

least

two

physical

network

adapters

dedicatedtothecluster(plusonenetworkadapterdedicatedtotheservice

console).

YoumustuseanRDMineitherphysicalorvirtualcompatibilitymode

(passthroughRDMornonpassthroughRDM).Youcannotusevirtualdisksfor

sharedstorage.

SharedstoragemustbeonaSAN.

Prerequisites for Standby Host Clustering

Theprerequisitesforstandbyhost(N+1)clusteringaresimilartothoseforclustering

acrossboxes:

OntheESXServerhostdedicatedtothecluster,youneedtwophysicalnetwork

adaptersforusebythevirtualmachines(plusonenetworkadapterdedicatedto

theserviceconsole).

YoumustuseRDMinphysicalcompatibilitymode(passthroughRDM).You

cannotusevirtualdiskorRDMinvirtualcompatibilitymode(nonpassthrough

RDM)forsharedstorage.

Nomultipathingsoftwarecanberunninginthephysicalmachine.(SEEUPDATE)

NOTE TheRDM

requirement

is

different

in

ESX

Server

3.0

than

in

ESX

Server

2.x.


16/56


16 VMware, Inc.

FortheFCHBA(QLogicorEmulex)inthephysicalWindowsmachineyoumust

usetheSCSIportMiniportdriver.Clusterfailoveroperationsfailifyouusethe

STORportMiniportdriver.

Shared Storage Summary

Thefollowingtableillustrateswhichsharedstoragesetupisallowedforwhich

clusteringsolution.Therecommendedoptionsareshowninbold.

Caveats and Restrictions

Thissectionsummarizescaveatsandrestrictions.Thesoftwarelistedassupportedhas

beentestedbyVMware.Othersoftwarehasnotbeentested.

EachvirtualmachinebydefaulthasfivePCIslotsavailable.Aclusterusesfourof

theseslots(twonetworkadaptersandtwoSCSIhostbusadapters),leavingone

PCI

slot

for

a

third

network

adapter

(or

other

device),

if

needed. VMwarevirtualmachinescurrentlyemulateonlytheSCSI2diskreservation

protocolanddonotsupportapplicationsusingSCSI3diskreservations.

Youmustuse2GBFCHBAswithoneofthedriverslistedinthechecklist.See

Appendix A.

YoumustuseLSILogicvirtualSCSIadapter.

YoumustuseVMXNet(notvlance).

Youcanuseonly32bitvirtualmachines(not64bitvirtualmachines).

Youcanuseonly2nodeclustering.

iSCSIclusteringisnotsupportedoniSCSIorNFSdisks.

TheSTORPortdriverisnotsupportedintheguestoperatingsystem.OnlytheSCSI

miniportdriver

is

supported.

NICteamingisnotsupportedwithclustering.

Table 1-1. Shared Storage Summary

Cluster in a

Box

Cluster Across

Boxes

N+1

Clustering

Virtualdisks Yes No No

PassthroughRDM

(physicalcompatibilitymode)

No Yes Yes

NonpassthroughRDM

(virtualcompatibilitymode)

Yes Yes No


17/56

VMware, Inc. 17


Thebootdiskforthevirtualmachinemustbestoredonlocalstorage.

BootfromSANfortheESXServerhostisnotsupported.

MixedHBAenvironments(QLogicandEmulex)onthesamehostarenotsupported.

MixedenvironmentsusingbothESXServer2.5andESXServer3.0arenot

supported.

ClusteredvirtualmachinescannotbepartofVMwareclusters(DRSorHA).

YoucannotuseVMotiononvirtualmachinesthatrunclustersoftware.

Potential Issues After Setup

SettheI/Otimetosixtysecondsormorebysetting

HKEY_LOCAL_MACHINE\System\CurrentControlSet\Services\

Disk\TimeOutValue.

Thesystemmayresetthisvalueifyourecreateacluster.Youmustsetitagainin

thatcase.

IfyoucloneavirtualmachinewithRDMs,theRDMsareconvertedtovirtualdisks

duringtheconversionprocess.RemoveallRDMsbeforecloning,thenremapthem

aftercloningiscomplete.

Adding Disks Before Networking (SEE UPDATE)

WhenyouadddiskstoavirtualmachinethatrunsaMicrosoftWindowsoperatingsystem,MicrosoftWindowsconsolidatestheIPaddressesofthatvirtualmachine.After

youhaveaddedthedisks,youusuallyhaveonevalidIPaddressandoneinvalidIP

address.

Forallclusters,youmustalwaysaddalldisksbeforeyouconfigurenetworking.Ifyou

lateradddisksbecauseofincreasedstoragerequirements,youmustcheck(and

possiblycorrect)thenetworkingsetup.

Verifying QLogic HBA Settings for MSCS

IfyouuseMicrosoftClusterServicetoclustervirtualmachinesbetweenyourESX

Serverhosts,youmustusesharedstorage.IfyouintendtoaccesssharedLUNsona

SANusingaQLogicHBA,youmustuseparticularvaluesforsomeQLogicHBA

configurationsettings.


18/56


18 VMware, Inc.

To verify the QLogic HBA settings

1 ReboottheESXServerhost.

2 EntertheQLogicHBAconfigurationutilityduringbootup.UnderAdvancedConfigurationSettings,ensurethatthefollowingsettingsareused:

Table 1-2.

Field Setting

EnableTargetReset Yes

FullLIPLogin Yes

FullLIPReset No


19/56

VMware, Inc. 19

ThischapterguidesyouthroughcreatingatwonodeMSCSclusteronasingleESX

Servermachine.

ProcessOverviewonpage 19

CreatingtheFirstNodeonpage 21

CreatingtheSecondNodeonpage 23

AddingHardDiskstoBothNodesonpage 23

InstallingMicrosoftClusterServiceonpage 25

Process OverviewThissectiongivesanoverviewforcreatingaclusteronasinglephysicalmachine

(clusterinabox).Theprocessconsistsoffourtasks,discussedindetailintherestofthis

chapter.

Task 1: Creating and Customizing the First Node

ThistaskisdiscussedindetailinCreatingtheFirstNodeonpage 21.Itconsistsofthesemajorsteps:

1 CreatingthevirtualmachineforNode1withtwovirtualnetworkadapters.

2 Puttingthebootdiskonlocalstorage.

3 Installingtheoperatingsystem.

4 Poweringdown

the

first

node.

Clustering Virtual Machines

on One Physical Host

2

S t f Mi ft Cl t S i


20/56


20 VMware, Inc.

Task 2: Creating the Second Node

ThistaskisdiscussedindetailinCreatingtheSecondNodeonpage 23.Thetask

consists

of

cloning

the

Node1

virtual

machine

and

choosing

the

Node1

ESX

Server

host

asthedestination.

Task 3: Adding Storage and Configuring IP Addresses

ThistaskisdiscussedindetailinAddingHardDiskstoBothNodesonpage 23.It

consistsofthesemajorsteps:

1 Addingtworemotedisks,oneforthequorumdiskandoneforthesharedstorage

disk,toNode1.

2 ConfiguringtheguestoperatingsystemsprivateandpublicIPaddresses.Seethe

documentationfortheMicrosoftoperatingsystemyouareusingforinformation.

Figure 21showsyoursetupatthispoint:

Figure 2-1. Cluster in a Box, Node1 Setup

3 AddingharddisksandconfiguringIPaddressestoNode2.Theprivateandpublic

networksmustmatchthoseofNode1,andthetwonodesmustpointtothesame

sharedstorage.

ThecompletedsetupisshowninFigure 22.

physicalmachine


local storage

FC

VNIC1 VNIC2

NIC1

VSCSI1 VSCSI2

SCSI1 SCSI2

virtual switch1 virtual switch2

remote storage

Chapter 2 Clustering Virtual Machines on One Physical Host


21/56

VMware, Inc. 21


Figure 2-2. Cluster in a Box Complete Setup

Task 4: Installing and Configuring Microsoft Cluster Service

InstallMicrosoftClusterServicefirstonone,thenontheothervirtualmachine,

followingtheinstructionsintheMicrosoftdocumentation.

Creating the First Node

Creatingthefirstnodeinvolvescreatingthevirtualmachine,addingdisks,and

installingtheoperatingsystem.Thissectionstepsyouthrougheachofthesetasks.

virtual switch2(private)

virtual switch1

(public)

physical machine


FC

VNIC1 VNIC2

NIC1

VSCSI1 VSCSI2


VNIC1VNIC2

VSCSI1VSCSI2

SCSI2

remote storage

local storage

SCSI1

NOTE MicrosoftClusterServiceisincludedintheinstallationforWindows2003servers.For

Windows2000servers,youmustinstallthesoftware.



22/56


22 VMware, Inc.

To create and configure the first nodes virtual machine

1 LaunchaVIClientandconnecttotheESXServerhostoraVirtualCenterServer.

Usetheusernameandpasswordoftheuserwhowillownthevirtualmachine.

2 Intheinventorypanel,rightclickthehostandchooseNewVirtualMachine,then

makethefollowingselectionsusingthewizard:

Next,youneedasecondSCSIcontrollerandtwoormoreshareddisksforsharedaccess

toclusteredservicesanddata.

Installing the Guest Operating System

Anew

virtual

machine

is

like

aphysical

computer

with

ablank

hard

disk.

You

need

to

installanoperatingsystemtouseit.

Table 2-1.

Page Selection

WizardType Typical.

NameandLocation Chooseanameandlocationyouwanttouse.ThisexampleusesNode1.

ResourcePool Selecttheresourcepoolforthevirtualmachine,orthehostiftherearenoresourcepools.

Datastore Thispageallowsyoutochoosethelocationforthevirtualmachineconfigurationfileandthevirtualmachinedisk(.vmdk)file.

Choosethelocaldatastore.

Note:Thevirtualmachineconfigurationfileandthe.vmdkfileshouldalwaysbestoredonthelocaldisk.

GuestOperatingSystem ChoosetheWindowsServer2000orWindowsServer2003operatingsystemyouintendtoinstall.

CPUs Usethedefaultunlessyouhavespecialrequirements.

Memory Usethedefaultunlessyouneedadditionalmemoryandyour

serversupports

it.

Network ChangeNICstoConnectto2,thenselectthesecondnetworkforthesecondNIC.

YouneedoneNICfortheprivatenetwork,thesecondNICforthepublicnetwork.

VirtualDiskCapacity IfyouneedaprimarySCSIdisklargerthan4GB,entertheappropriatevalueintheCapacityfield.

Readyto

Complete Click

OK

to

create

the

virtual

machine.



23/56

VMware, Inc. 23

p g y

To install one of the Microsoft 2003 Server operating systems

1 InserttheinstallationCDROMforyourguestoperatingsystem.

2 SelectthevirtualmachineandchoosePoweronfromtherightbuttonmenu.

Becausenooperatingsystemisinstalled,thevirtualmachinecheckstheCDROM

driveandfindstheinstallationCDROM.

3 Followtheinstallationinstructionsintheoperatingsystemdocumentation.

4 Whenyouredone,removetheCDROMfromtheserversCDROMdrive.

Creating the Second NodeCreatingthesecondnodeinvolvescloningtheNode1virtualmachineandaddingdisks

thatpointtothesharedstorage.Thissectionguidesyouthroughthetasks.

To clone the Node1 virtual machine

1 Shutdowntheguestoperatingsystemandpoweroffthevirtualmachine.

2 IntheVIClientsinventorypanel,selectNode1andchooseClonefromthe

rightbuttonmenu.Makethefollowingselectionswiththewizard:

Youhavenowcreatedavirtualmachinewithtwonetworkadaptersonwhichthe

operatingsystemisalreadyinstalled.

Adding Hard Disks to Both Nodes

Afteryouhavecreatedthetwovirtualmachineswiththeoperatingsystemsinstalled,

youcanaddtwoormoreharddiskstoeachvirtualmachineassharedresources.One

harddiskwillbethequorumdisk;thesecondwillbethesharedstoragedisk.

Table 2-2.

Page Selection

NameandLocation Chooseanameandlocationyouwanttouse(forexample,Node2).

ResourcePartition Selecttheresourcepoolforthevirtualmachine,orselectthehostiftherearenoresourcepools.

Datastore Thiswizardallowsyoutochoosethelocationforthevirtualmachineconfigurationfileandthe.vmdkfile.

Choosethelocaldatastore.

Customization ChooseDonotcustomize.

ReadytoComplete ClickOKtocreatethevirtualmachine.



24/56

24 VMware, Inc.

To prepare for adding disks

Youmustzerooutthedisksyouusewithaclusterinaboxscenario.Youhavethese

options:

Tocreateandzerooutinonesweep,typethefollowingatthecommandline:

vmkfstools -c -d eagerzeroedthick

/vmfs/volumes//.vmdk

Tozerooutanexistingdisk,typethefollowingatthecommandline:

vmkfstools [-w |--writezeroes] /vmfs/volumes//.vmdk

Ifyouwishtosavetime,anddontmindhavingstaledataasitexistsonthe

physicalmediuminyourvirtualdisk,typethefollowingatthecommandline:

vmkfstools -c -d thick /vmfs/volumes//.vmdk

To add a quorum disk and shared storage disk

1 SelectthevirtualmachineyoujustcreatedandchooseEditSettings.

2 ClickAdd,selectHardDisk,andclickNext.

3 SelectChooseanexistingvirtualdiskandselectoneofthedisksyouprepared

(seeToprepareforaddingdisks).

4 Chooseanewvirtualdevicenode.ForexamplechooseSCSI(1:0)andusethe

defaultmode.

5 ClickFinish.

NOTE ForNode1,pointeachdisktoadifferentlocation.ForNode2,choosethesamelocations

asyoudidforNode1.

NOTE Youmustrepeatthisprocessforeachvirtualdiskyouwanttouseasashareddisk

inthecluster.Forexample,ifyouhaveonequorumdiskandonesharedstorage

disk,youmustrunthetoolonbothdisks.

NOTE YoucanalsouseamappedSANLUNsettovirtualcompatibilitymode.Inthat

case,youdontneedtorunthevmkfstoolscommandslistedinTopreparefor

addingdisks.

NOTE Thismustbeanewcontroller.YoucannotuseSCSI0.



25/56

VMware, Inc. 25

Whenyouredone,noticethatthewizardhascreatedbothanewharddiskanda

newSCSIcontroller.

6 SelectthenewSCSIcontrollerandclickChangeControllerType.Makesurethe

controllerissettoLsiLogic(thedefault).BusLogicisnotsupportedwhenyouuse

MSCSwithESXServer3.0orlater.

7 Inthesamepanel,setSCSIBusSharingtoVirtualandclickOK.

8 Repeatsteps1through6butchooseanewtargetdevice,suchasSCSI(1:1),onthe

controllerthatwasjustcreated.

Foradditionaldisks,youcanrepeatstep9.

AfteryouvecompletedsettingupNode1,repeattheprocesstoaddtwodiskstoNode2.PointthequorumdisktothesamelocationastheNode1quorumdisk,andthe

sharedstoragedisktothesamelocationastheNode1sharedstoragedisk.

Installing Microsoft Cluster Service

ThefinaltaskistoinstallMicrosoftClusterService.

NOTE WhenaddinganRDMorvirtualdisktothesecondnode,chooseUseexistingdisk.

CAUTION IfyoudecidetocloneavirtualmachinewithanRDMsetup,allRDMsare

convertedtovirtualdisks.YoushouldthereforeunmapallRDMsbeforecloning,thenremapthemaftercloningiscomplete.

NOTEMicrosoft

Cluster

Service

is

already

installed

for

Windows

2003

servers.

For

Windows

2000servers,youneedtoinstallthesoftware.



26/56

26 VMware, Inc.

RefertotheMicrosoftdocumentationforinformation.Onedocumentaboutinstalling

MicrosoftClusterServiceisatthefollowinglocation:




27/56

VMware, Inc. 27

ThischapterguidesyouthroughcreatinganMSCSclusterthatconsistsoftwovirtual

machinesontwoESXServerhosts.

Thechapterconsistsofthefollowingsections:



Creatingthe

Second

Node

(SEEUPDATE)onpage 32

AddingHardDiskstoBothNodesonpage 32

InstallingandRunningMicrosoftClusterServiceonpage 34

Process Overview

Thissectiongivesanoverviewofcreatingacluster.Theprocessconsistsoffourtasks.

Clustering Virtual Machines

Across Physical Hosts 3

NOTE Althoughthis

process

is

similar

to

the

process

for

setting

up

acluster

in

abox,

steps

are

repeatedforeaseofuse.



28/56

28 VMware, Inc.

Task 1: Creating and Customizing the First Node

ThistaskisdiscussedindetailinCreatingtheFirstNodeonpage 30.Itconsistsof

thesemajorsteps:

1 CreatingthevirtualmachineforNode1withtwonetworkadaptersandlocal

storageforthebootdisk.

2 InstallingtheoperatingsystemonNode1.

Task 2: Creating and Customizing the Second Node

ThistaskisdiscussedindetailinCreatingtheSecondNode(SEEUPDATE)onpage 32.ThetaskconsistsofcloningtheNode1virtualmachineandchoosingthesecondserver

asthedestination.

Task 3: Adding Storage and Configuring IP AddressesThistaskisdiscussedindetailinAddingHardDiskstoBothNodesonpage 32.It

consistsofthesemajorsteps:

1 Addingremotedisks,oneforthequorumdiskandoneormorefortheshared

storagedisk,toNode1.

2 ConfiguringtheguestoperatingsystemsprivateandpublicIPaddresses.Seethe

documentationfortheMicrosoftoperatingsystemyouareusingforinformation.

Figure 31showsthesetupatthispoint.

NOTE TheESXServerhostmusthavetwophysicalnetworkadaptersforvirtualmachines,in

additiontothenetworkadapterfortheserviceconsole.

NOTE These

disks

must

point

to

SAN

LUNs.

RDM

in

physical

compatibility

mode

(passthroughRDM)isrecommended.

Chapter 3 Clustering Virtual Machines Across Physical Hosts


29/56

VMware, Inc. 29

Figure 3-1. Cluster Across Boxes, Node1 Setup

3 AddingharddisksandconfiguringIPaddressestoNode2.Theprivateandpublic

networksmustmatch,andthetwonodesmustpointtothesamesharedstorage.

Thecompletedsetuplooksasfollows.

physicalmachine


local storage

FC

VNIC1 VNIC2

NIC1 NIC2

VSCSI1 VSCSI2

SCSI1 SCSI2

virtual switch1

(public)

virtual switch2

(private)

remote storage



30/56

30 VMware, Inc.

Figure 3-2. Cluster Across Boxes Complete Setup

Task 4: Setting Up Microsoft Cluster Service

Afteryouhavesetupthetwonodeswithvirtualmachinesthathavetheappropriate

diskand

network

configuration,

you

can

install

Microsoft

Cluster

Service.

See

InstallingandRunningMicrosoftClusterServiceonpage 34.


Creatingthefirstnodeinvolvescreatingthevirtualmachineandinstallingtheoperatingsystem.Thissectionguidesyouthroughthesetasks.

physicalmachine

physicalmachine


local storage

FC

VNIC1 VNIC2

NIC1 NIC2

VSCSI1 VSCSI2

SCSI1 SCSI2

local storage


FC

VNIC1VNIC2

NIC1NIC2


virtual switch1(public)

virtual switch1(public)


VSCSI1VSCSI2

SCSI1SCSI2

remote storage

NOTE MicrosoftClusterServiceisincludedintheinstallationforWindows2003servers.For

Windows2000serversyouneedtoinstallthesoftware.



31/56

VMware, Inc. 31

To create the first nodes virtual machine (SEE UPDATE)

1 LaunchaVIClientandconnecttotheESXServerhost.Usetheusernameand

passwordoftheuserwhowillownthevirtualmachine.

2 Intheinventorypanel,rightclickthehostandchooseNewVirtualMachine.

Makethefollowingselectionswiththewizard:


Anewvirtualmachineislikeaphysicalcomputerwithablankharddisk.Youneedto

installan

operating

system

to

use

it.





driveand

finds

the

installation

CD

ROM.


Table 3-1.

Page Selection

WizardType Typical.

Nameand

Location Choose

aname

and

location

you

want

to

use,

such

as

Node1.

ResourcePool Selecttheresourcepoolforthevirtualmachine,orthehostiftherearenoresourcepools.

Datastore Thispageallowsyoutochoosethelocationforthevirtualmachineconfigurationfileandthe.vmdkfile.Choosealocaldatastore.

GuestOperating

System Choose

the

Windows

2003

Server

operating

system

you

intendtoinstall.

CPUs Usethedefaultsuggestedforyouroperatingsystem.

Memory Usethedefaultunlessyouneedadditionalmemoryandyourserversupportsit.






32/56

32 VMware, Inc.


Creating the Second Node (SEE UPDATE)

CreatingthesecondnodeinvolvescloningtheNode1virtualmachineandaddingdisks

thatpointtothestoragesharedwithNode1.Thissectionguidesyouthroughthetasks.

To clone the Node1 virtual machine

1 Shutdowntheguestoperatingsystemandpoweroffthevirtualmachine.

2 IntheVIClientsinventorypanel,selectNode1andchooseClonefromthe

rightbuttonmenu.Makethefollowingselectionswiththewizard:

Youhavenowcreatedavirtualmachinewithtwonetworkadaptersonwhichthe

operatingsystemyouchoseforNode1isalreadyinstalled.

Adding Hard Disks to Both Nodes

Afteryouhavecreatedthetwovirtualmachineswiththeoperatingsysteminstalled,

youneedtoaddtwoharddisks.Oneharddiskwillbethequorumdisk,andthesecond

willbethesharedstoragedisk.

Table 3-2.

Page Selection

NameandLocation Chooseanameyouwanttouse(forexample,Node2)andthedatacenterinwhichbothhostsarelocated.

HostorCluster Choosethesecondhostfortheclustersetup.

ResourcePartition Selecttheresourcepoolforthevirtualmachine,orselectthehostiftherearenoresourcepools.

Datastore Thispageallowsyoutochoosethelocationforthevirtualmachineconfigurationfileandthe.vmdkfile.

Choosealocaldatastore.

Customization ChooseDonotcustomize.


NOTE Forthefirstnode,pointeachdisktoadifferentlocation.Forthesecondnode,choose

thesamelocationsasyoudidforthefirstnode.(SEEUPDATE)



33/56

VMware, Inc. 33


1 SelectthevirtualmachinejustcreatedandchooseEditSettings.

2 ClickAdd,

select

Hard

Disk,

and

click

Next.

3 IntheSelectaDiskpage,chooseMappedSANLUNandclickNext.(SEEUPDATE)YourharddiskpointstoaLUNthatusesRDM.

4 IntheLUNselectionpage,chooseanunformattedLUNandclickNext.

AskyourSANadministratorwhichoftheLUNsareunformatted.Youcanalsosee

allformattedLUNsinthehostsConfigurationtabanddeducewhichLUNsare

unformattedbycomparingthelistofformattedLUNswiththelistintheLUN

selectionpage.

5 IntheSelectDatastorepage,selectthelocaldatastore,whichisalsothelocationof

thebootdisk,thenclickNext.

ThisisthelocationwheretheRDM(mapping)isstored.

6 Select

Physical

compatibility

mode,

then

click

Next.ASCSIControllerthatusesphysicalcompatibilitymodeiscreatedwhenthe

virtualharddiskiscreated.

7 Chooseanewvirtualdevicenode,forexamplechooseSCSI(1:0)andusethe

defaultmode.

8 ClickFinishtocompletecreatingthedisk.

Whenyouredone,noticethatthewizardhascreatedbothanewSCSIcontroller

andanewharddisk.

9 SelectthenewSCSIcontrollerandclickChangeControllerType.SelectLsiLogic

inthedialogboxthatappears.

MSCSonESXServer3.0isnotsupportedinconjunctionwithBusLogic.

10 Inthesamepanel,setSCSIBusSharingtoPhysical,thenclickOK.

NOTE ThismustbeanewSCSIController.YoucannotuseSCSI0.



34/56

34 VMware, Inc.

11 Repeatsteps1through8butchooseanewVirtualDeviceNodesuchasSCSI(1:1).

AfteryouvecompletedsettingupNode1,repeattheprocesstoaddtwodisksto

Node2.PointthequorumdisktothesamelocationastheNode1quorumdisk,andthe

sharedstoragedisktothesamelocationastheNode1sharedstoragedisk.Todoso,

createanewmappedSANLUNthatpointstoadisksharedwithNode1.

Installing and Running Microsoft Cluster Service


MicrosoftprovidesadocumentaboutinstallingMicrosoftClusterServiceatthe

followinglocation:



Running Microsoft Cluster ServiceMicrosoftClusterServiceshouldoperatenormallyinthevirtualmachineafteritis

installed.

NOTE MicrosoftClusterServiceisalreadyinstalledforWindows2003servers.For

Windows2000serversyouneedtoinstallthesoftware.


35/56

VMware, Inc. 35

ThischapterguidesyouthroughcreatinganMSCSclusterinwhicheachphysical

machinehasacorrespondingvirtualmachine.

Thechapterconsistsofthefollowingsections:



Creatingthe

Second

Node

on

page 37

InstallingtheGuestOperatingSystemonpage 39

InstallingMicrosoftClusterServiceonpage 39

RunningMicrosoftClusterServiceonpage 40

Process Overview

Thissectiongivesanoverviewandsomeexplanationoftheprocessofcreatingclusters.

SeeClusteringPhysicalMachinesandVirtualMachines(StandbyHost)onpage 13

forbackgroundinformation.

Theprocessconsistsoffourtasks.

Clustering Physical and

Virtual Machines 4

NOTE Although

this

process

is

similar

to

(but

not

the

same

as)

the

process

for

setting

up

a

clusterinabox,stepsarerepeatedforeaseofuse.



36/56

36 VMware, Inc.

Task 1: Creating the First Node (Physical Machine)

ThistaskisdiscussedbrieflyinCreatingtheFirstNodeonpage 37.Youmightnot

needtocustomizethephysicalmachine.However,yoursetupmustfulfillthefollowing

requirements:

Thephysicalmachinemusthavenetworkadapters.

ThephysicalmachinemusthaveaccesstothesamestorageonaSANastheESX

Serverhostonwhichyouwillrunthevirtualmachines.

Theoperatingsystemyouwanttousethroughouttheclustermusthavebeen

installed.

Task 2: Creating and Customizing the Second Node (VirtualMachine)

ThistaskisdiscussedindetailinCreatingtheSecondNodeonpage 37.Itconsistsof

thefollowing

major

steps:

1 Creatingavirtualmachinethatissetupforclusteringacrossboxes.

2 MakingsurethesharedstoragevisiblefromNode1(thephysicalmachine)isalso

visiblefromNode2(thevirtualmachine).

3 Installingtheoperatingsystem.

Task 3: Setting Up Microsoft Cluster Service

SetupMicrosoftClusterService,firstforthephysicalmachineandthenforthevirtual

machine.

NOTE Nomultipathingsoftwarecanberunninginthephysicalmachine.

NOTE TheESX

Server

host

must

have

two

physical

network

adapters

for

the

virtual

machines,oneforthepublicnetwork,andonefortheprivatenetwork.(Thehost

alsohasanetworkadapterfortheserviceconsole.)

NOTE MicrosoftClusterServiceisalreadyinstalledforWindows2003servers.Youneedto

installthesoftwareforWindows2000servers.

NOTE Incontrasttotheothertwoclustertypes,thisclustertyperequiresasmallamountof

customization.SeeInstallingMicrosoftClusterServiceonpage 39.

Chapter 4 Clustering Physical and Virtual Machines

T k 4 C ti Additi l Ph i l/Vi t l P i


37/56

VMware, Inc. 37

Task 4: Creating Additional Physical/Virtual Pairs

Foreachphysicalmachineyourepeattasks1and2tosetupanadditionalvirtual

machineontheESXServerhostandclusterthetwosystems.


Becausethefirstnodeisaphysicalmachine,noinstructionsforcreatingthefirstnode

areincludedinthischapter.SeetheMicrosoftClusterServicedocumentationforall

prerequisitesandcaveats.

Makesurethephysicalmachinehasatleasttwonetworkadapters.

MakesurethephysicalmachinehasaccesstothesamestorageonaSANasthe

ESXServerhost.

Creating the Second Node

Creatingthesecondnodeinvolvescreatingavirtualmachinethathastwonetwork

adapters(onefortheprivateandoneforthepublicnetwork)andaddingdisksthat

pointtosharedstorage.Thissectionguidesyouthroughthetasks.

To create the second node

1 LaunchaVIclientandconnecttotheESXServerhost.Usetheusernameand

passwordoftheuserwhowillownthevirtualmachine.

2 Intheinventorypanel,rightclickthehostandchooseNewVirtualMachine,then

makethefollowingselectionswiththewizard:

Table 4-1.

Page Selection

WizardType Typical.

NameandLocation Chooseanameandlocationyouwanttouse,suchasNode2.

ResourcePool Selecttheresourcepoolforthevirtualmachine,orthehostif

there

are

no

resource

pools.Datastore Thispageallowsyoutochoosethelocationforthevirtual

machineconfigurationfileandthe.vmdkfile.

Chooseadatastoreonlocalstorage.

GuestOperatingSystem

ChoosetheWindowsServer2000orWindowsServer2003operatingsystemyouwanttoinstalllater.

CPUs Usethedefault.


Table 4 1


38/56

38 VMware, Inc.

YouneedasharedSCSIcontrollerandsharedSCSIdisksforsharedaccesstoclustered

servicesanddata.ThenextsectionsetsupthedisksforNode2topointtothequorum

diskandsharedstoragedisksforNode1.


1 SelectthevirtualmachineyouvejustcreatedandchooseEditSettings.

2 ClickAdd,selectHardDisk,andclickNext.

3 IntheSelectaDiskpage,chooseMappedSANLUNandclickNext.

YourharddiskpointstoaLUNusingRDM.

4 IntheLUNselectionpage,choosetheLUNthatisusedbyNode1.

5 IntheSelectDatastorepage,selectthelocaldatastore,whichisalsothelocationof

theboot

disk,

and

click

Next.

6 SelectPhysicalcompatibilitymodeandclickNext.

7 SelectavirtualdevicenodeonadifferentSCSIControllerthantheonethatwas

createdwhenyoucreatedthevirtualmachine.

ThisSCSIControlleriscreatedwhenthevirtualharddiskiscreated.

8 ClickFinishtocompletecreatingthedisk.

Whenyouredone,noticethatthewizardhascreatedbothanewdevicenodeand

anewharddisk.

9 SelectthenewSCSIcontroller,setSCSIBusSharingtoPhysical,andclickOK.

10 Repeatsteps1through6butchooseadisk.Youshouldusethesamevirtual

adapter.





Table 4-1.

Page Selection

Chapter 4 Clustering Physical and Virtual Machines



39/56

VMware, Inc. 39


Anewvirtualmachineislikeaphysicalcomputerwithablankharddisk.Youneedto

installanoperatingsystemtouseit.





driveandfindstheinstallationCDROM.



Installing Microsoft Cluster Service


MicrosoftprovidesadocumentaboutinstallingMicrosoftClusterServiceatthe

followinglocation:



Insomecomplexstoragesolutions,suchasanFCswitchedfabric,aparticularstorage

unitmighthaveadifferentidentity(targetIDorrawdiskID)oneachcomputerinthe

cluster.Althoughthisisavalidstorageconfiguration,itcausesaproblemwhenyou

laterwanttoaddanodetothecluster.

To avoid identity target problems

1 DisablethestoragevalidationheuristicsbyclickingtheBackbuttontoreturntotheSelectComputerpage.

2 IntheSelectComputerpage,clicktheAdvancedbuttonandselecttheAdvanced

(minimum)configurationoption.

NOTE MicrosoftClusterServiceisalreadyinstalledforWindows2003servers.ForWindows

2000servers,youneedtoinstallthesoftware.


Running Microsoft Cluster Service


40/56

40 VMware, Inc.

Running Microsoft Cluster Service

MicrosoftClusterServiceshouldoperatenormallyinthevirtualmachineafteritis

installed.


41/56

VMware, Inc. 41

ThischapterdiscusseshowtoupgradeclustersthatuseVMFS2toVMFS3.Itpresents

acomprehensivediscussionofallcasesinthefollowingsections:

Overviewonpage 41

UpgradingClusterinaBoxonpage 42

UpgradingClusterAcrossBoxesonpage 44

UpgradingClustersUsingPhysicaltoVirtualClusteringonpage 46

OverviewUsingVMFS2,youhadanumberofoptionsforsettingupyourMSCScluster:

Forvirtualmachinesclusteredonasinglephysicalhost(clusterinabox),you

coulduseapublicVMFSinoneoftwoways:

UsingnonpassthroughRDMs

Usingsharedvirtualdisks

Forvirtualmachinesclusteredonmultiplephysicalhosts(clusteracrossboxes),

youhadthreeoptions:

ShareddisksonsharedVMFS

TwopassthroughRDMsbackedbythesameLUNonpublicvolume

Asingle

pass

through

RDM

on

ashared

VMFS

volume

Upgrading Clustered Virtual

Machines 5

NOTE UpgradingissupportedonlyfromESXServer2.5.2toESXServer3.0.


Forclustersofphysicalandvirtualmachines(N+1clustering),youusedapublic


42/56

42 VMware, Inc.

p y ( g) y p

volumeusingpassthroughRDM.

Thischapterstepsyouthroughtheupgradeprocessforeachoftheseoptions.

Upgrading Cluster in a Box

WithVMFS2,aclusterinaboxsetupusesapublicVMFS.Bydefault,thegeneral

upgradeprocess,discussedintheInstallationandUpgradeGuide,includesupgradingofpublic

VMFS

2

volumes

to

VMFS

3.

If

you

did

not

upgrade

the

VMFS

used

by

the

clusterduringtheupgradeprocess,youcanupgradeusingtheVIClientlater.

SeetheInstallationandUpgradeGuideformoreinformationonupgrading.Upgrading CIB: Shared RDMs and Boot Disks in Separate VMFSVolumes

Thissectionstepsyouthroughupgradingaclusterinaboxthatusesshared

nonpassthroughRDMsthatresideinadifferentVMFS2volumethanthebasedisks

fortheclustervirtualmachines.

To perform the upgrade

1 Poweroffallclusteredvirtualmachines.

2 UpgradetheESXServerhostfromESXServer2.5.2toESXServer3.0.

3 IfyoudidnotupgradetheVMFS2volumewhereyourcluster.vmdkfilesarekept

toVMFS3duringupgradeofthehost,doitnow:

a SelecttheupgradedhostinaVIClientandclicktheConfigurationtab,then

clickStorage.

b Selectthevolume.

c ClickUpgradetoVMFS3.

4 Ifnecessary,upgradethevolumewhereyoursharedRDMfilesarelocatedand

upgradethosefiles,asinthepreviousstep.

5 RightclickeachclustervirtualmachineintheinventorypanelandclickUpgrade

VirtualHardware.

6 Poweroneachvirtualmachineandverifyclustersetup.

NOTE UpgradingissupportedonlyfromESXServer2.5.2toESXServer3.

Chapter 5 Upgrading Clustered Virtual Machines

IfthevirtualmachinefailstopoweronwitherrormessageInvalid Argument,


43/56

VMware, Inc. 43

youhaveamisconfiguredclustersetup.ThevirtualdiskusedinESX2.xisnot

allowedtopoweroninESX3.0becauseESX3.0checksforinvaliddisktypes.

7 Importtheoldvirtualdisktothenewvirtualdisk,asfollows:

vmkfstools -I /vmfs/volumes/vol1/.vmdk

/vmfs/volumes/vol2//.vmdk

old-virtdisk.vmdkthevirtualdiskfromwhichyouareimporting

new-virtdisk.vmdk thenewvirtualdisktowhichyouareimporting

8 Renameold-virtdisk.vmdkandeditthe.vmxfiletopointto

new-virtdisk.vmdk.

9 Poweronthenodeandverifythattheclusterservicestartswithoutproblems.

Upgrading CIB: RDMs and Boot Disks in Same VMFS Volume

Thissectionstepsyouthroughupgradingaclusterinaboxthatusesshared

nonpassthroughRDMsthatresideinthesameVMFS2volumeasthebasedisksfor

theclustervirtualmachines.

To perform the upgrade


2 SelecttheupgradedhostinaVIClientandclicktheConfigurationtab,thenclick

Storage.

3 UpgradetheVMFS2volumewhereyourcluster.vmdkfilesandyoursharedRDMfilesarelocatedtoVMFS3,asfollows:

a Selectthevolumewherethefilesarelocated.

b ClickUpgradetoVMFS3.

ThisupgradestheVMFS2volumestoVMFS3andrelocatesthe.vmxfileforthe

clustervirtualmachinesintotheupgradedVMFS3volumeinadirectory

structure.

4 Rightclickthesecondclusternodesvirtualmachineintheinventorypaneland

clickUpgradeVirtualHardware.

Anerrorlikethefollowingresults:

VMware ESX Server could not completely upgrade your virtual disk

NOTE ThisrelocatesbothsharedRDMsandthefirstclusternodes.vmxfile.


/vmfs/volumes/2a3330116-da-11....vmdk due to the following error:

Th t t fi d th fil ifi d


44/56

44 VMware, Inc.

The system cannot find the file specified.

Thisisbecauseofstep3,wheretheclustersvirtualmachineswererelocatedtothe

firstnodes

directory.

5 Ignoretheerror.

Thesystemupdatesyourvirtualhardwareregardlessoftheerror.Youcanverify

thisbyviewingthe.vmxfileentriesofthesecondclusternode.

6 Manuallyeditthe.vmxfileofthesecondclustervirtualmachinesothattheentries

ofthequorumdiskandanyothershareddiskpointtothesharedRDMfilesthat

arenow

inside

the

first

nodes

directory

inside

the

VMFS

3partition.

7 Poweroneachvirtualmachineandverifyclustersetup.

Upgrading Cluster Across Boxes

Therearetwotypesofclustersacrossboxes.Thissectionexplainshowtoupgrade

clustersacrossboxesusingsharedpassthroughRDMsandhowtoupgradeclusters

acrossboxes

with

shared

file

systems.

Using Shared Pass-through RDMs

ThissectionexplainshowtoupgradeaclusterwithpassthroughRDMsforeachnode.

To upgrade the cluster


2 SelecttheupgradedhostinaVIClientandclicktheConfigurationtab,thenclick

Storage.

3 UpgradetheVMFS2volumewhereyoursharedpassthroughRDMfilesarekept

toVMFS3:

a Selectthevolume.

b ClickUpgradeto

VMFS

3.

4 Selectthevolumewherethebootdiskfortheclustervirtualmachineislocatedand

upgradeitasinStep3.

Thisupgradesthevolumeandrelocatesthe.vmxfilesrelatedtothevirtual

machinesinsidethevolume.Thenewdirectorystructureisorganizedforeasy

management.

Chapter 5 Upgrading Clustered Virtual Machines

5 Rightclickontheclustervirtualmachineintheinventorypanelontheleftand

h U d Vi t l H d f th i ht b tt


45/56

VMware, Inc. 45

chooseUpgradeVirtualHardwarefromtherightbuttonmenu.

6 RepeatthestepsfortheNode2host.

7 Poweronthevirtualmachinesandverifythecluster.

Using Files in Shared VMFS-2 Volumes

Thissectionexplainshowtoupgradeaclusteracrossboxesifyouusedsharedfilesin

asharedVMFS2volume.

To upgrade your cluster1 BeforeupgradingtoVMFS3,changethesharedVMFS2volumefromsharedto

public,asfollows:

vmkfstools -L lunreset vmhba:0

vmkfstools -F public vmhba

2 PerformthehostupgradesfromESXServer2.5.2toESXServer3.0.

3 SelectthefirstupgradedhostinaVIClientandclicktheConfigurationtab,thenclickStorage.

4 UpgradetheVMFS2volumewhereyourcluster.vmdkfilesarekepttoVMFS3:

a Selectthevolume.

b ClickUpgradetoVMFS3.

5 CreateLUNsforeachshareddisk(i.e.oneLUNforeachshareddisk).

6 Foreachdisk,createaseparateRDMforeachclusternodebackedbythesame

physicaldevice.

a CreatetheRDMandimportthevirtualdisktothisRDM.

vmkfstools -i /vmfs/volumes/vol1/.vmdk

/vmfs/volumes/vol2/// -d

rdmp:/vmfs/devices/disks/vmhbax.y.0

old-virtdisk.vmdk thevirtualdiskfromwhichyouareimporting

myrdm.mdk thenewRDMforNode1

vmhbax.y.z theLUNthatbackstheRDM

7 Editthe.vmxfiletopointtotheRDMinsteadofthesharedfile:

scsi:. = rdm-fxy vm/.vmdk

8 Poweronthenodesandverifythattheclusterservicestartswithoutproblems.


Upgrading Clusters Using Physical to Virtual Clustering


46/56

46 VMware, Inc.

IfyouareusingaphysicaltovirtualclusterusingVMFS2,youuseapublicdiskthatis

mappedusingRDMfromthevirtualmachine.

Bydefault,theupgradeprocessconvertsyourVMFS2diskstoVMFS3.Youcanalso

explicitlyconvertVMFS2volumeslaterifyoudidnotconvertthemaspartofthe

defaultconversion.


47/56

VMware, Inc. 47

AdministratorswhoaresettingupMicrosoftClusterServiceonESXServer3canuse

thisappendixasachecklist.

Theappendixincludesinformationinthefollowingtables:

Table A1RequirementsforNonclusteredDisks(SEEUPDATE). Table A2RequirementsforClusteredDisks.

Table A3OtherClusteringRequirements.

Setup Checklist

Table A-1. Requirements for Non-clustered Disks

Component Requirements

Virtualmachinebootdiskandpagingfile

Mustbeonlocalstorage,notonaSAN.

Mustbeanonclustereddisk.

Nonclustered,virtual(.vmdk)disk

MustresideonalocalVMFS.

SCSIBusSharingModemustbesettoNone (thedefault).

Nonclustered,RDM MustresideonalocalVMFS.

DiskmustbeinPersistentmode(thedefault).

DeviceType

must

be

set

to

Virtual Compatibility

mode

(SCSI

NPT)

or

Physical Compatibilitymode(SCSIpassthroughRDM).Thisissetwhenyouaddtheharddisk.

SCSIBusSharingModemustbesettoNone(thedefault).

Nonclustered,rawdisk MustresideonalocalVMFS.

SCSIBusSharingModemustbesettoNone (thedefault).


Table A-2. Requirements for Clustered Disks


48/56

48 VMware, Inc.

Component Single-host Clustering Multi-host Clustering

Clustered

Virtual(.vmdk)disk

MustusePersistentmode.

SCSIbussharingmodemustbesettoVirtual.

Notsupported.

Clustereddisks,virtualcompatibilitymode(nonpassthroughRDM)

DiskmustbeinPersistentmode.

SCSIbussharingmodemustbesettoVirtual.

MustusesingleRDMmappingfile.

DiskmustbeinPersistentmode.

SCSIbussharingmodemustbesettoPhysical.

Clustereddisks,physical

compatibilitymode(passthroughRDM).

Notsupported. DiskmustbeinPersistentmode.

DevicetypemustbePhysicalcompatibilitymode.Thisissetduringharddiskcreation.

SCSIbussharingmodemustbesettoPhysical.

Clusteredrawdisk Notsupported. Notsupported.UseRDMinstead.

Alltypes AllclusterednodesmustusethesametargetID(onthevirtualSCSI

adapter)forthesameclustereddisk.Aseparatevirtualadaptermustbeusedforclustereddisks.

Table A-3. Other Clustering Requirements (SEE UPDATE)

Component Requirement

ESXServer

configuration

Allconfigurationfiles,logfiles,andnvramforthevirtualmachinemustbeonlocal

storage,

not

on

a

SAN.Selectthehost,clicktheConfigurationtab,clickAdvanced Settings, andclickDisk.

MakesureDisk.UseLunResetissetto1(thedefault).

MakesureSetDisk.UseDeviceResetissetto0(thedefault).

SetDisk.UseResetOnFailoverto1.Dontovercommitmemoryi.e.setMemory Reservation (minimummemory)tothesameasMemory Limit(maxmemory).

Ifmemorycanbeovercommittedundercertaincircumstances,theswapfilemustbe

local,not

on

the

SAN.

QlogicHBA Forinformationondriverrevision,seetheESXServerI/OCompatibilityGuide.

BIOSSettings:

EnableTargetReset=Yes

FullLIPLogin=Yes

FullLIPReset=No

EmulexHBA Forinformationondriverrevision,seetheESXServerI/OCompatibilityGuide.

Setup Checklist

Table A-3. Other Clustering Requirements (SEE UPDATE)



49/56

VMware, Inc. 49

Windows OperatingsystemisWindows2000orWindows2003.

Onlytwoclusternodes.

I/Otimeoutissixtysecondsormore(HKEY_LOCAL_MACHINE\System\CurrentControlSet\Services\Disk\TimeOutValue).

Note:Ifyourecreatethecluster,thisvaluemayberesettoitsdefault,soyoumustchangeitagain.

Clusterservicemustrestartautomaticallyonfailure(first,second,andsubsequenttimes).

Information

requiredbytechnicalsupporttoanalyzeclusteringrelatedissues

Verify

that

the

setup

complies

with

the

checklist.vmsupporttarball(vmkernellog,virtualmachineconfigurationfilesandlogs,)

Applicationandsystemeventlogsofallvirtualmachineswiththeproblem.

Clusterlogofallvirtualmachineswiththeproblem(i.e.%ClusterLog%whichisusuallysetto%SystemRoot%\cluster\cluster.log).

DiskI/Otimeout(HKEY_LOCAL_MACHINE\System\CurrentControlSet\Services\Disk\TimeOutValue)

Nameofthevirtualmachinesexperiencingtheproblem.

Dateandtimeandtheproblemoccurred.SANconfigurationoftheESXServersystem(LUNs,paths,andadapters).




50/56

50 VMware, Inc.

Index


51/56

VMware, Inc. 51VMware, Inc. 51

A

across boxes 27

introduction 11

prerequisites 15adding storage 20, 28

applications 9

C

caveats 16

cloning node1 23, 32

cluster across boxes 27first node 30

introduction 11, 12

prerequisites 15

second node 32

upgrading 44, 45

cluster in a box 19

first node 21

introduction 11

prerequisites 14

second node 23

upgrading 42, 43

clustering applications 9

clustering hardware 10clustering physical and virtual

machines 13, 35

first node 37

second node 37

clustering software 10

clustering virtual across physical

hosts 27

introduction 11

prerequisites 15

clustering virtual machines on one

host 19

introduction 11

prerequisites 14

configuring IP addresses 20, 28

D

disks

adding before networking 17adding to nodes (across boxes) 32

adding to nodes (in-a-box) 23

quorum 24, 33, 38

shared 24, 33, 38

F

first nodecreating (across boxes) 30

creating (in-a-box) 21

creating (standby host) 37

G

guest operating system

installing 22, 31, 39

H

hardware 10

HBA settings 17, 18

I

in-a-box 19


introduction 11

prerequisites 14

quorum disk 24, 33, 38

R
http://-/?-http://-/?-http://-/?-http://-/?-


52/56

52 VMware, Inc.

introduction 13

IP addresses 20, 28

K

knowledge base

accessing 7

M

Microsoft Cluster Serviceconfiguring 21

installing 21, 25, 34, 39

running 34, 40

setup 36

MSCS

configuring 21

installing 21, 25, 34, 39

running 34, 40

setup 36

N

N+1

prerequisites 15networking

effect of adding disks 17

node1

cloning 23, 32

O

operating systeminstalling 22, 23, 31, 39

P

prerequisites 14

Q

QLogic HBA settings 17, 18

R

restrictions 16

S

second node

creating (across boxes) 32

creating (in-a-box) 23

creating (standby host) 37

server operating systeminstalling 23, 31

setup

troubleshooting 17

shared storage disk 24, 33, 38

shared storage summary 16

standby host 35

introduction 13

prerequisites 15

upgrading 46

storage 20, 28

quorum disk 24, 33, 38

shared 24, 33, 38

U

upgrade 43

upgrading 42

cluster across boxes 44, 45

cluster in a box 42, 43

overview 41

standby-host cluster 46

user groups

accessing 7

V

VMware community forums

accessing 7

Updates for the Setup for Microsoft

Cl t S i


53/56

VMware, Inc. Update1

Cluster ServiceLastUpdated:February11,2008

ThisdocumentprovidesyouwithupdatestotheESXServer3.0.1and

VirtualCenter 2.0.1versionoftheSetupforMicrosoftClusterService.Updateddescriptions,procedures,andgraphicsareorganizedbypagenumbersothatyoucan

easilylocatetheareasoftheguidethathavechanges.Ifthechangespansmultiple

sequentialpages,thisdocumentprovidesthestartingpagenumberonly.

ThefollowingisalistofSetupforMicrosoftClusterServicepageupdatesinthisdocument:

UpdatesforthePrerequisitesforStandbyHostClusteringSectiononPage 15

UpdatesfortheAddingDisksBeforeNetworkingSectiononPage 17

UpdatesfortheCreatingtheFirstNodeProcedureonPage 31

UpdatesfortheCreatingtheSecondNodeSectiononPage 32

UpdatesfortheAddingHardDiskstoBothNodesSectiononPage 32

UpdatesfortheAddingaQuorumDiskandSharedStorageDiskProcedureon

Page 33

UpdatesforTableA3onPage 48

Updates for the Prerequisites for Standby Host ClusteringSection on Page 15

ThethirdbulletinthePrerequisitesforStandbyHostClusteringsectionshouldread

asfollows:

Nomultipathingsoftwarecanberunninginthephysicalmachineorthevirtual

machine.The

ESX

Server

host

automatically

uses

native

ESX

Server

multipathing.

Becauseyoucannotrunmultipathingsoftwareonthephysicalorthevirtual

machine,bothhostsonactive/passivearrayscanbeconnectedtoonlyasingle

storageprocessorandtherecanbeonlyasinglepathfromthephysicalmachine

hostingthenativenodetothearray.

Updates for the Setup for Microsoft Cluster Service

Updates for the Adding Disks Before Networking Sectionon Page 17


54/56

Update2 VMware, Inc.

g

Replace

text

in

the

Adding

Disks

Before

Networking

with

the

following:AddingavirtualdiskonanauxiliaryvirtualSCSIcontrollertoavirtualmachinemoves

otherdevicestonewPCIslots.TheVMwarevPlatformusesastandardplantoarrange

theslotorderofvirtualdevicesinavirtualmachine.Currentlyyoucannotspecifythe

loadorderofindividualvirtualPCIdevices(forexample,scsi0goesinPCIslot0x11,

andsoon).

VirtualPCIdevicesareplacedintothePCIslotsinavirtualmachinebyusinga

predefinedscanorder:

1 PCI0x00:0x0f.0x00(PCIbuszero,slotfifteen,functionzero)containstheVMware

SVGAIIvideoadapter.Thismapstoslot1onthevirtualhardware.Youcannot

disablethevirtualvideoadapterdevice.TheremainingfivevirtualPCIslotsare

filledbasedontheiravailability.

2 AllvirtualSCSIcontrollersareaddedbasedonthenumberingkey(scsi#),starting

atPCI

0x00:0x10.0x00

(PCI

bus

zero,

slot

sixteen,

function

zero),

with

the

lowest

numberedvirtualSCSIcontroller.

3 AfterallvirtualSCSIcontrollersareadded,thevirtualEthernetcontrollersare

added.

4 Thevirtualsoundcard(ifavailableandconfigured)isadded.

AddingorremovingavirtualSCSIcontroller,forexample,causesthedeviceslowerin

thescanorder(virtualEthernetcontrollersandthevirtualsoundcard)tomovetonewvirtualPCIslotlocations.

BringingupvirtualPCIdevicesinthisorderpreservesthevirtualPCIslotmappingfor

thefirstvirtualSCSIcontrolleratalltimes.ThefirstvirtualSCSIcontrolleristypically

usedasthebootSCSIcontroller,andmanyoperatingsystemsrelyonthatSCSI

controllerbeinginafixedlocationonthePCIbus.


Updates for the Creating the First Node Procedure onPage 31


55/56

VMware, Inc. Update3

g

Replace

the

To

create

the

first

nodes

virtual

machine

procedure

with

the

following:

To create the first nodes virtual machine

1 StartaVIClientandconnecttotheVirtualCenterServerthatmanagestheESX

Serverhoststhatcomprisethecluster.

Usetheusernameandpasswordoftheuserwhowillownthevirtualmachine.

2 Ontheinventorypanel,rightclicktheESXServerhostandchooseNewVirtual

Machine.

Makethefollowingselectionswiththewizard:

Table 3-1. New Virtual Machine Properties

Page Selection

WizardType Typical.

NameandLocation Chooseanameandlocationtouse,suchasNode1.

ResourcePool Selecttheresourcepoolforthevirtualmachine,orthehostifnoresourcepoolsarepresent.

Datastore Choosethelocationforthevirtualmachineconfigurationfileandthe.vmdkfile.Choosealocaldatastore.

GuestOperatingSystem ChoosetheWindows2003Serveroperatingsystemtoinstall.

CPUs Usethe

default

suggested

for

your

operating

system.






Updates for the Creating the Second Node Section onPage 32


56/56

Update4 VMware, Inc.

ThefirstparagraphintheCreatingtheSecondNodesectionshouldread:

CreatingthesecondnodeinvolvescloningtheNode1virtualmachineontoasecond

ESXServerhost,addingdiskstothatvirtualmachine,andensuringthatthesedisks

pointtothestoragesharedwithNode1.

Updates for the Adding Hard Disks to Both Nodes Sectionon Page 32

ThefirstnoteintheAddingHardDiskstoBothNodessectionshouldreadasfollows:

Updates for the Adding a Quorum Disk and SharedStorage Disk Procedure on Page 33

Step 3oftheToaddaquorumdiskandsharedstoragediskprocedureshouldreadas

follows:

OntheSelectaDiskpage,chooseRawDeviceMappingandclickNext.

Updates for Table A-3 on Page 48InTable A3intherequirementsforESXServerconfiguration,notethefollowing

corrections:

ThedefaultvalueofDisk.UseDeviceReset is1,not0.

Change Disk.UseResetOnFailovertoDisk.ResetOnFailover.

NOTE Forthefirstnode,pointeachdisktoadifferentLUN.Forthesecondnode,

choosethesameLUNsasyoudidforthefirstnode.

Documents

VMware Infrastructure Setup for Microsoft Cluster Service