8/19/2019 How to Install and Configure a Two 4.0 Solaris 11
1/14
How to Install and Configure a Two-NodeCluster
Using Oracle Solaris Cluster 4.0 on Oracle Solaris 11by Subarna Ganguly and Jonathan Mellors, December 2011
How to quickl and easil install and configure Oracle Solaris Cluster software for two nodes! includingconfiguring a quoru" de#ice.
Introduction
This article provides a step-by-step process for using the
interactive scinstall utility to install and configure Oracle Solaris Cluster software for two nodes, including the configuration of a quorum device. It does
not cover the configuration of highly available services.
Note !or more details on how to install and configure other Oracle Solaris
Cluster software configurations, see the Oracle Solaris Cluster Software
Installation "uide.
The interactive scinstall utility is menu-driven. The menus help reduce the chance of mista#es and promote
best practices by using default values, prompting you for information specific to your cluster, and identifying
invalid entries.
The scinstall utility also eliminates the need to manually set up a quorum device by automating the
configuration of a quorum device for the new cluster.
Note This article refers to the Oracle Solaris Cluster $.% release. !or more information about the latest Oracle
Solaris Cluster release, see the release notes.$rerequisites! %ssu"&tions! and 'efaults
This section discusses several prerequisites, assumptions, and defaults for two-node clusters.
Configuration %ssu"&tionsThis article assumes the following conditions are met
• &ou are installing on Oracle Solaris '' and you have basic system administration s#ills.
• &ou are installing Oracle Solaris Cluster $.% software.
• The cluster hardware is supported with Oracle Solaris Cluster $.% software. (See Oracle Solaris Cluster
System )equirements.*
• + two-node cluster is installed. /owever, the installation procedure is applicable to S0+)C clustersas well.
• 1ach node has two spare networ# interfaces to be used as private interconnects, also #nown as
transports, and at least one networ# interface that is connected to the public networ#.
• SCSI shared storage is connected to the two nodes.
• &our setup loo#s li#e !igure ', although you might have fewer or more devices, depending on your
system or networ# configuration.
Note It is recommended, but not required, that you have console access to the nodes during cluster installation.
2ant technical articles li#e this
one delivered to yourinbo3 Subscribe to theSystems Community4ewsletter 5only technicalcontent for sysadmins anddevelopers.
http://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLISThttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLISThttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLISThttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLRELhttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLRELhttp://www.oracle.com/technetwork/server-storage/solaris-cluster/overview/sysreq-cluster-166689.pdfhttp://www.oracle.com/technetwork/server-storage/solaris-cluster/overview/sysreq-cluster-166689.pdfhttp://www.oracle.com/technetwork/server-storage/solaris-cluster/overview/sysreq-cluster-166689.pdfhttp://www.oracle.com/us/syndication/subscribe/index.html#newslettershttp://www.oracle.com/us/syndication/subscribe/index.html#newslettershttp://www.oracle.com/us/syndication/subscribe/index.html#newslettershttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLISThttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLISThttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLISThttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLISThttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLRELhttp://www.oracle.com/technetwork/server-storage/solaris-cluster/overview/sysreq-cluster-166689.pdfhttp://www.oracle.com/technetwork/server-storage/solaris-cluster/overview/sysreq-cluster-166689.pdfhttp://www.oracle.com/us/syndication/subscribe/index.html#newslettershttp://www.oracle.com/us/syndication/subscribe/index.html#newslettershttp://www.oracle.com/us/syndication/subscribe/index.html#newsletters
8/19/2019 How to Install and Configure a Two 4.0 Solaris 11
2/14
(igure 1. Oracle Solaris Cluster Hardware Configuration
$rerequisites for )ac* Sste"This article assumes that Oracle Solaris '' has been installed on both systems.
Initial $re&aration of $u+lic I$ %ddresses and ,ogical Host Na"es
&ou must have the logical names (host names* and I0 addresses of the nodes that are to be configured as a
cluster. +dd those entries to each node6s /etc/inet/hosts file or to a naming service if a naming service,
such as 74S, 4IS, or 4IS8 maps, is used.
The eample in this article uses the 4IS service and the configuration shown in Table '.
Ta+le 1. Configuration
CO$ON)NT
Cluster 4ame
4ode '
4ode 9
'efaultsThe scinstall interactive utility in Typical mode installs the Oracle Solaris Cluster software with the following
defaults
• 0rivate-networ# address ':9.'.%.%
• 0rivate-networ# netmas# 9;;.9;;.9$.%
• Cluster-transport switches switch1 and switch2
The eample in this article has no cluster-transport switches. Instead, the private networ#ing is resolved by using
bac#-to-bac# cables.
In the eample in this article, the interfaces of the private interconnects are nge1 and e1000g1 on both cluster
nodes.
$reinstallation C*ecks0erform the following steps.
8/19/2019 How to Install and Configure a Two 4.0 Solaris 11
3/14
'. Temporarily enable rsh or ssh access for root on the cluster nodes.
9.
8/19/2019 How to Install and Configure a Two 4.0 Solaris 11
4/14
o If the networ# interfaces are not configured as static I0 addresses, on each node, run the
command shown in
8/19/2019 How to Install and Configure a Two 4.0 Solaris 11
5/14
i. Hre-%lCster-s11 - - 174.0$ static 2011-04-27 03:1. s11 ( ).05 static 2011-04-25 03:0
Configuring t*e Oracle Solaris Cluster $u+lis*er
There are two main ways to access the Oracle Solaris Cluster pac#age repository, depending on whether the
cluster nodes have direct access (or access through a 2eb proy* to the Internet
• ?se a repository hosted on p#g.oracle.com.• ?se a local copy of the repository.
Using a e&ositor Hosted on &kg.oracle.co"To access either the Oracle Cluster Solaris )elease or Support repositories, obtain the SS< public and private
#eys, as follows
'. "o to http@@p#g-register.oracle.com (login required*.9. Choose the Oracle Solaris Cluster )elease or Support repository.
=. +ccept the license.
$. )equest a new certificate by choosing the Oracle Solaris Cluster software and submitting a request. (+certification page is displayed with download buttons for the #ey and certificate.*
;. 7ownload the #ey and certificate and install them, as described in the certification page.
. Configure the ha-cluster publisher with the downloaded SS< #eys to point to the selected repository
?)< on p#g.oracle.com. The following eample uses the release repository
7. # pkg set-publisher \ -k/var/pkg/ssl/#racle$%olaris$!luster$&.'.key.pem \ -c/var/pkg/ssl/#racle$%olaris$!luster$&.'.certificate.pem \ -ghttps://pkg.oracle.com/ha-cluster/release/ ha-cluster
Using a ,ocal Co& of t*e e&ositorTo access a local copy of the Oracle Solaris Cluster )elease or Support repository, download the repository
image, as follows.
'. 7ownload the repository image from one of the following sites
o Oracle Technology 4etwor#
o Oracle Software 7elivery Cloud (login required*
9. On the Aedia 0ac# Search page, select Oracle Solaris as the 0roduct 0ac# and clic# 3o.=. Choose Oracle Solaris Cluster 4.0 edia $ack and download the file.$. Aount the repository image and copy the data to a shared file system that all the cluster nodes can
access.
. # lofiadm -a /tmp/osc&.'-repo-full.iso5. delofi17. # mount -( hsfs /dev/lofi/ /mnt3. # rsync -a /mnt/repo /export4. # share /export/repo'%. Configure the ha-cluster publisher. The following eample uses node ' as the system that shared
the local copy of the repository
11. # pkg set-publisher -g file:///net/phys-schost-/export/repo ha-clusterInstalling t*e Oracle Solaris Cluster Software $ackages
'. On each node, ensure the correct Oracle Solaris pac#age repositories are published. If they are not,unset the incorrect publishers and set the correct ones. The installation of the ha-cluster pac#ages is li#ely to
fail if it cannot access the Oracle Solaris publisher.
http://www.oracle.com/technetwork/articles/servers-storage-admin/o11-147-install-2node-cluster-1395587.html#hostedhttp://www.oracle.com/technetwork/articles/servers-storage-admin/o11-147-install-2node-cluster-1395587.html#localhttp://pkg-register.oracle.com/http://pkg-register.oracle.com/http://pkg-register.oracle.com/http://www.oracle.com/technetwork/server-storage/solaris-cluster/downloads/index.htmlhttp://edelivery.oracle.com/http://edelivery.oracle.com/http://www.oracle.com/technetwork/articles/servers-storage-admin/o11-147-install-2node-cluster-1395587.html#hostedhttp://www.oracle.com/technetwork/articles/servers-storage-admin/o11-147-install-2node-cluster-1395587.html#localhttp://pkg-register.oracle.com/http://www.oracle.com/technetwork/server-storage/solaris-cluster/downloads/index.htmlhttp://edelivery.oracle.com/
8/19/2019 How to Install and Configure a Two 4.0 Solaris 11
6/14
2. # pkg publisher/.). H,!IS "VI%"net/ "thernet CnknoGn 0 CnknoGn e1000g1net0 "thernet Cp 1000 fCll nge0net) "thernet CnknoGn 0 CnknoGn e1000g2net2 "thernet CnknoGn 0 CnknoGn e1000g0net1 "thernet CnknoGn 0 CnknoGn nge1net "thernet CnknoGn 0 CnknoGn e1000g/
On node 9, run this command.
# dladm show-phys
I($ "IA S&A&" SH"" ,H"> "VI%"net/ "thernet CnknoGn 0 CnknoGn e1000g1net0 "thernet Cp 1000 fCll nge0net) "thernet CnknoGn 0 CnknoGn e1000g2net2 "thernet CnknoGn 0 CnknoGn e1000g0net1 "thernet CnknoGn 0 CnknoGn nge1net "thernet CnknoGn 0 CnknoGn e1000g/
In our eample, we will be using net1 and net3 on each node as private interconnects.
9. On both nodes, ensure that SA! services are not disabled.
/. # svcs -x
8/19/2019 How to Install and Configure a Two 4.0 Solaris 11
7/14
$. On each node, ensure that the service network/rpc/bind:default has
its local_only configuration set to false.
. # svcprop network/rpc/bind:default ) grep local$only5.
7. configlocal=only boolean falseIf it is not set to false, set it as follows
# svccfgsc:6 select network/rpc/bind sc:netGorkrpcbind6 setprop config/local$only=falsesc:netGorkrpcbind6 *uit
# svcadm refresh network/rpc/bind:default# svcprop network/rpc/bind:default ) grep local$onlyconfiglocal=only boolean false
. !rom one of the nodes, start the Oracle Solaris Cluster configuration utility by runningthe scinstall command, which will configure the software on the other node as well, and then type 1 from the
Aain menu to choose to create a new cluster or add a cluster node.
In the eample shown in
8/19/2019 How to Install and Configure a Two 4.0 Solaris 11
8/14
23. &his tool sCpports tGo odes of operation9 &ypical ode and%Csto
24. ode. +or ost clCsters9 yoC can Cse &ypical ode.
8/19/2019 How to Install and Configure a Two 4.0 Solaris 11
9/14
traffic on those interfaces, it will as# for confirmation to use them anyway. 1nsure that those interfaces are notconnected to any other networ#, and then confirm their use as transport adapters, as shown in
8/19/2019 How to Install and Configure a Two 4.0 Solaris 11
10/14
1. Attachent ?SA&A@ disks9 or if yoCr shared disks do not sCpport15. S%SI-29 yoC Cst disable this featCre.17.13. If yoC disable aCtoatic NCorC deice selection noG9 or if yoC
intend14. to Cse a NCorC deice that is not a shared disk9 yoC Cst
instead Cse20. clsetCp?1@ to anCally configCre NCorC once both nodes haeoined
21. the clCster for the first tie.22.2/. o yoC Gant to disable aCtoatic NCorC deice selection
?yesno@ EnoFM2).2. Is it okay to create the neG clCster ?yesno@ EyesFM25. Cring the clCster creation process9 clCster check is rCn on each
of the neG clCster nodes.27. If clCster check detects probles9 yoC can either interrCpt the
process or check the log
23. files after the clCster has been established.24./0. InterrCpt clCster creation for clCster check errors ?yesno@
EnoFM
8/19/2019 How to Install and Configure a Two 4.0 Solaris 11
11/14
available applications. These cluster components can include device groups, cluster file systems, highly availablelocal file systems, and individual data services and one clusters. To configure these components, consultthe documentation library.
c. On each node, verify that multi-user services for the Oracle Solaris Service Aanagement !acility (SA!* areonline. +lso ensure that the new services added by Oracle Solaris Cluster are all online.
d. # svcs -xe. # svcs multi-user-serverf. S&A&" S&I" +Ig. online 4:3:)) sc:ilestoneClti-Cser-serer:defaClth. !rom one of the nodes, verify that both nodes have Doined the cluster, as shown in
8/19/2019 How to Install and Configure a Two 4.0 Solaris 11
12/14
bd. ----------------- ----------- ----------------------------------
be.bf. --- Clti-oGner eice roCp StatCs ---bg.bh. eice roCp (ae (ode (ae StatCs
bi. ----------------- --------- ------b.bk. QQQ %lCster esoCrce roCps QQQbl.b. roCp (ae (ode (ae SCspended Statebn. ---------- --------- --------- -----bo.bp. QQQ %lCster esoCrces QQQbN.br. esoCrce (ae (ode (ae State StatCs essagebs. ------------- --------- ----- --------------bt.bC. QQQ %lCster I eices QQQ
b. eice Instance (ode StatCsbG. --------------- ---- ------bD. dedidrdskd1 phys-schost-1 'kby. phys-schost-2 'kbR. dedidrdskd2 phys-schost-1 'kca. phys-schost-2 'kcb. dedidrdskd/ phys-schost-1 'kcc. dedidrdskd) phys-schost-1 'kcd. dedidrdskd phys-schost-2 'kce. dedidrdskd5 phys-schost-2 'kcf.cg. QQQ one %lCsters QQQch.
ci. --- one %lCster StatCs ---c.ck. (ae (ode (ae one
8/19/2019 How to Install and Configure a Two 4.0 Solaris 11
13/14
1.2./. phys-schost-2 # %lCster (ode1.2./.5 schost-lh
9. !rom one of the nodes, create a pool with the two shared storagedis#s /dev/did/rdsk/d1s0 and /dev/did/rdsk/d2s0. In our eample, we have assigned the entire dis# to
slice % of the dis#s, using the format utility.
/. # pool create -m /fs pool mirror /dev/did/dsk/ds'/dev/did/dsk/ds'
).. # df -k /fs5. +ilesyste 102)-blocks ,sed Aailable %apacity
oCnted on7. pool1 201)315 /1 201)722 1T
Rfs1
The pool will now be placed in a highly available resource group as a resource of type SUNW.HAStoragePlus.
This resource type has to be registered before it is used for the first time.. Create a highly available resource group to house the resources by doing the following on one node
4. # /usr/cluster/bin/clrg create test-rg'%. Then add the networ# resource to the group
11. # /usr/cluster/bin/clrslh create -g test-rg -h schost-lh schost-lhres
'9. )egister the storage resource type
1/. # /usr/cluster/bin/clrt register %012.34%toragelus'$. +dd the pool to the group
1. # /usr/cluster/bin/clrs create -g test-rg -t %012.34%toragelus-p \ pools=pool hasp-res
'. >ring the group online
17. # /usr/cluster/bin/clrg online -e5 test-rg'. Chec# the status of the group and the resources, as shown in
8/19/2019 How to Install and Configure a Two 4.0 Solaris 11
14/14
/3./4. schost-lhres phys-schost-1 'nline 'nline -
ogical