24
Sun Cluster 3.1 Data Service for Oracle Parallel Server/Real Application Clusters Sun Microsystems, Inc. 4150 Network Circle Santa Clara, CA 95054 U.S.A. Part No: 817–1535–10 May 2003, Revision A

Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

Embed Size (px)

Citation preview

Page 1: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

Sun Cluster 3.1 Data Service forOracle Parallel Server/Real

Application Clusters

Sun Microsystems, Inc.4150 Network CircleSanta Clara, CA 95054U.S.A.

Part No: 817–1535–10May 2003, Revision A

Page 2: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

Copyright 2003 Sun Microsystems, Inc. 4150 Network Circle, Santa Clara, CA 95054 U.S.A. All rights reserved.

This product or document is protected by copyright and distributed under licenses restricting its use, copying, distribution, and decompilation. Nopart of this product or document may be reproduced in any form by any means without prior written authorization of Sun and its licensors, if any.Third-party software, including font technology, is copyrighted and licensed from Sun suppliers.

Parts of the product may be derived from Berkeley BSD systems, licensed from the University of California. UNIX is a registered trademark in the U.S.and other countries, exclusively licensed through X/Open Company, Ltd.

Sun, Sun Microsystems, the Sun logo, docs.sun.com, AnswerBook, AnswerBook2, and Solaris are trademarks, registered trademarks, or service marksof Sun Microsystems, Inc. in the U.S. and other countries. All SPARC trademarks are used under license and are trademarks or registered trademarksof SPARC International, Inc. in the U.S. and other countries. Products bearing SPARC trademarks are based upon an architecture developed by SunMicrosystems, Inc.

The OPEN LOOK and Sun™ Graphical User Interface was developed by Sun Microsystems, Inc. for its users and licensees. Sun acknowledges thepioneering efforts of Xerox in researching and developing the concept of visual or graphical user interfaces for the computer industry. Sun holds anon-exclusive license from Xerox to the Xerox Graphical User Interface, which license also covers Sun’s licensees who implement OPEN LOOK GUIsand otherwise comply with Sun’s written license agreements.

Federal Acquisitions: Commercial Software–Government Users Subject to Standard License Terms and Conditions.

DOCUMENTATION IS PROVIDED “AS IS” AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES,INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT, AREDISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.

Copyright 2003 Sun Microsystems, Inc. 4150 Network Circle, Santa Clara, CA 95054 U.S.A. Tous droits réservés.

Ce produit ou document est protégé par un copyright et distribué avec des licences qui en restreignent l’utilisation, la copie, la distribution, et ladécompilation. Aucune partie de ce produit ou document ne peut être reproduite sous aucune forme, par quelque moyen que ce soit, sansl’autorisation préalable et écrite de Sun et de ses bailleurs de licence, s’il y en a. Le logiciel détenu par des tiers, et qui comprend la technologie relativeaux polices de caractères, est protégé par un copyright et licencié par des fournisseurs de Sun.

Des parties de ce produit pourront être dérivées du système Berkeley BSD licenciés par l’Université de Californie. UNIX est une marque déposée auxEtats-Unis et dans d’autres pays et licenciée exclusivement par X/Open Company, Ltd.

Sun, Sun Microsystems, le logo Sun, docs.sun.com, AnswerBook, AnswerBook2, et Solaris sont des marques de fabrique ou des marques déposées, oumarques de service, de Sun Microsystems, Inc. aux Etats-Unis et dans d’autres pays. Toutes les marques SPARC sont utilisées sous licence et sont desmarques de fabrique ou des marques déposées de SPARC International, Inc. aux Etats-Unis et dans d’autres pays. Les produits portant les marquesSPARC sont basés sur une architecture développée par Sun Microsystems, Inc.

L’interface d’utilisation graphique OPEN LOOK et Sun™ a été développée par Sun Microsystems, Inc. pour ses utilisateurs et licenciés. Sun reconnaîtles efforts de pionniers de Xerox pour la recherche et le développement du concept des interfaces d’utilisation visuelle ou graphique pour l’industriede l’informatique. Sun détient une licence non exclusive de Xerox sur l’interface d’utilisation graphique Xerox, cette licence couvrant également leslicenciés de Sun qui mettent en place l’interface d’utilisation graphique OPEN LOOK et qui en outre se conforment aux licences écrites de Sun.

CETTE PUBLICATION EST FOURNIE “EN L’ETAT” ET AUCUNE GARANTIE, EXPRESSE OU IMPLICITE, N’EST ACCORDEE, Y COMPRIS DESGARANTIES CONCERNANT LA VALEUR MARCHANDE, L’APTITUDE DE LA PUBLICATION A REPONDRE A UNE UTILISATIONPARTICULIERE, OU LE FAIT QU’ELLE NE SOIT PAS CONTREFAISANTE DE PRODUIT DE TIERS. CE DENI DE GARANTIE NES’APPLIQUERAIT PAS, DANS LA MESURE OU IL SERAIT TENU JURIDIQUEMENT NUL ET NON AVENU.

030313@5533

Page 3: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

Contents

Preface 5

Installing and Configuring Sun Cluster Support for Oracle Parallel Server/RealApplication Clusters 9

Installing and Configuring Sun Cluster Support for Oracle Parallel Server/RealApplication Clusters 9Overview 10

An Atypical Data Service 10Pre-Installation Considerations 11

Special Requirements 1132-Bit or 64-Bit Mode 12Log File Locations 12Node Failures and Recovery Procedures 12Using the Oracle Parallel Fail Safe/Real Application Clusters Guard Option WithSun Cluster 3.1 13

Installing Volume Management Software With Sun Cluster Support for Oracle ParallelServer/Real Application Clusters 13

� How to Use VxVM 14� How to Use Hardware RAID Support 14

Installing Sun Cluster Support for Oracle Parallel Server/Real Application ClustersPackages 16

� How to Install Sun Cluster Support for Oracle Parallel Server/Real ApplicationClusters Packages With VxVM 16� How to Install Sun Cluster Support for Oracle Parallel Server/Real ApplicationClusters Packages With Hardware RAID 17

Installing the Oracle Software 18� How to Prepare the Sun Cluster Nodes 18

3

Page 4: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

� How to Install the Oracle UDLM Software 19

� How to Install the Oracle RDBMS Software and Create Your Oracle Database21

Index 23

4 Sun Cluster 3.1 Data Service for Oracle Parallel Server/Real Application Clusters • May 2003, Revision A

Page 5: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

Preface

Sun Cluster 3.1 Data Service for Oracle Parallel Server/Real Application Clusters containsprocedures to install and configure the Sun Cluster Support for Oracle ParallelServer/Real Application Clusters on your Sun Cluster nodes.

This document is intended for system administrators with extensive knowledge ofSun software and hardware. Do not use this document as a planning or presalesguide. Before reading this document, you should have already determined yoursystem requirements and purchased the appropriate equipment and software.

The instructions in this document assume knowledge of the Solaris™ operatingenvironment and expertise with the volume manager software used with Sun Cluster.

UNIX CommandsThis document contains information on commands specific to installing andconfiguring Sun Cluster data services. It might not contain information on basicUNIX® commands and procedures, such as shutting down the system, booting thesystem, and configuring devices. For that information, see one or more of thefollowing:

� Online documentation for the Solaris software environment� Solaris operating environment man pages� Other software documentation that you received with your system

5

Page 6: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

Typographic ConventionsThe following table describes the typographic changes used in this book.

TABLE P–1 Typographic Conventions

Typeface or Symbol Meaning Example

AaBbCc123 The names of commands, files, anddirectories; on-screen computer output

Edit your .login file.

Use ls -a to list all files.

machine_name% you havemail.

AaBbCc123 What you type, contrasted withon-screen computer output

machine_name% su

Password:

AaBbCc123 Command-line placeholder: replace witha real name or value

To delete a file, type rmfilename.

AaBbCc123 Book titles, new words, or terms, orwords to be emphasized.

Read Chapter 6 in User’s Guide.

These are called class options.

You must be root to do this.

Shell Prompts in Command ExamplesThe following table shows the default system prompt and superuser prompt for the Cshell, Bourne shell, and Korn shell.

TABLE P–2 Shell Prompts

Shell Prompt

C shell prompt machine_name%

C shell superuser prompt machine_name#

Bourne shell and Korn shell prompt $

Bourne shell and Korn shell superuser prompt #

6 Sun Cluster 3.1 Data Service for Oracle Parallel Server/Real Application Clusters • May 2003, Revision A

Page 7: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

Related Documentation

Application Title Part Number

Installation Sun Cluster 3.1 Software Installation Guide 816-3388

Hardware Sun Cluster 3.1 Hardware Administration Manual 817–0168

Sun Cluster 3.x Hardware Administration Collection athttp://docs.sun.com/db/coll/1024.1

API development Sun Cluster 3.1 Data Services Developer’s Guide 816-3385

Data Services Sun Cluster 3.1 Data Service Planning and AdministrationGuide

817–1526

Sun Cluster 3.1 Data Service Collection athttp://docs.sun.com/db/coll/573.10

Administration Sun Cluster 3.1 System Administration Guide 816-3384

Cluster concepts Sun Cluster 3.1 Concepts Guide 816-3383

Error Messages Sun Cluster 3.1 Error Messages Guide 816-3382

Man Pages Sun Cluster 3.1 Man Page Reference Manual 816–5251

Release Notes Sun Cluster 3.1 Release Notes 816-5317

Sun Cluster 3.1 Release Notes Supplement 816-3381

Sun Cluster 3.1 Data Service Release Notes 817–1790

Accessing Sun Documentation OnlineThe docs.sun.comSM Web site enables you to access Sun technical documentationonline. You can browse the docs.sun.com archive or search for a specific book title orsubject. The URL is http://docs.sun.com.

Preface 7

Page 8: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

HelpIf you have problems installing or using Sun Cluster, contact your service providerand provide the following information:

� Your name and E-mail address (if available)� Your company name, address, and phone number� The model and serial numbers of your systems� The release number of the operating environment (for example, Solaris 8)� The release number of Sun Cluster (for example, Sun Cluster 3.0)

Use the following commands to gather information about each node on your systemfor your service provider.

Command Function

prtconf -v Displays the size of the system memory and reports information aboutperipheral devices.

psrinfo -v Displays information about processors.

showrev –p Reports which patches are installed.

prtdiag -v Displays system diagnostic information.

scinstall -pv Displays Sun Cluster release and package version information.

Also have available the contents of the /var/adm/messages file.

8 Sun Cluster 3.1 Data Service for Oracle Parallel Server/Real Application Clusters • May 2003, Revision A

Page 9: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

Installing and Configuring Sun ClusterSupport for Oracle ParallelServer/Real Application Clusters

This chapter describes the steps to install and configure Sun Cluster Support forOracle Parallel Server/Real Application Clusters on your Sun Cluster nodes. Thischapter contains the following procedures.

� “How to Use VxVM” on page 14� “How to Use Hardware RAID Support” on page 14� “How to Install Sun Cluster Support for Oracle Parallel Server/Real Application

Clusters Packages With VxVM” on page 16� “How to Install Sun Cluster Support for Oracle Parallel Server/Real Application

Clusters Packages With Hardware RAID” on page 17� “How to Prepare the Sun Cluster Nodes” on page 18� “How to Install the Oracle UDLM Software” on page 19� “How to Install the Oracle RDBMS Software and Create Your Oracle Database”

on page 21

Installing and Configuring Sun ClusterSupport for Oracle Parallel Server/RealApplication ClustersThe following table lists the sections that describe the installation and configurationtasks.

9

Page 10: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

TABLE 1–1 Task Map: Installing and Configuring Sun Cluster Support for Oracle ParallelServer/Real Application Clusters

Task For Instructions, Go To …

Understand pre-installationconsiderations and specialrequirements

“Overview” on page 10

“Special Requirements” on page 11

(Optional) Install volumemanagement software

“Installing Volume Management Software With SunCluster Support for Oracle Parallel Server/RealApplication Clusters” on page 13

Install data service packages “Installing Sun Cluster Support for Oracle ParallelServer/Real Application Clusters Packages” on page 16

Install the UNIX Distributed LockManager and Oracle software

“Installing the Oracle Software” on page 18

OverviewBefore you install the data service, consider the points listed in the following sections.

An Atypical Data ServiceSun Cluster Support for Oracle Parallel Server/Real Application Clusters is an atypicalSun Cluster high availability data service. This data service does not provideautomatic failover or fault monitoring because the Oracle Parallel Server/RealApplication Clusters software already provides this functionality. This data service is aset of packages that, when installed, enables Oracle Parallel Server/Real ApplicationClusters to run on Sun Cluster nodes.

The Oracle Parallel Server/Real Application Clusters software is not registered with ormanaged by the Sun Cluster Resource Group Manager (RGM). However, Sun ClusterSupport for Oracle Parallel Server/Real Application Clusters is similar to other dataservices in that it depends on the RGM to query cluster information.

You can configure Oracle Parallel Server/Real Application Clusters to use theshared-disk architecture of the Sun Cluster software. In this configuration, a singledatabase is shared among multiple instances of the Oracle Parallel Server/RealApplication Clusters software that access the database concurrently. The UNIXDistributed Lock Manager (Oracle UDLM) controls access to shared resources betweencluster nodes. Typically, these shared resources contain process and database instancemembership information. The internal DLM that resides in each Oracle database

10 Sun Cluster 3.1 Data Service for Oracle Parallel Server/Real Application Clusters • May 2003, Revision A

Page 11: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

instance controls access to shared resources between cluster nodes. The sharedresources are typically disk blocks and other shared resources such as transactionlocks. See the Oracle documentation for details about the globally shared resourcesthat the internal DLM manages.

Pre-Installation ConsiderationsBefore you begin the installation, note the following pre-installation considerations.

� Sun Cluster Support for Oracle Parallel Server/Real Application Clusters requires afunctioning cluster with the initial cluster framework already installed. See the SunCluster 3.1 Software Installation Guide for details about initial installation of clustersoftware.

� Decide which volume manager you will use—either VERITAS Volume Manager(VxVM) or RAID Manager.

� Verify that you have obtained the appropriate licenses for your software. If, forexample, you use VxVM, run the vxlicense -p check command to ensure thatyou have installed a valid license for the Volume Manager cluster feature. If youinstall your licenses incorrectly or incompletely, the nodes might abort.

� Check with a Sun Enterprise Services representative for the current supportedtopologies for Sun Cluster Support for Oracle Parallel Server/Real ApplicationClusters, cluster interconnect, volume manager, and hardware configurations.

� Ensure that you have installed all of the applicable software patches for Solaris,Sun Cluster, Oracle, and your volume manager. The Oracle UDLM consists of twopackages—ORCLudlm, which Oracle supplies, and SUNWudlm, which Sun supplies.You must install both of these packages. If you need to install any Sun ClusterSupport for Oracle Parallel Server/Real Application Clusters patches, you mustapply these patches after you install the data service.

� You should install the Oracle binaries locally on each node in the cluster, ratherthan globally on the cluster file system, to avoid overwrite issues withconfiguration files and logs. However, if you plan to install the Oracle binaries onthe cluster file system, contact Oracle to validate the support of this configuration.Additionally, see the Oracle documentation for configuration specifics.

Special RequirementsThis section lists special requirements for Sun Cluster Support for Oracle ParallelServer/Real Application Clusters.

Installing and Configuring Sun Cluster Support for Oracle Parallel Server/Real Application Clusters 11

Page 12: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

32-Bit or 64-Bit ModeBefore you decide on which architecture to use for the Oracle components (OracleUDLM and RDBMS), note the following points.

� The architecture of both Oracle components must match. For example, if you have64-bit architecture for your Oracle UDLM, you must have 64-bit architecture foryour RDBMS.

� If you have 32-bit architecture for your Oracle components, you can boot the nodeon which the components reside in either 32-bit or 64-bit mode. However, if youhave 64-bit architecture for your Oracle components, you must boot the node onwhich the components reside in 64-bit mode.

� You must use the same architecture when you boot all of the nodes. For example, ifyou boot one node to use 32-bit architecture, you must boot all of the nodes to use32-bit architecture.

Log File LocationsThe following list shows the locations of the data service log files.

� Current log – /var/cluster/ucmm/ucmm_reconf.log

� Previous logs – /var/cluster/ucmm/ucmm_reconf.log.0 (0,1,...) If youcannot find the Oracle log files at this location, contact Oracle support. Thislocation is dependent on the Oracle UDLM package.

� Oracle UDLM logs – /var/cluster/ucmm/dlm_nodename/logs

� Oracle UDLM core files – /var/cluster/ucmm/dlm_nodename/cores

Node Failures and Recovery ProceduresIf a node fails in an Oracle Parallel Server/Real Application Clusters environment, youcan configure Oracle clients to reconnect to the surviving server without the use of theIP failover that Sun Cluster failover data services use. The Sun Cluster 3.1 ConceptsGuide document describes this failover process. In an Oracle Parallel Server/RealApplication Clusters environment, multiple Oracle instances cooperate to provideaccess to the same shared database. The Oracle clients can use any of the instances toaccess the database. Thus, if one or more instances have failed, clients can connect to asurviving instance and continue to access the database.

Note – If a node fails, boot the node into maintenance mode to correct the problem.See the Sun Cluster 3.1 System Administration Guide for more information.

12 Sun Cluster 3.1 Data Service for Oracle Parallel Server/Real Application Clusters • May 2003, Revision A

Page 13: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

Note – When you install this data service, ensure that you complete all steps of allprocedures that precede “How to Install the Oracle RDBMS Software and Create YourOracle Database” on page 21 before you reboot the nodes. Otherwise, the nodes willpanic. If the nodes panic, you must boot into maintenance mode to correct theproblem.

Using the Oracle Parallel Fail Safe/RealApplication Clusters Guard Option With SunCluster 3.1Note the following points if you plan to use the Oracle Parallel Fail Safe/RealApplication Clusters Guard option with Sun Cluster 3.1.

� If you use this option, before you install Sun Cluster 3.1, you must consider thefollowing special requirement. Hostnames that you use in your cluster cannotcontain special characters. You cannot change the hostname after you install SunCluster 3.1. See the Oracle documentation for more information about this specialrequirement and any others before you install Sun Cluster 3.1.

� Refer to the Oracle documentation for installation, administration and operation ofthis product option.

� Do not use Sun Cluster commands to manipulate the state of resources that OracleParallel Fail Safe/Real Application Clusters Guard installs. To do so might result infailures. Do not rely on the Sun Cluster commands to query the state of theresources that Oracle Parallel Fail Safe/Real Application Clusters Guard installs.This state may not reflect the actual state. To check the state of the Oracle ParallelFail Safe/Real Application Clusters Guard, use the commands that Oracle supplies.

Installing Volume Management SoftwareWith Sun Cluster Support for OracleParallel Server/Real ApplicationClustersFor Sun Cluster Support for Oracle Parallel Server/Real Application Clusters disks,use the following configurations.

� VxVM with the cluster feature enabled

Installing and Configuring Sun Cluster Support for Oracle Parallel Server/Real Application Clusters 13

Page 14: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

� Hardware RAID support

� How to Use VxVMTo use the VxVM software with Sun Cluster Support for Oracle Parallel Server/RealApplication Clusters, perform the following tasks.

1. Obtain a license for the Volume Manager cluster feature in addition to the basicVxVM license.

See your VxVM documentation for more information about VxVM licensingrequirements.

Caution – Failure to correctly install the license for the Volume Manager clusterfeature might result in a panic when you install Oracle Parallel Server/RealApplication Clusters support. Before you install the Oracle Parallel Server/RealApplication Clusters packages, run the vxlicense -p check command to ensure thatyou have installed a valid license for the Volume Manager cluster feature.

2. Install and configure the VxVM software on the cluster nodes.

See the VxVM appendix in the Sun Cluster 3.1 Software Installation Guide and the VxVMdocumentation for more information.

3. Use VERITAS commands to create a separate shared disk group for the OracleParallel Server/Real Application Clusters database to use (see your VxVMdocumentation for details on shared disk groups).

Before you create the shared disk group, note the following points.

� Do not register the shared disk group within the cluster.� Do not create any file systems in the shared disk group because only the raw data

file will use this disk group.� Create volumes as the gen use type.� Disks that you add to the shared disk group must be directly attached to all of the

cluster nodes.� Ensure that your VxVM license is current. If your license expires, the node will

panic.

� How to Use Hardware RAID SupportYou can use Sun Cluster Support for Oracle Parallel Server/Real Application Clusterswith hardware RAID support.

14 Sun Cluster 3.1 Data Service for Oracle Parallel Server/Real Application Clusters • May 2003, Revision A

Page 15: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

For example, you can use Sun StorEdge™ A3500/A3500FC disk arrays with hardwareRAID support and without VxVM software. To do so, configure raw device IDs(/dev/did/rdsk*) on top of the disk arrays’ logical unit numbers (LUNs). To set upthe raw devices for Oracle Parallel Server/Real Application Clusters on a cluster thatuses StorEdge A3500/A3500FC disk arrays with hardware RAID, perform thefollowing steps.

1. Create LUNs on the disk arrays.

See the Sun Cluster 3.1 Hardware Guide for information on how to create LUNs.

2. After you create the LUNs, run the format(1M) command to partition the diskarrays’ LUNs into as many slices as you need.

The following example lists output from the format command.

# format

0. c0t2d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>/sbus@3,0/SUNW,fas@3,8800000/sd@2,0

1. c0t3d0 <SUN18G cyl 7506 alt 2 hd 19 sec 248>/sbus@3,0/SUNW,fas@3,8800000/sd@3,0

2. c1t5d0 <Symbios-StorEDGEA3000-0301 cyl 21541 alt 2 hd 64 sec 64>/pseudo/rdnexus@1/rdriver@5,0

3. c1t5d1 <Symbios-StorEDGEA3000-0301 cyl 21541 alt 2 hd 64 sec 64>/pseudo/rdnexus@1/rdriver@5,1

4. c2t5d0 <Symbios-StorEDGEA3000-0301 cyl 21541 alt 2 hd 64 sec 64>/pseudo/rdnexus@2/rdriver@5,0

5. c2t5d1 <Symbios-StorEDGEA3000-0301 cyl 21541 alt 2 hd 64 sec 64>/pseudo/rdnexus@2/rdriver@5,1

6. c3t4d2 <Symbios-StorEDGEA3000-0301 cyl 21541 alt 2 hd 64 sec 64>

/pseudo/rdnexus@3/rdriver@4,2

Note – If you use slice 0, do not start the partition at cylinder 0.

3. Run the scdidadm(1M) command to find the raw device ID (DID) that correspondsto the LUNs that you created in Step 1.

The following example lists output from the scdidadm -L command.

# scdidadm -L

1 phys-schost-1:/dev/rdsk/c0t2d0 /dev/did/rdsk/d11 phys-schost-2:/dev/rdsk/c0t2d0 /dev/did/rdsk/d12 phys-schost-1:/dev/rdsk/c0t3d0 /dev/did/rdsk/d22 phys-schost-2:/dev/rdsk/c0t3d0 /dev/did/rdsk/d23 phys-schost-2:/dev/rdsk/c4t4d0 /dev/did/rdsk/d33 phys-schost-1:/dev/rdsk/c1t5d0 /dev/did/rdsk/d34 phys-schost-2:/dev/rdsk/c3t5d0 /dev/did/rdsk/d44 phys-schost-1:/dev/rdsk/c2t5d0 /dev/did/rdsk/d45 phys-schost-2:/dev/rdsk/c4t4d1 /dev/did/rdsk/d55 phys-schost-1:/dev/rdsk/c1t5d1 /dev/did/rdsk/d56 phys-schost-2:/dev/rdsk/c3t5d1 /dev/did/rdsk/d6

Installing and Configuring Sun Cluster Support for Oracle Parallel Server/Real Application Clusters 15

Page 16: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

6 phys-schost-1:/dev/rdsk/c2t5d1 /dev/did/rdsk/d6

4. Use the DID that the scdidadm output identifies to set up the raw devices.

For example, the scdidadm output might identify that the raw DID that correspondsto the disk arrays’ LUNs is d4. In this instance, use the /dev/did/rdsk/d4sN rawdevice, where N is the slice number.

Installing Sun Cluster Support for OracleParallel Server/Real ApplicationClusters PackagesUse one of the following procedures to install the packages that you need to run SunCluster Support for Oracle Parallel Server/Real Application Clusters.

� If you use VxVM as your volume manager, perform the procedure “How to InstallSun Cluster Support for Oracle Parallel Server/Real Application Clusters PackagesWith VxVM” on page 16.

� If you use hardware RAID support, perform the procedure “How to Install SunCluster Support for Oracle Parallel Server/Real Application Clusters PackagesWith Hardware RAID” on page 17.

� How to Install Sun Cluster Support for OracleParallel Server/Real Application Clusters PackagesWith VxVMTo complete this procedure, you need the Sun Cluster 3.1 CD-ROM. Perform thisprocedure on all of the cluster nodes that can run Sun Cluster Support for OracleParallel Server/Real Application Clusters.

Note – Due to the preparation that is required prior to installation, thescinstall(1M) utility does not support automatic installation of the data servicepackages.

1. Load the Sun Cluster 3.1 CD-ROM into the CD-ROM drive.

2. Become superuser.

16 Sun Cluster 3.1 Data Service for Oracle Parallel Server/Real Application Clusters • May 2003, Revision A

Page 17: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

3. Change the current working directory to the directory that contains the packages forthe version of the Solaris operating environment that you are using.

� If you are using Solaris 8, run the following command:

# cd /cdrom/suncluster_3_1/SunCluster_3.1/Sol_8/Packages

� If you are using Solaris 9, run the following command:

# cd /cdrom/suncluster_3_1/SunCluster_3.1/Sol_9/Packages

4. On all of the nodes, run the following command to install the data service packages.

# pkgadd -d . SUNWscucm SUNWudlm SUNWudlmr SUNWcvmr SUNWcvm

Caution – Before you reboot the nodes, you must ensure that you have correctlyinstalled and configured the Oracle UDLM software (“How to Install the OracleUDLM Software” on page 19). Also verify that you have correctly installed yourvolume manager packages. If you use VxVM, check that you have installed thesoftware and that the license for the VxVM cluster feature is valid. Otherwise, a panicwill occur.

Where to Go From HereGo to “Installing the Oracle Software” on page 18 to install the Oracle UDLM andOracle software.

� How to Install Sun Cluster Support for OracleParallel Server/Real Application Clusters PackagesWith Hardware RAIDTo complete this procedure, you need the Sun Cluster 3.1 CD-ROM. Perform thisprocedure on all of the cluster nodes that can run Sun Cluster Support for OracleParallel Server/Real Application Clusters.

Note – Due to the preparation that is required prior to installation, thescinstall(1M) utility does not support automatic installation of the data servicepackages.

1. Load the Sun Cluster 3.1 CD-ROM into the CD-ROM drive.

2. Become superuser.

3. Change the current working directory to the directory that contains the packages forthe version of the Solaris operating environment that you are using.

Installing and Configuring Sun Cluster Support for Oracle Parallel Server/Real Application Clusters 17

Page 18: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

� If you are using Solaris 8, run the following command:

# cd /cdrom/suncluster_3_1/SunCluster_3.1/Sol_8/Packages

� If you are using Solaris 9, run the following command:

# cd /cdrom/suncluster_3_1/SunCluster_3.1/Sol_9/Packages

4. On all of the nodes, run the following command to install the data service packages.

# pkgadd -d . SUNWscucm SUNWudlm SUNWudlmr SUNWschwr

Caution – Before you reboot the nodes, you must ensure that you have correctlyinstalled and configured the Oracle UDLM software (“How to Install the OracleUDLM Software” on page 19). Also verify that you have correctly installed yourvolume manager packages. If you use VxVM, check that you have installed thesoftware and that the license for the VxVM cluster feature is valid. Otherwise, a panicwill occur.

Where to Go From HereGo to “Installing the Oracle Software” on page 18 to install the Oracle UDLM andOracle software.

Installing the Oracle SoftwareUse the procedures in this section to perform the following tasks.

� Prepare the nodes.� Install the Oracle Oracle UDLM software.� Install the Oracle RDBMS software.

� How to Prepare the Sun Cluster NodesFor the Oracle UDLM software to run correctly, sufficient shared memory must beavailable on all of the cluster nodes. See the Oracle Parallel Server/Real ApplicationClusters CD-ROM for all of the installation instructions. To prepare the Sun Clusternodes, check that you have completed the following tasks.

� You have correctly set up the Oracle user account and database administrationgroup.

� You have configured the system to support the shared memory requirements of theOracle UDLM.

18 Sun Cluster 3.1 Data Service for Oracle Parallel Server/Real Application Clusters • May 2003, Revision A

Page 19: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

Note – Perform the following steps as superuser on each cluster node.

1. On each node, create an entry for the database administrator group in the/etc/group file, and add potential users to the group.

This group normally is named dba. Verify that root and oracle are members of the dbagroup, and add entries as necessary for other DBA users. Verify that the group IDs arethe same on all of the nodes that run Sun Cluster Support for Oracle ParallelServer/Real Application Clusters. For example, add the following entry to the/etc/group file.

dba:*:520:root,oracle

You can make the name service entries in a network name service (for example, NIS orNIS+) so that the information is available to the data service clients. You can also makeentries in the local /etc files to eliminate dependency on the network name service.

2. On each node, create an entry for the Oracle user ID (the group and password) inthe /etc/passwd file, and run the pwconv(1M) command to create an entry in the/etc/shadow file.

This Oracle user ID is normally oracle. For example, add the following entry to the/etc/passwd file.

# useradd -u 120 -g dba -d /Oracle-home oracle

Ensure that the user IDs are the same on all of the nodes that run Sun Cluster Supportfor Oracle Parallel Server/Real Application Clusters.

Where to Go From HereAfter you set up the cluster environment for Oracle Parallel Server/Real ApplicationClusters, go to “How to Install the Oracle UDLM Software” on page 19 to install theOracle UDLM software on each cluster node.

� How to Install the Oracle UDLM Software

Note – You must install the Oracle UDLM software on the local disk of each node.

Installing and Configuring Sun Cluster Support for Oracle Parallel Server/Real Application Clusters 19

Page 20: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

Caution – Before you install the Oracle UDLM software, ensure that you have createdentries for the database administrator group and the Oracle user ID. See “How toPrepare the Sun Cluster Nodes” on page 18 for details.

1. Become superuser on a cluster node.

2. Install the Oracle UDLM software.

See the appropriate Oracle Parallel Server/Real Application Clusters installationdocumentation for instructions.

Note – Ensure that you did not receive any error messages when you installed theOracle UDLM packages. If an error occurred during package installation, correct theproblem before you install the Oracle UDLM software.

3. Update the /etc/system file with the shared memory configuration information.

You must configure these parameters based on the resources that are available in thecluster. Decide on the appropriate values, but ensure that the Oracle UDLM can createa shared memory segment according to its configuration requirements.The following example shows entries to configure in the /etc/system file.

*SHARED MEMORY/ORACLEset shmsys:shminfo_shmmax=268435456set semsys:seminfo_semmap=1024set semsys:seminfo_semmni=2048set semsys:seminfo_semmns=2048set semsys:seminfo_semmsl=2048set semsys:seminfo_semmnu=2048set semsys:seminfo_semume=200set shmsys:shminfo_shmmin=200set shmsys:shminfo_shmmni=200set shmsys:shminfo_shmseg=200forceload: sys/shmsysforceload: sys/semsysforceload: sys/msgsys

4. Shut down and reboot all of the nodes.

Caution – Before you reboot, you must ensure that you have correctly installed andconfigured the Oracle UDLM software. Also verify that you have correctly installedyour volume manager packages. If you use VxVM, check that you have installed thesoftware and that the license for the VxVM cluster feature is valid. Otherwise, a panicwill occur.

20 Sun Cluster 3.1 Data Service for Oracle Parallel Server/Real Application Clusters • May 2003, Revision A

Page 21: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

a. From one node only—such as phys-schost-1—run the following command toshut down the cluster.

phys-schost-1# scshutdown -g0 -y

See the scshutdown(1M) man page for details.

b. Reboot each node into cluster mode.

ok boot

Where to Go From HereAfter you have installed the Oracle UDLM software on each cluster node, go to “Howto Install the Oracle RDBMS Software and Create Your Oracle Database” on page 21 toinstall the Oracle RDBMS software.

� How to Install the Oracle RDBMS Software andCreate Your Oracle DatabaseSee your Oracle Parallel Server/Real Application Clusters installation documentationfor instructions on how to install the RDBMS software and create your Oracledatabase.

Installing and Configuring Sun Cluster Support for Oracle Parallel Server/Real Application Clusters 21

Page 22: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

22 Sun Cluster 3.1 Data Service for Oracle Parallel Server/Real Application Clusters • May 2003, Revision A

Page 23: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

Index

Aadding

See modifying

Cchanging

See modifyingcommands

prtconf -v, 8prtdiag -v, 8psrinfo -v, 8showrev –p, 8

Ddeleting

See modifyingdisabling

See stoppingdisplaying

See listing

Eediting

See modifyingenabling

See startingexecuting

See starting

HHardware RAID support, Sun Cluster HA for

Oracle Parallel Server/ Real ApplicationClusters, 14

Iinstalling

Oracle Parallel Server/ Real ApplicationClusters, 16

Sun Cluster support for Oracle ParallelServer/ Real Application Clusters

23

Page 24: Sun Cluster 3.1 Data Service for Oracle Parallel Server ... · Node Failures and Recovery Procedures 12 ... Oracle Parallel Server/Real Application Clusters on ... Cluster Support

Sun Cluster support for Oracle Parallel Server/Real Application Clusters (Continued)

with Hardware RAID, 17with VxVM, 16

OOPS/RAC

See Oracle Parallel Server/Real ApplicationCluster

Oracle Parallel Server/ Real ApplicationClustersinstallation

installing software, 16Oracle RDBMS software, 21Oracle UDLM software, 19preparing the nodes, 18

Oracle Parallel Server/Real ApplicationClustersSee overviewSee task map32–bit mode, 1264–bit mode, 12installation

considerations, 11log file locations, 12requirements, 11Sun Cluster 3.1, 13

node recovery, 12Oracle RDBMS software, installing, 21Oracle UDLM software, installing, 19

Pprinting

See listingprtconf -v command, 8psrinfo -v command, 8-pv command, 8

Rrunning

See enabling

SSun Cluster HA for Oracle Parallel Server/ Real

Application Clusters, hardware RAIDsupport, 14

Sun Cluster support for Oracle Parallel Server/Real Application Clustersinstallation

with Hardware RAID, 17with VxVM, 16

installing VxVM, 14Sun support for Oracle Parallel Server/Real

Application ClustersSee Oracle Parallel Server/Real Application

Cluster

Ttask map

See Oracle Parallel Server/Real ApplicationCluster

turning offSee disabling

turning onSee enabling

U/usr/cluster/bin/scinstall -pv, 8

VVxVM, Sun Cluster HA for Oracle Parallel

Server/ Real Application Clusters, 14

24 Sun Cluster 3.1 Data Service for Oracle Parallel Server/Real Application Clusters • May 2003, Revision A