SFRAC 4.0 MP1 INSTALLATION COOKBOOK FOR AIX PLATFORMeval.symantec.com/.../AIX_RAC_Install_Cookbook_6.26.05.pdf · SFRAC 4.0 MP1 INSTALLATION COOKBOOK FOR AIX PLATFORM ... • Maxreqs=4#disksqueue_depth

W H I T E P A P E R

SFRAC 4.0 MP1 Installation Cookbook for AIX

SFRAC 4.0 MP1 INSTALLATION COOKBOOK FOR AIX PLATFORM

VERSION INCLUDES TABLE OF CONTENTS STYLES 1

W H I T E P A P E R TABLE OF CONTENT Table Of Content ............................................................................................................................. 2 Introduction ...................................................................................................................................... 3 Hardware requirements ................................................................................................................... 4 Checking system requirements for AIX ........................................................................................... 5

1. Verify os level and mirror the rootvg............................................................................... 5 2. Check system is running of the 64 bit kernel.................................................................. 5 3. Check System packages ................................................................................................ 6 4. Apply required APARs.................................................................................................... 6 5. Reboot ............................................................................................................................ 7 6. Verify the disk space: ..................................................................................................... 7 7. Check system to system communication & TIME .......................................................... 8 8. AIX Specific Parameters............................................................................................... 10 Check the Array Requirements ........................................................................................ 10 IBM Enterprise Storage Server (ESS) storage arrays...................................................... 10 EMC Symmetrix DMX Series storage arrays ................................................................... 10 EMC Symmetrix 8000 Series storage arrays ................................................................... 10 Hitachi 9900 Series storage arrays .................................................................................. 10 CLARIION......................................................................................................................... 11 FAStT................................................................................................................................ 11

SFRAC Installation ........................................................................................................................ 12 1.verify the installation ...................................................................................................... 13 2.Apply VERITAS PAtches............................................................................................... 14 3. Verify the disks ............................................................................................................. 14 4. If odm does not start..................................................................................................... 15

Install Oracle.................................................................................................................................. 17 Appendix A: Creating storage for oracle install on the shared file system.................................... 18 Appendix B: Installing AIX ............................................................................................................. 20


W H I T E P A P E R

INTRODUCTION The purpose of this document is to serve as a guide that provides a list of prerequisite checks to be performed prior to the installation of VERITAS Storage Foundation for Oracle RAC 4.0 on the AIX platform. This information contain herein is targeted for the VERITAS SFRAC 4.0MP1 release. Additionally, this document is intended to supplement, not replace, configuration guides which should be used as references for an Oracle RAC installation on AIX, such as the materials listed below: http://support.veritas.com • VERITAS Storage Foundation 4.0 for Oracle RAC – Release Notes (AIX) • VERITAS Storage Foundation 4.0 for Oracle RAC – Installation and Configuration Guide (AIX) http://docs.oracle.com • Oracle 9i Database Release documentation • Oracle 10g Database Release documentation For the latest information available for Storage Foundation 4.0 products on AIX, please refer to the following TechNote on the VERITAS Technical Support website: http://support.veritas.com/docs/269928..


HARDWARE REQUIREMENTS Prior to installing the Storage Foundation for Oracle RAC software, basic infrastructure requirements must be met. Two-to-Four designated systems (AIX based pSeries/RS6000 servers) that are running the same version of AIX. Each system at a minimum must have:

• Shared storage set up such that each system can access it through a switch. Designated SAN attached storage arrays must support SCSI-3 persistent reservations.

• Three separate LUNs (physical volumes) to support I/O Fencing Operations. • Two or more dedicated 100BaseT or Gigabit Ethernet connections are required for RAC Cluster

heartbeat interconnects. They must directly link all systems to form a private network that will enable direct system-to-system communication. Separate Hubs or Switches are recommended for each private network link (to eliminate a SPOF). All private links must be of the same transfer rate. Mixing 100BaseT and Gigabit is not permitted.

• One Ethernet port for public IP connection (or two ports for MultiNIC configuration)

RITAS support web site to insure Note – Please review the Hardware Capability Matrix in detail on the VEmpliance of the above described details - co http://support.veritas.com.

Copyright © 2003 VERITAS Software Corporation. All rights reserved. VERITAS, the VERITAS Logo and all other VERITAS product names and slogans are trademarks or registered trademarks of VERITAS Software Corporation. VERITAS, the VERITAS Logo Reg. U.S. Pat. & Tm. Off. Other product names and/or slogans mentioned herein may be trademarks or registered trademarks of their respective companies. Specifications and product offerings subject to change without notice.

4

http://support.veritas.com/

CHECKING SYSTEM REQUIREMENTS FOR AIX All of the following steps must be performed on each system: 1. VERIFY OS LEVEL AND MIRROR THE ROOTVG For AIX 5.2: # oslevel -r 5200-04 For AIX 5.3: # oslevel -r 5300-01 Use the base AIX CD to upgrade if the required level is not already installed. Be sure to use the base CD rather than upgrade CD as additional packages may be required. The required maintenance level for AIX 5.2 is ML4, while AIX 5.3 requires ML1. Note - Since VERITAS software does not encapsulate the rootvg, typical operating system preparation tasks involving the rootvg must be done using AIX commands. Mirror rootvg (assuming hdisk0 is the current boot disk, and hdisk1 is available):

• root# mirrorvg rootvg hdisk1 • root# bosboot –ad /dev/hdisk1 • root# bootlist –m normal hdisk0 hdisk1

2. CHECK SYSTEM IS RUNNING OF THE 64 BIT KERNEL Check to see if the kernel is 32 or 64-bit: root# bootinfo –K If the kernel is 32-bit, change to 64-bit: root# ln –sf /usr/lib/boot/unix_64 /unix root# ln –sf /usr/lib/boot/unix_64 /usr/lib/boot/unix root# bosboot –ad /dev/hdisk0 # assuming hdisk0 is the boot device root# shutdown –Fr


5

3. CHECK SYSTEM PACKAGES Check that all required packages are installed. Required packages are listed in /opt/VRTS/rac/bin/scripts/sfrac.pm FILESET(52). They are:

Required filesets:

xlC.aix50.rte (6.0.0.7 or higher)

bos.adt.libm

perfagent.tools

bos.perf

Java14

rsct.core

rsct.compat.basic

rsct.compat.clients

rsct.basic

rsct.clients To check a package: # lslpp –l |grep “pkg name” For example: # lslpp -l|grep libm bos.adt.libm 5.2.0.30 COMMITTED Base Application 4. APPLY REQUIRED APARS Check for patches and efixes listed below and install as needed:

• root# instfix –ik <patch #> The following APARs are required: AIX 5.2: IY67584 AIX 5.3: IY65495, IY66534, IY68510 and IY69539 You can download APARs from: http://www-912.ibm.com/eserver/support/fixes/ Set the search criteria to the following: OS level: From the drop-down list, select the appropriate OS level. Search by: APAR number Search string: IY59620 Follow the instructions to download and install this fix. To install APARs run:


6

http://www-912.ibm.com/eserver/support/fixes/

# smitty install After all packages are installed, verify that all of them are also applied. To do so, run the following commands: $ instfix -ivqk IY56497 $ instfix -ivqk IY59620 For example: # instfix -ivqk IY56497 IY56497 Abstract: VxFS: setmod pfend, v_protectp, vm_ioaccessp Fileset bos.mp:5.2.0.32 is applied on the system. Fileset bos.mp64:5.2.0.32 is applied on the system. Fileset bos.perf.libperfstat:5.2.0.31 is applied on the system. Fileset bos.sysmgt.serv_aid:5.2.0.32 is applied on the system. Fileset bos.up:5.2.0.32 is applied on the system. Fileset perfagent.tools:5.2.0.32 is applied on the system. 5. REBOOT After applying the APARs systems must be rebooted 6. VERIFY THE DISK SPACE: Each system in the cluster requires at least the following local disk space: SFRAC 4.0 • RAM: each system requires a minimum of 512 megabytes RAM. • Verify available free space for VERITAS binaries in the file systems on each system as documented in the

Release Notes and Installation Guide.

/ 100 MB /usr 210 MB /opt 750 MB /var 200 MB /tmp 400 MB

Note that Filesystems can be expanded via the following commands:

# chfs –a size=+<#M> <filesystem> e.g. # chfs –a size=+100M /usr # to increase /usr by 100 MB • Swap space: during the installation of VERITAS Storage Foundation 4.0 for Oracle RAC, each system requires

1 gigabyte. • SFRAC 4.0 MP1 Patch Software (Upgrading from SFRAC 4.0)


7

• Swap space: during the installation of VERITAS Storage Foundation 4.0 for Oracle RAC MP1 software upgrade

patch, each system requires 1 gigabyte. Oracle9i • Local disk space: for the installation of Oracle9i locally, each system requires approximately 7.0 gigabytes. • Swap space required during the installation of Oracle9i: for the duration of the installation, Oracle9i requires 1

gigabyte (or twice the size of RAM). Where systems have 2 gigabytes or more of RAM, swap space may be between 1 and 2 times the size of RAM.

Oracle 10g • Local disk space: for the installation of Oracle 10g software locally (including CRS installation), each system

requires approximately 9.5 gigabytes. • Swap space required during the installation of Oracle 10g: for the duration of the installation, Oracle 10g

requires 1 gigabyte (or twice the size of RAM). Where systems have 2 gigabytes or more of RAM, swap space may be between 1 and 2 times the size of RAM.

To check the current RAM installed on a system: # /usr/sbin/lsattr -E -l sys0 -a realmem To check the amount of paging space configured for a system: # /usr/sbin/lsps -a The following IBM Paging Space Tips link lists the current recommendations on sizing paging space: http://www-1.ibm.com/support/docview.wss?rs=111&context=SWG10&q1=paging+space&uid=isg1pTechnote0191&loc=en_US&cs=utf-8&lang=en To check for the current space available in the /tmp directory: # df -k /tmp 7. CHECK SYSTEM TO SYSTEM COMMUNICATION & TIME To give remote access to the system running the install program, place a “+” character in the first line of the file /.rhosts on each node. Check that each node has remote rsh access to the other, by running: #rsh sysA date #rsh sysB date Verify system time are synchronized via ntp or setclock:

# setclock <hostname>


8

8. AIX Specific Tunable parameter changes AIOservers (use ‘smit aio’ to change): As ODM uses kernelized async I/O (aio), aioservers need to be enabled, but the minserver and maxserver values do not need to be increased from the defaults: • Minserver=(default value) • Maxserver=(default value) • Maxreqs=4*#disks*queue_depth (do not decrease below 4096) • Enable at system restart. Monitor periodically using `pstat –a | grep aios | wc –l` Virtual Memory Manager (VMM) initial settings:

• Minperm% 5% o root# vmo –p –o minperm%=5

• Maxperm% 20% o root# vmo –p –o maxperm%=20

• Maxclient% Set equal to maxperm o root# vmo –p –o maxclient%=20

For a complete discussion on VMM and other tuning parameters, refer to the IBM Redbook “Database Performance Tuning on AIX”, available for download from http://www.redbooks.ibm.com. Configure AIX Network parameters

• Set sb_max >= 1 MB (1048576) • Set tcp_sendspace = 262144 • Set tcp_recvspace = 262144 • Set rfc1323 = 1 (enable) • Set maxmbuf (on sys0) = 0

Note - SFRAC doesn’t use the UDP protocol, udp_sendspace and udp_recvspace parameters only need to be set if needed for non-cluster UDP traffic.


9

CHECK THE ARRAY REQUIREMENTS Review the hardware compatibility information on http://support.veritas.com for details. The list of supported hardware items is routinely updated. Server systems must be one of the AIX systems in the list of compatible hardware. Each system requires two CPUs and minimum of 1GB RAM For each array, an Array Support Library package (ASL) must be installed on all nodes. Typically, these are installed for supported arrays. See VERITAS Volume Manger Hardware Notes for more information about how to obtain, install, and upgrade ASLs. IBM ENTERPRISE STORAGE SERVER (ESS) STORAGE ARRAYS Minimum firmware levels for ESS: F20: 2.3.2.70 800: 2.3.2.71

EMC SYMMETRIX DMX SERIES STORAGE ARRAYS Array Support Library package (ASL) must be installed on all nodes. PGR bit must be turned on

EMC SYMMETRIX 8000 SERIES STORAGE ARRAYS

Array Support Library package (ASL) must be installed on all nodes. PGR bit must be turned on HITACHI 9900 SERIES STORAGE ARRAYS Minimum firmware level for HDS 9900: 21-06-22-00/00

HDS 9900 system option 254 must be set on the array.

HDS array-specific ODM definitions must be installed on all nodes in cluster. Array Support Library package (ASL) must be installed on all nodes.


10

CLARIION Array Support Library package (ASL) must be installed on all nodes. DMP failover must be mode2 Minimum flare code level must be 14. To check for flare code equivalence on CX series, follow this example: 02.06.700.5.003 02 = AX or CX series 06 = flare code 13 700 = model specific for CX700 (the same functional flare code on all CX series, but just in case something ever happens) 5.003 = source control info Other flare codes: 02:06 = flare 13 02:07 = flare code 14 02:08 = flare code 15 (only available on AX ) 02:09 = flare code 16 (in process) 02:18 = planned change where second digit becomes the flare code number FASTT

For the up to date detail on configuring FAStT array please refer to the Technote 277228 at:

http://library.veritas.com/docs/277228


11

SFRAC INSTALLATION To install SFRAC run the “installsfrac script” on one node. “VERITAS Storage Foundation 4.0 for Oracle RAC, Installation and Configuration Guide” can be referenced for detailed instructions and examples. The IBM white paper “Oracle 9i RAC Deployment on AIX Using VERITAS Storage Foundation for Oracle RAC 4.0 as Clusterware” provides step by step instructions on how to install Storage Foundation for Oracle RAC. It has been published by IBM Advanced Technical Support and is available at: http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP100472or http://eval.veritas.com/mktginfo/products/White_Papers/High_Availability/IBM_Paper_on_SFRAC.pdf Note that SFRAC 4.0 supports only AIX 5.2. SFRAC 4.0MP1 supports both AIX 5.2 and AIX 5.3. If at AIX 5.2 you will: • install SFRAC 4.0 • apply SFRAC MP1 For release level AIX 5.3 use 4.0MPP1 distribution marked for AIX 5.3 and do a full install of SFRAC 4.0MP1. At the ftp site this file is named cluster_file_solutions.cd1.4.0.01.0.aix5.3.tar.gz


12

http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP100472

http://eval.veritas.com/mktginfo/products/White_Papers/High_Availability/IBM_Paper_on_SFRAC.pdf

To download SFRAC package from the ftp site:

ftp ftp.veritas.com Connected to ftp.veritas.com. 220-ftp 220-*********************************************************************** 220- This system is for the use of authorized users only. Individuals 220- using this computer system without authority, or in excess of their 220- authority, are subject to having all of their activities on this 220- system monitored and recorded. 220- In the course of monitoring individuals improperly using this 220- system, or in the course of system maintenance, the activities of 220- authorized users also are monitored. 220- Anyone using this system expressly consents to such monitoring 220- and recording. Please be advised that unauthorized access to this 220- system is a violation of State and Federal law. If monitoring 220- reveals possible evidence of criminal activity, system personnel 220- may provide that evidence to law enforcement officials. 220-*********************************************************************** 220 Name (ftp.veritas.com:root): anonymous 331 Guest login ok, send your complete e-mail address as password. Password: 230 Logged in anonymously. ftp> bin 200 Type okay. ftp> cd pub 250 "/pub" is new cwd. ftp> cd products 250 "/pub/products" is new cwd. ftp> get cluster_file_solutions.cd1.4.0.01.0.aix5.3.tar.gz 200 PORT command successful. 150 Opening BINARY mode data connection for cluster_file_solutions.cd1.4.0.01.0.aix5.3.tar.gz (385932252 bytes).

1. VERIFY THE INSTALLATION Verify the installation: # /opt/VRTSvcs/bin/chk_sfrac_pkgs SFRAC Package Status


13

==================== Package | Status VRTSvxvm | OK VRTSvxfs | OK VRTSglm | OK VRTScavf | OK VRTSgms | OK VRTSodm | OK VRTSvlic | OK VRTSllt.rte | OK VRTSgab.rte | OK VRTSvcs.rte | OK VRTSperl.rte | VERSION MISMATCH 4.0.2.0 != 4.0.0.0 VRTSvcsag.rte | OK VRTSvcs.msg.en_US | OK VRTSdbac.rte | OK VRTSvcsor.rte | OK 2. APPLY VERITAS PATCHES http://library.veritas.com/docs/273873 : VERITAS File System Rolling Patch 1 (4.0.0.10) 144338 + 148379 VxFS 4.0 VxFS 4.0 RP1 (4.0.0.10) AIX 5.1, 5.2 273873 README Upload http://library.veritas.com/docs/269928 : VERITAS Oracle Disk Manager (ODM) Rolling Patch (4.0.0.10)

148646 + 148664

Support of DS_VMZ volumes for ODM

ODM 4.0.0.0

AIX 5.1, 5.2 269928 README

Upload 3. VERIFY THE DISKS # lsdev -Cc disk hdisk0 Available 1S-08-00-8,0 16 Bit LVD SCSI Disk Drive hdisk1 Available 1S-08-00-9,0 16 Bit LVD SCSI Disk Drive hdisk2 Available 1n-08-01 Other FC SCSI Disk Drive


14


http://apgs.veritas.com/cgi-bin/pointpatch/incident?144338


http://verisearch.veritas.com/Tnotes/All_Docs/273873.htm

http://apgs.veritas.com/cgi-bin/pointpatch/cat_readme?/net/goldeneyes/cspatches/VxFS/4.0_AIX/4.0.0.10/README

http://apgs.veritas.com/cgi-bin/pointpatch/upload?/cspatches/VxFS/4.0_AIX/4.0.0.10/4.0RP1b_aix.tar




http://verisearch.veritas.com/Tnotes/All_Docs/269928.htm

http://apgs.veritas.com/cgi-bin/pointpatch/cat_readme?/net/goldeneyes/cspatches/DBED/4.0/i148646%2B148664/README

http://apgs.veritas.com/cgi-bin/pointpatch/upload?/net/goldeneyes/cspatches/DBED/4.0/i148646%2B148664/odm-4.0-i148646%2B148664.tar.Z

hdisk3 Available 1n-08-01 Other FC SCSI Disk Drive After new storage is added, run: # cfgmgr on both systems # lsdev -Cc disk hdisk0 Available 1S-08-00-8,0 16 Bit LVD SCSI Disk Drive hdisk1 Available 1S-08-00-9,0 16 Bit LVD SCSI Disk Drive hdisk2 Available 1n-08-01 Other FC SCSI Disk Drive hdisk3 Available 1n-08-01 Other FC SCSI Disk Drive hdisk4 Available 1n-08-01 Other FC SCSI Disk Drive hdisk5 Available 1n-08-01 Other FC SCSI Disk Drive hdisk12 Available 1n-08-01 MPIO Other FC SCSI Disk Drive hdisk13 Available 1n-08-01 MPIO Other FC SCSI Disk Drive hdisk14 Available 1n-08-01 MPIO Other FC SCSI Disk Drive hdisk15 Available 1n-08-01 MPIO Other FC SCSI Disk Drive hdisk16 Available 1n-08-01 MPIO Other FC SCSI Disk Drive # vxdisk scandisks To see /dev for the disk name: >vxdmpadm getdmpnode nodename=hdisk$i For example: # vxdmpadm getdmpnode nodename=hdisk44 NAME STATE ENCLR-TYPE PATHS ENBL DSBL ENCLR-NAME ========================================================================= EMC0_3 ENABLED EMC 1 1 0 EMC0 4. IF ODM DOES NOT START Check: # cat /dev/odm/cluster cluster status: disabled If disabled: 1. make sure /dev/odm is unmounted before starting odm


15

2. check that gsm is loaded by: # //etc/methods/gmskextadm status GMS PdDv entry: present GMS CuDv entry: present GMS Config_Rules phase 2 entry: present GMS Config_Rules phase 3 entry: present GMS driver is: loaded 3. If it is not loaded run # ./gmskextadm load # ./gmskextadm -help Unknown operand "-help" Usage: gmskextadm load|unload Usage: gmskextadm status


16

INSTALL ORACLE Oracle can be installed locally on each node, or on the shared file system. Follow instructions in the “VERITAS Storage Foundation 4.0 for Oracle RAC, Installation and Configuration Guide” to prepare storage for Oracle installation.

Storage Foundation 4.0 for Oracle RAC supports systems running the following Oracle versions: • Oracle9i RAC, Release 2 (64-bit), Patch 2, 3, 4, 5, or 6

Patch 5 (64-bit version) requires Oracle patch 3566662 • Oracle 10g running the latest patches

For Oracle 10g support information, refer Oracle MetaLink TechNotes 202036.1 and 283743.1

AIX filesets required by Oracle installation are: • bos.adt.libm • bos.perf • perfagent.tools • rsct.core • rsct.compat.basic • rsct.compat.clients • rsct.basic Installing Oracle9i in a VERITAS Storage Foundation for Oracle RAC environment involves the following tasks: • Run the script preinstallora • Install Oracle Binaries

Oracle9i RAC, Release 2 (64-bit), version 9.2.0.5. Oracle patch ID 3734279 Oracle patch id 3712203

• Run the script postinstallora


17

APPENDIX A: CREATING STORAGE FOR ORACLE INSTALL ON THE SHARED FILE SYSTEM # vxdg list orasrv_dg Group: orasrv_dg dgid: 1091660693.54.mtvp630-01 import-id: 33792.55 flags: shared cds version: 110 alignment: 8192 (bytes) local-activation: shared-write cluster-actv-modes: mtvp630-01=sw mtvp630-02=sw ssb: on detach-policy: global copies: nconfig=default nlog=default config: seqno=0.1029 permlen=1280 free=1277 templen=2 loglen=192 config disk EMC0_0 copy 1 len=1280 state=clean online log disk EMC0_0 copy 1 len=192 # vxassist -g orasrv_dg make srvm_vol 300M # vxedit -g orasrv_dg set user=oracle group=dba mode=660 srvm_vol # mkfs -V vxfs /dev/vx/rdsk/orasrv_dg/srvm_vol version 6 layout 614400 sectors, 307200 blocks of size 1024, log size 1024 blocks largefiles supported # mkdir /orasrv # mount -V vxfs -o cluster /dev/vx/dsk/orasrv_dg/srvm_vol /orasrv # chown -R oracle:dba /orasrv # vxdg list ora_dg Group: ora_dg dgid: 1091663982.60.mtvp630-01 import-id: 33792.57 flags: shared cds version: 110 alignment: 8192 (bytes) local-activation: shared-write cluster-actv-modes: mtvp630-01=sw mtvp630-02=sw ssb: on detach-policy: global copies: nconfig=default nlog=default config: seqno=0.1035 permlen=1280 free=1276 templen=3 loglen=192 config disk EMC0_4 copy 1 len=1280 state=clean online config disk EMC0_6 copy 1 len=1280 state=clean online log disk EMC0_4 copy 1 len=192 log disk EMC0_6 copy 1 len=192 # vxassist -g ora_dg make ora_vol 2G # vxedit -g ora_dg set user=oracle group=dba mode=660 ora_vol # mkfs -V vxfs /dev/vx/rdsk/ora_dg/ora_vol version 6 layout 4194304 sectors, 2097152 blocks of size 1024, log size 16384 blocks largefiles supported # mkdir /oracle # mkdir /oracle/oradata


18

# mount -V vxfs -o cluster /dev/vx/dsk/ora_dg/ora_vol /oracle/oradata # chown -R oracle:dba /oracle/oradata # vxdg deport oracle_dg # vxdg -s import oracle_dg # vxdg list oracle_dg # vxassist -g oracle_dg make ora_vol 2G # vxedit -g oracle_dg set user=oracle group=dba mode=660 oracle_vol # mkfs -V vxfs /dev/vx/rdsk/oracle_dg/oracle_vol version 6 layout 614400 sectors, 307200 blocks of size 1024, log size 1024 blocks largefiles supported # mkdir /oracle/oracle # mount -V vxfs -o cluster /dev/vx/dsk/ora_dg/oracle_vol /oracle/oracle # chown -R oracle:dba /oracle/oracle


19

APPENDIX B: INSTALLING AIX

1) Connect to the Terminal Server or system console.

2) Put the AIX 5.3 Volume 1 CD in the drive 3) Login to server’s console 4) Boot the server; be prepared to press 6 between the display of memory and speaker (see sample

console output below); this forces the system to boot from the CD.

AIX Version 5 (C) Copyrights by IBM and by others 1982, 2000. Console login: Entering Direct mode...Server = gps-aix1 *** FCode LP9000 PCI_Bus (lpfc) Version 1.31a4 *** memory keyboard network scsi speaker STARTING SOFTWARE PLEASE WAIT... ------------------------------------------------------------------ Welcome to AIX. boot image timestamp: 14:54 03/21 The current time and date: 17:31:24 02/25/2003 number of processors: 1 size of memory: 2048Mb boot device: /pci@fef00000/ide@b,1/disk@0:\ppc\chrp\bootfile.exe closing stdin and stdout... ------------------------------------------------------------------ AIX Version 5.3

Note: The alternate method to boot from the CD is to: # bootlist -m normal cd0 hdisk0 # shutdown -r

This will boot off of the cd first and if something is wrong with the cd it will continue on to hdisk0. It default back to hdisk0 once the reload of the OS has finished

The system will take about 3 minutes to boot up. Console will present the following: ******* Please define the System Console. *******

Type a 1 and press Enter to use this terminal as the system console. Pour definir ce terminal comme console systeme, appuyez sur 1 puis sur Entree. Taste 1 und anschliessend die Eingabetaste druecken, um diese Datenstation als Systemkonsole zu verwenden. Premere il tasto 1 ed Invio per usare questo terminal come console.


20

Escriba 1 y pulse Intro para utilizar esta terminal como consola del sistema. Escriviu 1 1 i premeu Intro per utilitzar aquest terminal com a consola del

sistema. Digite um 1 e pressione Enter para utilizar este terminal como console do sistema.

Press 1 to choose the system console

5) Then you will be presented with this screen:

1 Type 1 and press Enter to have English during install. 2 Entreu 2 i premeu Intro per veure la instal·lació en català. 3 Entrez 3 pour effectuer l'installation en français. 4 Für Installation in deutscher Sprache 4 eingeben und die Eingabetaste drücken. 5 Immettere 5 e premere Invio per l'installazione in italiano. 6 Digite 6 e pressione Enter para usar Português na instalação. 7 Escriba 7 y pulse Intro para la instalación en español.

Press 1 to continue in English You will then be presented with this screen:

Welcome to Base Operating System Installation and Maintenance Type the number of your choice and press Enter. Choice is indicated by >>>. >>> 1 Start Install Now with Default Settings 2 Change/Show Installation Settings and Install

3 Start Maintenance Mode for System Recovery

Choose option 2 to show the install settings.

6) You will then be presented with this screen. Choose 1 to change the method of installation from

preserve to overwrite. Either type 0 and press Enter to install with current settings, or type the

number of the setting you want to change and press Enter. 1 System Settings: Method of Installation.............Preservation Disk Where You Want to Install.....hdisk0 2 Primary Language Environment Settings (AFTER Install): Cultural Convention................English (United States) Language ..........................English (United States) Keyboard ..........................English (United States) Keyboard Type......................Default 3 Advanced Options >>> 0 Install with the current settings listed above. >>> Choice [0]: 1


21

7) Choose option 1 for “New and Complete Overwrite” Change Method of Installation Type the number of the installation method and press Enter. 1 New and Complete Overwrite Overwrites EVERYTHING on the disk selected for installation. Warning: Only use this method if the disk is totally empty or if there is nothing on the disk you want to preserve. >>> 2 Preservation Install Preserves SOME of the existing data on the disk selected for installation. Warning: This method overwrites the usr (/usr), variable (/var), temporary (/tmp), and root (/) file systems. Other product (applications) files and configuration data will be destroyed. 88 Help ? 99 Previous Menu >>> Choice [2]: 1

8) Choose 1 to use the first disk Change Disk(s) Where You Want to Install Type one or more numbers for the disk(s) to be used for installation and press Enter. To cancel a choice, type the corresponding number and Press Enter. At least one bootable disk must be selected. The current choice is indicated by >>>. Name Location Code Size(MB) VG Status Bootable >>> 1 hdisk0 10-60-00-10,0 17357 rootvg Yes 2 hdisk1 10-60-00-12,0 17357 none Yes >>> 0 Continue with choices indicated above 66 Devices not known to Base Operating System Installation 77 Display More Disk Information 88 Help ? 99 Previous Menu >>> Choice [0]: 1

9) Choose 0 to continue with the same disks 10) Choose 3 to select “Advanced Options” Installation and Settings Either type 0 and press Enter to install with current settings, or type the number of the setting you want to change and press Enter. 1 System Settings: Method of Installation.............Preservation Disk Where You Want to Install.....hdisk0 2 Primary Language Environment Settings (AFTER Install): Cultural Convention................English (United States) Language ..........................English (United States)


22

Keyboard ..........................English (United States) Keyboard Type......................Default 3 Advanced Options >>> 0 Install with the current settings listed above. +----------------------------------------------------- 88 Help ? | WARNING: Base Operating System Installation will 99 Previous Menu | destroy or impair recovery of SOME data on the | destination disk hdisk0. >>> Choice [0]: 3

11) Choose 3 to enable 64-bit Kernel and JFS2 Advanced Options Either type 0 and press Enter to install with current settings, or type the number of the setting you want to change and press Enter. 1 Installation Package Set............ Default 2 Enable Trusted Computing Base....... No 3 Enable 64-bit Kernel and JFS2....... No >>> 0 Install with the current settings listed above. 88 Help ? 99 Previous Menu >>> Choice [0]: 3

12) Choose 99 to return to the previous men 13) Choose 0 to install 14) When prompted for additional CDs replace the CD and continue.

15) The machine will finish installing and then reboot. 16) Execute program install_assist if not automatically started after the reboot 17) You will be presented with this screen:

Set Terminal Type The terminal is not properly initialized. Please enter a terminal type and press Enter. Some terminal types are not supported in non-English languages. ibm3101 tvi912 vt330 ibm3151 tvi920 vt340 ibm3161 tvi925 wyse30 ibm3162 tvi950 wyse50 ibm3163 vs100 wyse60 ibm3164 vt100 wyse100 ibmpc vt320 wyse350 lft sun +-----------------------Messages------------------------


23

| If the next screen is unreadable, press Break (Ctrl-c) 88 Help ? | to return to this screen. 99 Exit | | >>> Choice []: vt100

Enter vrt100.

18) Choose to accept the license agreement 19) Tab the No to Yes 20) Press Enter to accept the agreement 21) When the command shows as OK, press Esc-0 to exit to this menu: 22) Set the Date and Time using SMIT. We will use Pacific Time 23) Set the root password 24) Set paging space to 2048 25) Configure Networking. Choose Configure Network Communications 26) Choose TCP/IP startup 27) Choose en4. This is the internal network card 28) Set the following params:

a. Hostname=gps-aix5 b. Internet address = 10.136.225.75 c. Network mask = 255.255.248.0 d. Nameserver = 10.136.225.9 e. Domainname = gps.veritas.com f. Default gateway = 10.136.224.1

29) Extend selected file systems using SMIT • In SMIT, navigate menus to System Storage management->File Systems/Add-Change-

Show/Enhanced JFS/Change Characteristics • Select file system to extend • Set /home to 3276800 (512-byte blocks) • Set /usr to 2621440 • Set /opt to 917504 • Set /tmp to 458752 • Set /var to 458752

30) Install all rpms using rpm –install <rpmname>. List of rpm’s is listed below: • bash-2.05a-1.aix4.3.ppc.rpm • binutils-2.9.aix51.020209-1.aix5.1.ppc.rpm • gcc-2.9.aix51.020209-1.aix5.1.ppc.rpm • make-3.79.1-3.aix4.3.ppc.rpm • openssl-0.9.6e-2.aix4.3.ppc.rpm

# pwd /home/tt/gnu # ls -l total 33896 -rw-r--r-- 1 root system 1273021 Mar 09 14:29 bash-2.05a-1.aix4.3.ppc.rpm -rw-r--r-- 1 root system 5685014 Mar 09 14:29 binutils-2.9.aix51.020209-1.aix5.1.ppc.rpm -rw-r--r-- 1 root system 6283249 Mar 09 14:29 gcc-2.9.aix51.020209-1.aix5.1.ppc.rpm


24

-rw-r--r-- 1 root system 233088 Mar 09 14:29 make-3.79.1-3.aix4.3.ppc.rpm -rw-r--r-- 1 root system 2542717 Mar 09 14:29 openssh34p1_3.4.0.3_51.tar.Z -rw-r--r-- 1 root system 1331377 Mar 09 14:29 openssl-0.9.6e-2.aix4.3.ppc.rpm # # rpm --install bash-2.05a-1.aix4.3.ppc.rpm # rpm --install binutils-2.9.aix51.020209-1.aix5.1.ppc.rpm # rpm --install gcc-2.9.aix51.020209-1.aix5.1.ppc.rpm Running fixincludes for powerpc-ibm-aix5.1.0.0. Verbose output will be stored in /opt/freeware/GNUPro/aix51-020209/fixincludes.log. This will take some time. system header files now ANSI compatible ansi/posix prototypes added to include files Fixed include files installed! Done. # rpm --install make-3.79.1-3.aix4.3.ppc.rpm # rpm --install openssl-0.9.6e-2.aix4.3.ppc.rpm # # rpm -q -a mtools-3.9.8-1 cdrecord-1.9-4 mkisofs-1.13-4 AIX-rpm-5.1.0.25-1 bash-2.05a-1 binutils-2.9.aix51.020209-1 gcc-2.9.aix51.020209-1 make-3.79.1-3 openssl-0.9.6e-2 #

31) Install openssh using SMIT (openssh34p1_3.4.0.3_51.tar.Z). First, extract the contents of the

compressed-tar file to a dedicated directory. Use this directory as the input device for SMIT’s install process.

To prevent an install failure, be sure to set the option “ACCEPT new license agreements?” to yes. Screen below reflects gps-aix1 before pressing enter key.

Install Software Type or select values in entry fields. Press Enter AFTER making all desired changes. [Entry Fields] * INPUT device / directory for software /home/tt/gnu/openssh * SOFTWARE to install [_all_latest] PREVIEW only? (install operation will NOT occur) no COMMIT software updates? yes SAVE replaced files? no AUTOMATICALLY install requisite software? yes EXTEND file systems if space needed? yes OVERWRITE same or newer versions? no VERIFY install and check file sizes? no Include corresponding LANGUAGE filesets? yes DETAILED output? no Process multiple volumes? yes ACCEPT new license agreements? yes Preview new LICENSE agreements? no

[Partial output of install process] Finished processing all filesets. (Total time: 23 secs). +-----------------------------------------------------------------------------+ Summaries: +-----------------------------------------------------------------------------+


25

Installation Summary -------------------- Name Level Part Event Result ------------------------------------------------------------------------------- openssh.license 3.4.0.3 USR APPLY SUCCESS openssh.base.client 3.4.0.3 USR APPLY SUCCESS openssh.base.server 3.4.0.3 USR APPLY SUCCESS openssh.base.client 3.4.0.3 ROOT APPLY SUCCESS openssh.base.server 3.4.0.3 ROOT APPLY SUCCESS openssh.msg.en_US 3.4.0.3 USR APPLY SUCCESS openssh.man.en_US 3.4.0.3 USR APPLY SUCCESS

32) Configure ssh to auto-start on each system

a. Ssh is auto-started if the script Ssshd is located in /etc/rc.d/rc2.d. Verify this. b. Remove the following line if it exists in /etc/inittab (CAREFULLY):

install_assist:2:wait:/usr/sbin/install_assist </dev/console >/dev/console 2>&1 This appears to have prevented ssh for auto-starting at boot.

33) Install Fibre HBA card device drivers (see following files). Card is IBM 6228 (i.e. Emulex model). Obtain files from AIX install CD, disk 1 and copy to /usr/sys/inst.images (files are also stored in /gps/software/ibm/aix).

34) # lslpp -l|grep devices # lslpp -l|grep fcp devices.fcp.disk.array.diag devices.fcp.disk.array.rte devices.fcp.disk.rte 5.3.0.10 COMMITTED FC SCSI CD-ROM, Disk, devices.fcp.tape.rte 5.3.0.10 COMMITTED FC SCSI Tape Device Software devices.fcp.disk.array.rte devices.fcp.disk.rte 5.3.0.10 COMMITTED FC SCSI CD-ROM, Disk, devices.fcp.tape.rte 5.3.0.10 COMMITTED FC SCSI Tape Device Software # 35) # lsdev -Cc disk 36) hdisk0 Available 10-60-00-10,0 16 Bit LVD SCSI Disk Drive 37) hdisk1 Available 10-60-00-11,0 16 Bit LVD SCSI Disk Drive 38) hdisk2 Available 20-60-01 MPIO Other FC SCSI Disk Drive 39) hdisk3 Available 20-60-01 MPIO Other FC SCSI Disk Drive 40) hdisk4 Available 20-60-01 MPIO Other FC SCSI Disk Drive 41) hdisk5 Available 20-60-01 MPIO Other FC SCSI Disk Drive 42) hdisk6 Available 20-60-01 MPIO Other FC SCSI Disk Drive 43) hdisk7 Available 20-60-01 MPIO Other FC SCSI Disk Drive 44) hdisk8 Available 20-60-01 MPIO Other FC SCSI Disk Drive 45) hdisk9 Available 20-60-01 MPIO Other FC SCSI Disk Drive 46) # vxdisk list 47) DEVICE TYPE DISK GROUP STATUS 48) Disk_0 auto:none - - online invalid 49) Disk_1 auto:LVM - - LVM 50) HDS99100_0 auto:aixdisk - - online


26

51) HDS99100_1 auto:aixdisk - - online 52) HDS99100_2 auto:aixdisk - - online 53) HDS99100_3 auto:aixdisk - - online 54) HDS99100_4 auto:aixdisk - - online 55) HDS99100_5 auto:aixdisk - - online 56) HDS99100_6 auto:aixdisk - - online 57) HDS99100_7 auto:aixdisk - - online 58) #

Use SMIT “Install Software” option. devices.fcp.disk devices.fcp.disk.array devices.fcp.disk.array.rte.5.1.0.37.bff devices.scsi.scarray

Summary output from SMIT installp: bosboot process completed. +-----------------------------------------------------------------------------+ Summaries: +-----------------------------------------------------------------------------+ Installation Summary -------------------- Name Level Part Event Result ------------------------------------------------------------------------------- devices.scsi.scarray.rte 5.1.0.0 USR APPLY SUCCESS devices.scsi.scarray.diag 5.1.0.0 USR APPLY SUCCESS devices.scsi.scarray.rte 5.1.0.0 ROOT APPLY SUCCESS devices.fcp.disk.array.rte 5.1.0.25 USR APPLY SUCCESS devices.fcp.disk.array.diag 5.1.0.0 USR APPLY SUCCESS devices.fcp.disk.array.rte 5.1.0.25 ROOT APPLY SUCCESS devices.fcp.disk.array.rte 5.1.0.37 USR APPLY SUCCESS devices.fcp.disk.array.rte 5.1.0.37 ROOT APPLY SUCCESS devices.fcp.disk.array.rte 5.1.0.37 USR COMMIT SUCCESS devices.fcp.disk.array.rte 5.1.0.37 ROOT COMMIT SUCCESS

59) Install the latest release bundle patches. Obtain patch 5300001 from

https://techsupport.services.ibm.com/server/mlfixes/53/01/00to01.html 60) Put the package (a tar.gz file) in /usr/sys/inst.images 61) Extract the filesets from the package.

a. cd /usr/sys/inst.images b. gzip -d -c 530001.tar.gz | tar -xvf –

# cd /usr/sys/inst.images # gzip -d -c 530001.tar.gz | tar -xvf - x README.5300-01, 1243 bytes, 3 media blocks. x U464537.bff, 9216 bytes, 18 media blocks. x U465594.bff, 70656 bytes, 138 media blocks. x U465614.bff, 53248 bytes, 104 media blocks. x U465620.bff, 13710336 bytes, 26778 media blocks. x U465623.bff, 116736 bytes, 228 media blocks. x U465631.bff, 8192 bytes, 16 media blocks. x U465634.bff, 112640 bytes, 220 media blocks.


27

x U465641.bff, 72704 bytes, 142 media blocks. x U465643.bff, 37888 bytes, 74 media blocks. x U465646.bff, 30720 bytes, 60 media blocks. x U465658.bff, 257024 bytes, 502 media blocks. x U465669.bff, 92160 bytes, 180 media blocks. x U465672.bff, 595968 bytes, 1164 media blocks. x U465719.bff, 22528 bytes, 44 media blocks. x U465722.bff, 183296 bytes, 358 media blocks. x U465727.bff, 8192 bytes, 16 media blocks. x U465729.bff, 32768 bytes, 64 media blocks. x U465732.bff, 61440 bytes, 120 media blocks. x U465738.bff, 132096 bytes, 258 media blocks. x U465748.bff, 108544 bytes, 212 media blocks. x U465780.bff, 14336 bytes, 28 media blocks. x U465783.bff, 24576 bytes, 48 media blocks. x U465786.bff, 105472 bytes, 206 media blocks. x U468512.bff, 109568 bytes, 214 media blocks. x U468516.bff, 184320 bytes, 360 media blocks. x U468519.bff, 4096 bytes, 8 media blocks. x U468521.bff, 617472 bytes, 1206 media blocks. x U468524.bff, 15360 bytes, 30 media blocks. x U468528.bff, 51200 bytes, 100 media blocks. x U468533.bff, 1015808 bytes, 1984 media blocks. x U468534.bff, 1235968 bytes, 2414 media blocks.

62) Back up your system. 63) This package is the size of 1GB, you may been to increase the size of /usr by:

# chfs -a size=+2040000 /usr Filesystem size changed to 4325376

64) Install the package by creating a table of contents for install to use. Then update the install subsystem itself. Run SMIT to complete the installation.

a. inutoc /usr/sys/inst.images b. installp -acgXd /usr/sys/inst.images bos.rte.install

# inutoc /usr/sys/inst.images # installp -acgXd /usr/sys/inst.images bos.rte.install +-----------------------------------------------------------------------------+ Pre-installation Verification... +-----------------------------------------------------------------------------+ Verifying selections...done Verifying requisites...done Results... SUCCESSES --------- Filesets listed in this section passed pre-installation verification


28

and will be installed. Mandatory Fileset Updates ------------------------- (being installed automatically due to their importance) bos.rte.install 5.3.0.11 # LPP Install Commands << End of Success Section >> FILESET STATISTICS ------------------ 1 Selected to be installed, of which: 1 Passed pre-installation verification ---- 1 Total to be installed +-----------------------------------------------------------------------------+ Installing Software... +-----------------------------------------------------------------------------+ installp: APPLYING software for: bos.rte.install 5.3.0.11 . . . . . << Copyright notice for bos >> . . . . . . . Licensed Materials - Property of IBM 5765G0300 (C) Copyright International Business Machines Corp. 1985, 2005. (C) Copyright AT&T 1984, 1985, 1986, 1987, 1988, 1989. (C) Copyright Regents of the University of California 1980, 1982, 1983, 1985, 1986, 1987, 1988, 1989. (C) Copyright BULL 1993, 2004. (C) Copyright Digi International Inc. 1988-1993. (C) Copyright Interactive Systems Corporation 1985, 1991. (C) Copyright ISQUARE, Inc. 1990. (C) Copyright Mentat Inc. 1990, 1991. (C) Copyright Open Software Foundation, Inc. 1989, 1994. (C) Copyright Sun Microsystems, Inc. 1984, 1985, 1986, 1987, 1988, 1991. All rights reserved. US Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. . . . . . << End of copyright notice for bos >>. . . . Finished processing all filesets. (Total time: 5 secs). +-----------------------------------------------------------------------------+ Pre-commit Verification... +-----------------------------------------------------------------------------+ Verifying requisites...done Results... SUCCESSES --------- Filesets listed in this section passed pre-commit verification and will be committed. Selected Filesets ----------------- bos.rte.install 5.3.0.11 # LPP Install Commands


29

<< End of Success Section >> +-----------------------------------------------------------------------------+ Committing Software... +-----------------------------------------------------------------------------+ installp: COMMITTING software for: bos.rte.install 5.3.0.11 Finished processing all filesets. (Total time: 6 secs). +-----------------------------------------------------------------------------+ Summaries: +-----------------------------------------------------------------------------+ Installation Summary -------------------- Name Level Part Event Result ------------------------------------------------------------------------------- bos.rte.install 5.3.0.11 USR APPLY SUCCESS bos.rte.install 5.3.0.11 USR COMMIT SUCCESS

c. smit update_all

d. Input /usr/sys/inst.images as the input device directory

e. oslevel –r (look for 5100-03) f. shutdown -r

# oslevel -r 5300-01 # shutdown -r SHUTDOWN PROGRAM Fri Apr 22 12:47:22 CDT 2005 Broadcast message from root@gps-aix6 (tty) at 12:47:22 ... shutdown: PLEASE LOG OFF NOW !!! All processes will be killed in 1 minute.

65) Verify that shared disks are accessible via Fibre adapter. Use SMIT, “Devices/Fixed Disk/List

All”. 66) Configure up NFS using SMIT (Commun Applic & Services => NFS => etc). Just simply start-up

NFS services. Choose the option to start NFS now and to also start NFS on reboot (“both” option). 67) Configure up NIS using SMIT (Commun Applic & Services => NFS => NIS => etc)

a. Change domain name to veritas.com b. Configure this Host as a NIS Client c. Start / Stop Configured NIS Daemons

1. Start the Client Daemon, ypbind d. Execute ypcat hosts to verify NIS is working


30

68) Configure automount on each system by performing the following:

a. Set /etc/irs.conf to hosts local continue hosts nis continue hosts dns services local continue services nis

b. Set /etc/auto.gps to +auto.gps

c. Set /etc/auto.home to +auto.home

d. Set /etc/auto_master to +auto.master

e. Edit /etc/filesystems to mount /home as /home_old f. Create the directory /home_old if it does not exist g. Execute automount


31

For additional information about VERITAS Software, its products, or the location of an office near you, please call our corporate headquarters or visit our Web site at www.veritas.com.

VERITAS Software Corporation Corporate Headquarters 350 Ellis Street Mountain View, CA 94043 650-527-8000 or 866-837-4827


32

http://www.veritas.com/

Documents

SFRAC 4.0 MP1 INSTALLATION COOKBOOK FOR AIX PLATFORMeval.symantec.com/.../AIX_RAC_Install_Cookbook_6.26.05.pdf · SFRAC 4.0 MP1 INSTALLATION COOKBOOK FOR AIX PLATFORM ... • Maxreqs=4*#disks*queue_depth

SFRAC 4.0 MP1 INSTALLATION COOKBOOK FOR AIX PLATFORMeval.symantec.com/.../AIX_RAC_Install_Cookbook_6.26.05.pdf · SFRAC 4.0 MP1 INSTALLATION COOKBOOK FOR AIX PLATFORM ... • Maxreqs=4#disksqueue_depth