ZXWR RNC SBCX Audit MOP_ZTE WCDMA (2).pdf

MOP_RNC SBCX Audit_ ZTE WCDMA

RNC SBCX Audit

MOP

Document Number: ZTE-WCDMA-26092013-0001

Prepared By

Reviewed By

Authorized By

Darshan Patil

Deep Dhiman

Santosh Jagtap

Release On :-26th

September 2013

Validity: Till Further Notification


Audit Measures

1) SBCX Hardware faulty

2) Procedure to telnet SBCX

3) OmmHost process

4) OMM application process

5) OMCB application process

6) Master-slave data synchronization


Steps to check sbcx redundancy readiness:

1) SBCX Hardware faulty

Check if the slave SBCX has any physical alarm. If found, do fill the respective column in the audit sheet.

2) Procedure to telnet SBCX

1. Procedure to Telnet master SBCX using command prompt:

telnet rnc ip (e.g telnet 97.146.27.5 kol rnc 36)

sbcx361 (Linux release 2.6.9-55.ELsmp #1 SMP Fri Apr 20 17:03:35 EDT 2007) (3)

login: womc

Password for womc:

login: Resource temporarily unavailable while getting initial credentials

Last login: Thu Sep 26 02:29:37 from 97.150.112.15

-bash-3.00$ su - root

Password: root123

[root@sbcx361 ~]#

2. Procedure to Telnet slave SBCX using command prompt:

telnet rnc ip (e.g telnet 97.146.27.5 kol rnc 36)

check eth2 ip (192.168.100+rncid.1 master / 192.168.100+rncid.2 slave)

telnet eth2 of slave from master as follows:


login: womc

Password for womc:


Last login: Thu Sep 26 02:29:37 from 97.150.112.15

-bash-3.00$ su - root

Password: root123


[root@sbcx361 ~]#

[root@sbcx361 ~]# ifconfig eth2

eth2 Link encap:Ethernet HWaddr 00:19:C6:40:67:7F

inet addr:192.168.136.1 Bcast:192.168.136.255 Mask:255.255.255.0

inet6 addr: fe80::219:c6ff:fe40:677f/64 Scope:Link

UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1

RX packets:0 errors:0 dropped:0 overruns:0 frame:0

TX packets:3 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:1000

RX bytes:0 (0.0 b) TX bytes:210 (210.0 b)

[root@sbcx361 ~]# telnet 192.168.136.2

Trying 192.168.136.2...

Connected to 192.168.136.2 (192.168.136.2).

Escape character is '^]'.


login: womc

Password for womc:


Last login: Thu Jul 18 13:36:30 from 128.0.28.1

-bash-3.00$

-bash-3.00$

If unable to telnet slave sbcx, please fill the audit respective column in the audit sheet. Escalate to TEC.

3) OmmHost process

Check following process in SBCX.

1. OmmHost process in master SBCX:


[root@sbcx03 ~]# ps -ef| grep /home/zte/OmmHost/

root 4358 1 0 2012 ? 00:00:11 /home/zte/OmmHost/bin/SysCtrlProc

root 5222 4358 0 2012 ? 03:10:42 /home/zte/OmmHost/bin/CommProc BOARD_MASTER

BOARD_LEFT

root 21263 21232 0 17:36 pts/1 00:00:00 grep /home/zte/OmmHost/

2. OmmHost process in slave SBCX:

[root@sbcx04 ~]# ps -ef| grep /home/zte/OmmHost/

root 3050 3013 0 17:52 pts/3 00:00:00 grep /home/zte/OmmHost/

root 4055 1 0 Apr22 ? 00:00:01 /home/zte/OmmHost/bin/SysCtrlProc

root 13980 4055 0 Apr22 ? 01:41:51 /home/zte/OmmHost/bin/CommProc BOARD_SLAVE

BOARD_RIGHT

4) OMM application process

Total 5 processes (BootMain, Rctserver, BackUpControl, FtpServer, BoostMain) should be visible

in master SBCX and 3 (BootMain, BackUpControl, FtpServer) processes in slave SBCX as belows.

root@sbcx03 ~]# ps -ef| grep /home/womc/ZXWR-RB/WOMC/

root 5223 4358 0 2012 ? 00:00:00 /bin/sh /home/womc/ZXWR-RB/WOMC/ums-

svr/bin/console-linux.sh BOARD_MASTER BOARD_LEFT

root 5279 5270 0 2012 ? 00:07:31 /home/womc/ZXWR-RB/WOMC/jdk-linux/bin/java -Xms64m

-Xmx256m -Djava.rmi.server.useCodebaseOnly=true -Xbootclasspath/p:/home/womc/ZXWR-

RB/WOMC/ums-svr/bin/boot_lib/uep-prert.jar -DrunPath=/home/womc/ZXWR-RB/WOMC/ums-

svr/platform/psl/ext-service/console -DfamilyType=/home/womc/ZXWR-RB/WOMC/ums-

svr/platform/psl/ext-service/console/../../../../../ -DprocType=Console -Dumd=true -Duep=3X -cp

/home/womc/ZXWR-RB/WOMC/ums-svr/platform/psl/ext-service/console/lib/boot.jar

com.zte.ums.uep.psl.console.manager.BootMain

root 5396 5279 0 2012 ? 00:08:04 /home/womc/ZXWR-RB/WOMC/ums-

svr/tools/rct_v2_server_w/../../../jdk-linux/bin/java -

Dcom.zte.ums.uep.psl.console.jvmlabel=135642727079430531338 -

Dcom.zte.ums.uep.psl.console.jvmserial=0 -DSYSTEM_PROPERTY_MAINCONTROLLER_PORT=22001 -

DSYSTEM_PROPERTY_MAINCONTROLLER_RMI_PORT=22002 -

DSYSTEM_PROPERTY_KEEP_ALIVE_PORT=22004 -Djava.util.logging.config.file=/home/womc/ZXWR-


RB/WOMC/ums-svr/tools/rct_v2_server_w/lib/logging.properties -

Djava.library.path=/home/womc/ZXWR-RB/WOMC/ums-svr/lib -Duser.dir=/home/womc/ZXWR-

RB/WOMC/ums-svr/tools/rct_v2_server_w -DprocType=Tfserver -DfamilyType=/home/womc/ZXWR-

RB/WOMC -DrunPath=/home/womc/ZXWR-RB/WOMC/ums-svr/tools/rct_v2_server_w -

Xbootclasspath/p:/home/womc/ZXWR-RB/WOMC/ums-svr/bin/boot_lib/uep-prert.jar -classpath

/home/womc/ZXWR-RB/WOMC/ums-svr/tools/rct_v2_server_w/lib/xml.jar:/home/womc/ZXWR-

RB/WOMC/ums-svr/tools/rct_v2_server_w/lib/jdom.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/rct_v2_server_w/lib/root.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/rct_v2_server_w/lib/tkit-common-v201001.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/rct_v2_server_w/lib/rctServer.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/rct_v2_server_w/lib/uep-util-consoleagent.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/rct_v2_server_w/lib/uep-psl-consolelib.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/rct_v2_server_w/lib/uep-util-toolkit.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/rct_v2_server_w/lib:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/rct_v2_server_w/lib/log4j.jar rct.module.server.Rctserver

root 5467 5279 0 2012 ? 00:18:46 /home/womc/ZXWR-RB/WOMC/jdk-linux/bin/java -




DSYSTEM_PROPERTY_KEEP_ALIVE_PORT=22004 -server -Xms256m -Xmx512m -

Djava.util.logging.config.file=/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/backup/lib/logging.properties -Djava.library.path=/home/womc/ZXWR-RB/WOMC/ums-svr/lib

-Duser.dir=/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup -

XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/backup/ -DrunPath=/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup -

DfamilyType=/home/womc/ZXWR-RB/WOMC -DprocType=UMS_BACKUP -Dumd=true -Duep=3X -XX:-

UseGCOverheadLimit -Xbootclasspath/p:/home/womc/ZXWR-RB/WOMC/ums-svr/bin/boot_lib/uep-

prert.jar -classpath /home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup:/home/womc/ZXWR-

RB/WOMC/ums-svr/tools/backup/conf:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/backup/lib:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup/lib/backport-util-

concurrent.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup/lib/commons-

dbcp.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup/lib/commons-

net.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup/lib/commons-

pool.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup/lib/jakarta-oro.jar:/home/womc/ZXWR-

RB/WOMC/ums-svr/tools/backup/lib/jnpserver.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/backup/lib/uep-psl-naming.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/backup/lib/jtds-1.2.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/backup/lib/log4j.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/backup/lib/ojdbc14.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup/lib/uep-psl-

consolelib.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup/lib/uep-util-

consoleagent.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup/lib/uep-psl-


consoleControlProcess.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup/lib/uep-util-

toolkit.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup/lib/jdom.jar:/home/womc/ZXWR-

RB/WOMC/ums-svr/tools/backup/lib/zxmuep-common-sbcx.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/backup/lib/zxmuep-sbcx-dbsync.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/backup/lib/uep-psl-ftpclient.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/backup/lib/uep-api.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/backup/lib/jboss.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup/lib/jboss-

common.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup/lib/jboss-

j2ee.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup/lib/uep-psl-

backup.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/backup/../../platform/psl/uep-psl-

sftpserver.par/uep-psl-ssh.jar com.zte.ums.uep.psl.backup.BackUpControl

root 5478 5279 0 2012 ? 06:30:04 /home/womc/ZXWR-RB/WOMC/jdk-linux/bin/java -




DSYSTEM_PROPERTY_KEEP_ALIVE_PORT=22004 -Djava.util.logging.config.file=/home/womc/ZXWR-

RB/WOMC/ums-svr/tools/ftpserver/lib/logging.properties -Djava.library.path=/home/womc/ZXWR-

RB/WOMC/ums-svr/lib -Duser.dir=/home/womc/ZXWR-RB/WOMC/ums-svr/tools/ftpserver -

DprocType=FtpServer -DfamilyType=/home/womc/ZXWR-RB/WOMC -DrunPath=/home/womc/ZXWR-

RB/WOMC/ums-svr/tools/ftpserver -Dumd=true -Duep=3X -Xmx512m -Xms256m -

Xbootclasspath/p:/home/womc/ZXWR-RB/WOMC/ums-svr/bin/boot_lib/uep-prert.jar -classpath

/home/womc/ZXWR-RB/WOMC/ums-svr/tools/ftpserver/conf:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/ftpserver/lib/run.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/ftpserver/lib/jboss-

common.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/ftpserver/lib/jnpserver.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/ftpserver/lib/uep-

psl-naming.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/ftpserver/lib/log4j.jar:/home/womc/ZXWR-RB/WOMC/ums-

svr/tools/ftpserver/lib/concurrent.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/ftpserver/lib/uep-

util-toolkit.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/ftpserver/lib/uep-psl-

ftpserver.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/ftpserver/lib/uep-util-

consoleagent.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/ftpserver/lib/uep-psl-

consolelib.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/tools/ftpserver/lib

com.zte.ums.uep.psf.ftp.server.FtpServer

root 5718 5279 0 2012 ? 2-17:43:01 /home/womc/ZXWR-RB/WOMC/ums-svr/../jdk-

linux/bin/java -Dcom.zte.ums.uep.psl.console.jvmlabel=135642727079430531338 -



DSYSTEM_PROPERTY_KEEP_ALIVE_PORT=22004 -server -Dumd=true -Duep=3X -

DrunPath=/home/womc/ZXWR-RB/WOMC/ums-svr/bin/inner/ -DfamilyType=/home/womc/ZXWR-

RB/WOMC/ums-svr/../ -DprocType=UMS_SVR -Xmx1400m -XX:MaxPermSize=128m -Xms1400m -


Xms1400m -Xss256K -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=40 -

XX:CMSFullGCsBeforeCompaction=5 -XX:+UseCMSCompactAtFullCollection -XX:ParallelGCThreads=3 -

XX:+HeapDumpOnOutOfMemoryError -verbose:gc -XX:+PrintGCDetails -Xloggc:/home/womc/ZXWR-

RB/WOMC/ums-svr/log/gc-12-12-25-14-51-15.log -Dant.home=/home/womc/ZXWR-RB/WOMC/ums-

svr -Dums.process.name=master -Djava.library.path=/home/womc/ZXWR-RB/WOMC/ums-svr/lib -

Djboss.server.temp.dir=/home/womc/ZXWR-RB/WOMC/ums-svr/temp -Djboss.deploy.localcopy=off -

Dprogram.name=run-linuxexc.sh -Djava.awt.headless=true -

Djava.util.logging.config.file=/home/womc/ZXWR-RB/WOMC/ums-svr/lib/logging.properties -

Ddebug.mode=true -

Djava.rmi.server.RMIClassLoaderSpi=com.zte.ums.uep.psl.systemsupport.provider.RmiSpiProvider -

Dsun.lang.ClassLoader.allowArraySyntax=true -XX:+HeapDumpOnOutOfMemoryError -

XX:HeapDumpPath=/home/womc/ZXWR-RB/WOMC/ums-svr/log/ -

Djavax.management.builder.initial=org.jboss.system.server.jmx.MBeanServerBuilderImpl -

Djboss.platform.mbeanserver -Xbootclasspath/p:/home/womc/ZXWR-RB/WOMC/ums-

svr/bin/boot_lib/uep-prert.jar -classpath :/home/womc/ZXWR-RB/WOMC/ums-svr/../jdk-

linux/lib/tools.jar:/home/womc/ZXWR-RB/WOMC/ums-svr/bin/boost.jar:/home/womc/ZXWR-

RB/WOMC/ums-svr/deploy:/home/womc/ZXWR-RB/WOMC/ums-svr/kernel/lib/jboss-jmx-wrapper.jar

com.zte.ums.BoostMain

5) OMCB application process

Similarly check processes in OMCB. Total 4 processes (BootMain, BackUpControl, FtpServer,

BoostMain) should be visible in master SBCX and 3 (BootMain, BackUpControl, FtpServer)

processes in slave SBCX.


6) Master-slave data synchronization

1. Compare following commands in master and slave sbcx at the same time.

Command prompt window 1: Telnet the master sbcx (procedure provided above in point 1)

Command prompt window 2: Telnet the slave sbcx (procedure provided above in point 2)

Use Oracle user (su oracle/ password: oracle123)

Table 22 checks whether the key data synchronization database

Check items method of operation

Configure Data Synchronization

sqlplus uep/u_tywg_2008;

select count(*) from motree;

Alarm data synchronization

sqlplus caffm/u_tywg_2008;

select count(*) from CAF_ALARM;

select count(*) from caf_fmrule;

Performance data synchronization

sqlplus rns_pm/u_tywg_2008

select count(*) from A_RNC_CPU;

select count(*) from ueppm.PM_TASKGENERALINFO_TABLE;

Note: If the results on both windows is same, then the data in the database is synchronized.

If all the above procedure is normal, slave sbcx readiness is alright. If anything out-of-flow found out, do

escalate to TEC.

SBCX redundancy audit_26092013.xlsx

Documents

ZXWR RNC SBCX Audit MOP_ZTE WCDMA (2).pdf