Wednesday, 8 May 2019

APPLY PATCHES IN RAC GRID/ORACLE DB HOME

/*FOLLOWING STEPS TO APPLY PATCHES IN RAC GRID/ORACLE DB HOME ENVIRONMENT */

Grid Home: /orahps/12.2.0/grid

Oracle Home: /orahps/12.2.0/db/app/product/12.2.0/hpsrac_dbhome

>> Analyze patches from root user.

---- Using below command can analyze both home grid and DB Home in once
/orahps/12.2.0/grid/OPatch/opatchauto apply /rmanhps/software/patches/28828733 -analyze

-- Using below command can analyze grid patch only.

/orahps/12.2.0/grid/OPatch/opatchauto apply /rmanhps/software/patches/28828733 -analyze -oh /orahps/12.2.0/grid

-- Using below command can analyze Oracle DB Home only.

/orahps/12.2.0/db/app/product/12.2.0/hpsrac_dbhome/OPatch/opatchauto apply /rmanhps/software/patches/28828733 -analyze -oh

/orahps/12.2.0/db/app/product/12.2.0/hpsrac_dbhome

>> How to check rollingpatch method.

root@testdbn01:~# /orahps/12.2.0/grid/bin/crsctl query crs activeversion -f
Oracle Clusterware active version on the cluster is [12.2.0.1.0]. The cluster upgrade state is [NORMAL]. The cluster active patch level is [1819134257].

Step:1 Create ocm response file using grid user.

/orahps/12.2.0/grid/OPatch/ocm/bin/emocmrsp -output /orahps/software/ocm.rsp

>> Stop crs from root user

/orahps/12.2.0/grid/bin/crsctl stop crs

/orahps/12.2.0/grid/crs/install/rootcrs.sh -prepatch

>> Give grid owner ship to PSU patches.

chown -R grid:oinstall /rmanhps/software/patches
su - grid

>> Check Opatch version from grid user.

/orahps/12.2.0/grid/OPatch/opatch version

>> Check applied patches from grid user.

/orahps/12.2.0/grid/OPatch/opatch lspatches -oh /orahps/12.2.0/grid

>> Login with Grid user and apply these patches in Grid home.

$ /orahps/12.2.0/grid/OPatch/opatch apply -oh /orahps/12.2.0/grid -local -silent /rmanhps/software/patches/28828733/28822515
$ /orahps/12.2.0/grid/OPatch/opatch apply -oh /orahps/12.2.0/grid -local -silent /rmanhps/software/patches/28828733/28870605
$ /orahps/12.2.0/grid/OPatch/opatch apply -oh /orahps/12.2.0/grid -local -silent /rmanhps/software/patches/28828733/28864846
$ /orahps/12.2.0/grid/OPatch/opatch apply -oh /orahps/12.2.0/grid -local -silent /rmanhps/software/patches/28828733/26839277
$ /orahps/12.2.0/grid/OPatch/opatch apply -oh /orahps/12.2.0/grid -local -silent /rmanhps/software/patches/28828733/28566910

>> Check patches are applied and not using below query.

/orahps/12.2.0/grid/OPatch/opatch lspatches -oh /orahps/12.2.0/grid

******************************* Process How to apply Patches in Oracle RAC Database Home ******************************

>> Change owner ship oracle for patches.

#chown -R oracle:oinstall /rmanhps/software/patches
#su - oracle

>> Check opatch version.

/orahps/12.2.0/db/app/product/12.2.0/hpsrac_dbhome/OPatch/opatch version

>> Check applied patches.

/orahps/12.2.0/db/app/product/12.2.0/hpsrac_dbhome/OPatch/opatch lspatches -oh /orahps/12.2.0/db/app/product/12.2.0/hpsrac_dbhome

>> Execute pre-patch command from oracle user.

$ /rmanhps/software/patches/28828733/28870605/custom/scripts/prepatch.sh -dbhome /orahps/12.2.0/db/app/product/12.2.0/hpsrac_dbhome

>> Applied Patches in oracle home from oracle user.

$ /orahps/12.2.0/db/app/product/12.2.0/hpsrac_dbhome/OPatch/opatch apply -oh /orahps/12.2.0/db/app/product/12.2.0/hpsrac_dbhome -local -silent /rmanhps/software/patches/28828733/28822515

$ /orahps/12.2.0/db/app/product/12.2.0/hpsrac_dbhome/OPatch/opatch apply -oh /orahps/12.2.0/db/app/product/12.2.0/hpsrac_dbhome -local -silent /rmanhps/software/patches/28828733/28870605

>> Execute postpatch command after applying patches.

$ /rmanhps/software/patches/28828733/28870605/custom/scripts/postpatch.sh -dbhome /orahps/12.2.0/db/app/product/12.2.0/hpsrac_dbhome 

/orahps/12.2.0/db/app/product/12.2.0/hpsrac_dbhome/OPatch/opatch lspatches -oh /orahps/12.2.0/db/app/product/12.2.0/hpsrac_dbhome

**********   Below steps are applicable only after grid patching.

/orahps/12.2.0/grid/rdbms/install/rootadd_rdbms.sh

/orahps/12.2.0/grid/crs/install/rootcrs.sh -postpatch

/orahps/12.2.0/grid/bin/crsctl check crs

>> This command will lock invertory if its unlock.

GRID_CHECK=$(stat -c %U /orahps/12.2.0/grid); if [[ $GRID_CHECK == root ]]; then echo -e \\nPASS: Grid Home is locked\\n; else  echo -e \\nFAIL: Grid Home is not locked. Locking Grid Home now . . .\\n;/orahps/12.2.0/grid/crs/install/rootcrs.sh -unlock; /orahps/12.2.0/grid/crs/install/rootcrs.sh -patch; fi


/rmanhps/software/patches/28828733/28822515
/rmanhps/software/patches/28828733/28870605
/rmanhps/software/patches/28828733/28864846
/rmanhps/software/patches/28828733/26839277
/rmanhps/software/patches/28828733/28566910


*****************************  Applying Patches in 11GR2 ************************
>> Execute following steps from root user.

/orahps/11.2.0/grid/bin/crsctl stop crs

/orahps/11.2.0/grid/crs/install/rootcrs.pl -unlock

>> Change ownership of patch.

chown -R grid:oinstall /orahps/software
su - grid

>> Create Grid response file from grid user.

/orahps/11.2.0/grid/OPatch/ocm/bin/emocmrsp -output /orahps/software/ocm.rsp

>> Check opatch version and inventory backed up.

/orahps/11.2.0/grid/OPatch/opatch version

/orahps/11.2.0/grid/OPatch/opatch lsinventory  -oh /orahps/11.2.0/grid > /tmp/grid.lsinventory.before

/orahps/11.2.0/grid/OPatch/opatch lspatches  -oh /orahps/11.2.0/grid

>> Apply following patches in Grid home from grid user.

/orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/24006111

/orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/23054319

/orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/22502505

/orahps/11.2.0/grid/OPatch/opatch lspatches  -oh /orahps/11.2.0/grid

********* Applicable following below steps duing patching of grid and oracle home *******************

>> Execute following steps from root user.

/orahps/11.2.0/grid/rdbms/install/rootadd_rdbms.sh

/orahps/11.2.0/grid/crs/install/rootcrs.pl -patch

/orahps/11.2.0/grid/bin/crsctl check crs

>> This command will lock inventory if it is unlock.

GRID_CHECK=$(stat -c %U /orahps/11.2.0/grid); if [[ $GRID_CHECK == root ]]; then echo -e \\nPASS: Grid Home is locked\\n; else  echo -e \\nFAIL: Grid Home is not locked. Locking Grid Home now . . .\\n;/orahps/11.2.0/grid/crs/install/rootcrs.pl -unlock; /orahps/11.2.0/grid/crs/install/rootcrs.pl -patch; fi

How to Apply PSU/CPU Patching in Oracle RDBMS Home

Steps how to apply patches in oracle home 11GR2/2246888.1)

Step:1 Change ownership of patches. 

chown -R oracle:oinstall /u01/patches/BP
su - oracle

/u04/app/orapoam/product/11.2.0.4/POAM/OPatch/opatch version

Step:2 Check versions before starting

/u04/app/orapoam/product/11.2.0.4/POAM/OPatch/opatch lsinventory -oh /u04/app/orapoam/product/11.2.0.4/POAM > /tmp/database1.lsinventory.before
/u04/app/orapoam/product/11.2.0.4/POAM/OPatch/opatch lspatches -oh /u04/app/orapoam/product/11.2.0.4/POAM

Step:3 Stop the database and listener before start below process

/u04/app/orapoam/product/11.2.0.4/POAM/OPatch/ocm/bin/emocmrsp -output /u01/patches/BP/ocm.rsp

/u01/patches/BP/27980213/27441052/custom/server/27441052/custom/scripts/prepatch.sh -dbhome /u04/app/orapoam/product/11.2.0.4/POAM

Step:4 Applied patches.

/u04/app/orapoam/product/11.2.0.4/POAM/OPatch/opatch napply -oh /u04/app/orapoam/product/11.2.0.4/POAM -local -silent -ocmrf /u01/patches/BP/ocm.rsp /u01/patches/BP/27980213/27734978

/u04/app/orapoam/product/11.2.0.4/POAM/OPatch/opatch napply -oh /u04/app/orapoam/product/11.2.0.4/POAM -local -silent -ocmrf /u01/patches/BP/ocm.rsp /u01/patches/BP/27980213/27441052/custom/server/27441052

/u01/patches/BP/27980213/27441052/custom/server/27441052/custom/scripts/postpatch.sh -dbhome /u04/app/orapoam/product/11.2.0.4/POAM

>> Install OHVM patches if it is required.

Install OJVM
/u04/app/orapoam/product/11.2.0.4/POAM/OPatch/opatch apply -oh /u04/app/orapoam/product/11.2.0.4/POAM -local -silent -ocmrf /u01/patches/BP/ocm.rsp /u01/patches/ONEOFF/27923163

Check Results
/u04/app/orapoam/product/11.2.0.4/POAM/OPatch/opatch lspatches -oh /u04/app/orapoam/product/11.2.0.4/POAM
exit

How to Apply Oracle 11gR2 GRID PSU/CPU Patching

**********************  Patching in GRID Home ***** Supplemental Readme - Grid Infrastructure Release Update 12.2.0.1.x / 18c (Doc ID 2246888.1)

Step:1 Stop the CRS services on node 1

/orahps/11.2.0/grid/bin/crsctl stop crs

Step:2 : Unlock inventory for patching.

/orahps/11.2.0/grid/crs/install/rootcrs.pl -unlock

Change patch permission.

chown -R grid:oinstall /orahps/software

su - grid

Step:3: 

/orahps/11.2.0/grid/OPatch/ocm/bin/emocmrsp -output /orahps/software/ocm.rsp

/orahps/11.2.0/grid/OPatch/opatch version

Step:4 Take exiting patch applied backup.

/orahps/11.2.0/grid/OPatch/opatch lsinventory  -oh /orahps/11.2.0/grid > /tmp/grid.lsinventory.before

/orahps/11.2.0/grid/OPatch/opatch lspatches  -oh /orahps/11.2.0/grid

Step:5 Applying GRID Patch.

/orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/24006111

/orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/23054319

/orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/22502505

/orahps/11.2.0/grid/OPatch/opatch lspatches  -oh /orahps/11.2.0/grid

exit

Step:6 Perform follwoing steps after patching.

/orahps/11.2.0/grid/rdbms/install/rootadd_rdbms.sh

/orahps/11.2.0/grid/crs/install/rootcrs.pl -patch

/orahps/11.2.0/grid/bin/crsctl check crs

Step: 7 This below command will check your Grid home is locked and not if not locked then automatically will locked. 

Note: This command has to be run only patching window.

GRID_CHECK=$(stat -c %U /orahps/11.2.0/grid); if [[ $GRID_CHECK == root ]]; then echo -e \\nPASS: Grid Home is locked\\n; else  echo -e \\nFAIL: Grid Home is not locked. Locking Grid Home now . . .\\n;/orahps/11.2.0/grid/crs/install/rootcrs.pl -unlock; /orahps/11.2.0/grid/crs/install/rootcrs.pl -patch; fi

******************  PATCH LOGS ****************************
grid@testdbn03:~$ /orahps/11.2.0/grid/OPatch/ocm/bin/emocmrsp -output /orahps/software/ocm.rsp
OCM Installation Response Generator 10.3.7.0.0 - Production
Copyright (c) 2005, 2012, Oracle and/or its affiliates.  All rights reserved.

Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:

You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  y
The OCM configuration response file (/orahps/software/ocm.rsp) was successfully created.

>> Applied patches.

grid@testbn03:~$ /orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/24006111
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2019, Oracle Corporation.  All rights reserved.


Oracle Home       : /orahps/11.2.0/grid
Central Inventory : /orahps/app/oraInventory
   from           : /orahps/11.2.0/grid/oraInst.loc
OPatch version    : 11.2.0.3.15
OUI version       : 11.2.0.4.0
Log file location : /orahps/11.2.0/grid/cfgtoollogs/opatch/opatch2019-04-07_08-50-56AM_1.log

Verifying environment and performing prerequisite checks...
OPatch continues with these patches:   17478514  18031668  18522509  19121551  19769489  20299013  20760982  21352635  21948347  22502456  23054359  24006111

Do you want to proceed? [y|n]
Y (auto-answered by -silent)
User Responded with: Y
All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/orahps/11.2.0/grid')


Is the local system ready for patching? [y|n]
Y (auto-answered by -silent)
User Responded with: Y
Backing up files...
Applying sub-patch '17478514' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.sdo, 11.2.0.4.0 ] , [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.sdo.locator, 11.2.0.4.0...

Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...

Patching component oracle.xdk.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18031668' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.ldap.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.crs, 11.2.0.4.0...

Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...

Patching component oracle.rdbms.deconfig, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18522509' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.rman, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '19121551' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.rman, 11.2.0.4.0...

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.ordim.client, 11.2.0.4.0...

Patching component oracle.ordim.jai, 11.2.0.4.0...
Applying sub-patch '19769489' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.ovm, 11.2.0.4.0 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.oraolap, 11.2.0.4.0 ] , [ oracle.sysman.agent, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms.util, 11.2.0.4.0...

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.xdk.parser.java, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.xdk.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.rman, 11.2.0.4.0...

Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20299013' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ] , [ oracle.rdbms.oci, 11.2.0.4.0 ] , [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.sysman.common, 10.2.0.4.5...

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.xdk.parser.java, 11.2.0.4.0...

Patching component oracle.xdk.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.sysman.common.core, 10.2.0.4.5...

Patching component oracle.rdbms.rman, 11.2.0.4.0...

Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20760982' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.sysman.console.db, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '21352635' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.rman, 11.2.0.4.0...

Patching component oracle.rdbms, 11.2.0.4.0...
Applying sub-patch '21948347' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.ovm, 11.2.0.4.0 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.tfa, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] , [ oracle.sysman.oms.core, 10.2.0.4.5 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...

Patching component oracle.xdk.parser.java, 11.2.0.4.0...

Patching component oracle.xdk.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '22502456' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.tfa, 11.2.0.4.0 ] , [ oracle.rdbms.olap, 11.2.0.4.0 ] , [ oracle.oraolap, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.oraolap.dbscripts, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.rman, 11.2.0.4.0...

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Applying sub-patch '23054359' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '24006111' to OH '/orahps/11.2.0/grid'

Patching component oracle.sqlplus.ic, 11.2.0.4.0...

Patching component oracle.sqlplus, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

OPatch found the word "warning" in the stderr of the make command.
Please look at this stderr. You can re-run this make command.
Stderr output:
+ PATH=/bin:/usr/bin:/usr/ccs/bin
+ export PATH
+ lib=/orahps/11.2.0/grid/sqlplus/lib/libsqlplus.so
+ makefile=/orahps/11.2.0/grid/sqlplus/lib/ins_sqlplus.mk
+ so_ext=so
+ target=dlopenlib
+ var=''
+ basename /orahps/11.2.0/grid/sqlplus/lib/libsqlplus.so .so
+ libname=libsqlplus
+ dirname /orahps/11.2.0/grid/sqlplus/lib/libsqlplus.so
+ dir=/orahps/11.2.0/grid/sqlplus/lib
+ [ var '=' dlopenlib ]
+ [ -f /orahps/11.2.0/grid/sqlplus/lib/libsqlplus.a ]
+ dir2=/orahps/11.2.0/grid/sqlplus/lib/
+ [ '' '!=' '' ]
+ make -f /orahps/11.2.0/grid/sqlplus/lib/ins_sqlplus.mk dlopenlib _FULL_LIBNAME=/orahps/11.2.0/grid/sqlplus/lib/libsqlplus.so _LIBNAME=libsqlplus _LIBDIR=/orahps/11.2.0/grid/sqlplus/lib/ _LIBNAME_LIBS='$(libsqlplusLIBS)' _LIBNAME_EXTRALIBS='$(libsqlplusEXTRALIBS)'
ld: warning: symbol '_init' not found, but .init section exists - possible link-edit without using the compiler driver
ld: warning: symbol '_fini' not found, but .fini section exists - possible link-edit without using the compiler driver

Composite patch 24006111 successfully applied.
OPatch Session completed with warnings.
Log file location: /orahps/11.2.0/grid/cfgtoollogs/opatch/opatch2019-04-07_08-50-56AM_1.log

OPatch completed with warnings.
grid@testdbn03:~$ /orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/23054319
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2019, Oracle Corporation.  All rights reserved.

Oracle Home       : /orahps/11.2.0/grid
Central Inventory : /orahps/app/oraInventory
   from           : /orahps/11.2.0/grid/oraInst.loc
OPatch version    : 11.2.0.3.15
OUI version       : 11.2.0.4.0
Log file location : /orahps/11.2.0/grid/cfgtoollogs/opatch/opatch2019-04-07_08-52-19AM_1.log

Verifying environment and performing prerequisite checks...
OPatch continues with these patches:   23054319

Do you want to proceed? [y|n]
Y (auto-answered by -silent)
User Responded with: Y
All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/orahps/11.2.0/grid')

Is the local system ready for patching? [y|n]
Y (auto-answered by -silent)
User Responded with: Y
Backing up files...
Applying interim patch '23054319' to OH '/orahps/11.2.0/grid'

Patching component oracle.crs, 11.2.0.4.0...

OPatch found the word "warning" in the stderr of the make command.
Please look at this stderr. You can re-run this make command.
Stderr output:
ld: warning: symbol '_init' not found, but .init section exists - possible link-edit without using the compiler driver
ld: warning: symbol '_fini' not found, but .fini section exists - possible link-edit without using the compiler driver


Patch 23054319 successfully applied.
OPatch Session completed with warnings.
Log file location: /orahps/11.2.0/grid/cfgtoollogs/opatch/opatch2019-04-07_08-52-19AM_1.log

OPatch completed with warnings.
grid@testdbn03:~$ /orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/22502505
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2019, Oracle Corporation.  All rights reserved.


Oracle Home       : /orahps/11.2.0/grid
Central Inventory : /orahps/app/oraInventory
   from           : /orahps/11.2.0/grid/oraInst.loc
OPatch version    : 11.2.0.3.15
OUI version       : 11.2.0.4.0
Log file location : /orahps/11.2.0/grid/cfgtoollogs/opatch/opatch2019-04-07_08-53-01AM_1.log

Verifying environment and performing prerequisite checks...
OPatch continues with these patches:   22502505

Do you want to proceed? [y|n]
Y (auto-answered by -silent)
User Responded with: Y
All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/orahps/11.2.0/grid')


Is the local system ready for patching? [y|n]
Y (auto-answered by -silent)
User Responded with: Y
Backing up files...
Applying interim patch '22502505' to OH '/orahps/11.2.0/grid'

Patching component oracle.usm, 11.2.0.4.0...
Patch 22502505 successfully applied.
Log file location: /orahps/11.2.0/grid/cfgtoollogs/opatch/opatch2019-04-07_08-53-01AM_1.log

OPatch succeeded.
grid@testdbn03:~$ /orahps/11.2.0/grid/OPatch/opatch lspatches  -oh /orahps/11.2.0/grid
22502505;ACFS Patch Set Update : 11.2.0.4.160419 (22502505)
23054319;OCW Patch Set Update : 11.2.0.4.160719 (23054319)
24006111;Database Patch Set Update : 11.2.0.4.161018 (24006111)

OPatch succeeded.

grid@testdbn03:~$ exit
logout
root@testdbn03:~# /orahps/11.2.0/grid/rdbms/install/rootadd_rdbms.sh

root@testdbn03:~# /orahps/11.2.0/grid/crs/install/rootcrs.pl -patch

Using configuration parameter file: /orahps/11.2.0/grid/crs/install/crsconfig_params
Installing Trace File Analyzer
CRS-4123: Oracle High Availability Services has been started.

root@testdbn03:~# /orahps/11.2.0/grid/bin/crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online

root@testdbn03:~# GRID_CHECK=$(stat -c %U /orahps/11.2.0/grid); if [[ $GRID_CHECK == root ]]; then echo -e \\nPASS: Grid Home is locked\\n; else  echo -e \\nFAIL: Grid Home is not locked. Locking Grid Home now . . .\\n;/orahps/11.2.0/grid/crs/install/rootcrs.pl -unlock; /orahps/11.2.0/grid/crs/install/rootcrs.pl -patch; fi

PASS: Grid Home is locked

root@testdbn03:~#

grid@testdbn03:~$ /orahps/11.2.0/grid/OPatch/opatch lspatches  -oh /orahps/11.2.0/grid
22502505;ACFS Patch Set Update : 11.2.0.4.160419 (22502505)
23054319;OCW Patch Set Update : 11.2.0.4.160719 (23054319)
24006111;Database Patch Set Update : 11.2.0.4.161018 (24006111)

OPatch succeeded.
grid@testdbn03:~$ exit

grid@testdbn04:~$ /orahps/11.2.0/grid/OPatch/opatch lspatches  -oh /orahps/11.2.0/grid
22502505;ACFS Patch Set Update : 11.2.0.4.160419 (22502505)
23054319;OCW Patch Set Update : 11.2.0.4.160719 (23054319)
24006111;Database Patch Set Update : 11.2.0.4.161018 (24006111)

OPatch succeeded.

Thursday, 11 April 2019

CONVERTING DATABASE TO SNAPSHOT MODE USING DGMGRL

CONVERTING DATABASE TO SNAPSHOT MODE USING DGMRL

STEP:1 CONNECT TO DATABASE.

oracle@hqphpsodbn03:/orahps/app/oracle/product/11.2.0/db_1/network/admin$ dgmgrl

DGMGRL for Solaris: Version 11.2.0.4.0 - 64bit Production

Copyright (c) 2000, 2009, Oracle. All rights reserved.

Welcome to DGMGRL, type "help" for information.

DGMGRL> connect sys/*****@pwcprod

Connected.

STEP:2 CHECKING DATA GUARD BROKER STATUS.

DGMGRL> show configuration

Configuration - pwc_dg_conf

  Protection Mode: MaxPerformance

  Databases:

    pwcprd   - Primary database

    pwcprod  - Physical standby database

    pwcstdby - Physical standby database

Fast-Start Failover: DISABLED

Configuration Status:

SUCCESS

STEP:3 CONVERT DATABASE TO SNAPSHOT MODE.

DGMGRL> convert database pwcprod to snapshot standby;

Converting database "pwcprod" to a Snapshot Standby database, please wait...

Database "pwcprod" converted successfully

STEP:4 CHECKING DATA GUARD BROKER STATUS.

DGMGRL> show configuration

Configuration - pwc_dg_conf

 Protection Mode: MaxPerformance

  Databases:

    pwcprd   - Primary database

    pwcprod  - Snapshot standby database

    pwcstdby - Physical standby database

Fast-Start Failover: DISABLED

Configuration Status:

SUCCESS

STEP:4 CONVERTING DATABASE TO PHYSICAL STANDBY.

DGMGRL> convert database pwcprod to physical standby;

Converting database "pwcprod" to a Physical Standby database, please wait...

Operation requires shutdown of instance "pwcprod2" on database "pwcprod"

Shutting down instance "pwcprod2"...

Database closed.

Database dismounted.

ORACLE instance shut down.

Operation requires startup of instance "pwcprod2" on database "pwcprod"

Starting instance "pwcprod2"...

ORACLE instance started.

Database mounted.

Continuing to convert database "pwcprod" ...

Operation requires shutdown of instance "pwcprod2" on database "pwcprod"

Shutting down instance "pwcprod2"...

ORA-01109: database not open

Database dismounted.

ORACLE instance shut down.

Operation requires startup of instance "pwcprod2" on database "pwcprod"

Starting instance "pwcprod2"...

ORACLE instance started.

Database mounted.

Database "pwcprod" converted successfully


STEP: 6 CHECK DATA GUARD BROKER STATUS.

DGMGRL> show configuration

Configuration - pwc_dg_conf

  Protection Mode: MaxPerformance

  Databases:

    pwcprd   - Primary database

    pwcprod  - Physical standby database

    pwcstdby - Physical standby database

Fast-Start Failover: DISABLED

Configuration Status:

SUCCESS
#############################################################################

Switch over DATABASE from production to DR

Switchover DATABASE from production to DR

1. ############### Perform on Production Database 192.168.5.132 ###############

PRODUCTION IP: 192.168.5.132

DR IP: 192.168.5.138

SQL> sqlplus / as sysdba

SQL> select status, error from v$archive_dest where dest_id = 2;

STATUS    ERROR
--------- -----------------------------------------------------------------
VALID

SQL> select switchover_status from v$database;

SWITCHOVER_STATUS
--------------------
SESSIONS ACTIVE

SQL> alter database commit to switchover to physical standby with session shutdown;

Database altered.

SQL> shutdown immediate;
ORA-01012: not logged on
SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
oracle@oraprd01:/export/home/oracle/Scripts1$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.4.0 Production on Tue Dec 4 21:55:33 2018

Copyright (c) 1982, 2013, Oracle.  All rights reserved.

Connected to an idle instance.

SQL> startup mount;
ORACLE instance started.

Total System Global Area 2572910592 bytes
Fixed Size                  2184312 bytes
Variable Size             788532104 bytes
Database Buffers         1761607680 bytes
Redo Buffers               20586496 bytes
Database mounted.

3.  #################### Perform on DR Database 192.168.5.138   #################

SQL>  sqlplus / as sysdba

SQL>  select switchover_status from v$database;

SQL>  alter database commit to switchover to primary with session shutdown;

SQL>  shutdown immediate;

SQL>  startup;

4. ##############DISCONNECT on PRIMARY 192.168.5.132 ###############

SQL> sqlplus / as sysdba

SQL> ALTER DATABASE RECOVER MANAGED STANDBY DATABASE DISCONNECT FROM SESSION;

Database altered.

SQL> select process,status from v$managed_standby;

SQL> SELECT THREAD#, MAX(SEQUENCE#)
FROM V$LOG_HISTORY
WHERE RESETLOGS_CHANGE# =
(SELECT RESETLOGS_CHANGE#
FROM V$DATABASE_INCARNATION
WHERE STATUS = 'CURRENT')
GROUP BY THREAD#;


#################################  Revert Back ##############################

            ########## Perform on DR 192.168.5.138 ###################

SQL> sqlplus / as sysdba

SQL> alter system switch logfile;

SQL> sqlplus / as sysdba

SQL> select status, error from v$archive_dest where dest_id = 2;

SQL> select switchover_status from v$database;

SQL> alter database commit to switchover to physical standby with session shutdown;

SQL> shutdown immediate;

SQL> startup mount;

##################### Perform on PRD 192.168.5.132 #####################

SQL> sqlplus / as sysdba

SQL> select switchover_status from v$database;

SQL> alter database commit to switchover to primary with session shutdown;

SQl> shutdown immediate;

SQL> startup;

######################  Disconnect on DR 192.168.5.138 ##########################

SQL> sqlplus / as sysdba

SQL> alter database recover managed standby database disconnect from session;

Database altered.

SQL> select process,status from v$managed_standby;
PROCESS   STATUS
--------- ------------
ARCH      CONNECTED
ARCH      CONNECTED
RFS       IDLE
RFS       IDLE
RFS       RECEIVING
MRP0      APPLYING_LOG

#################### PRODUCTION 192.168.5.132 ###########################
Please validate the replication.

SQL>SELECT THREAD#, MAX(SEQUENCE#)
FROM V$LOG_HISTORY
WHERE RESETLOGS_CHANGE# =
(SELECT RESETLOGS_CHANGE#
FROM V$DATABASE_INCARNATION
WHERE STATUS = 'CURRENT')
GROUP BY THREAD#;

   THREAD# MAX(SEQUENCE#)
---------- --------------
         1           1460
##################### DR DATABASE 192.168.5.138 ########################

SQL>SELECT al.thrd "Thread", almax "Last Seq Received", lhmax "Last Seq Applied" FROM (select thread# thrd, MAX(sequence#) almax FROM v$archived_log
WHERE resetlogs_change#=(SELECT resetlogs_change# FROM v$database) GROUP BY thread#) al, (SELECT thread# thrd, MAX(sequence#) lhmax
FROM v$log_history WHERE resetlogs_change#=(SELECT resetlogs_change# FROM v$database) GROUP BY thread#) lh WHERE al.thrd = lh.thrd;

    Thread Last Seq Received Last Seq Applied
---------- ----------------- ----------------
         1              1460             1460

################################################################################

Wednesday, 10 April 2019

Convert the Physical Standby Database into a Snapshot Standby Database

Manual: Convert the Physical Standby Database into a Snapshot Standby Database 

Reference: 11g Using Snapshot Standby Database. (Doc ID 443720.1)

Step:1 Please set db_recovery_file_dest if  not set.

SQL> show parameter db_recovery_file_dest

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
db_recovery_file_dest                string      /orabin/fast_recovery_area
db_recovery_file_dest_size           big integer 4122M

SQL> select name,open_mode from v$database;

NAME      OPEN_MODE
--------- --------------------
PRDDR    MOUNTED

SQL> select flashback_on from V$database;

FLASHBACK_ON
------------------
NO

Step:2 Cancel media recovery and validate.

SQL> alter database recover managed standby database cancel;

Database altered.

SQL> select process,status from v$managed_standby;

PROCESS   STATUS
--------- ------------
ARCH      CLOSING
ARCH      CONNECTED
ARCH      CLOSING
RFS       IDLE
RFS       IDLE

9 rows selected.

Step:3 Please enable flashback.

SQL> alter database flashback on;

Database altered.

SQL> select flashback_on from V$database;

FLASHBACK_ON
------------------
YES

SQL> select NAME,GUARANTEE_FLASHBACK_DATABASE from v$restore_point;

no rows selected

SQL> select open_mode,database_role from v$database;

OPEN_MODE            DATABASE_ROLE
-------------------- ----------------
MOUNTED              PHYSICAL STANDBY

Step:4 CONVERT database to snapshot mode.

SQL> ALTER DATABASE CONVERT TO SNAPSHOT STANDBY;

Database altered.

SQL> select open_mode,database_role from v$database;

OPEN_MODE            DATABASE_ROLE
-------------------- ----------------
MOUNTED              SNAPSHOT STANDBY

Step:5 Open database in READ/Write mode.

SQL> alter database open;

Database altered.

SQL> select NAME,GUARANTEE_FLASHBACK_DATABASE from v$restore_point;

NAME
--------------------------------------------------------------------------------
GUA
---
SNAPSHOT_STANDBY_REQUIRED_01/29/2019 11:35:41
YES


SQL> select open_mode,database_role from v$database;

OPEN_MODE            DATABASE_ROLE
-------------------- ----------------
READ WRITE           SNAPSHOT STANDBY

SQL> SELECT al.thrd "Thread", almax "Last Seq Received", lhmax "Last Seq Applied" FROM (select thread# thrd, MAX(sequence#) almax FROM v$archived_log
   WHERE resetlogs_change#=(SELECT resetlogs_change# FROM v$database) GROUP BY thread#) al, (SELECT thread# thrd, MAX(sequence#) lhmax
    FROM v$log_history WHERE resetlogs_change#=(SELECT resetlogs_change# FROM v$database) GROUP BY thread#) lh WHERE al.thrd = lh.thrd;  2    3

    Thread Last Seq Received Last Seq Applied
---------- ----------------- ----------------
         1                 1                1

Step:6 Shutdown database to convert back in physical standby mode.

SQL> shutdown immediate;
Database closed.
Database dismounted.
ORACLE instance shut down.
---
SQL> startup mount;
ORACLE instance started.

Total System Global Area 2522791936 bytes
Fixed Size                  2161944 bytes
Variable Size             704643816 bytes
Database Buffers         1795162112 bytes
Redo Buffers               20824064 bytes
Database mounted.
---
SQL> select open_mode,database_role from v$database;

OPEN_MODE            DATABASE_ROLE
-------------------- ----------------
MOUNTED              SNAPSHOT STANDBY

CONVERT database in physical mode.

SQL> ALTER DATABASE CONVERT TO PHYSICAL STANDBY;

Database altered.

SQL> select open_mode,database_role from v$database;
select open_mode,database_role from v$database
                                    *
ERROR at line 1:
ORA-01507: database not mounted


SQL> startup mount;
ORA-01081: cannot start already-running ORACLE - shut it down first

SQL> select status from v$instance;

STATUS
------------
STARTED

SQL> shutdown immediate;
ORA-01507: database not mounted


ORACLE instance shut down.

Step:7 Start database in mount mode.

SQL> startup mount;
ORACLE instance started.

Total System Global Area 2522791936 bytes
Fixed Size                  2161944 bytes
Variable Size             704643816 bytes
Database Buffers         1795162112 bytes
Redo Buffers               20824064 bytes
Database mounted.
SQL> select open_mode,database_role from v$database;

OPEN_MODE            DATABASE_ROLE
-------------------- ----------------
MOUNTED              PHYSICAL STANDBY

Step:8 Disable flashback in database.

SQL> alter database flashback off;

Database altered.

SQL> select flashback_on from gV$database;

FLASHBACK_ON
------------------
NO

Step:9 Start the media recovery and check replication.

SQL> alter database recover managed standby database disconnect from session;
alter database recover managed standby database disconnect from session
*
ERROR at line 1:
ORA-01153: an incompatible media recovery is active


SQL> select process,status from v$managed_standby;

PROCESS   STATUS
--------- ------------
ARCH      CONNECTED
ARCH      CONNECTED
ARCH      CONNECTED
ARCH      CLOSING
ARCH      CLOSING
RFS       IDLE
RFS       IDLE
RFS       IDLE
RFS       IDLE
MRP0      APPLYING_LOG

10 rows selected.

SQL> SELECT al.thrd "Thread", almax "Last Seq Received", lhmax "Last Seq Applied" FROM (select thread# thrd, MAX(sequence#) almax FROM v$archived_log
WHERE resetlogs_change#=(SELECT resetlogs_change# FROM v$database) GROUP BY thread#) al, (SELECT thread# thrd, MAX(sequence#) lhmax
FROM v$log_history WHERE resetlogs_change#=(SELECT resetlogs_change# FROM v$database) GROUP BY thread#) lh WHERE al.thrd = lh.thrd;

    Thread Last Seq Received Last Seq Applied
---------- ----------------- ----------------
         1             84591            84591

*********************************************************************************

ORA-01017: invalid username/password; logon denied using DGMGRL

CONVERTING DATABASE PHYSICAL STANDBY TO SNAPSHOT IN RAC USING DGMGRL.

STEP:1 CONNECT TO DATABASE USING DGMGRL.

oracle@oraodbn01:/orahps/app/oracle/product/11.2.0/db_1/network/admin$ dgmgrl

DGMGRL for Solaris: Version 11.2.0.4.0 - 64bit Production

Copyright (c) 2000, 2009, Oracle. All rights reserved.

Welcome to DGMGRL, type "help" for information.

DGMGRL> connect sys/*****@pwcprod

Connected.

STEP:2 CHECK DATA BROKER STATUS.

DGMGRL> show configuration

Configuration - pwc_dg_conf

  Protection Mode: MaxPerformance

  Databases:

    pwcprd   - Primary database

    pwcprod  - Physical standby database

    pwcstdby - Physical standby database

Fast-Start Failover: DISABLED

Configuration Status:

SUCCESS

STEP:3 CONVERT TO SNAPSHOT MODE.

################ CONVERT TO SNAPSHOT MODE #######

DGMGRL> convert database pwcprod to snapshot standby;

Converting database "pwcprod" to a Snapshot Standby database, please wait...

Database "pwcprod" converted successfully

STEP:4 CHECK DATA GUARD STATUS.

DGMGRL> show configuration

Configuration - pwc_dg_conf

  Protection Mode: MaxPerformance

  Databases:

    pwcprd   - Primary database

    pwcprod  - Snapshot standby database

    pwcstdby - Physical standby database

Fast-Start Failover: DISABLED

Configuration Status:

SUCCESS

STEP:5 CONVERT TO PHYSICAL STANDBY DATABASE.

#################### CONVERT TO PHYSICAL STANDBY #########

DGMGRL> convert database pwcprod to Physical standby;
Converting database "pwcprod" to a Physical Standby database, please wait...
Operation requires shutdown of instance "pwcprod1" on database "pwcprod"
Shutting down instance "pwcprod1"...
ORA-01017: invalid username/password; logon denied

Warning: You are no longer connected to ORACLE.

Please complete the following steps and reissue the CONVERT command:
shut down instance "pwcprod1" of database "pwcprod"
start up and mount instance "pwcprod1" of database "pwcprod"


Solutions: Please correct listener.ora on all nodes in Grid Home. if you are using RAC.
**********
ORA-1017 during switchover from data guard broker for RAC database (Doc ID 2115559.1)

SID_LIST_LISTENER =
  (SID_LIST =
    (SID_DESC =
      (ORACLE_HOME = /orahps/11.2.0/grid)
      (GLOBAL_DBNAME = +ASM)
      (SID_NAME = +ASM1)
    )
    (SID_DESC =
      (ORACLE_HOME = /orahps/11.2.0/grid)
      (GLOBAL_DBNAME = pwcprd)
      (SID_NAME = pwcprod1)
      (ENVS="TNS_ADMIN=/orahps/11.2.0/grid/network/admin")
    )
    (SID_DESC =
      (ORACLE_HOME = /orahps/app/oracle/product/11.2.0/db_1)  --> Update Oracle Home... earlier it was grid home.
      (GLOBAL_DBNAME = pwcprod_DGMGRL)
      (SID_NAME = pwcprod1)
      (ENVS="TNS_ADMIN=/orahps/app/oracle/product/11.2.0/db_1/network/admin") --> Update Oracle Home... earlier it was grid home.
    )
  )

ADR_BASE_LISTENER = /orahps/app/oracle

*************************************************************************

*********After above changes tried again. It's working fine now.*************

#################### CONVERT TO PHYSICAL STANDBY #########

DGMGRL> convert database pwcprod to physical standby;

Converting database "pwcprod" to a Physical Standby database, please wait...

Operation requires shutdown of instance "pwcprod2" on database "pwcprod"

Shutting down instance "pwcprod2"...

Database closed.

Database dismounted.

ORACLE instance shut down.

Operation requires startup of instance "pwcprod2" on database "pwcprod"

Starting instance "pwcprod2"...

ORACLE instance started.

Database mounted.

Continuing to convert database "pwcprod" ...

Operation requires shutdown of instance "pwcprod2" on database "pwcprod"

Shutting down instance "pwcprod2"...

ORA-01109: database not open


Database dismounted.

ORACLE instance shut down.

Operation requires startup of instance "pwcprod2" on database "pwcprod"

Starting instance "pwcprod2"...

ORACLE instance started.

Database mounted.

Database "pwcprod" converted successfully

STEP:7 CHECKING DATA GUARD STATUS.

DGMGRL> show configuration

Configuration - pwc_dg_conf

  Protection Mode: MaxPerformance
  Databases:
    pwcprd   - Primary database
    pwcprod  - Physical standby database
    pwcstdby - Physical standby database

Fast-Start Failover: DISABLED

Configuration Status:
SUCCESS


STEP 8: CHECKING DATABASE STATUS.

SQL> select open_mode,database_role from v$database;

OPEN_MODE            DATABASE_ROLE
-------------------- ----------------
MOUNTED              PHYSICAL STANDBY

oracle@oraodbn01:~$ srvctl status database -d pwcprod
Instance pwcprod1 is running on node oraodbn01
Instance pwcprod2 is running on node oraodbn02

oracle@oraodbn01:~$ srvctl config database -d pwcprod
Database unique name: pwcprod
Database name:
Oracle home: /orahps/app/oracle/product/11.2.0/db_1/
Oracle user: oracle
Spfile: +DATA/PWCPROD/PARAMETERFILE/spfile.345.1004971829
Domain:
Start options: mount
Stop options: immediate
Database role: PHYSICAL_STANDBY
Management policy: AUTOMATIC
Server pools: pwcprod
Database instances: pwcprod1,pwcprod2
Disk Groups: DATA,ARCH
Mount point paths:
Services: hpspcard
Type: RAC
Database is administrator managed


OS Watcher Installation in RAC

 Step:1 Download and untar the oswbb812.tar under the grid user in RAC on the both nodes. Follow the OS Watcher User's Guide (Doc ID 153...