How to Apply Oracle 11gR2 GRID PSU/CPU Patching

**********************  Patching in GRID Home ***** Supplemental Readme - Grid Infrastructure Release Update 12.2.0.1.x / 18c (Doc ID 2246888.1)

Step:1 Stop the CRS services on node 1

/orahps/11.2.0/grid/bin/crsctl stop crs

Step:2 : Unlock inventory for patching.

/orahps/11.2.0/grid/crs/install/rootcrs.pl -unlock

Change patch permission.

chown -R grid:oinstall /orahps/software

su - grid

Step:3: 

/orahps/11.2.0/grid/OPatch/ocm/bin/emocmrsp -output /orahps/software/ocm.rsp

/orahps/11.2.0/grid/OPatch/opatch version

Step:4 Take exiting patch applied backup.

/orahps/11.2.0/grid/OPatch/opatch lsinventory  -oh /orahps/11.2.0/grid > /tmp/grid.lsinventory.before

/orahps/11.2.0/grid/OPatch/opatch lspatches  -oh /orahps/11.2.0/grid

Step:5 Applying GRID Patch.

/orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/24006111

/orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/23054319

/orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/22502505

/orahps/11.2.0/grid/OPatch/opatch lspatches  -oh /orahps/11.2.0/grid

exit

Step:6 Perform follwoing steps after patching.

/orahps/11.2.0/grid/rdbms/install/rootadd_rdbms.sh

/orahps/11.2.0/grid/crs/install/rootcrs.pl -patch

/orahps/11.2.0/grid/bin/crsctl check crs

Step: 7 This below command will check your Grid home is locked and not if not locked then automatically will locked. 

Note: This command has to be run only patching window.

GRID_CHECK=$(stat -c %U /orahps/11.2.0/grid); if [[ $GRID_CHECK == root ]]; then echo -e \\nPASS: Grid Home is locked\\n; else  echo -e \\nFAIL: Grid Home is not locked. Locking Grid Home now . . .\\n;/orahps/11.2.0/grid/crs/install/rootcrs.pl -unlock; /orahps/11.2.0/grid/crs/install/rootcrs.pl -patch; fi

******************  PATCH LOGS ****************************
grid@testdbn03:~$ /orahps/11.2.0/grid/OPatch/ocm/bin/emocmrsp -output /orahps/software/ocm.rsp
OCM Installation Response Generator 10.3.7.0.0 - Production
Copyright (c) 2005, 2012, Oracle and/or its affiliates.  All rights reserved.

Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:

You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  y
The OCM configuration response file (/orahps/software/ocm.rsp) was successfully created.

>> Applied patches.

grid@testbn03:~$ /orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/24006111
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2019, Oracle Corporation.  All rights reserved.


Oracle Home       : /orahps/11.2.0/grid
Central Inventory : /orahps/app/oraInventory
   from           : /orahps/11.2.0/grid/oraInst.loc
OPatch version    : 11.2.0.3.15
OUI version       : 11.2.0.4.0
Log file location : /orahps/11.2.0/grid/cfgtoollogs/opatch/opatch2019-04-07_08-50-56AM_1.log

Verifying environment and performing prerequisite checks...
OPatch continues with these patches:   17478514  18031668  18522509  19121551  19769489  20299013  20760982  21352635  21948347  22502456  23054359  24006111

Do you want to proceed? [y|n]
Y (auto-answered by -silent)
User Responded with: Y
All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/orahps/11.2.0/grid')


Is the local system ready for patching? [y|n]
Y (auto-answered by -silent)
User Responded with: Y
Backing up files...
Applying sub-patch '17478514' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.sdo, 11.2.0.4.0 ] , [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.sdo.locator, 11.2.0.4.0...

Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...

Patching component oracle.xdk.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18031668' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.ldap.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.crs, 11.2.0.4.0...

Patching component oracle.ldap.rsf.ic, 11.2.0.4.0...

Patching component oracle.rdbms.deconfig, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.rdbms.rman, 11.2.0.4.0...
Applying sub-patch '18522509' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.rman, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '19121551' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.rman, 11.2.0.4.0...

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.ordim.client, 11.2.0.4.0...

Patching component oracle.ordim.jai, 11.2.0.4.0...
Applying sub-patch '19769489' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.ovm, 11.2.0.4.0 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.oraolap, 11.2.0.4.0 ] , [ oracle.sysman.agent, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms.util, 11.2.0.4.0...

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.xdk.parser.java, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.xdk.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.rman, 11.2.0.4.0...

Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20299013' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ] , [ oracle.rdbms.oci, 11.2.0.4.0 ] , [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.sysman.common, 10.2.0.4.5...

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.xdk.parser.java, 11.2.0.4.0...

Patching component oracle.xdk.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.sysman.common.core, 10.2.0.4.5...

Patching component oracle.rdbms.rman, 11.2.0.4.0...

Patching component oracle.rdbms.deconfig, 11.2.0.4.0...
Applying sub-patch '20760982' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.sysman.console.db, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '21352635' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.rman, 11.2.0.4.0...

Patching component oracle.rdbms, 11.2.0.4.0...
Applying sub-patch '21948347' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.sysman.agent, 10.2.0.4.5 ] , [ oracle.ovm, 11.2.0.4.0 ] , [ oracle.xdk, 11.2.0.4.0 ] , [ oracle.tfa, 11.2.0.4.0 ] , [ oracle.sysman.console.db, 11.2.0.4.0 ] , [ oracle.sysman.oms.core, 10.2.0.4.5 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.nlsrtl.rsf, 11.2.0.4.0...

Patching component oracle.xdk.parser.java, 11.2.0.4.0...

Patching component oracle.xdk.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '22502456' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.precomp.common, 11.2.0.4.0 ] , [ oracle.tfa, 11.2.0.4.0 ] , [ oracle.rdbms.olap, 11.2.0.4.0 ] , [ oracle.oraolap, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.oraolap.dbscripts, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.rdbms.rman, 11.2.0.4.0...

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...
Applying sub-patch '23054359' to OH '/orahps/11.2.0/grid'
ApplySession: Optional component(s) [ oracle.rdbms.dv, 11.2.0.4.0 ]  not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...
Applying sub-patch '24006111' to OH '/orahps/11.2.0/grid'

Patching component oracle.sqlplus.ic, 11.2.0.4.0...

Patching component oracle.sqlplus, 11.2.0.4.0...

Patching component oracle.rdbms.rsf, 11.2.0.4.0...

Patching component oracle.rdbms, 11.2.0.4.0...

Patching component oracle.rdbms.dbscripts, 11.2.0.4.0...

OPatch found the word "warning" in the stderr of the make command.
Please look at this stderr. You can re-run this make command.
Stderr output:
+ PATH=/bin:/usr/bin:/usr/ccs/bin
+ export PATH
+ lib=/orahps/11.2.0/grid/sqlplus/lib/libsqlplus.so
+ makefile=/orahps/11.2.0/grid/sqlplus/lib/ins_sqlplus.mk
+ so_ext=so
+ target=dlopenlib
+ var=''
+ basename /orahps/11.2.0/grid/sqlplus/lib/libsqlplus.so .so
+ libname=libsqlplus
+ dirname /orahps/11.2.0/grid/sqlplus/lib/libsqlplus.so
+ dir=/orahps/11.2.0/grid/sqlplus/lib
+ [ var '=' dlopenlib ]
+ [ -f /orahps/11.2.0/grid/sqlplus/lib/libsqlplus.a ]
+ dir2=/orahps/11.2.0/grid/sqlplus/lib/
+ [ '' '!=' '' ]
+ make -f /orahps/11.2.0/grid/sqlplus/lib/ins_sqlplus.mk dlopenlib _FULL_LIBNAME=/orahps/11.2.0/grid/sqlplus/lib/libsqlplus.so _LIBNAME=libsqlplus _LIBDIR=/orahps/11.2.0/grid/sqlplus/lib/ _LIBNAME_LIBS='$(libsqlplusLIBS)' _LIBNAME_EXTRALIBS='$(libsqlplusEXTRALIBS)'
ld: warning: symbol '_init' not found, but .init section exists - possible link-edit without using the compiler driver
ld: warning: symbol '_fini' not found, but .fini section exists - possible link-edit without using the compiler driver

Composite patch 24006111 successfully applied.
OPatch Session completed with warnings.
Log file location: /orahps/11.2.0/grid/cfgtoollogs/opatch/opatch2019-04-07_08-50-56AM_1.log

OPatch completed with warnings.
grid@testdbn03:~$ /orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/23054319
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2019, Oracle Corporation.  All rights reserved.

Oracle Home       : /orahps/11.2.0/grid
Central Inventory : /orahps/app/oraInventory
   from           : /orahps/11.2.0/grid/oraInst.loc
OPatch version    : 11.2.0.3.15
OUI version       : 11.2.0.4.0
Log file location : /orahps/11.2.0/grid/cfgtoollogs/opatch/opatch2019-04-07_08-52-19AM_1.log

Verifying environment and performing prerequisite checks...
OPatch continues with these patches:   23054319

Do you want to proceed? [y|n]
Y (auto-answered by -silent)
User Responded with: Y
All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/orahps/11.2.0/grid')

Is the local system ready for patching? [y|n]
Y (auto-answered by -silent)
User Responded with: Y
Backing up files...
Applying interim patch '23054319' to OH '/orahps/11.2.0/grid'

Patching component oracle.crs, 11.2.0.4.0...

OPatch found the word "warning" in the stderr of the make command.
Please look at this stderr. You can re-run this make command.
Stderr output:
ld: warning: symbol '_init' not found, but .init section exists - possible link-edit without using the compiler driver
ld: warning: symbol '_fini' not found, but .fini section exists - possible link-edit without using the compiler driver


Patch 23054319 successfully applied.
OPatch Session completed with warnings.
Log file location: /orahps/11.2.0/grid/cfgtoollogs/opatch/opatch2019-04-07_08-52-19AM_1.log

OPatch completed with warnings.
grid@testdbn03:~$ /orahps/11.2.0/grid/OPatch/opatch napply -oh /orahps/11.2.0/grid -local -silent -ocmrf /orahps/software/ocm.rsp /orahps/software/24436338/22502505
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2019, Oracle Corporation.  All rights reserved.


Oracle Home       : /orahps/11.2.0/grid
Central Inventory : /orahps/app/oraInventory
   from           : /orahps/11.2.0/grid/oraInst.loc
OPatch version    : 11.2.0.3.15
OUI version       : 11.2.0.4.0
Log file location : /orahps/11.2.0/grid/cfgtoollogs/opatch/opatch2019-04-07_08-53-01AM_1.log

Verifying environment and performing prerequisite checks...
OPatch continues with these patches:   22502505

Do you want to proceed? [y|n]
Y (auto-answered by -silent)
User Responded with: Y
All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/orahps/11.2.0/grid')


Is the local system ready for patching? [y|n]
Y (auto-answered by -silent)
User Responded with: Y
Backing up files...
Applying interim patch '22502505' to OH '/orahps/11.2.0/grid'

Patching component oracle.usm, 11.2.0.4.0...
Patch 22502505 successfully applied.
Log file location: /orahps/11.2.0/grid/cfgtoollogs/opatch/opatch2019-04-07_08-53-01AM_1.log

OPatch succeeded.
grid@testdbn03:~$ /orahps/11.2.0/grid/OPatch/opatch lspatches  -oh /orahps/11.2.0/grid
22502505;ACFS Patch Set Update : 11.2.0.4.160419 (22502505)
23054319;OCW Patch Set Update : 11.2.0.4.160719 (23054319)
24006111;Database Patch Set Update : 11.2.0.4.161018 (24006111)

OPatch succeeded.

grid@testdbn03:~$ exit
logout
root@testdbn03:~# /orahps/11.2.0/grid/rdbms/install/rootadd_rdbms.sh

root@testdbn03:~# /orahps/11.2.0/grid/crs/install/rootcrs.pl -patch

Using configuration parameter file: /orahps/11.2.0/grid/crs/install/crsconfig_params
Installing Trace File Analyzer
CRS-4123: Oracle High Availability Services has been started.

root@testdbn03:~# /orahps/11.2.0/grid/bin/crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online

root@testdbn03:~# GRID_CHECK=$(stat -c %U /orahps/11.2.0/grid); if [[ $GRID_CHECK == root ]]; then echo -e \\nPASS: Grid Home is locked\\n; else  echo -e \\nFAIL: Grid Home is not locked. Locking Grid Home now . . .\\n;/orahps/11.2.0/grid/crs/install/rootcrs.pl -unlock; /orahps/11.2.0/grid/crs/install/rootcrs.pl -patch; fi

PASS: Grid Home is locked

root@testdbn03:~#

grid@testdbn03:~$ /orahps/11.2.0/grid/OPatch/opatch lspatches  -oh /orahps/11.2.0/grid
22502505;ACFS Patch Set Update : 11.2.0.4.160419 (22502505)
23054319;OCW Patch Set Update : 11.2.0.4.160719 (23054319)
24006111;Database Patch Set Update : 11.2.0.4.161018 (24006111)

OPatch succeeded.
grid@testdbn03:~$ exit

grid@testdbn04:~$ /orahps/11.2.0/grid/OPatch/opatch lspatches  -oh /orahps/11.2.0/grid
22502505;ACFS Patch Set Update : 11.2.0.4.160419 (22502505)
23054319;OCW Patch Set Update : 11.2.0.4.160719 (23054319)
24006111;Database Patch Set Update : 11.2.0.4.161018 (24006111)

OPatch succeeded.

CONVERTING DATABASE TO SNAPSHOT MODE USING DGMGRL

CONVERTING DATABASE TO SNAPSHOT MODE USING DGMRL

STEP:1 CONNECT TO DATABASE.

oracle@hqphpsodbn03:/orahps/app/oracle/product/11.2.0/db_1/network/admin$ dgmgrl

DGMGRL for Solaris: Version 11.2.0.4.0 - 64bit Production

Copyright (c) 2000, 2009, Oracle. All rights reserved.

Welcome to DGMGRL, type "help" for information.

DGMGRL> connect sys/*****@pwcprod

Connected.

STEP:2 CHECKING DATA GUARD BROKER STATUS.

DGMGRL> show configuration

Configuration - pwc_dg_conf

  Protection Mode: MaxPerformance

  Databases:

    pwcprd   - Primary database

    pwcprod  - Physical standby database

    pwcstdby - Physical standby database

Fast-Start Failover: DISABLED

Configuration Status:

SUCCESS

STEP:3 CONVERT DATABASE TO SNAPSHOT MODE.

DGMGRL> convert database pwcprod to snapshot standby;

Converting database "pwcprod" to a Snapshot Standby database, please wait...

Database "pwcprod" converted successfully

STEP:4 CHECKING DATA GUARD BROKER STATUS.

DGMGRL> show configuration

Configuration - pwc_dg_conf

 Protection Mode: MaxPerformance

  Databases:

    pwcprd   - Primary database

    pwcprod  - Snapshot standby database

    pwcstdby - Physical standby database

Fast-Start Failover: DISABLED

Configuration Status:

SUCCESS

STEP:4 CONVERTING DATABASE TO PHYSICAL STANDBY.

DGMGRL> convert database pwcprod to physical standby;

Converting database "pwcprod" to a Physical Standby database, please wait...

Operation requires shutdown of instance "pwcprod2" on database "pwcprod"

Shutting down instance "pwcprod2"...

Database closed.

Database dismounted.

ORACLE instance shut down.

Operation requires startup of instance "pwcprod2" on database "pwcprod"

Starting instance "pwcprod2"...

ORACLE instance started.

Database mounted.

Continuing to convert database "pwcprod" ...

Operation requires shutdown of instance "pwcprod2" on database "pwcprod"

Shutting down instance "pwcprod2"...

ORA-01109: database not open

Database dismounted.

ORACLE instance shut down.

Operation requires startup of instance "pwcprod2" on database "pwcprod"

Starting instance "pwcprod2"...

ORACLE instance started.

Database mounted.

Database "pwcprod" converted successfully


STEP: 6 CHECK DATA GUARD BROKER STATUS.

DGMGRL> show configuration

Configuration - pwc_dg_conf

  Protection Mode: MaxPerformance

  Databases:

    pwcprd   - Primary database

    pwcprod  - Physical standby database

    pwcstdby - Physical standby database

Fast-Start Failover: DISABLED

Configuration Status:

SUCCESS
#############################################################################

Switch over DATABASE from production to DR

Switchover DATABASE from production to DR

1. ############### Perform on Production Database 192.168.5.132 ###############

PRODUCTION IP: 192.168.5.132

DR IP: 192.168.5.138

SQL> sqlplus / as sysdba

SQL> select status, error from v$archive_dest where dest_id = 2;

STATUS    ERROR
--------- -----------------------------------------------------------------
VALID

SQL> select switchover_status from v$database;

SWITCHOVER_STATUS
--------------------
SESSIONS ACTIVE

SQL> alter database commit to switchover to physical standby with session shutdown;

Database altered.

SQL> shutdown immediate;
ORA-01012: not logged on
SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
oracle@oraprd01:/export/home/oracle/Scripts1$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.4.0 Production on Tue Dec 4 21:55:33 2018

Copyright (c) 1982, 2013, Oracle.  All rights reserved.

Connected to an idle instance.

SQL> startup mount;
ORACLE instance started.

Total System Global Area 2572910592 bytes
Fixed Size                  2184312 bytes
Variable Size             788532104 bytes
Database Buffers         1761607680 bytes
Redo Buffers               20586496 bytes
Database mounted.

3.  #################### Perform on DR Database 192.168.5.138   #################

SQL>  sqlplus / as sysdba

SQL>  select switchover_status from v$database;

SQL>  alter database commit to switchover to primary with session shutdown;

SQL>  shutdown immediate;

SQL>  startup;

4. ##############DISCONNECT on PRIMARY 192.168.5.132 ###############

SQL> sqlplus / as sysdba

SQL> ALTER DATABASE RECOVER MANAGED STANDBY DATABASE DISCONNECT FROM SESSION;

Database altered.

SQL> select process,status from v$managed_standby;

SQL> SELECT THREAD#, MAX(SEQUENCE#)
FROM V$LOG_HISTORY
WHERE RESETLOGS_CHANGE# =
(SELECT RESETLOGS_CHANGE#
FROM V$DATABASE_INCARNATION
WHERE STATUS = 'CURRENT')
GROUP BY THREAD#;


#################################  Revert Back ##############################

            ########## Perform on DR 192.168.5.138 ###################

SQL> sqlplus / as sysdba

SQL> alter system switch logfile;

SQL> sqlplus / as sysdba

SQL> select status, error from v$archive_dest where dest_id = 2;

SQL> select switchover_status from v$database;

SQL> alter database commit to switchover to physical standby with session shutdown;

SQL> shutdown immediate;

SQL> startup mount;

##################### Perform on PRD 192.168.5.132 #####################

SQL> sqlplus / as sysdba

SQL> select switchover_status from v$database;

SQL> alter database commit to switchover to primary with session shutdown;

SQl> shutdown immediate;

SQL> startup;

######################  Disconnect on DR 192.168.5.138 ##########################

SQL> sqlplus / as sysdba

SQL> alter database recover managed standby database disconnect from session;

Database altered.

SQL> select process,status from v$managed_standby;
PROCESS   STATUS
--------- ------------
ARCH      CONNECTED
ARCH      CONNECTED
RFS       IDLE
RFS       IDLE
RFS       RECEIVING
MRP0      APPLYING_LOG

#################### PRODUCTION 192.168.5.132 ###########################
Please validate the replication.

SQL>SELECT THREAD#, MAX(SEQUENCE#)
FROM V$LOG_HISTORY
WHERE RESETLOGS_CHANGE# =
(SELECT RESETLOGS_CHANGE#
FROM V$DATABASE_INCARNATION
WHERE STATUS = 'CURRENT')
GROUP BY THREAD#;

   THREAD# MAX(SEQUENCE#)
---------- --------------
         1           1460
##################### DR DATABASE 192.168.5.138 ########################

SQL>SELECT al.thrd "Thread", almax "Last Seq Received", lhmax "Last Seq Applied" FROM (select thread# thrd, MAX(sequence#) almax FROM v$archived_log
WHERE resetlogs_change#=(SELECT resetlogs_change# FROM v$database) GROUP BY thread#) al, (SELECT thread# thrd, MAX(sequence#) lhmax
FROM v$log_history WHERE resetlogs_change#=(SELECT resetlogs_change# FROM v$database) GROUP BY thread#) lh WHERE al.thrd = lh.thrd;

    Thread Last Seq Received Last Seq Applied
---------- ----------------- ----------------
         1              1460             1460

################################################################################

Convert the Physical Standby Database into a Snapshot Standby Database

Manual: Convert the Physical Standby Database into a Snapshot Standby Database 

Reference: 11g Using Snapshot Standby Database. (Doc ID 443720.1)

Step:1 Please set db_recovery_file_dest if  not set.

SQL> show parameter db_recovery_file_dest

NAME                                 TYPE        VALUE

------------------------------------ ----------- ------------------------------

db_recovery_file_dest                string      /orabin/fast_recovery_area

db_recovery_file_dest_size           big integer 4122M

SQL> select name,open_mode from v$database;

NAME      OPEN_MODE

--------- --------------------

PRDDR    MOUNTED

SQL> select flashback_on from V$database;

FLASHBACK_ON

------------------

NO

Step:2 Cancel media recovery and validate.

SQL> alter database recover managed standby database cancel;

Database altered.

SQL> select process,status from v$managed_standby;

PROCESS   STATUS

--------- ------------

ARCH      CLOSING

ARCH      CONNECTED

ARCH      CLOSING

RFS       IDLE

RFS       IDLE

9 rows selected.

Step:3 Please enable flashback.

SQL> alter database flashback on;

Database altered.

SQL> select flashback_on from V$database;

FLASHBACK_ON

------------------

YES

SQL> select NAME,GUARANTEE_FLASHBACK_DATABASE from v$restore_point;

no rows selected

SQL> select open_mode,database_role from v$database;

OPEN_MODE            DATABASE_ROLE

-------------------- ----------------

MOUNTED              PHYSICAL STANDBY

Step:4 CONVERT database to snapshot mode.

SQL> ALTER DATABASE CONVERT TO SNAPSHOT STANDBY;

Database altered.

SQL> select open_mode,database_role from v$database;

OPEN_MODE            DATABASE_ROLE

-------------------- ----------------

MOUNTED              SNAPSHOT STANDBY

Step:5 Open database in READ/Write mode.

SQL> alter database open;

Database altered.

SQL> select NAME,GUARANTEE_FLASHBACK_DATABASE from v$restore_point;

NAME

--------------------------------------------------------------------------------

GUA

---

SNAPSHOT_STANDBY_REQUIRED_01/29/2019 11:35:41

YES

SQL> select open_mode,database_role from v$database;

OPEN_MODE            DATABASE_ROLE

-------------------- ----------------

READ WRITE           SNAPSHOT STANDBY

SQL> SELECT al.thrd "Thread", almax "Last Seq Received", lhmax "Last Seq Applied" FROM (select thread# thrd, MAX(sequence#) almax FROM v$archived_log

   WHERE resetlogs_change#=(SELECT resetlogs_change# FROM v$database) GROUP BY thread#) al, (SELECT thread# thrd, MAX(sequence#) lhmax

    FROM v$log_history WHERE resetlogs_change#=(SELECT resetlogs_change# FROM v$database) GROUP BY thread#) lh WHERE al.thrd = lh.thrd;  2    3

    Thread Last Seq Received Last Seq Applied

---------- ----------------- ----------------

         1                 1                1

Step:6 Shutdown database to convert back in physical standby mode.

SQL> shutdown immediate;

Database closed.

Database dismounted.

ORACLE instance shut down.

---

SQL> startup mount;

ORACLE instance started.

Total System Global Area 2522791936 bytes

Fixed Size                  2161944 bytes

Variable Size             704643816 bytes

Database Buffers         1795162112 bytes

Redo Buffers               20824064 bytes

Database mounted.

---

SQL> select open_mode,database_role from v$database;

OPEN_MODE            DATABASE_ROLE

-------------------- ----------------

MOUNTED              SNAPSHOT STANDBY

CONVERT database in physical mode.

SQL> ALTER DATABASE CONVERT TO PHYSICAL STANDBY;

Database altered.

SQL> select open_mode,database_role from v$database;

select open_mode,database_role from v$database

                                    *

ERROR at line 1:

ORA-01507: database not mounted

SQL> startup mount;

ORA-01081: cannot start already-running ORACLE - shut it down first

SQL> select status from v$instance;

STATUS

------------

STARTED

SQL> shutdown immediate;

ORA-01507: database not mounted

ORACLE instance shut down.

Step:7 Start database in mount mode.

SQL> startup mount;

ORACLE instance started.

Total System Global Area 2522791936 bytes

Fixed Size                  2161944 bytes

Variable Size             704643816 bytes

Database Buffers         1795162112 bytes

Redo Buffers               20824064 bytes

Database mounted.

SQL> select open_mode,database_role from v$database;

OPEN_MODE            DATABASE_ROLE

-------------------- ----------------

MOUNTED              PHYSICAL STANDBY

Step:8 Disable flashback in database.

SQL> alter database flashback off;

Database altered.

SQL> select flashback_on from gV$database;

FLASHBACK_ON

------------------

NO

Step:9 Start the media recovery and check replication.

SQL> alter database recover managed standby database disconnect from session;

alter database recover managed standby database disconnect from session

*

ERROR at line 1:

ORA-01153: an incompatible media recovery is active

SQL> select process,status from v$managed_standby;

PROCESS   STATUS

--------- ------------

ARCH      CONNECTED

ARCH      CONNECTED

ARCH      CONNECTED

ARCH      CLOSING

ARCH      CLOSING

RFS       IDLE

RFS       IDLE

RFS       IDLE

RFS       IDLE

MRP0      APPLYING_LOG

10 rows selected.

SQL> SELECT al.thrd "Thread", almax "Last Seq Received", lhmax "Last Seq Applied" FROM (select thread# thrd, MAX(sequence#) almax FROM v$archived_log

WHERE resetlogs_change#=(SELECT resetlogs_change# FROM v$database) GROUP BY thread#) al, (SELECT thread# thrd, MAX(sequence#) lhmax

FROM v$log_history WHERE resetlogs_change#=(SELECT resetlogs_change# FROM v$database) GROUP BY thread#) lh WHERE al.thrd = lh.thrd;

    Thread Last Seq Received Last Seq Applied

---------- ----------------- ----------------

         1             84591            84591

*********************************************************************************

ORA-01017: invalid username/password; logon denied using DGMGRL

CONVERTING DATABASE PHYSICAL STANDBY TO SNAPSHOT IN RAC USING DGMGRL.

STEP:1 CONNECT TO DATABASE USING DGMGRL.

oracle@oraodbn01:/orahps/app/oracle/product/11.2.0/db_1/network/admin$ dgmgrl

DGMGRL for Solaris: Version 11.2.0.4.0 - 64bit Production

Copyright (c) 2000, 2009, Oracle. All rights reserved.

Welcome to DGMGRL, type "help" for information.

DGMGRL> connect sys/*****@pwcprod

Connected.

STEP:2 CHECK DATA BROKER STATUS.

DGMGRL> show configuration

Configuration - pwc_dg_conf

  Protection Mode: MaxPerformance

  Databases:

    pwcprd   - Primary database

    pwcprod  - Physical standby database

    pwcstdby - Physical standby database

Fast-Start Failover: DISABLED

Configuration Status:

SUCCESS

STEP:3 CONVERT TO SNAPSHOT MODE.

################ CONVERT TO SNAPSHOT MODE #######

DGMGRL> convert database pwcprod to snapshot standby;

Converting database "pwcprod" to a Snapshot Standby database, please wait...

Database "pwcprod" converted successfully

STEP:4 CHECK DATA GUARD STATUS.

DGMGRL> show configuration

Configuration - pwc_dg_conf

  Protection Mode: MaxPerformance

  Databases:

    pwcprd   - Primary database

    pwcprod  - Snapshot standby database

    pwcstdby - Physical standby database

Fast-Start Failover: DISABLED

Configuration Status:

SUCCESS

STEP:5 CONVERT TO PHYSICAL STANDBY DATABASE.

#################### CONVERT TO PHYSICAL STANDBY #########

DGMGRL> convert database pwcprod to Physical standby;
Converting database "pwcprod" to a Physical Standby database, please wait...
Operation requires shutdown of instance "pwcprod1" on database "pwcprod"
Shutting down instance "pwcprod1"...
ORA-01017: invalid username/password; logon denied

Warning: You are no longer connected to ORACLE.

Please complete the following steps and reissue the CONVERT command:
shut down instance "pwcprod1" of database "pwcprod"
start up and mount instance "pwcprod1" of database "pwcprod"


Solutions: Please correct listener.ora on all nodes in Grid Home. if you are using RAC.
**********
ORA-1017 during switchover from data guard broker for RAC database (Doc ID 2115559.1)

SID_LIST_LISTENER =
  (SID_LIST =
    (SID_DESC =
      (ORACLE_HOME = /orahps/11.2.0/grid)
      (GLOBAL_DBNAME = +ASM)
      (SID_NAME = +ASM1)
    )
    (SID_DESC =
      (ORACLE_HOME = /orahps/11.2.0/grid)
      (GLOBAL_DBNAME = pwcprd)
      (SID_NAME = pwcprod1)
      (ENVS="TNS_ADMIN=/orahps/11.2.0/grid/network/admin")
    )
    (SID_DESC =
      (ORACLE_HOME = /orahps/app/oracle/product/11.2.0/db_1)  --> Update Oracle Home... earlier it was grid home.
      (GLOBAL_DBNAME = pwcprod_DGMGRL)
      (SID_NAME = pwcprod1)
      (ENVS="TNS_ADMIN=/orahps/app/oracle/product/11.2.0/db_1/network/admin") --> Update Oracle Home... earlier it was grid home.
    )
  )

ADR_BASE_LISTENER = /orahps/app/oracle

*************************************************************************

*********After above changes tried again. It's working fine now.*************

#################### CONVERT TO PHYSICAL STANDBY #########

DGMGRL> convert database pwcprod to physical standby;

Converting database "pwcprod" to a Physical Standby database, please wait...

Operation requires shutdown of instance "pwcprod2" on database "pwcprod"

Shutting down instance "pwcprod2"...

Database closed.

Database dismounted.

ORACLE instance shut down.

Operation requires startup of instance "pwcprod2" on database "pwcprod"

Starting instance "pwcprod2"...

ORACLE instance started.

Database mounted.

Continuing to convert database "pwcprod" ...

Operation requires shutdown of instance "pwcprod2" on database "pwcprod"

Shutting down instance "pwcprod2"...

ORA-01109: database not open


Database dismounted.

ORACLE instance shut down.

Operation requires startup of instance "pwcprod2" on database "pwcprod"

Starting instance "pwcprod2"...

ORACLE instance started.

Database mounted.

Database "pwcprod" converted successfully

STEP:7 CHECKING DATA GUARD STATUS.

DGMGRL> show configuration

Configuration - pwc_dg_conf

  Protection Mode: MaxPerformance
  Databases:
    pwcprd   - Primary database
    pwcprod  - Physical standby database
    pwcstdby - Physical standby database

Fast-Start Failover: DISABLED

Configuration Status:
SUCCESS


STEP 8: CHECKING DATABASE STATUS.

SQL> select open_mode,database_role from v$database;

OPEN_MODE            DATABASE_ROLE
-------------------- ----------------
MOUNTED              PHYSICAL STANDBY

oracle@oraodbn01:~$ srvctl status database -d pwcprod
Instance pwcprod1 is running on node oraodbn01
Instance pwcprod2 is running on node oraodbn02

oracle@oraodbn01:~$ srvctl config database -d pwcprod
Database unique name: pwcprod
Database name:
Oracle home: /orahps/app/oracle/product/11.2.0/db_1/
Oracle user: oracle
Spfile: +DATA/PWCPROD/PARAMETERFILE/spfile.345.1004971829
Domain:
Start options: mount
Stop options: immediate
Database role: PHYSICAL_STANDBY
Management policy: AUTOMATIC
Server pools: pwcprod
Database instances: pwcprod1,pwcprod2
Disk Groups: DATA,ARCH
Mount point paths:
Services: hpspcard
Type: RAC
Database is administrator managed

ORA-04091: table APPLSYS.FND_PROFILE_OPTION_VALUES is mutating, trigger/function may not see it

ERROR:

Autoconfig failed with following error , checking on this

ORA-04091: table APPLSYS.FND_PROFILE_OPTION_VALUES is mutating,
trigger/function may not see it
ORA-06512: at "APPS.FND_CORE_LOG", line 45
ORA-06512: at "APPS.FND_CORE_LOG", line 456
ORA-06512: at "APPS.FND_PROFILE", line 122
ORA-06512: at "APPS.ALR_FND_PROFILE_OPTIO_0_84_UAR", line 2
ORA-04088: error during execution of trigger
'APPS.ALR_FND_PROFILE_OPTIO_0_84_UAR'
ORA-06512: at line 43
ORA-06512: at line 123


Action Plan:

SQL> show user
USER is "APPS"


SQL> Alter TRIGGER APPS.ALR_FND_PROFILE_OPTIO_0_84_UAR disable;

Trigger altered.


>> adautoconfig completed successfully.

SQL> Alter TRIGGER APPS.ALR_FND_PROFILE_OPTIO_0_84_UAR enable;

Trigger altered.

[ERROR]: The value of s_appltmp is not set correctly in at least one of the context files. validateServerSSLConfig

We faced this issue in Multi-Node Application R12.2 environment.

ADOP PREPARE PHASE ERROR:

Validating configuration on admin node: [appltst1].
  Output: /u01/test/fs_ne/EBSapps/log/adop/46/20180127_013644/prepare/validate/remote_execution_result_level1.xml
  [ERROR]   txkADOPValidation failed on Node: "apptst1"
  [ERROR]   txkADOPValidation failed or is incomplete on Admin node: appltst1
  [ERROR]   Unable to continue processing on other available nodes: appltst2
  [UNEXPECTED]Error running "txkADOPValidation" on node(s): appltst1.



Cause:  [ERROR]: The value of s_appltmp is not set correctly in at least one of the context files.
validateServerSSLConfig:

ADOP do not use the shared directory for APPLTMP.

Action Plan: We have implemented below action plan in appltst1 and appltst2 in TEST for both FS.

Appltst1:

>>>FS RUN:

bash-3.2$ diff test_appltst1.xml-org test_appltst1.xml
549c549
<     <APPLTMP oa_var="s_appltmp">/prd/share/test/appltmp</APPLTMP>
---
>     <APPLTMP oa_var="s_appltmp">//u01/appltst/fs1/inst/apps/test_appltst1/appltmp</APPLTMP>    ->>> This parameter needs to update.

>> Soft Link Creation:
/u01/appltst/fs1/inst/apps/test_appltst1
bash-3.2$ mv appltmp appltmp-org

bash-3.2$ ln -s /prd/share/test/appltmp appltmp

bash-3.2$ ls -ld /prd/test/fs1/inst/apps/test_appltst1/appltmp
lrwxrwxrwx  1 appltst fin      22 Jan 27 03:17 /prd/test/fs1/inst/apps/test_appltst1/appltmp -> /prd/share/test/appltmp

>>>FS Patch:

bash-3.2$ diff test_appltst1.xml-org test_appltst1.xml
549c549
<     <APPLTMP oa_var="s_appltmp">/prd/share/test/appltmp</APPLTMP>
---
>     <APPLTMP oa_var="s_appltmp">/prd/test/fs2/inst/apps/test_appltst1/appltmp</APPLTMP>    ->>> This parameter needs to update.

>> Soft Link Creation:
/prd/test/fs2/inst/apps/test_appltst1
bash-3.2$ mv appltmp appltmp-org
bash-3.2$ ls
admin    appl     appltmp-org logs     oam     ora     out     pids     portal    rgf     soa     temp
bash-3.2$ ln -s /prd/share/test/appltmp appltmp
bash-3.2$ ls -ld /prd/test/fs2/inst/apps/test_appltst1/appltmp
lrwxrwxrwx  1 appltst fin      22 Jan 27 03:58 /prd/test/fs2/inst/apps/test_appltst1/appltmp -> /prd/share/test/appltmp

Renebus2:

>>>FS RUN:

bash-3.2$ diff test_appltst2.xml-org test_appltst2.xml
549c549
<     <APPLTMP oa_var="s_appltmp">/prd/share/test/appltmp</APPLTMP>
---
>     <APPLTMP oa_var="s_appltmp">/prd/test/fs1/inst/apps/test_appltst2/appltmp</APPLTMP>   ->>> This parameter needs to update.


Soft Link Creation:

bash-3.2$ cd $INST_TOP
/prd/test/fs1/inst/apps/test_appltst2
bash-3.2$ mv appltmp appltmp-org
bash-3.2$ ln -s /prd/share/test/appltmp appltmp
bash-3.2$ ls -ld /prd/test/fs1/inst/apps/test_appltst2/appltmp
lrwxrwxrwx  1 appltst fin      22 Jan 27 04:18 /prd/test/fs1/inst/apps/test_appltst2/appltmp -> /prd/share/test/appltmp

>>>FS Patch:

bash-3.2$ diff test_appltst2.xml-org test_appltst2.xml
549c549
<     <APPLTMP oa_var="s_appltmp">/prd/share/test/appltmp</APPLTMP>
---
>     <APPLTMP oa_var="s_appltmp">/prd/test/fs2/inst/apps/test_appltst2/appltmp</APPLTMP>     ->>> This parameter needs to update.

Soft Link Creation:

bash-3.2$ cd $INST_TOP
bash-3.2$ mv appltmp appltmp-org
/prd/test/fs2/inst/apps/test_appltst2
bash-3.2$ ln -s /prd/share/test/appltmp appltmp
bash-3.2$ ls -ld /prd/test/fs2/inst/apps/test_appltst2/appltmp
lrwxrwxrwx  1 appltst fin      22 Jan 27 04:20 /prd/test/fs2/inst/apps/test_appltst2/appltmp -> /prd/share/test/appltmp

>> Executed adautoconfig.sh (1-2-1) on both Run FS and Patch.

OPATCH_JAVA_ERROR : An exception of type "OPatchException" has occurred:

If  below error reported during opatch in ERPTST then perform below.

ERROR:
In Release 12 in Production:
When attempting to apply the CPUJAN08 to the 10.1.2 or 10.1.3 Oracle Homes
the following error occurs.


OPATCH_JAVA_ERROR : An exception of type "OPatchException" has occurred:
OPatch Exception:
OUI found no such ORACLE_HOME set in the environment
Can not get details for given Oracle Home
An exception occurs
null

+++++++++++++++++++++++++++++++++++++++

Solution:

Or you can verify the following entry in /etc/oraInst.loc

inventory_loc=/u01/app/apptst/TEST/apps/tech_st/10.1.3
inventory_loc=/u01/app/apptst/TEST/apps/tech_st/10.1.2

1. Run opatch lsinventory using the command

opatch lsinventory -invPtrLoc <PATH to oraInst.loc file>
eg:
opatch lsinventory -invPtrLoc $ORACLE_HOME/oraInst.loc

To implement the solution, please execute the following steps:

2. Run OPatch pointing to the local inventory either 10.1.2 or 10.1.3

opatch apply -invPtrLoc $ORACLE_HOME/oraInst.loc

Opatch Prerequisite check "CheckActiveFilesAndExecutables" failed. The details are: Following executables are active : /u01/app/11.2.0/grid/lib/libclntsh.so.11.1

Opatch auto failed with error:

Prerequisite check "CheckActiveFilesAndExecutables" failed.
The details are:
Following executables are active :
/u01/app/11.2.0/grid/lib/libclntsh.so.11.1

OPatch failed with error code 73

Cause

This library is still being referenced by an active process:
/u01/app/11.2.0/grid/lib/libclntsh.so.11.1

This error during apply is indicative of the cause of the problem:

Prerequisite check "CheckActiveFilesAndExecutables" failed.
The details are:
Following executables are active :
/u01/app/11.2.0/grid/lib/libclntsh.so.11.1

Solution

As per opatch*.log, there are still processes using one of the files that is being patched:
Following executables are active :
/u01/app/11.2.0/grid/lib/libclntsh.so.11.1

ACTION PLAN
~~~~~~~~~~~
1. As 'root' user, identify process using this file/library:
  # fuser /u01/app/11.2.0/grid/lib/libclntsh.so.11.1
  # lsof /u01/app/11.2.0/grid/lib/libclntsh.so.11.1

2. You may shutdown application or kill process using above file/library before trying opatch again.
  # crsctl stop crs -f
  # fuser /u01/app/11.2.0/grid/lib/libclntsh.so.11.1
  # kill -9 <ospid of process identified above>

ADOP Phase=Preppare ERROR: [ERROR]: Patch file system WebLogic domain edit lock is enabled.

Action:

I run the adop phase=prepare on the run file system.

ERROR:

ERROR:

Verifying existence of context files in database.

Checking if adop can continue with available nodes in the configuration.

    Log: /u02/erptest/fs_ne/EBSapps/log/adop/23/20170227_125158/prepare/erplxtst1

        txkADOPEvalSrvStatus.pl returned SUCCESS

Validating configuration on admin node: [erplxtst1].

    Output: /u02/erptest/fs_ne/EBSapps/log/adop/23/20170227_125158/prepare/validate/remote_execution_result_level1.xml

    [ERROR]     txkADOPValidation failed on Node: "erplxtst1"

    [ERROR]     txkADOPValidation failed or is incomplete on Admin node: erplxtst1

    [ERROR]     Unable to continue processing on other available nodes: erplxtst2

    [UNEXPECTED]Error running "txkADOPValidation" on node(s): erplxtst1.

<?xml version = '1.0' encoding = 'UTF-8'?>

<NODES>

   <Node>

      <Name>erplxtst1</Name>

      <ProcessName>erplxtst1_erplxtst1pool-1-thread-1_erplxtst1_erplxtst1</ProcessName>

      <ResultString>    [WARNING]: There could be issues while validating the ports used for E-Business Suite instance against ports used in /etc/services. Refer the log file for more details.

        [ERROR]: Patch file system WebLogic domain edit lock is enabled.

.end std out.

end err out.

</ResultString>

      <Status>failed</Status>

      <TraceFile>NoTraceFile</TraceFile>

   </Node>

</NODES>

Solutions:

1.    On the PATCH file system:

mv /dev7i/applmgr/fs2/FMW_Home/user_projects/domains/EBS_domain_dev7i/edit.lock edit.lockOLD


2. Source the Run file system environment.

3. Re-run prepare:
 
  adop phase=prepare

  

Adop Phase=prepare Failed After Creating the Custom Application in EBS R12.2

ERROR:

he adop phase=prepare failed with error.  The unexpected error occurred while executing txkADOPPreparePhaseSynchronize.pl.

In txkADOPPreparePhaseSynchronize log file
=============================
Inside evalADPATCHStatus()...
=============================
message_status: ERROR
Adsplice action did not go through successfully.
*******FATAL ERROR*******
PROGRAM : (//EBSDEV/fs2/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl)
FUNCTION: main::execADSPLICE [ Level 1 ]
ERRORMSG: Adsplice action did not go through successfully.

Solutions:

Please run the following steps.

1. adop phase=abort,cleanup cleanup_mode=full (as env is currently in prepare failed state after adsplice was run on Run FS).
2. adop phase=fs_clone
3. adop phase=prepare

ERROR: After run the EXEC FND_CONC_CLONE.SETUP_CLEAN;

Action: Action: After run the EXEC FND_CONC_CLONE.SETUP_CLEAN;

Running adautoconfig.sh then facing below error.

1. ERROR:

begin

*

ERROR at line 1:

ORA-00955: name is already used by an existing object

ORA-06512: at “APPS.ADX_PRF_PKG”, line 83

ORA-01403: no data found

ORA-06512: at line 7

 

2.Solution:

1. Run adadmin–>Recreate Grants and Synonyms

2. Compile Apps Schema

 

 

Login Page Issue 500 Internal Server Error

ERROR:

I found that error in application log and Database alert log when hitting the login URL.

Error in executing triggers on connect internal
*** 2017-01-21 18:37:11.364
----- Error Stack Dump -----
ORA-00604: error occurred at recursive SQL level 1
ORA-01438: value larger than specified precision allowed for this column
ORA-06512: at line 5


Solutions:

column TRIGGER_BODY format a1000
set pagesize 1000
spool trg.txt

SQL>select OWNER, TRIGGER_NAME,
TRIGGER_TYPE, TRIGGERING_EVENT, STATUS, TRIGGER_BODY
from DBA_TRIGGERS
where trim(triggering_event) = 'LOGON';

Status: Enabled


SQL>alter trigger LOGON_AUDIT_TRIGGER disable;


After disable the trigger Login page is opening.