Contact Premier Online Trainings Today
Premier Online Trainings

Oracle Apps DBA - How to upgrade Oracle E-Business Suite from R12.2.0 to 12.2.9 - Part 2

Date Added: 22 Nov.2019 Date Updated: 31 May.2020 Oracle Apps DBA Full Blog

How to upgrade  Oracle E-Business Suite from R12.2.0 to 12.2.9 - Part 2

 

- Apply ETCC recommended patches on DB Server
 
- Shutdown application services 
 
[applprd@ebs1229 ~]$ . APPSPROD_ebs1229.env
[applprd@ebs1229 ~]$
[applprd@ebs1229 ~]$
[applprd@ebs1229 ~]$ cd $ADMIN_SCRIPTS_HOME
[applprd@ebs1229 scripts]$
[applprd@ebs1229 scripts]$ sh adstpall.sh apps/apps
You are running adstpall.sh version 120.22.12020000.7
Enter the WebLogic Server password:
The logfile for this session is located at /u02/applprd/PROD/fs1/inst/apps/PROD_ebs1229/logs/appl/admin/log/adstpall.log
 
All enabled services on this node are stopped.
adstpall.sh:Exiting with status 0
 
adstpall.sh: check the logfile /u02/applprd/PROD/fs1/inst/apps/PROD_ebs1229/logs/appl/admin/log/adstpall.log for more information ...
 
[applprd@ebs1229 scripts]$
 
- Shutdown the database and listener then apply the Database patches
 
[oraprd@ebs1229 ~]$ . PROD_ebs1229.env
[oraprd@ebs1229 ~]$
[oraprd@ebs1229 ~]$
[oraprd@ebs1229 ~]$ lsnrctl stop PROD
LSNRCTL for Linux: Version 12.1.0.2.0 - Production on 14-MAY-2020 16:03:53
Copyright (c) 1991, 2014, Oracle.  All rights reserved.
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=ebs1229.premier.com)(PORT=1521)))
The command completed successfully
[oraprd@ebs1229 ~]$
[oraprd@ebs1229 ~]$
 
 
[oraprd@ebs1229 ~]$ sqlplus '/as sysdba'
SQL*Plus: Release 12.1.0.2.0 Production on Thu May 14 16:03:58 2020
Copyright (c) 1982, 2014, Oracle.  All rights reserved.
Connected to:
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Partitioning, OLAP, Advanced Analytics and Real Application Testing options
SQL>
 
SQL> shut immediate
Database closed.
Database dismounted.
ORACLE instance shut down.
SQL>
 
- Apply the below patches on Database node as per DB checker ouput.
 
- Filename: p8975044_121020_Linux-x86-64.zip
    - Filename: p27264965_121020_Linux-x86-64.zip
    - Filename: p18793246_121020_Generic.zip
     - Filename: p25599890_121020_Generic.zip
    - Filename: p19068380_121020_Linux-x86-64.zip
    - Filename: p30092105_121020_Linux-x86-64.zip
    - Filename: p29748518_121020_Linux-x86-64.zip
     - Filename: p19591608_121020_Linux-x86-64.zip
     - Filename: p20766180_121020_Generic.zip
    - Filename: p22098146_121020_Linux-x86-64.zip
    - Filename: p21321429_121020_Generic.zip
    - Filename: p21864513_121020_Linux-x86-64.zip
    - Filename: p21904072_121020_Linux-x86-64.zip
    - Filename: p21967332_121020_Linux-x86-64.zip
    - Filename: p22496904_121020_Linux-x86-64.zip
    - Filename: p23089357_121020_Linux-x86-64.zip
    - Filename: p26113202_121020_Linux-x86-64.zip
    - Filename: p24560906_121020_Linux-x86-64.zip
    - Filename: p25305405_121020_Linux-x86-64.zip
    - Filename: p25643931_121020_Linux-x86-64.zip
    - Filename: p25906117_121020_Linux-x86-64.zip
    - Filename: p28653113_121020_Generic.zip
    - Filename: p29842421_121020_Linux-x86-64.zip
 
Download the below patch and copy to stage location 
 
[oraprd@ebs1229 DBpatch]$ pwd
/soft/1229upgrade/DBpatch
[oraprd@ebs1229 DBpatch]$ ls -trl p30147721_121020_Linux-x86-64.zip
-rw-r--r--. 1 oraprd dba 10343717 May 13 10:18 p30147721_121020_Linux-x86-64.zip
[oraprd@ebs1229 DBpatch]$
[oraprd@ebs1229 DBpatch]$
 
 
- Unzip the patch 
[oraprd@ebs1229 DBpatch]$ pwd
/soft/1229upgrade/DBpatch
[oraprd@ebs1229 DBpatch]$ unzip -o p30147721_121020_Linux-x86-64.zip
 
The below directory is created go to below path and apply all the patches 
 
[oraprd@ebs1229 12.1.0.2]$ pwd
/soft/1229upgrade/DBpatch/etcc-bundle/LINUX_X86-64/database/12.1.0.2
[oraprd@ebs1229 12.1.0.2]$
 
Example for applying opatch (29842421) on database node, same way you can apply all the patches
[oraprd@ebs1229 ~]$ . PROD_ebs1229.env
[oraprd@ebs1229 ~]$ echo $ORACLE_HOME
/u01/oraprd/PROD/12.1.0
[oraprd@ebs1229 ~]$
[oraprd@ebs1229 ~]$$ORACLE_HOME/OPatch/opatch lsinventory
[oraprd@ebs1229 ~]$ cd /soft/1229upgrade/DBpatch/etcc-bundle/LINUX_X86-64/database/12.1.0.2/29842421
[oraprd@ebs1229 29842421]$
[oraprd@ebs1229 29842421]$$ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -ph ./
[oraprd@ebs1229 29842421]$$ORACLE_HOME/OPatch/opatch lsinventory | grep 29842421
[oraprd@ebs1229 8975044]$$ORACLE_HOME/OPatch/opatch apply
 
EX- The patch output 
[oraprd@ebs1229 29842421]$ $ORACLE_HOME/OPatch/opatch apply
Oracle Interim Patch Installer version 12.1.0.1.10
Copyright (c) 2020, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/oraprd/PROD/12.1.0
Central Inventory : /u01/app/oraInventory
   from           : /u01/oraprd/PROD/12.1.0/oraInst.loc
OPatch version    : 12.1.0.1.10
OUI version       : 12.1.0.2.0
Log file location : /u01/oraprd/PROD/12.1.0/cfgtoollogs/opatch/29842421_May_14_2020_09_52_02/apply2020-05-14_09-52-02AM_1.log
 
Verifying environment and performing prerequisite checks...
OPatch continues with these patches:   29842421
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
 
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/u01/oraprd/PROD/12.1.0')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '29842421' to OH '/u01/oraprd/PROD/12.1.0'
 
Patching component oracle.rdbms.rsf, 12.1.0.2.0...
 
Patching component oracle.rdbms, 12.1.0.2.0...
Patch 29842421 successfully applied.
Log file location: /u01/oraprd/PROD/12.1.0/cfgtoollogs/opatch/29842421_May_14_2020_09_52_02/apply2020-05-14_09-52-02AM_1.log
OPatch succeeded.
[oraprd@ebs1229 29842421]$
 
Check patch is applied or not
 
[oraprd@ebs1229 ~]$ $ORACLE_HOME/OPatch/opatch lsinventory | grep 29842421
Patch  29842421     : applied on Thu May 14 09:52:58 IST 2020
[oraprd@ebs1229 ~]$
 
The below three patches will get the issue.
Solution -
Rollback the below patches then apply the main patch
Main patch Patch 21967332
$ORACLE_HOME/OPatch/opatch rollback -id 18893947
Main patch patch 25305405
$ORACLE_HOME/OPatch/opatch rollback -id 21188532
Main patch patch 29842421
$ORACLE_HOME/OPatch/opatch rollback -id 19779059
 
Patch issue -
[oraprd@ebs1229 21967332]$ $ORACLE_HOME/OPatch/opatch apply
Oracle Interim Patch Installer version 12.1.0.1.10
Copyright (c) 2020, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/oraprd/PROD/12.1.0
Central Inventory : /u01/app/oraInventory
   from           : /u01/oraprd/PROD/12.1.0/oraInst.loc
OPatch version    : 12.1.0.1.10
OUI version       : 12.1.0.2.0
Log file location : /u01/oraprd/PROD/12.1.0/cfgtoollogs/opatch/21967332_May_14_2020_08_53_04/apply2020-05-14_08-53-04AM_1.log
Verifying environment and performing prerequisite checks...
Conflicts/Supersets for each patch are:
Patch : 21967332
 
        Conflict with 18893947
        Conflict details:
        /u01/oraprd/PROD/12.1.0/lib/libgeneric12.a:qcdo.o
Following patches have conflicts: [   18893947   21967332 ]
Refer to My Oracle Support Note 1299688.1 for instructions on resolving patch conflicts.
UtilSession failed: Inter-conflict checking failed in apply incoming patches
Log file location: /u01/oraprd/PROD/12.1.0/cfgtoollogs/opatch/21967332_May_14_2020_08_53_04/apply2020-05-14_08-53-04AM_1.log
OPatch failed with error code 73
[oraprd@ebs1229 21967332]$
 
Solution -
Rollback the patch and apply the main patch
Main patch Patch 21967332
$ORACLE_HOME/OPatch/opatch rollback -id 18893947
 
Rollback the patch
[oraprd@ebs1229 21967332]$ $ORACLE_HOME/OPatch/opatch rollback -id 18893947
Oracle Interim Patch Installer version 12.1.0.1.10
Copyright (c) 2020, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/oraprd/PROD/12.1.0
Central Inventory : /u01/app/oraInventory
   from           : /u01/oraprd/PROD/12.1.0/oraInst.loc
OPatch version    : 12.1.0.1.10
OUI version       : 12.1.0.2.0
Log file location : /u01/oraprd/PROD/12.1.0/cfgtoollogs/opatch/18893947_May_14_2020_08_53_26/rollback2020-05-14_08-53-26AM_1.log
RollbackSession rolling back interim patch '18893947' from OH '/u01/oraprd/PROD/12.1.0'
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/u01/oraprd/PROD/12.1.0')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Patching component oracle.rdbms.rsf, 12.1.0.2.0...
Patching component oracle.rdbms, 12.1.0.2.0...
RollbackSession removing interim patch '18893947' from inventory
Log file location: /u01/oraprd/PROD/12.1.0/cfgtoollogs/opatch/18893947_May_14_2020_08_53_26/rollback2020-05-14_08-53-26AM_1.log
OPatch succeeded.
[oraprd@ebs1229 21967332]$
 
 
After rollback apply the patch.
[oraprd@ebs1229 21967332]$ $ORACLE_HOME/OPatch/opatch apply
Oracle Interim Patch Installer version 12.1.0.1.10
Copyright (c) 2020, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/oraprd/PROD/12.1.0
Central Inventory : /u01/app/oraInventory
   from           : /u01/oraprd/PROD/12.1.0/oraInst.loc
OPatch version    : 12.1.0.1.10
OUI version       : 12.1.0.2.0
Log file location : /u01/oraprd/PROD/12.1.0/cfgtoollogs/opatch/21967332_May_14_2020_08_54_08/apply2020-05-14_08-54-08AM_1.log
Verifying environment and performing prerequisite checks...
OPatch continues with these patches:   21967332
Do you want to proceed? [y|n]
y
User Responded with: Y
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/u01/oraprd/PROD/12.1.0')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Applying interim patch '21967332' to OH '/u01/oraprd/PROD/12.1.0'
Patching component oracle.rdbms.rsf, 12.1.0.2.0...
Patching component oracle.rdbms, 12.1.0.2.0...
Patch 21967332 successfully applied.
Log file location: /u01/oraprd/PROD/12.1.0/cfgtoollogs/opatch/21967332_May_14_2020_08_54_08/apply2020-05-14_08-54-08AM_1.log
OPatch succeeded.
[oraprd@ebs1229 21967332]$
 
 
After apply the all patches then Check as below command
 

EBS120to1229-upgrade6.jpg

 

 
- Start Database and listener 
 
[oraprd@ebs1229 ~]$ lsnrctl start PROD
LSNRCTL for Linux: Version 12.1.0.2.0 - Production on 14-MAY-2020 09:54:13
Copyright (c) 1991, 2014, Oracle.  All rights reserved.
Starting /u01/oraprd/PROD/12.1.0/bin/tnslsnr: please wait...
TNSLSNR for Linux: Version 12.1.0.2.0 - Production
System parameter file is /u01/oraprd/PROD/12.1.0/network/admin/PROD_ebs1229/listener.ora
Log messages written to /u01/oraprd/PROD/12.1.0/admin/PROD_ebs1229/diag/tnslsnr/ebs1229/prod/alert/log.xml
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=ebs1229.premier.com)(PORT=1521)))
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=ebs1229.premier.com)(PORT=1521)))
STATUS of the LISTENER
------------------------
Alias                     PROD
Version                   TNSLSNR for Linux: Version 12.1.0.2.0 - Production
Start Date                14-MAY-2020 09:54:25
Uptime                    0 days 0 hr. 0 min. 19 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /u01/oraprd/PROD/12.1.0/network/admin/PROD_ebs1229/listener.ora
Listener Log File         /u01/oraprd/PROD/12.1.0/admin/PROD_ebs1229/diag/tnslsnr/ebs1229/prod/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=ebs1229.premier.com)(PORT=1521)))
Services Summary...
Service "PROD" has 1 instance(s).
  Instance "PROD", status UNKNOWN, has 1 handler(s) for this service...
The command completed successfully
[oraprd@ebs1229 ~]$
[oraprd@ebs1229 ~]$
 
[oraprd@ebs1229 ~]$
[oraprd@ebs1229 ~]$ sqlplus '/as sysdba'
SQL*Plus: Release 12.1.0.2.0 Production on Thu May 14 09:54:39 2020
Copyright (c) 1982, 2014, Oracle.  All rights reserved.
Connected to an idle instance.
 
SQL>
SQL>
SQL> startup
ORA-32004: obsolete or deprecated parameter(s) specified for RDBMS instance
ORACLE instance started.
Total System Global Area 2147483648 bytes
Fixed Size                  2926472 bytes
Variable Size             452987000 bytes
Database Buffers         1677721600 bytes
Redo Buffers               13848576 bytes
Database mounted.
Database opened.
SQL>
 
Note: Perform post install datapatch.
 
[oraprd@ebs1229 ~]$ $ORACLE_HOME/OPatch/datapatch
SQL Patching tool version 12.2.0.0.0 on Thu May 14 09:56:06 2020
Copyright (c) 2014, Oracle.  All rights reserved.
Connecting to database...OK
Determining current state...done
Adding patches to installation queue and performing prereq checks...done
Installation queue:
  The following patches will be rolled back:
    18966843 ()
    20204035 ()
    20476776 ()
  The following patches will be applied:
    18793246 ()
    21321429 ()
    22098146 ()
    25599890 ()
    27264965 ()
    28653113 ()
catcon: ALL catcon-related output will be written to /tmp/sqlpatch_catcon__catcon_2218.lst
catcon: See /tmp/sqlpatch_catcon_*.log files for output generated by scripts
catcon: See /tmp/sqlpatch_catcon__*.lst files for spool files, if any
Installing patches...
Patch installation complete.  Total patches installed: 9
Validating logfiles...done
SQL Patching tool complete on Thu May 14 12:05:33 2020
[oraprd@ebs1229 ~]$
 
Run the DB checker on DB node after apply the patch and post steps
 
[oraprd@ebs1229 DBpatch]$ pwd
/soft/1229upgrade/DBpatch
[oraprd@ebs1229 DBpatch]$ ./checkDBpatch.sh
 +===============================================================+
 |    Copyright (c) 2005, 2019 Oracle and/or its affiliates.     |
 |                     All rights reserved.                      |
 |             Oracle E-Business Suite Release 12.2              |
 |          Database EBS Technology Codelevel Checker            |
 +===============================================================+
Using context file from currently set database environment:
/u01/oraprd/PROD/12.1.0/appsutil/PROD_ebs1229.xml
Starting Database EBS Technology Codelevel Checker, Version 120.72
Thu May 14 15:16:39 IST 2020
Log file for this session : /soft/1229upgrade/DBpatch/log/checkDBpatch_24759.log
Identifying database release.
Database release set to 12.1.0.2.
Connecting to database.
Database connection successful.
Database PROD is in READ WRITE mode.
Identifying APPS and APPLSYS schema names.
 - APPS schema : APPS
 - APPLSYS schema : APPLSYS
Checking for DB-ETCC results table.
Table to store DB-ETCC results already exists in the database.
Bugfix file ./db/onprem/txk_R1220_DB_base_bugs.xml : 120.0.12020000.50
This file will be used for identifying missing bugfixes.
Mapping file ./db/onprem/txk_R1220_DB_mappings.xml : 120.0.12020000.25
This file will be used for mapping bugfixes to patches.
[WARNING] DB-ETCC: Bugfix XML file (./db/onprem/txk_R1220_DB_base_bugs.xml) is more than 30 days old.
 Check if a newer version is available in patch 17537119.
Checking Bugfix XML file for 12.1.0.2
Obtained list of bugfixes to be applied and the list to be rolled back.
Now checking Database ORACLE_HOME.
The opatch utility is version 12.1.0.1.10.
DB-ETCC is compatible with this opatch version.
Found patch records in the inventory.
Checking Mapping XML file for 12.1.0.2
All the required one-off bugfixes are present in Database ORACLE_HOME.
 
Stored Technology Codelevel Checker results in the database PROD successfully.
Finished checking fixes for Oracle Database: Thu May 14 15:16:59 IST 2020
Log file for this session: /soft/1229upgrade/DBpatch/log/checkDBpatch_24759.log
===============================================================================
[oraprd@ebs1229 DBpatch]$
 
- Apply ETCC recommended patches on Apps Server
 
Apply etcc patches on application node
 
- Shutdown the Database and listener services 
- Download the below patch and copy to stage location 
+-----------------------------------------------------------------------------+
A consolidated zip file with the required application tier patches is
available on My Oracle Support via:
  Patch 30147763
    - EBS RELEASE 12.2 CONSOLIDATED FMW FIXES FOR OCT 2019
+-----------------------------------------------------------------------------+
[applprd@ebs1229 etcc]$ pwd
/soft/1229upgrade/appatch/etcc
[applprd@ebs1229 etcc]$ ls -trl p30147763_R12_LINUX.zip
-rw-r--r-- 1 applprd dba 635175819 May 14 16:32 p30147763_R12_LINUX.zip
[applprd@ebs1229 etcc]$
 
- Apply the patches by exporting ORACLE_HOME and PATH for oracle_common, webtier and WLS_HOME.
 
-------------------------------------------------------------------------------
Oracle Forms and Reports 10.1.2.3.0
-------------------------------------------------------------------------------
    - Filename: p26825525_101232_LINUX.zip
      - Filename: p25342269_101232_Generic.zip
    - Filename: p27491934_101232_LINUX.zip
 
[applprd@ebs1229 ~]$ . APPSPROD_ebs1229.env
[applprd@ebs1229 ~]$
[applprd@ebs1229 ~]$ echo $ORACLE_HOME
/u02/applprd/PROD/fs1/EBSapps/10.1.2
[applprd@ebs1229 ~]$
[applprd@ebs1229 26825525]$ pwd
/soft/1229upgrade/appatch/etcc/etcc-bundle/LINUX_X86-64/forms/10.1.2.3.0/26825525
[applprd@ebs1229 26825525]$
[applprd@ebs1229 26825525]$ $ORACLE_HOME/OPatch/opatch apply
 
- Apply all the patches and check lsinventory 
 
[applprd@ebs1229 ~]$ echo $ORACLE_HOME
/u02/applprd/PROD/fs1/EBSapps/10.1.2
[applprd@ebs1229 ~]$
[applprd@ebs1229 ~]$ $ORACLE_HOME/OPatch/opatch lsinventory |egrep '26825525|25342269|27491934'
  1) Patch  27491934 applied on Thu May 14 16:42:33 IST 2020
      [ Bug fixes: 27491934  ]
  2) Patch  25342269 applied on Thu May 14 16:41:40 IST 2020
      [ Bug fixes: 25342269  ]
  3) Patch  26825525 applied on Thu May 14 16:40:22 IST 2020
[applprd@ebs1229 ~]$
 
-------------------------------------------------------------------------------
Oracle Fusion Middleware (FMW) - Web Tier 11.1.1.9.0
-------------------------------------------------------------------------------
    - Filename: p22288381_111190_Generic.zip
    - Filename: p27301611_111190_Linux-x86-64.zip
    - Filename: p27047184_111190_Linux-x86-64.zip
    - Filename: p23716938_111190_Generic.zip
[applprd@ebs1229 ~]$ export ORACLE_HOME=/u02/applprd/PROD/fs1/FMW_Home/webtier
[applprd@ebs1229 ~]$
[applprd@ebs1229 ~]$ echo $ORACLE_HOME
/u02/applprd/PROD/fs1/FMW_Home/webtier
[applprd@ebs1229 ~]$
[applprd@ebs1229 ~]$ cd /soft/1229upgrade/appatch/etcc/etcc-bundle/LINUX_X86-64/webtier/11.1.1.9.0/22288381
[applprd@ebs1229 22288381]$
[applprd@ebs1229 22288381]$ $ORACLE_HOME/OPatch/opatch apply
 
- Apply all the patches and check lsinventory 
 
[applprd@ebs1229 ~]$ echo $ORACLE_HOME
/u02/applprd/PROD/fs1/FMW_Home/webtier
[applprd@ebs1229 ~]$
 
[applprd@ebs1229 ~]$ $ORACLE_HOME/OPatch/opatch lsinventory |egrep '22288381|27301611|27047184|23716938'
Patch  23716938     : applied on Thu May 14 16:53:19 IST 2020
     23716938
Patch  27047184     : applied on Thu May 14 16:52:09 IST 2020
Patch  27301611     : applied on Thu May 14 16:50:38 IST 2020
Patch  22288381     : applied on Thu May 14 16:49:45 IST 2020
[applprd@ebs1229 ~]$
 
-------------------------------------------------------------------------------
RSF within FMW Web tier 11.1.0.7.0
-------------------------------------------------------------------------------
    - Filename: p22290164_111070_Linux-x86-64.zip
[applprd@ebs1229 22290164]$ pwd
/soft/1229upgrade/appatch/etcc/etcc-bundle/LINUX_X86-64/webtier/11.1.0.7.0/22290164
[applprd@ebs1229 22290164]$
[applprd@ebs1229 22290164]$ echo $ORACLE_HOME
/u02/applprd/PROD/fs1/FMW_Home/webtier
[applprd@ebs1229 22290164]$
[applprd@ebs1229 22290164]$ $ORACLE_HOME/OPatch/opatch apply
 
After apply the patch check the lsinventory 
[applprd@ebs1229 22290164]$ $ORACLE_HOME/OPatch/opatch lsinventory |egrep '22290164'
Patch  22290164     : applied on Thu May 14 16:58:18 IST 2020
[applprd@ebs1229 22290164]$
 
-------------------------------------------------------------------------------
Oracle Fusion Middleware (FMW) - oracle_common 11.1.1.9.0
-------------------------------------------------------------------------------
    - Filename: p9905685_111190_Generic.zip
    - Filename: p17428617_111190_Generic.zip
    - Filename: p21366277_111190_Generic.zip
    - Filename: p21628307_111190_Generic.zip
    - Filename: p24606362_111190_Generic.zip
    - Filename: p24843064_111190_Generic.zip
    - Filename: p13544814_111190_Generic.zip
    - Filename: p16089637_111190_Generic.zip
    - Filename: p20141119_111190_Generic.zip
    - Filename: p29669847_111190_Generic.zip
    - Filename: p27212806_111190_Generic.zip
    - Filename: p28708563_111190_Generic.zip
[applprd@ebs1229 ~]$ export ORACLE_HOME=/u02/applprd/PROD/fs1/FMW_Home/oracle_common
[applprd@ebs1229 ~]$
[applprd@ebs1229 ~]$ echo $ORACLE_HOME
/u02/applprd/PROD/fs1/FMW_Home/oracle_common
[applprd@ebs1229 ~]$
[applprd@ebs1229 ~]$ cd /soft/1229upgrade/appatch/etcc/etcc-bundle/LINUX_X86-64/oracle_common/11.1.1.9.0/9905685/oui
[applprd@ebs1229 oui]$
[applprd@ebs1229 oui]$ $ORACLE_HOME/OPatch/opatch apply
 
The below patches need to apply from oui directory as per readme file
[applprd@ebs1229 oui]$ pwd
/soft/1229upgrade/appatch/etcc/etcc-bundle/LINUX_X86-64/oracle_common/11.1.1.9.0/9905685/oui
[applprd@ebs1229 oui]$
[applprd@ebs1229 oui]$ pwd
/soft/1229upgrade/appatch/etcc/etcc-bundle/LINUX_X86-64/oracle_common/11.1.1.9.0/24843064/oui
[applprd@ebs1229 oui]$
[applprd@ebs1229 oui]$ pwd
/soft/1229upgrade/appatch/etcc/etcc-bundle/LINUX_X86-64/oracle_common/11.1.1.9.0/29669847/oui
[applprd@ebs1229 oui]$
 
Apply all the patches and check lsinventory
[applprd@ebs1229 ~]$ echo $ORACLE_HOME
/u02/applprd/PROD/fs1/FMW_Home/oracle_common
[applprd@ebs1229 ~]$
[applprd@ebs1229 ~]$ $ORACLE_HOME/OPatch/opatch lsinventory |egrep '9905685|17428617|21366277|21628307|24606362|24843064|13544814|16089637|20141119|29669847|27212806|28708563'
Patch  28708563     : applied on Thu May 14 17:22:44 IST 2020
Patch  27212806     : applied on Thu May 14 17:22:12 IST 2020
     27212806
Patch  29669847     : applied on Thu May 14 17:21:37 IST 2020
Patch  20141119     : applied on Thu May 14 17:19:56 IST 2020
     20141119
Patch  16089637     : applied on Thu May 14 17:19:14 IST 2020
     16089637
Patch  13544814     : applied on Thu May 14 17:18:24 IST 2020
     13544814
Patch  24843064     : applied on Thu May 14 17:17:25 IST 2020
     24843064
Patch  24606362     : applied on Thu May 14 17:16:27 IST 2020
     24606362
Patch  21628307     : applied on Thu May 14 17:15:40 IST 2020
     21628307
Patch  21366277     : applied on Thu May 14 17:14:58 IST 2020
     21366277
Patch  17428617     : applied on Thu May 14 17:14:12 IST 2020
     17428617
Patch  9905685      : applied on Thu May 14 17:13:13 IST 2020
     9905685
[applprd@ebs1229 ~]$
 
 
-------------------------------------------------------------------------------
Oracle WebLogic Server (WLS) 10.3.6.0.7
-------------------------------------------------------------------------------
  Patch 27919965 [SU Patch [B47X]: WLS PSU 10.3.6.0.180717]
    - Filename: p27919965_1036_Generic.zip
 
- Check applied patches on weblogic
 
[applprd@ebs1229 ~]$ . APPSPROD_ebs1229.env
 [applprd@ebs1229 ~]$ echo $FMW_HOME
/u02/applprd/PROD/fs1/FMW_Home
[applprd@ebs1229 ~]$ cd $FMW_HOME/utils/bsu
 [applprd@ebs1229 bsu]$ ls -tlr bsu.sh
-rwxr-x---. 1 applprd dba 179 May 13 01:31 bsu.sh
 [applprd@ebs1229 bsu]$ ./bsu.sh -prod_dir=$FMW_HOME/wlserver_10.3 -status=applied -view
ProductName:       WebLogic Server
ProductVersion:    10.3 MP6
Components:        WebLogic Server/Core Application Server,WebLogic Server/Admi
                   nistration Console,WebLogic Server/Configuration Wizard and
                   Upgrade Framework,WebLogic Server/Web 2.0 HTTP Pub-Sub Serve
                   r,WebLogic Server/WebLogic SCA,WebLogic Server/WebLogic JDBC
                    Drivers,WebLogic Server/Third Party JDBC Drivers,WebLogic S
                   erver/WebLogic Server Clients,WebLogic Server/WebLogic Web S
                   erver Plugins,WebLogic Server/UDDI and Xquery Support,WebLog
                   ic Server/Evaluation Database,WebLogic Server/Workshop Code
                   Completion Support
BEAHome:           /u02/applprd/PROD/fs1/FMW_Home
ProductHome:       /u02/applprd/PROD/fs1/FMW_Home/wlserver_10.3
PatchSystemDir:    /u02/applprd/PROD/fs1/FMW_Home/utils/bsu
PatchDir:          /u02/applprd/PROD/fs1/FMW_Home/patch_wls1036
Profile:           Default
DownloadDir:       /u02/applprd/PROD/fs1/FMW_Home/utils/bsu/cache_dir
JavaVersion:       1.6.0_29
JavaVendor:        Sun
Patch ID:          32I2
Patch ID:          YHJK
Patch ID:          S9MN (14272383)
Patch ID:          TTEM (14621810)
Patch ID:          CIH8 (17431995,17495356)
Patch ID:          FCX7 (17572726)
Patch ID:          CW9T (13337000)
Patch ID:          2GYW (17319481)
Patch ID:          7FC9 (17893334)
Patch ID:          Y5AP (19600486)
Patch ID:          S8H6 (20474010)
Patch ID:          1LRI (19687084)
Patch ID:          VKXF (11781879)
Patch ID:          BLTG (13729611)
Patch ID:          YVDZ (13964737)
[applprd@ebs1229 bsu]$
 
 
Oracle E-Business Suite Release Notes, Release 12.2 (Doc ID 1320300.1)
 
1.5 Apply latest application tier technology patches to run file system
Oracle E-Business Suite 12.2.9 Release Update Pack Patch 28840850 requires a minimum Oracle WebLogic Server PSU version of 10.3.6.0.190416 Patch 29204678 or higher. If you are planning an immediate upgrade to Oracle E-Business Suite 12.2.9 Release Update Pack (Patch 28840850) or higher, you must apply the Oracle WebLogic Server PSU version 10.3.6.0.190416 Patch 29204678 or higher and then re-run the Middle Tier EBS Technology Codelevel Checker (MT-ETCC) on the Oracle E-Business Suite application tier nodes.
 
As per oracle doc the PSU version 10.3.6.0.190416 is required 
Apply the weblogic patch – 10.3.6.0.190416 Patch 29204678
The p29204678_1036_Generic.zip and copy to $FMW_HOME/utils/bsu/cache_dir
[applprd@ebs1229 etcc]$ pwd
/soft/1229upgrade/appatch/etcc
[applprd@ebs1229 etcc]$ ls -trl p29204678_1036_Generic.zip
-rwxr-x--- 1 applprd dba 101146352 May 14 17:36 p29204678_1036_Generic.zip
[applprd@ebs1229 etcc]$
$cd $FMW_HOME/utils/bsu/cache_dir
$unzip -o p29204678_1036_Generic.zip
$cd $FMW_HOME/utils/bsu
$./bsu.sh -install -patch_download_dir=$FMW_HOME/utils/bsu/cache_dir -patchlist=U5I2 -prod_dir=$FMW_HOME/wlserver_10.3
As per redme-
Smart Update Details of Oracle WebLogic Server Patch Set Update 10.3.6.0.190416
--------------------------------------------------------------------------
Patch ID - U5I2
Patch Number – 29204678
[applprd@ebs1229 bsu]$  ./bsu.sh -install -patch_download_dir=$FMW_HOME/utils/bsu/cache_dir -patchlist=U5I2 -prod_dir=$FMW_HOME/wlserver_10.3
Checking for conflicts..
Conflict(s) detected - resolve conflict condition and execute patch installation again
Conflict condition details follow:
Patch U5I2 is mutually exclusive and cannot coexist with patch(es): CW9T,FCX7,1LRI,2GYW,BLTG,VKXF,Y5AP
[applprd@ebs1229 bsu]$
 
The Main patch need apply as below order 
- remove the conflict patche below order then will apply the main patch (U5I2)
$cd $FMW_HOME/utils/bsu
./bsu.sh -remove -patchlist=CW9T -prod_dir=$FMW_HOME/wlserver_10.3
./bsu.sh -remove -patchlist=1LRI -prod_dir=$FMW_HOME/wlserver_10.3
./bsu.sh -remove -patchlist=2GYW -prod_dir=$FMW_HOME/wlserver_10.3
./bsu.sh -remove -patchlist=BLTG -prod_dir=$FMW_HOME/wlserver_10.3
./bsu.sh -remove -patchlist=VKXF -prod_dir=$FMW_HOME/wlserver_10.3
./bsu.sh -remove -patchlist=Y5AP -prod_dir=$FMW_HOME/wlserver_10.3
./bsu.sh -remove -patchlist=FCX7 -prod_dir=$FMW_HOME/wlserver_10.3
./bsu.sh -install -patch_download_dir=$FMW_HOME/utils/bsu/cache_dir -patchlist=U5I2 -prod_dir=$FMW_HOME/wlserver_10.3
[applprd@ebs1229 bsu]$  ./bsu.sh -install -patch_download_dir=$FMW_HOME/utils/bsu/cache_dir -patchlist=U5I2 -prod_dir=$FMW_HOME/wlserver_10.3
Checking for conflicts..
No conflict(s) detected
Installing Patch ID: U5I2..
Result: Success
[applprd@ebs1229 bsu]$
[applprd@ebs1229 bsu]$ ./bsu.sh -prod_dir=$FMW_HOME/wlserver_10.3 -status=applied -view
ProductName:       WebLogic Server
ProductVersion:    10.3 MP6
Components:        WebLogic Server/Core Application Server,WebLogic Server/Admi
                   nistration Console,WebLogic Server/Configuration Wizard and
                   Upgrade Framework,WebLogic Server/Web 2.0 HTTP Pub-Sub Serve
                   r,WebLogic Server/WebLogic SCA,WebLogic Server/WebLogic JDBC
                    Drivers,WebLogic Server/Third Party JDBC Drivers,WebLogic S
                   erver/WebLogic Server Clients,WebLogic Server/WebLogic Web S
                   erver Plugins,WebLogic Server/UDDI and Xquery Support,WebLog
                   ic Server/Evaluation Database,WebLogic Server/Workshop Code
                   Completion Support
BEAHome:           /u02/applprd/PROD/fs1/FMW_Home
ProductHome:       /u02/applprd/PROD/fs1/FMW_Home/wlserver_10.3
PatchSystemDir:    /u02/applprd/PROD/fs1/FMW_Home/utils/bsu
PatchDir:          /u02/applprd/PROD/fs1/FMW_Home/patch_wls1036
Profile:           Default
DownloadDir:       /u02/applprd/PROD/fs1/FMW_Home/utils/bsu/cache_dir
JavaVersion:       1.6.0_29
JavaVendor:        Sun
Patch ID:          32I2
Patch ID:          YHJK
Patch ID:          S9MN (14272383)
Patch ID:          TTEM (14621810)
Patch ID:          CIH8 (17431995,17495356)
Patch ID:          7FC9 (17893334)
Patch ID:          S8H6 (20474010)
Patch ID:          YVDZ (13964737)
Patch ID:          U5I2 (29204678)
[applprd@ebs1229 bsu]$
 
 
- Start the database and listener 
[oraprd@ebs1229 ~]$ . PROD_ebs1229.env
[oraprd@ebs1229 ~]$ lsnrctl start PROD
LSNRCTL for Linux: Version 12.1.0.2.0 - Production on 14-MAY-2020 21:30:10
Copyright (c) 1991, 2014, Oracle.  All rights reserved.
Starting /u01/oraprd/PROD/12.1.0/bin/tnslsnr: please wait...
TNSLSNR for Linux: Version 12.1.0.2.0 - Production
System parameter file is /u01/oraprd/PROD/12.1.0/network/admin/PROD_ebs1229/listener.ora
Log messages written to /u01/oraprd/PROD/12.1.0/admin/PROD_ebs1229/diag/tnslsnr/ebs1229/prod/alert/log.xml
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=ebs1229.premier.com)(PORT=1521)))
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=ebs1229.premier.com)(PORT=1521)))
STATUS of the LISTENER
------------------------
Alias                     PROD
Version                   TNSLSNR for Linux: Version 12.1.0.2.0 - Production
Start Date                14-MAY-2020 21:30:10
Uptime                    0 days 0 hr. 0 min. 7 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /u01/oraprd/PROD/12.1.0/network/admin/PROD_ebs1229/listener.ora
Listener Log File         /u01/oraprd/PROD/12.1.0/admin/PROD_ebs1229/diag/tnslsnr/ebs1229/prod/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=ebs1229.premier.com)(PORT=1521)))
Services Summary...
Service "PROD" has 1 instance(s).
  Instance "PROD", status UNKNOWN, has 1 handler(s) for this service...
The command completed successfully
[oraprd@ebs1229 ~]$
 
[oraprd@ebs1229 ~]$ sqlplus '/as sysdba'
SQL*Plus: Release 12.1.0.2.0 Production on Thu May 14 21:30:20 2020
Copyright (c) 1982, 2014, Oracle.  All rights reserved.
Connected to an idle instance.
SQL> startup
ORA-32004: obsolete or deprecated parameter(s) specified for RDBMS instance
ORACLE instance started.
Total System Global Area 2147483648 bytes
Fixed Size                  2926472 bytes
Variable Size             452987000 bytes
Database Buffers         1677721600 bytes
Redo Buffers               13848576 bytes
Database mounted.
Database opened.
SQL>
 
- Run MT checker on Application node
MT checker output as below 
[applprd@ebs1229 ~]$ . APPSPROD_ebs1229.env
[applprd@ebs1229 ~]$ cd  /soft/1229upgrade/appatch/etcc
[applprd@ebs1229 etcc]$ pwd
/soft/1229upgrade/appatch/etcc
[applprd@ebs1229 etcc]$ ./checkMTpatch.sh
 +===============================================================+
 |    Copyright (c) 2005, 2019 Oracle and/or its affiliates.     |
 |                     All rights reserved.                      |
 |             Oracle E-Business Suite Release 12.2              |
 |        Applicatione Tier Technology Codelevel Checker         |
 +===============================================================+
Using context file from currently set applications environment:
/u02/applprd/PROD/fs1/inst/apps/PROD_ebs1229/appl/admin/PROD_ebs1229.xml
Starting Application Tier Technology Codelevel Checker
Version: 120.0.12020000.38.
Thu May 14 19:33:57 IST 2020
Log file for this session: /soft/1229upgrade/appatch/etcc/log/checkMTpatch_4182.log
Bugfix XML file version: 120.0.12020000.43
This file will be used for identifying missing bugfixes.
Mapping XML file version: 120.0.12020000.27
This file will be used for mapping bugfixes to patches.
 
Checking for prerequisite bugfixes in File Edition: run
Enter the password for the APPS user:
Connecting to database.
Database connection successful.
The installed AD.C codelevel does not support storing the results in the database.
===============================================================================
Oracle Forms and Reports
===============================================================================
Now examining product Oracle Forms and Reports.
Oracle Home = /u02/applprd/PROD/fs1/EBSapps/10.1.2.
Product version = 10.1.2.3.0.
Checking required bugfixes for Oracle Forms and Reports 10.1.2.3.0.
All required bugfixes are present for Oracle Forms and Reports.
Checking required bugfixes for RSF within Forms 10.1.0.5.0.
All required bugfixes are present for RSF within Forms.
===============================================================================
Oracle Fusion Middleware (FMW) - Web Tier
===============================================================================
Now examining product Oracle Fusion Middleware (FMW) - Web Tier.
Oracle Home = /u02/applprd/PROD/fs1/FMW_Home/webtier.
Product Version = 11.1.1.9.0
Checking required bugfixes for FMW - Web Tier 11.1.1.9.0.
All required bugfixes are present for FMW - Web Tier.
 
Checking required bugfixes for RSF within FMW Web tier 11.1.0.7.0.
All required bugfixes are present for RSF within FMW Web tier.
===============================================================================
Oracle Fusion Middleware (FMW) - oracle_common
===============================================================================
Now examining product Oracle Fusion Middleware (FMW) - oracle_common.
Oracle Home = /u02/applprd/PROD/fs1/FMW_Home/oracle_common.
Product Version = 11.1.1.9.0
Checking required bugfixes for FMW - oracle common 11.1.1.9.0.
All required bugfixes are present for FMW - oracle common.
===============================================================================
Oracle WebLogic Server (WLS)
===============================================================================
Now examining product Oracle WebLogic Server (WLS).
Oracle Home = /u02/applprd/PROD/fs1/FMW_Home/wlserver_10.3.
Product Version = 10.3.6.0.190416
Note that for Oracle WebLogic Server, patches rather than bugfixes are verified.
Checking required patches for Oracle WebLogic Server (WLS) 10.3.6.0.190416.
  Missing Patch ID: 17319481
  Missing Patch ID: 19259028
  Missing Patch ID: 22323006
  Missing Patch ID: 26795917
  Missing Patch ID: 25373406
  Missing Patch ID: 16684205
  Missing Patch ID: 27158972
  Missing Patch ID: 29694149
The above list shows missing patches for Oracle WebLogic Server.
If you have applied other Oracle WebLogic Server patches, they may have included the bugfixes needed.
Contact Oracle Support if you require assistance in determining whether this is the case.
===============================================================================
Generating Patch Recommendation Summary.
===============================================================================
PATCH RECOMMENDATION SUMMARY
===============================================================================
One or more products have bugfixes missing.
The default patch recommendations to install these missing bugfixes are:
-------------------------------------------------------------------------------
Oracle WebLogic Server (WLS) 10.3.6.0.190416
-------------------------------------------------------------------------------
  Patch 17319481 [SU Patch [159X]]
    - Filename: p17319481_10360190416_Generic.zip
  Patch 19259028 [SU Patch [M3C7]]
    - Filename: p19259028_10360190416_Generic.zip
  Patch 22323006 [SU Patch [DI8E]]
    - Filename: p22323006_1036_Generic.zip
  Patch 26795917 [SU Patch [DN1F]]
    - Filename: p26795917_1036_Generic.zip
 
  Patch 25373406 [SU Patch [LLU8]]
    - Filename: p25373406_10360190416_Generic.zip
  Patch 16684205 [SU Patch [XNBA]]
    - Filename: p16684205_1036_Generic.zip
  Patch 27158972 [SU Patch [WFNK]]
    - Filename: p27158972_10360190416_Generic.zip
  Patch 29694149 [SU Patch [6JJ4]]
    - Filename: p29694149_10360190416_Generic.zip
Apply the required patches and rerun this script.
+-----------------------------------------------------------------------------+
A consolidated zip file with the required application tier patches is
available on My Oracle Support via:
  Patch 30147763
    - EBS RELEASE 12.2 CONSOLIDATED FMW FIXES FOR OCT 2019
+-----------------------------------------------------------------------------+
See Doc ID 1594274.1 for any special instructions regarding these patches.
Footnotes in Doc ID 1594274.1 also apply to corresponding overlay patches.
Finished checking prerequisite patches for File Edition: run.
Thu May 14 19:35:08 IST 2020
Log file for this session: /soft/1229upgrade/appatch/etcc/log/checkMTpatch_4182.log
===============================================================================
[applprd@ebs1229 etcc]$
 
Continuation  Oracle EBS 1229 upgrade