FAILED: file jlzzmigawtpop.sql EBS upgrade patch 28840850
Issue -
[applprd@ebs1229 PROD]$ adop phase=apply apply_mode=downtime patches=28840850 patchtop=/soft/1229upgrade/appatch/1229 workers=12
Enter the APPS password:
Enter the SYSTEM password:
Enter the WLSADMIN password:
Validating credentials.
Initializing.
Run Edition context : /u02/applprd/PROD/fs1/inst/apps/PROD_ebs1229/appl/admin/PROD_ebs1229.xml
Patch edition context: /u02/applprd/PROD/fs2/inst/apps/PROD_ebs1229/appl/admin/PROD_ebs1229.xml
Patch file system free space: 219.58 GB
Validating system setup.
Node registry is valid.
[WARNING] MTCC has not been run. Apply Patch 17537119 and run checkMTpatch.sh.
Checking for existing adop sessions.
Application tier services are down.
Continuing with the existing session [Session ID: 2].
===========================================================================
ADOP (C.Delta.11)
Session ID: 2
Node: ebs1229
Phase: apply
Log: /u02/applprd/PROD/fs_ne/EBSapps/log/adop/2/20200516_235658/adop.log
===========================================================================
Applying patch 28840850.
Log: /u02/applprd/PROD/fs_ne/EBSapps/log/adop/2/20200516_235658/apply/ebs1229/28840850/log/u28840850.log
AutoPatch error:
Error running SQL and EXEC commands in parallel
You should check the file
/u02/applprd/PROD/fs_ne/EBSapps/log/adop/2/20200516_235658/apply/ebs1229/28840850/log/u28840850.log
for errors.
[UNEXPECTED]Error occurred executing "adpatch workers=12 options=hotpatch console=no interactive=no
defaultsfile=/u02/applprd/PROD/fs1/EBSapps/appl/admin/PROD/adalldefaults.txt
patchtop=/soft/1229upgrade/appatch/1229/28840850 driver=u28840850.drv logfile=u28840850.log"
[UNEXPECTED]Refer to the log files for more information.
[UNEXPECTED]Apply phase has failed.
[STATEMENT] Please run adopscanlog utility, using the command
"adopscanlog -latest=yes"
to get the list of the log files along with snippet of the error message corresponding to each log file.
adop exiting with status = 1 (Fail)
[applprd@ebs1229 PROD]$
Patch logfile -
/u02/applprd/PROD/fs_ne/EBSapps/log/adop/2/20200516_235658/apply/ebs1229/28840850/log/u28840850.log
Time is: Wed May 20 2020 09:49:55
Deferred: file jlzzmigawtpop.sql on worker 5 for product jl username JL.
Time is: Wed May 20 2020 09:49:56
(Deferment number 2 for this job)
Assigned: file jlzzmigawtpop.sql on worker 2 for product jl username JL.
Time is: Wed May 20 2020 09:49:57
Completed: file zxmigregimes.sql on worker 4 for product zx username ZX.
Time is: Wed May 20 2020 09:49:57
FAILED: file jlzzmigawtpop.sql on worker 2 for product jl username JL.
Time is: Wed May 20 2020 09:49:58
Completed: file xlaugspes.sql on worker 1 for product xla username XLA.
Time is: Wed May 20 2020 09:50:03
ATTENTION: All workers either have failed or are waiting:
FAILED: file jlzzmigawtpop.sql on worker 2.
ATTENTION: Please fix the above failed worker(s) so the manager can continue.
Current time is: Wed May 20 2020 09:50:04
Telling workers to quit...
9 workers have quit. Waiting for 3 more.
All workers have quit.
Connecting to APPS......Connected successfully.
AutoPatch error:
Error running SQL and EXEC commands in parallel
Freeing includes hash table
Freeing fixes hash table
Freeing basedons hash table
Freeing entities hash table
You should check the file
/u02/applprd/PROD/fs_ne/EBSapps/log/adop/2/20200516_235658/apply/ebs1229/28840850/log/u28840850.log
for errors.
Worker logfile error
sqlplus /u02/applprd/PROD/fs1/EBSapps/appl/ad/12.0.0/patch/115/sql/adsqlwrapper.sql '/u02/applprd/PROD/fs1/EBSapps/appl/jl/12.0.0/patch/115/sql/jlzzmigawtpop.sql &un_jl'
Connected.
PL/SQL procedure successfully completed.
DECLARE
*
ERROR at line 1:
ORA-01658: unable to create INITIAL extent for segment in tablespace
APPS_TS_TX_DATA
ORA-06512: at line 67
Time when worker failed: Wed May 20 2020 09:49:58
Manager says to quit.
Time when worker quit: Wed May 20 2020 09:50:04
AD Worker is complete.
Solution -
Add the datafile -
SQL> ALTER TABLESPACE APPS_TS_TX_DATA ADD DATAFILE '/u01/oraprd/PROD/data/a_txn_data12.dbf' SIZE 500M
AUTOEXTEND ON;
Tablespace altered.
SQL>
start the patch again and Resstart the worker using adctrl.
[applprd@ebs1229 PROD]$ adop phase=apply apply_mode=downtime patches=28840850
patchtop=/soft/1229upgrade/appatch/1229 workers=12 restart=yes
Control
Worker Code Context Filename Status
------ -------- ----------------- -------------------------- --------------
1 Done AutoPatch R120 Wait
2 Done AutoPatch R120 jlzzmigawtpop.sql FAILED
3 Done AutoPatch R120 Wait
4 Done AutoPatch R120 Wait
5 Done AutoPatch R120 Wait
6 Done AutoPatch R120 Wait
7 Done AutoPatch R120 Wait
8 Done AutoPatch R120 Wait
9 Done AutoPatch R120 Wait
10 Done AutoPatch R120 Wait
11 Done AutoPatch R120 Wait
12 Done AutoPatch R120 Wait
Review the messages above, then press [Return] to continue.
AD Controller Menu
---------------------------------------------------
1. Show worker status
2. Tell worker to restart a failed job
3. Tell worker to quit
4. Tell manager that a worker failed its job
5. Tell manager that a worker acknowledges quit
6. Restart a worker on the current machine
7. Exit
Enter your choice [1] : 2
Enter the worker number(s)/range(s) or 'all' for all workers,
or press [Return] to go back to the menu : 2
Status changed to 'Fixed, restart' for worker 2.
Review the messages above, then press [Return] to continue.
AD Controller Menu
---------------------------------------------------
1. Show worker status
2. Tell worker to restart a failed job
3. Tell worker to quit
4. Tell manager that a worker failed its job
5. Tell manager that a worker acknowledges quit
6. Restart a worker on the current machine
7. Exit
Enter your choice [1] :
Control
Worker Code Context Filename Status
------ -------- ----------------- -------------------------- --------------
1 Done AutoPatch R120 Wait
2 Done AutoPatch R120 jlzzmigawtpop.sql Fixed, restart
3 Done AutoPatch R120 Wait
4 Done AutoPatch R120 Wait
5 Done AutoPatch R120 Wait
6 Done AutoPatch R120 Wait
7 Done AutoPatch R120 Wait
8 Done AutoPatch R120 Wait
9 Done AutoPatch R120 Wait
10 Done AutoPatch R120 Wait
11 Done AutoPatch R120 Wait
12 Done AutoPatch R120 Wait
Review the messages above, then press [Return] to continue.