Contact Premier Online Trainings Today
Premier Online Trainings

Oracle Apps DBA - ADOP_VALID_NODES table. Ensure AutoConfig has been run on all nodes and Database Autoconfig failed

Date Added: 19 Jan.2020 Date Updated: 19 Jan.2020 Oracle Apps DBA Full Blog

ADOP_VALID_NODES table. Ensure AutoConfig has been run on all nodes.

 

[applmgr@ebs122 ~]$ adop phase=apply apply_mode=downtime patches=24690690 patchtop=/apps/upg1227 workers=8 abandon=no restart=yes

 
Enter the APPS password:
Enter the SYSTEM password:
Enter the WLSADMIN password:
 
Validating credentials.
 
Initializing.
    Run Edition context  : /apps/applmgr/PROD/fs1/inst/apps/PROD_ebs122/appl/admin/PROD_ebs122.xml
    Patch edition context: /apps/applmgr/PROD/fs2/inst/apps/PROD_ebs122/appl/admin/PROD_ebs122.xml
*******FATAL ERROR*******
PROGRAM : (/apps/applmgr/PROD/fs1/EBSapps/appl/ad/12.0.0/bin/adzdoptl.pl)
TIME    : Sun Jan 19 20:16:46 2020
FUNCTION: ADOP::GlobalVars::_GetMandatoryArgs [ Level 1 ] 
ERRORMSG: Cannot identify any valid application tier nodes in
          ADOP_VALID_NODES table. Ensure AutoConfig has been run on all nodes.
 
 
[STATEMENT] Please run adopscanlog utility, using the command
 
"adopscanlog -latest=yes"
 
to get the list of the log files along with snippet of the error message corresponding to each log file.
 
 
adop exiting with status = 255 (Fail)
[applmgr@ebs122 ~]$
 
 
 
[oracle@ebs122 PROD_ebs122]$ sh adautocfg.sh
Enter the APPS user password:
The log file for this session is located at: /db/oracle/PROD/12.1.0/appsutil/log/PROD_ebs122/01192043/adconfig.log
 
AutoConfig is configuring the Database environment...
 
AutoConfig will consider the custom templates if present.
        Using ORACLE_HOME location : /db/oracle/PROD/12.1.0
        Classpath                   : :/db/oracle/PROD/12.1.0/jdbc/lib/ojdbc6.jar:/db/oracle/PROD/12.1.0/appsutil/java/xmlparserv2.jar:/db/oracle/PROD/12.1.0/appsutil/java:/db/oracle/PROD/12.1.0/jlib/netcfg.jar:/db/oracle/PROD/12.1.0/jlib/ldapjclnt12.jar
 
        Using Context file          : /db/oracle/PROD/12.1.0/appsutil/PROD_ebs122.xml
 
Context Value Management will now update the Context file
 
        Updating Context file...COMPLETED
 
        Attempting upload of Context file and templates to database...ERROR: InDbCtxFile.uploadCtx() : Exception : Error executng BEGIN fnd_gsm_util.upload_context_file(:1,:2,:3,:4,:5); END;: 1; Oracle error -1400: ORA-01400: cannot insert NULL into ("APPLSYS"."FND_OAM_CONTEXT_FILES"."NODE_NAME") has been detected in FND_GSM_UTIL.upload_context_file.
oracle.apps.ad.autoconfig.oam.InDbCtxFileException: Error executng BEGIN fnd_gsm_util.upload_context_file(:1,:2,:3,:4,:5); END;: 1; Oracle error -1400: ORA-01400: cannot insert NULL into ("APPLSYS"."FND_OAM_CONTEXT_FILES"."NODE_NAME") has been detected in FND_GSM_UTIL.upload_context_file.
        at oracle.apps.ad.autoconfig.oam.InDbCtxFile.uploadCtx(InDbCtxFile.java:281)
        at oracle.apps.ad.autoconfig.oam.CtxSynchronizer.uploadToDb(CtxSynchronizer.java:332)
        at oracle.apps.ad.tools.configuration.FileSysDBCtxMerge.updateDBCtx(FileSysDBCtxMerge.java:757)
        at oracle.apps.ad.tools.configuration.FileSysDBCtxMerge.updateDBFiles(FileSysDBCtxMerge.java:228)
        at oracle.apps.ad.context.CtxValueMgt.processCtxFile(CtxValueMgt.java:1721)
        at oracle.apps.ad.context.CtxValueMgt.main(CtxValueMgt.java:787)
FAILED
COMPLETED
 
Updating rdbms version in Context file to db121
Updating rdbms type in Context file to 64 bits
Configuring templates from ORACLE_HOME ...
 
AutoConfig completed with errors.
[oracle@ebs122 PROD_ebs122]$
 
Solution --
 
How to Synchronize the AD tables FND_NODES, ADOP_VALID_NODES, and FND_OAM_CONTEXT_FILES in 12.2 when adop fails. (Doc ID 2064223.1)
 
Note-
Backup the fnd_oam_context_files, fnd_nodes, and adop_valid_nodes tables, and if on AD/TXK 8 or higher; ad_nodes_config_status in the EBS env nodes
 
SQL>  select
  abbreviation
,codelevel
from
  ad_trackable_entities
where
  abbreviation in( 'ad','txk','fnd','fwk','atg_pf','icx' )
order by
  abbreviation;  2    3    4    5    6    7    8    9
 
ABBREVIATI CODELEVEL
---------- ----------
ad         C.10
atg_pf     C
fnd        C
fwk        C
icx        D
txk        C.10
 
6 rows selected.
 
SQL> conn applsys/apps
Connected.
SQL> create table fnd_oam_context_files_bkp as select * from fnd_oam_context_files;
 
Table created.
 
SQL> create table fnd_nodes_bk as select * from fnd_nodes;
 
Table created.
 
SQL> create table adop_valid_nodes_bk as select * from adop_valid_nodes;
 
Table created.
 
SQL>  create table ad_nodes_config_status_bk as select * from ad_nodes_config_status;
 
Table created.
 
SQL> truncate table fnd_oam_context_files;
 
Table truncated.
 
SQL> truncate table fnd_nodes;
 
Table truncated.
 
SQL>  truncate table adop_valid_nodes;
 
Table truncated.
 
SQL>  truncate table ad_nodes_config_status;
 
Table truncated.
 
SQL>
 
 
SQL> exec fnd_conc_clone.setup_clean;
 
PL/SQL procedure successfully completed.
 
SQL> commit;
 
Commit complete.
 
SQL>
 
 Please recreate the synonyms, after crated the synonym it is working fine.
 
[oracle@ebs122 PROD_ebs122]$ sqlplus apps/apps
 
SQL*Plus: Release 12.1.0.2.0 Production on Sun Jan 19 22:01:43 2020
 
Copyright (c) 1982, 2014, Oracle.  All rights reserved.
 
Last Successful login time: Sun Jan 19 2020 21:20:57 +05:30
 
Connected to:
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Partitioning, OLAP, Advanced Analytics and Real Application Testing options
 
SQL> drop synonym apps.fnd_nodes;
 
Synonym dropped.
 
SQL> create synonym apps.fnd_nodes for applsys.fnd_nodes;
 
Synonym created.
 
SQL> drop synonym apps.fnd_oam_context_files;
 
Synonym dropped.
 
SQL> create synonym apps.fnd_oam_context_files for applsys.fnd_oam_context_files;
 
Synonym created.
 
SQL>
 
- run the autoconfig on Database node.
 
[oracle@ebs122 PROD_ebs122]$ sh adautocfg.sh
Enter the APPS user password:
The log file for this session is located at: /db/oracle/PROD/12.1.0/appsutil/log/PROD_ebs122/01192203/adconfig.log
 
AutoConfig is configuring the Database environment...
 
AutoConfig will consider the custom templates if present.
        Using ORACLE_HOME location : /db/oracle/PROD/12.1.0
        Classpath                   : :/db/oracle/PROD/12.1.0/jdbc/lib/ojdbc6.jar:/db/oracle/PROD/12.1.0/appsutil/java/xmlparserv2.jar:/db/oracle/PROD/12.1.0/appsutil/java:/db/oracle/PROD/12.1.0/jlib/netcfg.jar:/db/oracle/PROD/12.1.0/jlib/ldapjclnt12.jar
 
        Using Context file          : /db/oracle/PROD/12.1.0/appsutil/PROD_ebs122.xml
 
Context Value Management will now update the Context file
 
        Updating Context file...COMPLETED
 
        Attempting upload of Context file and templates to database...COMPLETED
 
Updating rdbms version in Context file to db121
Updating rdbms type in Context file to 64 bits
Configuring templates from ORACLE_HOME ...
 
AutoConfig completed successfully.
[oracle@ebs122 PROD_ebs122]$ su - applmgr
Password:
[applmgr@ebs122 ~]$
[applmgr@ebs122 ~]$
 
- Run Autoconfig on the run file system.
[applmgr@ebs122 ~]$
[applmgr@ebs122 ~]$ cd /apps/applmgr/PROD/
[applmgr@ebs122 PROD]$
[applmgr@ebs122 PROD]$
[applmgr@ebs122 PROD]$ ls -tlr
total 20
drwxr-xr-x. 5 applmgr dba 4096 Jan  1 12:31 fs1
drwxr-xr-x. 5 applmgr dba 4096 Jan  1 12:32 fs2
drwxr-xr-x. 4 applmgr dba 4096 Jan  1 18:45 fs_ne
-rw-r--r--. 1 applmgr dba 6471 Jan  7 00:26 EBSapps.env
[applmgr@ebs122 PROD]$
[applmgr@ebs122 PROD]$
[applmgr@ebs122 PROD]$ . EBSapps.env run
 
  E-Business Suite Environment Information
  ----------------------------------------
  RUN File System           : /apps/applmgr/PROD/fs1/EBSapps/appl
  PATCH File System         : /apps/applmgr/PROD/fs2/EBSapps/appl
  Non-Editioned File System : /apps/applmgr/PROD/fs_ne
 
 
  DB Host: ebs122.premier.com  Service/SID: PROD
 
 
  Sourcing the RUN File System ...
 
[applmgr@ebs122 PROD]$
[applmgr@ebs122 PROD]$ cd $ADMIN_SCRIPTS_HOME
[applmgr@ebs122 scripts]$
[applmgr@ebs122 scripts]$ sh adautocfg.sh
Enter the APPS user password:
 
The log file for this session is located at: /apps/applmgr/PROD/fs1/inst/apps/PROD_ebs122/admin/log/01192205/adconfig.log
 
AutoConfig is configuring the Applications environment...
 
AutoConfig will consider the custom templates if present.
        Using CONFIG_HOME location     : /apps/applmgr/PROD/fs1/inst/apps/PROD_ebs122
        Classpath                   : /apps/applmgr/PROD/fs1/FMW_Home/Oracle_EBS-app1/shared-libs/ebs-appsborg/WEB-INF/lib/ebsAppsborgManifest.jar:/apps/applmgr/PROD/fs1/EBSapps/comn/java/classes
 
        Using Context file          : /apps/applmgr/PROD/fs1/inst/apps/PROD_ebs122/appl/admin/PROD_ebs122.xml
 
Context Value Management will now update the Context file
 
        Updating Context file...COMPLETED
 
        Attempting upload of Context file and templates to database...COMPLETED
 
Configuring templates from all of the product tops...
        Configuring AD_TOP........COMPLETED
        Configuring FND_TOP.......COMPLETED
        Configuring ICX_TOP.......COMPLETED
        Configuring MSC_TOP.......COMPLETED
        Configuring IEO_TOP.......COMPLETED
        Configuring BIS_TOP.......COMPLETED
        Configuring CZ_TOP........COMPLETED
        Configuring SHT_TOP.......COMPLETED
        Configuring AMS_TOP.......COMPLETED
        Configuring CCT_TOP.......COMPLETED
        Configuring WSH_TOP.......COMPLETED
        Configuring CLN_TOP.......COMPLETED
        Configuring OKE_TOP.......COMPLETED
        Configuring OKL_TOP.......COMPLETED
        Configuring OKS_TOP.......COMPLETED
        Configuring CSF_TOP.......COMPLETED
        Configuring IBY_TOP.......COMPLETED
        Configuring JTF_TOP.......COMPLETED
        Configuring MWA_TOP.......COMPLETED
        Configuring CN_TOP........COMPLETED
        Configuring CSI_TOP.......COMPLETED
        Configuring WIP_TOP.......COMPLETED
        Configuring CSE_TOP.......COMPLETED
        Configuring EAM_TOP.......COMPLETED
        Configuring GMF_TOP.......COMPLETED
        Configuring PON_TOP.......COMPLETED
        Configuring FTE_TOP.......COMPLETED
        Configuring ONT_TOP.......COMPLETED
        Configuring AR_TOP........COMPLETED
        Configuring AHL_TOP.......COMPLETED
        Configuring IES_TOP.......COMPLETED
        Configuring OZF_TOP.......COMPLETED
        Configuring CSD_TOP.......COMPLETED
        Configuring IGC_TOP.......COMPLETED
 
AutoConfig completed successfully.
[applmgr@ebs122 scripts]$ 
 
 
 
 
Disable the ebs_login trigger using the following SQL.
 
[applmgr@ebs122 scripts]$ sqlplus system/manager
 
SQL*Plus: Release 10.1.0.5.0 - Production on Sun Jan 19 22:28:28 2020
 
Copyright (c) 1982, 2005, Oracle.  All rights reserved.
 
 
Connected to:
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Partitioning, OLAP, Advanced Analytics and Real Application Testing options
 
SQL> 
 
 
SQL>alter trigger ebs_logon disable;
 
Trigger altered.
 
SQL> exit
Disconnected from Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Partitioning, OLAP, Advanced Analytics and Real Application Testing options
[applmgr@ebs122 scripts]$
[applmgr@ebs122 scripts]$
[applmgr@ebs122 scripts]$ cd -
/apps/applmgr/PROD
[applmgr@ebs122 PROD]$
 
Run Autoconfig on the patch file system
 
[applmgr@ebs122 PROD]$
[applmgr@ebs122 PROD]$ ls -tlr
total 20
drwxr-xr-x. 5 applmgr dba 4096 Jan  1 12:31 fs1
drwxr-xr-x. 5 applmgr dba 4096 Jan  1 12:32 fs2
drwxr-xr-x. 4 applmgr dba 4096 Jan  1 18:45 fs_ne
-rw-r--r--. 1 applmgr dba 6471 Jan 19 22:08 EBSapps.env
[applmgr@ebs122 PROD]$
[applmgr@ebs122 PROD]$
[applmgr@ebs122 PROD]$ . EBSapps.env patch
 
  E-Business Suite Environment Information
  ----------------------------------------
  RUN File System           : /apps/applmgr/PROD/fs1/EBSapps/appl
  PATCH File System         : /apps/applmgr/PROD/fs2/EBSapps/appl
  Non-Editioned File System : /apps/applmgr/PROD/fs_ne
 
 
  DB Host: ebs122.premier.com  Service/SID: PROD
 
 
  Sourcing the PATCH File System ...
 
[applmgr@ebs122 PROD]$ cd $ADMIN_SCRIPTS_HOME
[applmgr@ebs122 scripts]$
[applmgr@ebs122 scripts]$ sh adautocfg.sh
Enter the APPS user password:
 
The log file for this session is located at: /apps/applmgr/PROD/fs2/inst/apps/PROD_ebs122/admin/log/01192229/adconfig.log
 
AutoConfig is configuring the Applications environment...
 
AutoConfig will consider the custom templates if present.
        Using CONFIG_HOME location     : /apps/applmgr/PROD/fs2/inst/apps/PROD_ebs122
        Classpath                   : /apps/applmgr/PROD/fs2/FMW_Home/Oracle_EBS-app1/shared-libs/ebs-appsborg/WEB-INF/lib/ebsAppsborgManifest.jar:/apps/applmgr/PROD/fs2/EBSapps/comn/java/classes
 
        Using Context file          : /apps/applmgr/PROD/fs2/inst/apps/PROD_ebs122/appl/admin/PROD_ebs122.xml
 
Context Value Management will now update the Context file
 
        Updating Context file...COMPLETED
 
        Attempting upload of Context file and templates to database...COMPLETED
 
Configuring templates from all of the product tops...
        Configuring AD_TOP........COMPLETED
        Configuring FND_TOP.......COMPLETED
        Configuring ICX_TOP.......COMPLETED
        Configuring MSC_TOP.......COMPLETED
        Configuring IEO_TOP.......COMPLETED
        Configuring BIS_TOP.......COMPLETED
        Configuring CZ_TOP........COMPLETED
        Configuring AMS_TOP.......COMPLETED
        Configuring CCT_TOP.......COMPLETED
        Configuring WSH_TOP.......COMPLETED
        Configuring CLN_TOP.......COMPLETED
        Configuring OKE_TOP.......COMPLETED
        Configuring OKL_TOP.......COMPLETED
        Configuring OKS_TOP.......COMPLETED
        Configuring CSF_TOP.......COMPLETED
        Configuring IBY_TOP.......COMPLETED
        Configuring JTF_TOP.......COMPLETED
        Configuring MWA_TOP.......COMPLETED
        Configuring CN_TOP........COMPLETED
        Configuring CSI_TOP.......COMPLETED
        Configuring WIP_TOP.......COMPLETED
        Configuring CSE_TOP.......COMPLETED
        Configuring EAM_TOP.......COMPLETED
        Configuring FTE_TOP.......COMPLETED
        Configuring ONT_TOP.......COMPLETED
        Configuring AR_TOP........COMPLETED
        Configuring AHL_TOP.......COMPLETED
        Configuring IES_TOP.......COMPLETED
        Configuring OZF_TOP.......COMPLETED
        Configuring CSD_TOP.......COMPLETED
        Configuring IGC_TOP.......COMPLETED
 
AutoConfig completed successfully.
[applmgr@ebs122 scripts]$ sqlplus system/manager
 
SQL*Plus: Release 10.1.0.5.0 - Production on Sun Jan 19 22:37:44 2020
 
Copyright (c) 1982, 2005, Oracle.  All rights reserved.
 
 
Connected to:
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Partitioning, OLAP, Advanced Analytics and Real Application Testing options
 
SQL> 
Enable the ebs_login trigger using the following SQL.
 
sql>alter trigger ebs_logon enable;
 
Trigger altered.
 
SQL>
 
Change the worker status to restart using adcrtl utility
 
        Control
Worker  Code      Context            Filename                    Status
------  --------  -----------------  --------------------------  --------------
     1  Run       AutoPatch R120     fnd_mbl_application.xdf     Running       
     2  Run       AutoPatch R120     wf_item_attribute_values_n  Running       
     3  Run       AutoPatch R120                                 Wait          
     4  Run       AutoPatch R120     xlatabh.odf                 Running       
     5  Run       AutoPatch R120                                 Wait          
     6  Run       AutoPatch R120                                 Wait          
     7  Run       AutoPatch R120                                 Wait          
     8  Run       AutoPatch R120                                 Wait          
 
Review the messages above, then press [Return] to continue.
 
 
- Now the patch is working fine..
 
[applmgr@ebs122 ~]$ adop phase=apply apply_mode=downtime patches=24690690 patchtop=/apps/upg1227 workers=8 abandon=no restart=yes
 
Enter the APPS password:
Enter the SYSTEM password:
Enter the WLSADMIN password:
 
Validating credentials.
 
Initializing.
    Run Edition context  : /apps/applmgr/PROD/fs1/inst/apps/PROD_ebs122/appl/admin/PROD_ebs122.xml
    Patch edition context: /apps/applmgr/PROD/fs2/inst/apps/PROD_ebs122/appl/admin/PROD_ebs122.xml
    Patch file system free space: 75.54 GB
 
Validating system setup.
    Node registry is valid.
    [WARNING]   MTCC has not been run. Apply Patch 17537119 and run checkMTpatch.sh.
 
Checking for existing adop sessions.
    Session Id            :   2
    Prepare phase status  :   NOT APPLICABLE
    Apply phase status    :   ATLEAST ONE PATCH IS ALREADY APPLIED
    Cutover  phase status :   NOT APPLICABLE
    Abort phase status    :   NOT APPLICABLE
    Session status        :   RUNNING
    Continuing with existing session [Session ID: 2].
 
===========================================================================
ADOP (C.Delta.10)
Session ID: 2
Node: ebs122
Phase: apply
Log: /apps/applmgr/PROD/fs_ne/EBSapps/log/adop/2/20200119_223926/adop.log
===========================================================================
 
Applying patch 24690690.
    Log: /apps/applmgr/PROD/fs_ne/EBSapps/log/adop/2/20200119_223926/apply/ebs122/24690690/log/u24690690.log