1 2 Previous Next 20 Replies Latest reply on May 24, 2020 11:34 AM by Beauty_and_dBest

    Adop phase=prepare  failed?

    Beauty_and_dBest

      12.2.4

      11gR2

      OL6

       

       

      Hi ALL,

       

      I am running  adop phase=prepare , but it failed with logs below

       

       

      But if I run adop -status,   the prepare phase is still not started? 

       

      [apptest@dbserver ~]$ adop -status

      Enter the APPS password:

      Current Patching Session ID: 29

      Node Name       Node Type       Phase           Status          Started                        Finished                       Elapsed

      --------------- --------------- --------------- --------------- ------------------------------ ------------------------------ ------------

      dbserver        master          PREPARE         NOT STARTED

                                      APPLY           NOT STARTED

                                      FINALIZE        NOT STARTED

                                      CUTOVER         NOT STARTED

                                      CLEANUP         NOT STARTED

       

      File System Synchronization Used in this Patching Cycle: None

      For more information, run ADOP Status Report by using -detail option

      Generating ADOP Status Report at location: /mnt/db3/apptest/TEST/fs_ne/EBSapps/log/status_20200523_210237/adzdshowstatus.out

      Please wait...

      Done...!

      adop exiting with status = 0 (Success)

      [apptest@dbserver ~]$

       

       

      Please help how to troubleshoot error.

       

      Kind regards,

      Jc

       

       

        • 1. Re: Adop phase=prepare  failed?
          Arsalan Dehghanisariyarghan

          Hi JC

           

          The log file shows, phase=prepare failed on txkADOPValidate.pl, so it is maybe the t2pjdk directory is not created completely.

          Please first refer to FSCloneStageAppsTier_<time stamp>.log file to get the t2pjdk directory path.

           

          Following content might be found:

           

          Creating t2pjdk directory

          Directory $COMMON_TOP/<hostname>/FMW/t2pjdk already exists.

           

          -----> So the t2pjdk directory path is $COMMON_TOP/<hostname>/FMW/t2pjdk

           

          Then,

           

          ------> Move the *t2pjdk directory*  to a temp location

          For example:

           

          mkdir    /tmp/t2pjdk_backup

          mv    $COMMON_TOP/<hostname>/FMW/t2pjdk     /tmp/t2pjdk_backup/FMW/t2pjdk

           

          In the end:

           

          ------>. Rerun "adop phase=prepare".

           

           

           

           

          HTH

          Arsalan

          1 person found this helpful
          • 2. Re: Adop phase=prepare  failed?
            Beauty_and_dBest

            Thanks Arsalan,

             

            I thought you only specialize in core database

             

            I also see error log like below:

             

            But both context_file in fs1 and fs2 are existing  and not missing.

             

             

            Kind regards,

            • 3. Re: Adop phase=prepare  failed?
              Arsalan Dehghanisariyarghan

              Thanks, JC

               

              I also work as an Oracle App DBA.

               

              Regards

              • 4. Re: Adop phase=prepare  failed?
                Beauty_and_dBest

                Hi Arsalan and ALL,

                 

                I still encounter error , even I move the t2pjdk  directory

                 

                Please help...

                 

                Kind regards,

                • 5. Re: Adop phase=prepare  failed?
                  Arsalan Dehghanisariyarghan

                  Hi,

                   

                  Possible the cause of the issue is ContentsXML in inventory doesn't have adequate permission.

                  ------> Please check the ValidationResults.log file.

                   

                  Do you see anything like the following message in the contents of the file?

                   

                  -------> ERROR: Either /dir=<DIR>/dir=<DIR>/oraInventory/ContentsXML/inventory.xml file doesn't exist or doesn't have READ permission.

                   

                   

                  HTH

                  Arsalan

                   

                   

                   

                  1 person found this helpful
                  • 6. Re: Adop phase=prepare  failed?
                    Beauty_and_dBest

                    Hi Arsalan and ALL,

                     

                    I do not have permission Error, and inventory exist and all folder path location is in the inventory.

                     

                     

                    Regards,

                    • 7. Re: Adop phase=prepare  failed?
                      Beauty_and_dBest

                      Hi Arsalan,

                       

                      I already check it , I always chmod it to 777.

                       

                      I am sure my error is not on permission, because I already encountered it before I am making the inventory is always writable.

                       

                      My error log does not show any hint?

                       

                      Kind regards,

                      • 8. Re: Adop phase=prepare  failed?
                        Arsalan Dehghanisariyarghan

                        Can I see the contents of this log file?

                         

                        ----->>  /mnt/db3/apptest/TEST/fs_ne/EBSapps/log/adop/29/adop_20200523_234111.log

                         

                         

                        Regards

                        1 person found this helpful
                        • 9. Re: Adop phase=prepare  failed?
                          Beauty_and_dBest

                          Thanks Arsalan,

                           

                          How do I attached logfile here in forum?

                           

                          [apptest@dbserver ~]$ cat /mnt/db3/apptest/TEST/fs_ne/EBSapps/log/adop/29/adop_20200523_234111.log

                              Log file: /mnt/db3/apptest/TEST/fs_ne/EBSapps/log/adop/29/adop_20200523_234111.log

                          [START 2020/05/23 23:41:12]Arguments passed to adop

                              phase=prepare

                          [END   2020/05/23 23:41:12]Arguments passed to adop

                          [START 2020/05/23 23:41:12] Performing verification of parameters

                          [END   2020/05/23 23:41:45] Performing verification of parameters

                          [STATEMENT] Sourcing the Run Edition environment: /mnt/db3/apptest/TEST/fs2/EBSapps/appl/APPSTEST_dbserver.env

                          [EVENT]     [START 2020/05/23 23:41:47] Checking for the required ENV setup

                          [EVENT]     [END   2020/05/23 23:41:47] Checking for the required ENV setup

                          [STATEMENT]  Using 4 workers (Default: 4, Recommended maximum limit: 37)

                          [PROCEDURE] [START 2020/05/23 23:41:48] Determining admin node

                            [STATEMENT] Admin node : "dbserverappserver"

                          [PROCEDURE] [END   2020/05/23 23:41:48] Determining admin node

                          Validation successful. All expected nodes are listed in ADOP_VALID_NODES table.

                          [EVENT]     [START 2020/05/23 23:41:49] Performing database sanity checks

                          [EVENT]     [END   2020/05/23 23:41:52] Finished performing database sanity checks

                          [PROCEDURE] [START 2020/05/23 23:41:52] Acquiring lock on sessions table

                            [STATEMENT] Locking ad_adop_sessions table for dbserver with wait interval of 60 seconds and number of tries 2

                          [PROCEDURE] [END   2020/05/23 23:41:53] Acquiring lock on sessions table

                          [EVENT]     [START 2020/05/23 23:41:53] Checking for any pending sessions

                            [PROCEDURE] [START 2020/05/23 23:41:54] Checking active hotpatch session

                              [STATEMENT] Fetching number of incomplete cycles for dbserver having appltop_id=197.

                              [STATEMENT] value of incomplete_session: "0"

                            [PROCEDURE] [END   2020/05/23 23:41:54] Checking active hotpatch session

                            [STATEMENT] Master Session Id: "29"

                            [STATEMENT] Master Node: "dbserver"

                            [STATEMENT] Check if adop cycle for dbserver is incomplete at session_id 29

                            [STATEMENT] SQL output: "1"

                            There is already a session which is incomplete. Details are:

                            [STATEMENT] Fetching row information of incomplete and failed session for session_id : 29

                            [STATEMENT] output: "29,N,N,N,N,F"

                                  Session Id            :   29

                                  Prepare phase status  :   NOT COMPLETED

                                  Apply phase status    :   NOT COMPLETED

                                  Cutover  phase status :   NOT COMPLETED

                                  Abort phase status    :   NOT COMPLETED

                                  Session status        :   FAILED

                            Will continue with previous session

                            [PROCEDURE] [START 2020/05/23 23:41:54] Performing steps to get the previous session inputs

                              [STATEMENT] Key: "admin_node"       Value: "dbserverappserver"

                              [STATEMENT] Key: "phase_hash"       Value: "HASH(0x1aa4d50)"

                              [STATEMENT] Key: "initial_cutover_status"   Value: "N"

                              [STATEMENT] Key: "abortmode"        Value: "0"

                              [STATEMENT] Key: "LOG_LEVEL_VALUES" Value: "HASH(0x229cea0)"

                              [STATEMENT] Key: "num_tries"        Value: "2"

                              [STATEMENT] Key: "workers"  Value: "4"

                              [STATEMENT] Key: "max_workers"      Value: "37"

                              [STATEMENT] Key: "phase_seq_hash"   Value: "HASH(0x1aa4dc8)"

                              [STATEMENT] Key: "run_admin_status" Value: "1"

                              [STATEMENT] Key: "logidentmode"     Value: "SUBROUTINE"

                              [STATEMENT] Key: "LOG_LEVEL"        Value: "HASH(0x229ccc0)"

                              [STATEMENT] Key: "hotpatch" Value: "0"

                              [STATEMENT] Key: "logfile"  Value: "adop_20200523_234111.log"

                              [STATEMENT] Key: "appltop_type"     Value: "dual"

                              [STATEMENT] Key: "prompt"   Value: "1"

                              [STATEMENT] Key: "allnodes" Value: "1"

                              [STATEMENT] Key: "patchcontextfile" Value: "/mnt/db3/apptest/TEST/fs1/inst/apps/TEST_dbserver/appl/admin/TEST_dbserver.xml"

                              [STATEMENT] Key: "downtime" Value: "0"

                              [STATEMENT] Key: "session_id"       Value: "29"

                              [STATEMENT] Key: "recom_workers"    Value: "4"

                              [STATEMENT] Key: "skipsyncerror"    Value: "No"

                              [STATEMENT] Key: "lock_wait_interval"       Value: "60"

                              [STATEMENT] Key: "interim_cutover_desc"     Value: "ARRAY(0x1aa4cc0)"

                              [STATEMENT] Key: "loglevel" Value: "event"

                              [STATEMENT] Key: "patchtop" Value: "/mnt/db3/apptest/TEST/fs_ne/EBSapps/patch"

                              [STATEMENT] Key: "merge"    Value: "no"

                              [STATEMENT] Key: "phase"    Value: "prepare"

                              [STATEMENT] Key: "adpatch_interactive"      Value: "yes"

                              [STATEMENT] Key: "fileloglevel"     Value: "disable"

                              [STATEMENT] Key: "allowcoredump"    Value: "No"

                              [STATEMENT] Key: "super_node"       Value: "HASH(0x1aa4ed0)"

                              [STATEMENT] Key: "multi_node"       Value: "0"

                              [STATEMENT] Key: "diskspace"        Value: "10"

                              [STATEMENT] Key: "dbloglevel"       Value: "disable"

                              [STATEMENT] Key: "mtrestart"        Value: "1"

                              [STATEMENT] Key: "is_master"        Value: "1"

                              [STATEMENT] Key: "analytics"        Value: "0"

                              [STATEMENT] Key: "force"    Value: "0"

                              [STATEMENT] Key: "nodbaction"       Value: "0"

                              [STATEMENT] Key: "appsusername"     Value: "APPS"

                              [STATEMENT] Key: "runcontextfile"   Value: "/mnt/db3/apptest/TEST/fs2/inst/apps/TEST_dbserver/appl/admin/TEST_dbserver.xml"

                            [PROCEDURE] [END   2020/05/23 23:41:56] Performing steps to get the previous session inputs

                            [PROCEDURE] [START 2020/05/23 23:41:56] Unlocking sessions table

                              [STATEMENT] Unlocking ad_adop_sessions table for dbserver with wait interval of 60 seconds and number of tries 2

                            [PROCEDURE] [END   2020/05/23 23:41:56] Unlocking sessions table

                            [START 2020/05/23 23:41:56] adzdoptl.pl run

                              ADOP Session ID: 29

                              Phase: prepare

                              [STATEMENT] Inside createPatchCtxFile()...

                              [STATEMENT] PATCH context file exists

                              [STATEMENT] SQL statement: "  select count(1)

                            from  ad_adop_sessions

                            where  adop_session_id=29 and (prepare_status in ('N','R')) and node_name='dbserver'

                          "

                              [STATEMENT] SQL Output: "1".

                              [EVENT]     [START 2020/05/23 23:41:59] Calling task: "Executing txkADOPValidation script on dbserver"; script: "/mnt/db3/apptest/TEST/fs2/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPValidations.pl"; args: " -contextfile=/mnt/db3/apptest/TEST/fs2/inst/apps/TEST_dbserver/appl/admin/TEST_dbserver.xml -patchctxfile=/mnt/db3/apptest/TEST/fs1/inst/apps/TEST_dbserver/appl/admin/TEST_dbserver.xml -phase=prepare -logloc=/mnt/db3/apptest/TEST/fs_ne/EBSapps/log/adop/29/prepare_20200523_234111/TEST_dbserver -promptmsg=hide"

                                [EVENT]     [START 2020/05/23 23:41:59] Executing txkADOPValidation script on dbserver

                                  [EVENT]     Calling: /mnt/db3/apptest/TEST/fs2/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPValidations.pl

                                  [STATEMENT] Output directory: /mnt/db3/apptest/TEST/fs_ne/EBSapps/log/adop/29/prepare_20200523_234111/TEST_dbserver

                                  [UNEXPECTED]Error occurred while executing "perl /mnt/db3/apptest/TEST/fs2/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPValidations.pl  -contextfile=/mnt/db3/apptest/TEST/fs2/inst/apps/TEST_dbserver/appl/admin/TEST_dbserver.xml -patchctxfile=/mnt/db3/apptest/TEST/fs1/inst/apps/TEST_dbserver/appl/admin/TEST_dbserver.xml -phase=prepare -logloc=/mnt/db3/apptest/TEST/fs_ne/EBSapps/log/adop/29/prepare_20200523_234111/TEST_dbserver -promptmsg=hide"

                                  [UNEXPECTED]Error 1 occurred while Executing txkADOPValidation script on dbserver

                                  [PROCEDURE] [START 2020/05/23 23:42:41] Unlocking sessions table

                                    [STATEMENT] Unlocking ad_adop_sessions table for dbserver with wait interval of 60 seconds and number of tries 2

                                  [PROCEDURE] [END   2020/05/23 23:42:41] Unlocking sessions table

                                  [STATEMENT] SQL statement : "  update ad_adop_sessions

                            set status='F'

                             where adop_session_id = 29 and appltop_id = 197 and node_name='dbserver'

                          "

                                  Log file: /mnt/db3/apptest/TEST/fs_ne/EBSapps/log/adop/29/adop_20200523_234111.log

                           

                           

                           

                          Kind regards,

                          • 10. Re: Adop phase=prepare  failed?
                            Arsalan Dehghanisariyarghan

                            Hi

                             

                            Please execute the following steps and then announce the result:

                             

                            1--->  adop phase=abort

                            2--->  adop phase=cleanup cleanup_mode=full

                            3--->  adop phase=fs_clone

                            4--->  Now re-try the prepare phase.

                             

                             

                            HTH

                            Arsalan

                            1 person found this helpful
                            • 11. Re: Adop phase=prepare  failed?
                              Beauty_and_dBest

                              Ok thanks,  but can you check hint of errors below:

                               

                              $ adopscanlog -latest=yes

                               

                              Scanning /mnt/db3/apptest/TEST/fs_ne/EBSapps/log/adop/29/ directory ...

                               

                              /mnt/db3/apptest/TEST/fs_ne/EBSapps/log/adop/29/adop_20200523_234111.log:

                              -------------------------------------------------------------------------

                               

                              Lines #(102-106):

                                      [EVENT]     Calling: /mnt/db3/apptest/TEST/fs2/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPValidations.pl

                                      [STATEMENT] Output directory: /mnt/db3/apptest/TEST/fs_ne/EBSapps/log/adop/29/prepare_20200523_234111/TEST_dbserver

                                      [UNEXPECTED]Error occurred while executing "perl /mnt/db3/apptest/TEST/fs2/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPValidations.pl  -contextfile=/mnt/db3/apptest/TEST/fs2/inst/apps/TEST_dbserver/appl/admin/TEST_dbserver.xml -patchctxfile=/mnt/db3/apptest/TEST/fs1/inst/apps/TEST_dbserver/appl/admin/TEST_dbserver.xml -phase=prepare -logloc=/mnt/db3/apptest/TEST/fs_ne/EBSapps/log/adop/29/prepare_20200523_234111/TEST_dbserver -promptmsg=hide"

                                      [UNEXPECTED]Error 1 occurred while Executing txkADOPValidation script on dbserver

                                      [PROCEDURE] [START 2020/05/23 23:42:41] Unlocking sessions table

                               

                              Lines #(103-107):

                                      [STATEMENT] Output directory: /mnt/db3/apptest/TEST/fs_ne/EBSapps/log/adop/29/prepare_20200523_234111/TEST_dbserver

                                      [UNEXPECTED]Error occurred while executing "perl /mnt/db3/apptest/TEST/fs2/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPValidations.pl  -contextfile=/mnt/db3/apptest/TEST/fs2/inst/apps/TEST_dbserver/appl/admin/TEST_dbserver.xml -patchctxfile=/mnt/db3/apptest/TEST/fs1/inst/apps/TEST_dbserver/appl/admin/TEST_dbserver.xml -phase=prepare -logloc=/mnt/db3/apptest/TEST/fs_ne/EBSapps/log/adop/29/prepare_20200523_234111/TEST_dbserver -promptmsg=hide"

                                      [UNEXPECTED]Error 1 occurred while Executing txkADOPValidation script on dbserver

                                      [PROCEDURE] [START 2020/05/23 23:42:41] Unlocking sessions table

                                        [STATEMENT] Unlocking ad_adop_sessions table for dbserver with wait interval of 60 seconds and number of tries 2

                               

                              /mnt/db3/apptest/TEST/fs_ne/EBSapps/log/adop/29/prepare_20200523_234111/TEST_dbserver/ADOPValidations_Sat_May_23_23_42_09_2020.log:

                              -----------------------------------------------------------------------------------------------------------------------------------

                               

                              Lines #(85-89):

                              ==================================

                               

                              ERROR:

                              Nodes with context files in the FND_OAM_CONTEXT_FILES table on both run and patch file systems: dbserver

                              Nodes without context files in the FND_OAM_CONTEXT_FILES table on either/or run and patch file systems: appserver

                              [apptest@dbserver ~]$

                               

                               

                              Kind regards,

                              • 12. Re: Adop phase=prepare  failed?
                                Beauty_and_dBest

                                Hi Arsalan and ALL,

                                 

                                I resolved my issue using below steps.

                                 

                                *** Clean up Nodes, Run autocondig on Db,Apps,  Bounce EBS. ***

                                 

                                login as apps:

                                sql>  exec fnd_conc_clone.setup_clean ;

                                commit;

                                 

                                login as applsys:

                                    truncate table applsys.fnd_oam_context_files;

                                    truncate table applsys.fnd_nodes;

                                    truncate table applsys.adop_valid_nodes;

                                 

                                Run autoconfig on db.

                                Run autoconfig on apps run edition.

                                login system/manager

                                        alter trigger ebs_logon disable;'

                                Run autoconfig on apps patch edition

                                       alter trigger ebs_logon enable;

                                 

                                Bounce EBS:

                                Stop apps, db

                                Start db/apps

                                 

                                *** end ***

                                 

                                 

                                Kind regards,

                                • 13. Re: Adop phase=prepare  failed?
                                  Arsalan Dehghanisariyarghan

                                  Hi Beauty

                                   

                                  Thanks for sharing the contents of the log file. I have read the log file several times and I guess you need to abort the patching cycle and run a full cleanup and in the end, re-try prepare phase.

                                   

                                  HTH

                                  Arsalan

                                  • 14. Re: Adop phase=prepare  failed?
                                    Arsalan Dehghanisariyarghan

                                    That is good news. Good Luck!

                                     

                                    Regards

                                    1 2 Previous Next