9 Replies Latest reply on Oct 14, 2016 3:35 PM by jimd1673

    Error applying R12.AD.C.Delta.8 (21841299)

    jimd1673

      While trying to apply patch R12.AD.C.Delta.8, along with critical patch 24578455  The adop apply phase is failing with the following error.

       

      Time is: Tue Sep 27 2016 09:23:24

       

      Assigned: file AD_ZD_TABLE_APPLY.sql on worker  8 for product ad  username APPLSYS.

       

      Time is: Tue Sep 27 2016 09:23:24

      ORA-04068: existing state of packages has been discarded

      ORA-04061: existing state of package body "APPS.AD_FILE_UTIL" has been invalidated

      ORA-04065: not executed, altered or dropped package body "APPS.AD_FILE_UTIL"

      ORA-06508: PL/SQL: could not find program unit being called: "APPS.AD_FILE_UTIL"

      ORA-06512: at line 1

       

      AutoPatch error:

      Error while executing statement (Begin  AD_FILE_UTIL.Lock_And_Empty_Temp_Table (' APPLSYS '); End;)

       

      adphistUpdateCheckFileReposForCET: Error calling aiuoraRunStmt(lock_sql).

       

      Prior to applying the patch I did run the latest adgrants and verified there were no invalid ad objects.

      Any ideas would be helpful.  Our current system is 12.2.5 AD.Delta.7

        • 1. Re: Error applying R12.AD.C.Delta.8 (21841299)
          jimd1673

          The ad_file_util package is valid:

           

          select OWNER, OBJECT_NAME, STATUS from dba_objects where object_name = 'AD_FILE_UTIL

           

          OWNER                OBJECT_NAME                    STATUS

          -------------------- ------------------------------ -------

          APPS                AD_FILE_UTIL                  VALID

          APPS                AD_FILE_UTIL                  VALID

          • 2. Re: Error applying R12.AD.C.Delta.8 (21841299)
            jimd1673

            Output of adopscanlog

             

            $ adopscanlog -latest=yes

            Scanning /u01/ebsdevf/apps_st/fs_ne/EBSapps/log/adop/7/ directory ...

             

            /u01/ebsdevf/apps_st/fs_ne/EBSapps/log/adop/7/adop_20160927_091228.log:

            -----------------------------------------------------------------------

             

            Lines #(138-142):

                [EVENT]     Log: /u01/ebsdevf/apps_st/fs_ne/EBSapps/log/adop/7/apply_20160927_091228/ebsdevf_dmspebsapp1/ADOP_MRG_20160927_1474985585/log/u_ad_3029192231.log

                [PROCEDURE] Running: adpatch  workers=8 wait_on_failed_job=yes flags=autoskip      console=no interactive=no  defaultsfile=/u01/ebsdevf/apps_st/fs1/EBSapps/appl/admin/ebsdevf_patch/adalldefaults.txt patchtop=/u01/ebsdevf/apps_st/fs2/EBSapps/appl/admin/ebsdevf/log/ADOP_MRG_20160927_1474985585 driver=u_ad_3029192231.drv logfile=u_ad_3029192231.log acp=yes

                [UNEXPECTED]Error occurred executing "adpatch  workers=8 wait_on_failed_job=yes flags=autoskip      console=no interactive=no  defaultsfile=/u01/ebsdevf/apps_st/fs1/EBSapps/appl/admin/ebsdevf_patch/adalldefaults.txt patchtop=/u01/ebsdevf/apps_st/fs2/EBSapps/appl/admin/ebsdevf/log/ADOP_MRG_20160927_1474985585 driver=u_ad_3029192231.drv logfile=u_ad_3029192231.log"

                [UNEXPECTED]Refer to the log files for more information.

                [STATEMENT] sql stmt : <     update ad_adop_session_patches set  status='F'

             

            Lines #(139-143):

                [PROCEDURE] Running: adpatch  workers=8 wait_on_failed_job=yes flags=autoskip      console=no interactive=no  defaultsfile=/u01/ebsdevf/apps_st/fs1/EBSapps/appl/admin/ebsdevf_patch/adalldefaults.txt patchtop=/u01/ebsdevf/apps_st/fs2/EBSapps/appl/admin/ebsdevf/log/ADOP_MRG_20160927_1474985585 driver=u_ad_3029192231.drv logfile=u_ad_3029192231.log acp=yes

                [UNEXPECTED]Error occurred executing "adpatch  workers=8 wait_on_failed_job=yes flags=autoskip      console=no interactive=no  defaultsfile=/u01/ebsdevf/apps_st/fs1/EBSapps/appl/admin/ebsdevf_patch/adalldefaults.txt patchtop=/u01/ebsdevf/apps_st/fs2/EBSapps/appl/admin/ebsdevf/log/ADOP_MRG_20160927_1474985585 driver=u_ad_3029192231.drv logfile=u_ad_3029192231.log"

                [UNEXPECTED]Refer to the log files for more information.

                [STATEMENT] sql stmt : <     update ad_adop_session_patches set  status='F'

                 where adop_session_id=7

             

            Lines #(145-149):

            >

             

                [UNEXPECTED]Apply phase has failed.

                [PROCEDURE] [START 2016/09/27 09:23:34] Updating adop session status

                [STATEMENT] SQL statement : "  update ad_adop_sessions

             

            /u01/ebsdevf/apps_st/fs_ne/EBSapps/log/adop/7/apply_20160927_091228/ebsdevf_dmspebsapp1/ADOP_MRG_20160927_1474985585/log/u_ad_3029192231.log:

            ---------------------------------------------------------------------------------------------------------------------------------------------

             

            Lines #(5974-5978):

            ORA-06512: at line 1

             

            AutoPatch error:

            Error while executing statement (Begin  AD_FILE_UTIL.Lock_And_Empty_Temp_Table (' APPLSYS '); End;)

             

            Lines #(5988-5992):

            Connecting to APPS......Connected successfully.

             

            AutoPatch error:

             

            Error running SQL and EXEC commands in parallel

            • 3. Re: Error applying R12.AD.C.Delta.8 (21841299)
              RameshPatel

              Please do the following:

              Run catproc from as sysdba on database

              Run adgrants.sql as sysdba on database

              Run sqlplus apps/apps @$AD_TOP/patch/115/sql/adfiluts.pls
              Run sqlplus apps/apps @$AD_TOP/patch/115/sql/adfilutb.pls

               

              reapply the patch.

              • 4. Re: Error applying R12.AD.C.Delta.8 (21841299)
                jimd1673

                Should I start the adop session with restart=yes or abandon the patch and start over.

                • 5. Re: Error applying R12.AD.C.Delta.8 (21841299)
                  jimd1673

                  I completed all the steps you suggested and restarted the patch using abandon=no, restart=yes but it failed almost immediately.

                   

                  AutoPatch error:

                  Error while inserting row in AD_TIMESTAMPS

                   

                  AutoPatch error:

                  ORA-01400: cannot insert NULL into ("APPLSYS"."AD_TIMESTAMPS"."ATTRIBUTE")

                   

                  You should check the file

                  /u01/ebsdevf/apps_st/fs_ne/EBSapps/log/adop/7/apply_20160927_113254/ebsdevf_dmspebsapp1/ADOP_MRG_20160927_1474985585/log/u_ad_3029192231.log

                   

                  for errors.

                   

                      [UNEXPECTED]Error occurred executing "adpatch  abandon=no restart=yes workers=8 wait_on_failed_job=yes flags=autoskip      console=no interactive=no  defaultsfile=/u01/ebsdevf/apps_st/fs1/EBSapps/appl/admin/ebsdevf_patch/adalldefaults.txt patchtop=/u01/ebsdevf/apps_st/fs2/EBSapps/appl/admin/ebsdevf/log/ADOP_MRG_20160927_1474985585 driver=u_ad_3029192231.drv logfile=u_ad_3029192231.log"

                      [UNEXPECTED]Refer to the log files for more information.

                      [UNEXPECTED]Apply phase has failed.

                   

                  $ adopscanlog -latest=yes

                   

                  Scanning /u01/ebsdevf/apps_st/fs_ne/EBSapps/log/adop/7/ directory ...

                   

                  /u01/ebsdevf/apps_st/fs_ne/EBSapps/log/adop/7/adop_20160927_091228.log:

                  -----------------------------------------------------------------------

                   

                  Lines #(399-403):

                      [EVENT]    Log: /u01/ebsdevf/apps_st/fs_ne/EBSapps/log/adop/7/apply_20160927_113254/ebsdevf_dmspebsapp1/ADOP_MRG_20160927_1474985585/log/u_ad_3029192231.log

                      [PROCEDURE] Running: adpatch  abandon=no restart=yes workers=8 wait_on_failed_job=yes flags=autoskip      console=no interactive=no  defaultsfile=/u01/ebsdevf/apps_st/fs1/EBSapps/appl/admin/ebsdevf_patch/adalldefaults.txt patchtop=/u01/ebsdevf/apps_st/fs2/EBSapps/appl/admin/ebsdevf/log/ADOP_MRG_20160927_1474985585 driver=u_ad_3029192231.drv logfile=u_ad_3029192231.log acp=yes

                      [UNEXPECTED]Error occurred executing "adpatch  abandon=no restart=yes workers=8 wait_on_failed_job=yes flags=autoskip      console=no interactive=no  defaultsfile=/u01/ebsdevf/apps_st/fs1/EBSapps/appl/admin/ebsdevf_patch/adalldefaults.txt patchtop=/u01/ebsdevf/apps_st/fs2/EBSapps/appl/admin/ebsdevf/log/ADOP_MRG_20160927_1474985585 driver=u_ad_3029192231.drv logfile=u_ad_3029192231.log"

                      [UNEXPECTED]Refer to the log files for more information.

                      [STATEMENT] sql stmt : <    update ad_adop_session_patches set  status='F'

                   

                  Lines #(400-404):

                      [PROCEDURE] Running: adpatch  abandon=no restart=yes workers=8 wait_on_failed_job=yes flags=autoskip      console=no interactive=no  defaultsfile=/u01/ebsdevf/apps_st/fs1/EBSapps/appl/admin/ebsdevf_patch/adalldefaults.txt patchtop=/u01/ebsdevf/apps_st/fs2/EBSapps/appl/admin/ebsdevf/log/ADOP_MRG_20160927_1474985585 driver=u_ad_3029192231.drv logfile=u_ad_3029192231.log acp=yes

                      [UNEXPECTED]Error occurred executing "adpatch  abandon=no restart=yes workers=8 wait_on_failed_job=yes flags=autoskip      console=no interactive=no  defaultsfile=/u01/ebsdevf/apps_st/fs1/EBSapps/appl/admin/ebsdevf_patch/adalldefaults.txt patchtop=/u01/ebsdevf/apps_st/fs2/EBSapps/appl/admin/ebsdevf/log/ADOP_MRG_20160927_1474985585 driver=u_ad_3029192231.drv logfile=u_ad_3029192231.log"

                      [UNEXPECTED]Refer to the log files for more information.

                      [STATEMENT] sql stmt : <    update ad_adop_session_patches set  status='F'

                      where adop_session_id=7

                   

                  Lines #(406-410):

                  >

                   

                      [UNEXPECTED]Apply phase has failed.

                      [PROCEDURE] [START 2016/09/27 11:33:53] Updating adop session status

                      [STATEMENT] SQL statement : "  update ad_adop_sessions

                   

                  /u01/ebsdevf/apps_st/fs_ne/EBSapps/log/adop/7/apply_20160927_091228/ebsdevf_dmspebsapp1/ADOP_MRG_20160927_1474985585/log/u_ad_3029192231.log:

                  ---------------------------------------------------------------------------------------------------------------------------------------------

                   

                  Lines #(5974-5978):

                  ORA-06512: at line 1

                   

                  AutoPatch error:

                  Error while executing statement (Begin  AD_FILE_UTIL.Lock_And_Empty_Temp_Table (' APPLSYS '); End;)

                   

                  Lines #(5988-5992):

                  Connecting to APPS......Connected successfully.

                   

                  AutoPatch error:

                   

                  Error running SQL and EXEC commands in parallel

                  • 6. Re: Error applying R12.AD.C.Delta.8 (21841299)
                    RameshPatel

                    Hi

                    You need to abandon the current patch session, Cleanup any restart file and apply it as if you are doing it first time.

                     

                    Issue is with grants.

                    • 7. Re: Error applying R12.AD.C.Delta.8 (21841299)
                      jimd1673

                      I aborted that patch phase, ran cleanup and fs_clone,

                      Then did all the steps you suggested.

                      The patch still failed.

                       

                      Applying patch 21841299.

                          Log: /u01/ebsdevf/apps_st/fs_ne/EBSapps/log/adop/8/apply_20160928_074356/ebsdevf_dmspebsapp1/21841299/log/u21841299.log

                       

                       

                      AutoPatch error:

                      Error while executing statement (Begin  AD_FILE_UTIL.Lock_And_Empty_Temp_Table (' APPLSYS '); End;)

                       

                       

                      AutoPatch error:

                       

                       

                      Error running SQL and EXEC commands in parallel

                       

                       

                      $ adopscanlog -latest=yes

                       

                       

                      Scanning /u01/ebsdevf/apps_st/fs_ne/EBSapps/log/adop/8/ directory ...

                       

                       

                      /u01/ebsdevf/apps_st/fs_ne/EBSapps/log/adop/8/adop_20160928_074356.log:

                      -----------------------------------------------------------------------

                       

                       

                      Lines #(118-122):

                          [EVENT]    Log: /u01/ebsdevf/apps_st/fs_ne/EBSapps/log/adop/8/apply_20160928_074356/ebsdevf_dmspebsapp1/21841299/log/u21841299.log

                          [PROCEDURE] Running: adpatch  workers=8 wait_on_failed_job=yes flags=autoskip      console=no interactive=no  defaultsfile=/u01/ebsdevf/apps_st/fs1/EBSapps/appl/admin/ebsdevf_patch/adalldefaults.txt patchtop=/patch//21841299 driver=u21841299.drv logfile=u21841299.log acp=yes

                          [UNEXPECTED]Error occurred executing "adpatch  workers=8 wait_on_failed_job=yes flags=autoskip      console=no interactive=no  defaultsfile=/u01/ebsdevf/apps_st/fs1/EBSapps/appl/admin/ebsdevf_patch/adalldefaults.txt patchtop=/patch//21841299 driver=u21841299.drv logfile=u21841299.log"

                          [UNEXPECTED]Refer to the log files for more information.

                          [STATEMENT] sql stmt : <    update ad_adop_session_patches set  status='F'

                       

                       

                      Lines #(119-123):

                          [PROCEDURE] Running: adpatch  workers=8 wait_on_failed_job=yes flags=autoskip      console=no interactive=no  defaultsfile=/u01/ebsdevf/apps_st/fs1/EBSapps/appl/admin/ebsdevf_patch/adalldefaults.txt patchtop=/patch//21841299 driver=u21841299.drv logfile=u21841299.log acp=yes

                          [UNEXPECTED]Error occurred executing "adpatch  workers=8 wait_on_failed_job=yes flags=autoskip      console=no interactive=no  defaultsfile=/u01/ebsdevf/apps_st/fs1/EBSapps/appl/admin/ebsdevf_patch/adalldefaults.txt patchtop=/patch//21841299 driver=u21841299.drv logfile=u21841299.log"

                          [UNEXPECTED]Refer to the log files for more information.

                          [STATEMENT] sql stmt : <    update ad_adop_session_patches set  status='F'

                          where adop_session_id=8

                       

                       

                      Lines #(125-129):

                      >

                       

                       

                          [UNEXPECTED]Apply phase has failed.

                          [PROCEDURE] [START 2016/09/28 07:55:31] Updating adop session status

                          [STATEMENT] SQL statement : "  update ad_adop_sessions

                       

                       

                      /u01/ebsdevf/apps_st/fs_ne/EBSapps/log/adop/8/apply_20160928_074356/ebsdevf_dmspebsapp1/21841299/log/u21841299.log:

                      -------------------------------------------------------------------------------------------------------------------

                       

                       

                      Lines #(5924-5928):

                      ORA-06512: at line 1

                       

                       

                      AutoPatch error:

                      Error while executing statement (Begin  AD_FILE_UTIL.Lock_And_Empty_Temp_Table (' APPLSYS '); End;)

                       

                      Lines #(5939-5943):

                      Connecting to APPS......Connected successfully.

                       

                       

                      AutoPatch error:

                       

                       

                      Error running SQL and EXEC commands in parallel

                      • 8. Re: Error applying R12.AD.C.Delta.8 (21841299)
                        user10825635

                        HI

                        I am also facing the same issue.

                        Did you get a solution for this ?

                        please let me know

                        naimuddin.basha@its.ws

                        • 9. Re: Error applying R12.AD.C.Delta.8 (21841299)
                          jimd1673

                          I dug around and found two patches that helped me get past the errors trying to apply Delta 8.  It's confusing so there is probably a simpler way but here is what I did.

                           

                          1. Abandon the Delta 8 patch and get back to a clean file system.

                          2. Apply the Delta 7 patches

                          3. Apply 22123818

                          4. Apply 22700342

                           

                          Patch 22700342 fixes bug 22664007 - AD_FILE_UTIL FAILED WITH ORA-04068 DURING PATCHING.  After applying those patches I was then able to successfully apply the Delta 8 patches.

                          The confusing part is it seems you need to apply the Delta 7 patches plus to two extra patches before you can apply the Delta 8 patches.  Of course this shouldn't need to be done since the Delta patches are cumulative, but nevertheless, that was the only way I could get it to work.