1 2 Previous Next 26 Replies Latest reply on Aug 7, 2016 12:51 PM by Beauty_and_dBest

    Patch apply messed up

    Beauty_and_dBest

      Hi ALL,

       

      EBS R12.1.3

      OL6

      11gR1

       

       

      I am  applying a patch  connecting via network putty.

      While the patch is currently running, my laptop was disconnected from the network.

      Now my patch has error. I tried to restart worker001, but all seem waiting.

      I check it on adcrtl and below is the output:

       

                      AD Controller Menu

           ---------------------------------------------------

           1.    Show worker status

           2.    Tell worker to restart a failed job

           3.    Tell worker to quit

           4.    Tell manager that a worker failed its job

           5.    Tell manager that a worker acknowledges quit

           6.    Restart a worker on the current machine

           7.    Exit

       

      Enter your choice [1] : 1

       

              Control

      Worker  Code      Context            Filename                    Status

      ------  --------  -----------------  --------------------------  --------------

           1  Run       AutoPatch R120                                 Wait

           2  Run       AutoPatch R120     cealu.ldt                   Completed

           3  Run       AutoPatch R120     ce11704499.sql              Completed

           4  Run       AutoPatch R120     ce12659381.sql              Completed

           5  Run       AutoPatch R120     ce13080978.sql              Completed

           6  Run       AutoPatch R120     ce7678017.sql               Completed

           7  Run       AutoPatch R120     ce8933055.sql               Completed

           8  Run       AutoPatch R120     ibyfunc.ldt                 Completed

           9  Run       AutoPatch R120     ibyvmlu.ldt                 Completed

          10  Run       AutoPatch R120                                 Wait

          11  Run       AutoPatch R120                                 Wait

          12  Run       AutoPatch R120                                 Wait

          13  Run       AutoPatch R120                                 Wait

          14  Run       AutoPatch R120                                 Wait

          15  Run       AutoPatch R120                                 Wait

          16  Run       AutoPatch R120                                 Wait

       

      Review the messages above, then press [Return] to continue.

       

       

       

      Its been in this "state" for a long time. How do I abort, and restart from the beginning?

       

       

      Kind regards,

      jc

        • 1. Re: Patch apply messed up
          Bashar.

          Using adctrl, mark all workers as failed (option #4) then use option #2 for all of them.

          Start the adpatch session again after you're done.

           

          Regards,

          Bashar

          • 2. Re: Patch apply messed up
            Beauty_and_dBest

            Thanks Bashar,

             

            I have done that but still when I query the status, I still get:

             

            Enter your choice [1] : 1

             

                    Control

            Worker  Code      Context            Filename                    Status

            ------  --------  -----------------  --------------------------  --------------

                 1  Run       AutoPatch R120                                 Wait

                 2  Run       AutoPatch R120     cealu.ldt                   Completed

                 3  Run       AutoPatch R120     ce11704499.sql              Completed

                 4  Run       AutoPatch R120     ce12659381.sql              Completed

                 5  Run       AutoPatch R120     ce13080978.sql              Completed

                 6  Run       AutoPatch R120     ce7678017.sql               Completed

                 7  Run       AutoPatch R120     ce8933055.sql               Completed

                 8  Run       AutoPatch R120     ibyfunc.ldt                 Completed

                 9  Run       AutoPatch R120     ibyvmlu.ldt                 Completed

                10  Run       AutoPatch R120                                 Wait

                11  Run       AutoPatch R120                                 Wait

                12  Run       AutoPatch R120                                 Wait

                13  Run       AutoPatch R120                                 Wait

                14  Run       AutoPatch R120                                 Wait

                15  Run       AutoPatch R120                                 Wait

                16  Run       AutoPatch R120                                 Wait

             

             

            Kind regards,

            • 3. Re: Patch apply messed up
              Beauty_and_dBest

              The adpatch.log shows:

               

              Running SQL and EXEC commands in parallel...

               

              STRT_TASK: [Running parallel SQL and EXEC commands] [] [Wed Aug 03 2016 17:56:19]

               

              Connecting to APPLSYS......Connected successfully.

               

              Creating the AD_UTIL_PARAMS table...

              Table AD_UTIL_PARAMS already exists, so dropping the table and recreating it.

              DROP TABLE AD_UTIL_PARAMS

               

              CREATE TABLE ad_util_params( worker_id          number       not null,

              utility_name       varchar2(100)  not null, task

              varchar2(30)  not null, status             varchar2(100) not null,

              arguments          varchar2(2000) not null, rowid1

              varchar2(2000), utility_status     number not null, symbolic_arguments

              varchar2(2560) not null)

               

              Creating FND_INSTALL_PROCESSES table...

               

              Running adtasktim.sql ..

               

              Connected.

              Connected.

               

              PL/SQL procedure successfully completed.

               

              Commit complete.

               

              Already created fnd_install_processes table

              Already created FND_INSTALL_PROCESSES_U1 index.

              Connecting to APPS......Connected successfully.

              Connecting to APPLSYS......Connected successfully.

              Already created AD_DEFERRED_JOBS table

               

              Already created AD_DEFERRED_JOBS_U1 index.

               

              Connecting to APPS......Connected successfully.

               

              Writing dependencies of jobs to run to appldep.txt file...

               

              There are now 287 jobs remaining (current phase=A0):

                  0 running, 7 ready to run and 280 waiting.

               

              Reading completed jobs from restart file (if any).

              AutoPatch error:

              Unable to find job when restarting.

               

              At line number 193 in the main restart file, the job with:

                 product = ce username = CE

                 filename = ce7387802.sql phase = 9 ign = 1 arguments =

              has to run after some jobs that are not listed earlier in the file,

              or it is a duplicate of another line,

              or the job is invalid in some other way.

              AutoPatch error:

               

              Error running SQL and EXEC commands in parallel

               

              Freeing includes hash table

              Freeing fixes hash table

              Freeing basedons hash table

              Freeing entities hash table

               

               

               

              Where can I find this file >  ce7387802.sql

               

               

              Thanks,

              • 4. Re: Patch apply messed up
                Bashar.

                The file is located under $CE_TOP.

                I would suggest to apply the patch from scratch as there seems to be some issues with the restart files.

                 

                Regards,

                Bashar

                • 5. Re: Patch apply messed up
                  Pravin Takpire

                  Use option 6 and restart all workers.

                  regards

                  Pravin

                  • 6. Re: Patch apply messed up
                    Beauty_and_dBest

                    Thanks Bashar and Pravin,

                     

                    How do I abort a patch? and restart from scratch? Is it option #6?

                     

                    I tried all options in the menu but still the status does not change

                     

                    I also tried to apply a new patch, hence the more it got messed up.

                     

                    Restarting job that failed and was fixed.

                    Time when worker restarted job: Wed Aug 03 2016 17:43:35

                    Start time for file is: Wed Aug 03 2016 17:43:35

                    sqlplus -s APPS/***** @/u01/apptest/TEST/apps/apps_st/appl/ce/12.0.0/patch/115/sql/ce7387802.sql

                    Connected.

                    DECLARE

                    *

                    ERROR at line 1:

                    ORA-29282: invalid file ID

                    ORA-06512: at "SYS.UTL_FILE", line 878

                    ORA-06512: at line 118

                    ORA-29283: invalid file operation

                    ORA-06512: at "SYS.UTL_FILE", line 536

                    ORA-29283: invalid file operation

                     

                    Time when worker failed: Wed Aug 03 2016 17:43:35

                     

                     

                    Please help....

                    Kind regards,

                    • 7. Re: Patch apply messed up
                      Samrat Sinha

                      Hi

                       

                      You should follow :

                       

                      3. Tell worker to quit        (for all workers)             

                      4. Tell manager that a worker failed its job                

                      5. Tell manager that a worker acknowledges quit 

                       

                      And then try applying the patch from scratch with a new session.

                       

                      Thanks

                      • 8. Re: Patch apply messed up
                        Beauty_and_dBest

                        Thanks Sam and ALL,

                         

                        I have started the application servinces now because the users wanted to login.

                         

                        Is it okay to run actrl even if the apps is running?

                         

                         

                        Kind regards,

                        • 9. Re: Patch apply messed up
                          Samrat Sinha

                          Hi

                           

                          You can run adctrl.

                           

                          Thanks

                          • 10. Re: Patch apply messed up
                            Beauty_and_dBest

                            Thanks,

                             

                            I run adctrl,

                             

                            Then 3, and 1 to check but still the status is not changed They are all stubbornly waiting.

                             

                            Then 4, Still no change

                            Then 5, Still no change...it got stuck on something?

                             

                            Enter your choice [1] : 5

                             

                             

                            Enter the worker number(s)/range(s) or 'all' for all workers,

                            or press [Return] to go back to the menu : all

                             

                             

                            AD Controller error:

                            Worker 1 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 2 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 3 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 4 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 5 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 6 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 7 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 8 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 9 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 10 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 11 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 12 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 13 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 14 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 15 does not have control code 'Quit'.

                             

                             

                            AD Controller error:

                            Worker 16 does not have control code 'Quit'.

                             

                             

                            Review the messages above, then press [Return] to continue.

                            • 11. Re: Patch apply messed up
                              Samrat Sinha

                              Hi

                               

                              Please use option 3,4,5 and then check the status with option 1.

                               

                              Thanks

                              • 12. Re: Patch apply messed up
                                Beauty_and_dBest

                                That's what I did above.

                                • 13. Re: Patch apply messed up
                                  Samrat Sinha

                                  Hi

                                   

                                  Can you please post the current status for the workers. Also upload the adpatch logs for the current session.

                                   

                                  Thanks

                                  • 14. Re: Patch apply messed up
                                    Bashar.

                                    Forget about adctrl. It seems that not all processes are started thus making adctrl not useful in this case.

                                    Just kill all processes and start a new patching session.

                                     

                                    pkill -u applmgr_account adpatch

                                     

                                    Regards,

                                    Bashar

                                    1 2 Previous Next