10 Replies Latest reply on Aug 1, 2015 10:03 AM by Ali Raza Memon

    R12.2.4 - Concurrent Manager Down

    Ali Raza Memon

      Hi folks,

       

      We have upgraded our EBS R12.1.3 to R12.2.4. After some days testing, I have restarted server and noticed that all Concurrent servers were down. I tried to start them manually by "adcmctl" but no luck. Please, refer the attached screenshot.

      conc_manager.PNG

      Thank you!

      Ali

        • 1. Re: R12.2.4 - Concurrent Manager Down
          Bashar.

          Hi,

           

          Check the internal managers log from the Processes window.

          If there are any errors then please post them.

           

          Regards,

          Bashar

          • 2. Re: R12.2.4 - Concurrent Manager Down
            Ali Raza Memon

            Here you go!

             

            ========================================================================

            Starting LIVE_0518@LIVE Internal Concurrent Manager -- shell process ID 13112

            logfile=/d01/LIVE/appsTier/fs_ne/inst/LIVE_LIVE1224/logs/appl/conc/log/LIVE_0518.mgr

            PRINTER=noprint

                       mailto=applmgr

                      restart=N

                         diag=N

                        sleep=30

                         pmon=4

                       quesiz=1

                      Reviver is ENABLED

             

            +---------------------------------------------------------------------------+

            Application Object Library: Concurrent Processing version 12.2

             

            Copyright (c) 1998, 2013, Oracle and/or its affiliates. All rights reserved.

             

            Internal Concurrent Manager started : 18-MAY-2015 17:01:51

             

            +---------------------------------------------------------------------------+

                               Process monitor session started : 18-MAY-2015 17:01:51

             

            Starting PODAMGR Concurrent Manager : 18-MAY-2015 17:01:51

            Starting RCVOLTM Concurrent Manager : 18-MAY-2015 17:01:52

            Starting FFTM Concurrent Manager : 18-MAY-2015 17:01:52

            Starting INVTMRPM Concurrent Manager : 18-MAY-2015 17:01:52

            Starting FNDCPOPP Concurrent Manager : 18-MAY-2015 17:01:52

            Starting FNDCPOPP Concurrent Manager : 18-MAY-2015 17:01:53

            Starting FNDCPOPP Concurrent Manager : 18-MAY-2015 17:01:53

            Starting FNDCPOPP Concurrent Manager : 18-MAY-2015 17:01:53

            Starting WFWSSVC Concurrent Manager                : 18-MAY-2015 17:01:53

            Starting XDP_APPL_SVC Concurrent Manager : 18-MAY-2015 17:01:53

            Starting XDP_Q_EVENT_SVC Concurrent Manager : 18-MAY-2015 17:01:53

            Starting WFMLRSVC Concurrent Manager : 18-MAY-2015 17:01:54

            Starting WFALSNRSVC Concurrent Manager : 18-MAY-2015 17:01:54

            Starting FNDSCH Concurrent Manager : 18-MAY-2015 17:01:54

            Starting FNDCRM Concurrent Manager : 18-MAY-2015 17:01:54

            Starting FTE_TXN_MANAGER Concurrent Manager : 18-MAY-2015 17:01:54

            Starting STANDARD Concurrent Manager : 18-MAY-2015 17:01:54

            Starting STANDARD Concurrent Manager : 18-MAY-2015 17:01:54

            Starting STANDARD Concurrent Manager : 18-MAY-2015 17:01:54

            Starting STANDARD Concurrent Manager : 18-MAY-2015 17:01:54

            Starting STANDARD Concurrent Manager : 18-MAY-2015 17:01:54

            Starting STANDARD Concurrent Manager : 18-MAY-2015 17:01:54

            Starting STANDARD Concurrent Manager : 18-MAY-2015 17:01:54

            Starting STANDARD Concurrent Manager : 18-MAY-2015 17:01:54

            Starting INVMGR Concurrent Manager : 18-MAY-2015 17:01:54

            Starting PASMGR Concurrent Manager : 18-MAY-2015 17:01:54

            Starting OAMCOLMGR Concurrent Manager : 18-MAY-2015 17:01:54

            Starting IEU_WL_CS Concurrent Manager : 18-MAY-2015 17:01:54

            Starting IEU_SH_CS Concurrent Manager              : 18-MAY-2015 17:01:54

                                Process monitor session ended : 18-MAY-2015 17:01:54

            18-MAY-2015 17:03:24

            Request  : 16837189

            Priority : 0

            Program  : 0/5

            State    : Q

             

                               Process monitor session started : 18-MAY-2015 17:04:43

             

                                 Process monitor session ended : 18-MAY-2015 17:04:44

            sh: line 68: 13117 Killed FNDLIBR FND CPMGR "FNDCPMBR sysmgr=\"\" sleep=30 pmon=4 quesiz=1 diag=N logfile=/d01/LIVE/appsTier/fs_ne/inst/LIVE_LIVE1224/logs/appl/conc/log/LIVE_0518.mgr "  <<STOP

            $unpw

            STOP

             

            The LIVE_0518@LIVE internal concurrent manager has terminated with status 137 - giving up.

            ========================================================================

            Starting LIVE_0518@LIVE Internal Concurrent Manager -- shell process ID 18394

             

                      logfile=/d01/LIVE/appsTier/fs_ne/inst/LIVE_LIVE1224/logs/appl/conc/log/LIVE_0518.mgr

                      PRINTER=noprint

                       mailto=applmgr

                      restart=N

                         diag=N

                        sleep=30

                         pmon=4

                       quesiz=1

                      Reviver is ENABLED

             

            sh: line 68: 18399 Segmentation fault FNDLIBR FND CPMGR "FNDCPMBR sysmgr=\"\" sleep=30 pmon=4 quesiz=1 diag=N logfile=/d01/LIVE/appsTier/fs_ne/inst/LIVE_LIVE1224/logs/appl/conc/log/LIVE_0518.mgr "  <<STOP

            $unpw

            STOP

             

            The LIVE_0518@LIVE internal concurrent manager has terminated with status 139 - giving up.

            ========================================================================

            Starting LIVE_0518@LIVE Internal Concurrent Manager -- shell process ID 30552

             

                      logfile=/d01/LIVE/appsTier/fs_ne/inst/LIVE_LIVE1224/logs/appl/conc/log/LIVE_0518.mgr

                      PRINTER=noprint

                       mailto=applmgr

                      restart=N

                         diag=N

                        sleep=30

                         pmon=4

                       quesiz=1

                      Reviver is ENABLED

             

            sh: line 68: 30557 Segmentation fault FNDLIBR FND CPMGR "FNDCPMBR sysmgr=\"\" sleep=30 pmon=4 quesiz=1 diag=N logfile=/d01/LIVE/appsTier/fs_ne/inst/LIVE_LIVE1224/logs/appl/conc/log/LIVE_0518.mgr "  <<STOP

            $unpw

            STOP

             

            The LIVE_0518@LIVE internal concurrent manager has terminated with status 139 - giving up.

             

            ========================================================================

            Starting LIVE_0518@LIVE Internal Concurrent Manager -- shell process ID 13100

             

                      logfile=/d01/LIVE/appsTier/fs_ne/inst/LIVE_LIVE1224/logs/appl/conc/log/LIVE_0518.mgr

                      PRINTER=noprint

                       mailto=applmgr

                      restart=N

                         diag=N

                        sleep=30

                         pmon=4

                       quesiz=1

                      Reviver is ENABLED

             

            sh: line 68: 13105 Segmentation fault FNDLIBR FND CPMGR "FNDCPMBR sysmgr=\"\" sleep=30 pmon=4 quesiz=1 diag=N logfile=/d01/LIVE/appsTier/fs_ne/inst/LIVE_LIVE1224/logs/appl/conc/log/LIVE_0518.mgr "  <<STOP

            $unpw

            STOP

             

            The LIVE_0518@LIVE internal concurrent manager has terminated with status 139 - giving up.

            • 3. Re: R12.2.4 - Concurrent Manager Down
              Pravin Takpire

              sh: line 68: 13105 Segmentation fault FNDLIBR FND CPMGR "FNDCPMBR sysmgr=\"\" sleep=30 pmon=4 quesiz=1 diag=N logfile=/d01/LIVE/appsTier/fs_ne/inst/LIVE_LIVE1224/logs/appl/conc/log/LIVE_0518.mgr "


              Do relink of your all your Concurrent Manager exeuctables

              regards

              Pravin

              • 4. Re: R12.2.4 - Concurrent Manager Down
                Kirushna

                Hi,


                Process monitor session ended : 18-MAY-2015 17:04:44

                log date shows 18th may... later CM was not running?

                 

                internal concurrent manager has terminated with status 139 - giving up.

                Concurrent services didn't stop properly.

                 

                have you run cmclean script, before starting the Concurrent services?

                 

                Regards,

                Krish

                • 5. Re: R12.2.4 - Concurrent Manager Down
                  Ali Raza Memon

                  No, I didn't run cmlean. Do I?

                  • 6. Re: R12.2.4 - Concurrent Manager Down
                    Kirushna

                    Hi,

                     

                    Give a try!!!

                     

                    Regards,

                    Krish

                    • 7. Re: R12.2.4 - Concurrent Manager Down
                      Bashar.

                      Don't forget to run AutoConfig on the db and apps tiers after you run the script.

                      The application services must be down during the process.

                       

                      Regards,

                      Bashar

                      • 8. Re: R12.2.4 - Concurrent Manager Down
                        Kirushna

                        Hi Bashar,

                         

                        Is it required to down all application services?  Any specific reason...

                         

                        We can do as follows, (just Suggesting)

                        1. Make sure no FNDLIBR process is running.

                        2. Run cmclean script.

                        3. start concurrent services

                         

                        Regards,

                        krish

                        1 person found this helpful
                        • 9. Re: R12.2.4 - Concurrent Manager Down
                          Bashar.

                          Hi Krish,

                           

                          It is true that the only conc. managers should be down.

                           

                          However, the AutoConfig may cause issues if run while the application is up.

                          I prefer to shutdown all the application tier services before starting with the above procedure.

                           

                          Regards,

                          Bashar

                          • 10. Re: R12.2.4 - Concurrent Manager Down
                            Ali Raza Memon

                            Thanks Bashar. It went good!

                            Regards,

                            Ali