3 Replies Latest reply: Sep 14, 2013 4:54 AM by Asif Muhammad RSS

    Concurrent Manager suddenly doesn't work and other applications after using wrong user to start and stop

    984556

      Hello everyone,

       

      during a normal shutdown and startup of the application the concurrent manager stopped working, and I searched through the forum and found a post somewhat related  Concurrent Manager Inactive - No Manager

      however it didn't answer the question and hence i am posting this new thread


      Platform: AIX

      EBS Suite: 11.5.1

      Database : 9i

       

      Apparently this happened when one of the users STOPPED and STARTED the application as root user instead of Applmanager user


      I went to the location :

      /oraapp/prodcomn/admin/log/PROD_oraapp/

      root@oraapp:/oraapp/prodcomn/admin/log/PROD_oraapp>

      root@oraapp:/oraapp/prodcomn/admin/log/PROD_oraapp> ls -la | grep root

      applprod@oraapp:/oraapp/prodcomn/admin/log/PROD_oraapp>ls -la | grep root

      -rw-r--r--   1 root     dba            6032 14 ▒▒▒ 07:25 09140724.log

      -rw-r--r--   1 root     dba            5909 14 ▒▒▒ 10:28 09141028.log

      -rw-r--r--   1 root     dba            6032 14 ▒▒▒ 10:35 09141034.log

      -rw-r--r--   1 root     dba              73 14 ▒▒▒ 07:25 Errors135.log

      -rw-r--r--   1 root     dba              73 14 ▒▒▒ 10:35 Errors136.log

      -rw-r--r--   1 root     dba            9224 14 ▒▒▒ 10:29 Events135.log

      -rw-r--r--   1 root     dba            8958 14 ▒▒▒ 10:37 Events136.log

      applprod@oraapp:/oraapp/prodcomn/admin/log/PROD_oraapp>ls -la | grep root

      -rw-r--r--   1 root     dba            6032 14 ▒▒▒ 07:25 09140724.log

      -rw-r--r--   1 root     dba            5909 14 ▒▒▒ 10:28 09141028.log

      -rw-r--r--   1 root     dba            6032 14 ▒▒▒ 10:35 09141034.log

      -rw-r--r--   1 root     dba          730717 14 ▒▒▒ 12:14 PROD_0914.mgr

       

       

       

       


      changed the permissions of all the above files to applprod:dba  then started the application with APPLMANAGER user

       

      cd /oraapp/prodcomn/admin/scripts/PROD_oraapp

      ./adstrtal.sh apps/apps

      All enabled services for this node are started.

      Check logfile /oraapp/prodcomn/admin/log/PROD_oraapp/09141150.log for details

       

       

      Exiting with status 0

      Setting service Oracle Apache Server PROD_oraapp to mode 2

      Executing service control script:

      /oraapp/prodcomn/admin/scripts/PROD_oraapp/adapcctl.sh start

      Timeout specified in context file: 100 second(s)

       

       

      script returned:

      ****************************************************

       

       

      adapcctl.sh version 115.43

       

       

      Starting Apache Web Server Listener (dedicated HTTP) ...

      Starting Apache Web Server Listener (dedicated PLSQL) ...

       

       

      adapcctl.sh: exiting with status 0

       

       

       

       

      .end std out.

       

       

      .end err out.

       

       

      ****************************************************

      Setting service OracleTNSListener80APPS_PROD_oraapp to mode 2

      Executing service control script:

      /oraapp/prodcomn/admin/scripts/PROD_oraapp/adalnctl.sh start

      Timeout specified in context file: 100 second(s)

       

       

      script returned:

      ****************************************************

       

       

      adalnctl.sh version

       

       

      Checking for FNDFS executable.

      Starting listener process APPS_PROD.

       

       

      adalnctl.sh: exiting with status 0

       

       

       

       

      .end std out.

       

       

      .end err out.

       

       

      ****************************************************

       

      Setting service OracleConcMgrPROD_oraapp to mode 2

      Executing service control script:

      /oraapp/prodcomn/admin/scripts/PROD_oraapp/adcmctl.sh start

      Timeout specified in context file: 1000 second(s)

       

       

      script returned:

      ****************************************************

       

       

      You are running adcmctl.sh version 115.19

       

       

      Starting concurrent manager for PROD ...

      Starting PROD_0914@PROD Internal Concurrent Manager

      Default printer is noprint

       

       

      adcmctl.sh: exiting with status 0

       

       

       

       

      .end std out.

       

       

      .end err out.

       

       

      ****************************************************

       

      Setting service OracleFormsServer-Forms60PROD_oraapp to mode 2

      Executing service control script:

      /oraapp/prodcomn/admin/scripts/PROD_oraapp/adfrmctl.sh start

      Timeout specified in context file: 100 second(s)

       

       

      script returned:

      ****************************************************

       

       

      You are running adfrmctl.sh version 115.33

       

       

      Starting forms server for PROD on port 9000.

       

       

      adfrmctl.sh: exiting with status 0

       

       

       

       

      .end std out.

       

       

      .end err out.

       

       

      ****************************************************

      Setting service OracleReportServer-Rep60_PROD to mode 2

      Executing service control script:

      /oraapp/prodcomn/admin/scripts/PROD_oraapp/adrepctl.sh start

      Timeout specified in context file: 100 second(s)

       

       

      script returned:

      ****************************************************

       

       

      You are running adrepctl.sh version 115.29

       

       

      starting Reports Server for PROD on port 7000.

       

       

      adrepctl.sh: exiting with status 0

       

       

       

       

      .end std out.

       

       

      .end err out.

       

       

      ****************************************************

       

       

       

       

      Setting service Oracle Metrics Client PROD_oraapp to mode 2

      /oraapp/prodcomn/admin/scripts/PROD_oraapp/addisctl.sh start

      Timeout specified in context file: 100 second(s)

       

       

      script returned:

      ****************************************************

       

       

      addisctl.sh version 115.8

       

       

      /oraapp/prodora/8.0.6/vbroker/bin/osagent

      Started osagent.

      Osagent logs messages to the file /oraapp/prodora/8.0.6/discwb4/util/osagent.log

      .

      Waiting for OAD to start...

      Started OAD.

      OAD logs messages to the file /oraapp/prodora/8.0.6/discwb4/util/oad.log.

      Discoverer Locator Started.

      Locator logs messages to the file /oraapp/prodora/8.0.6/discwb4/util/locator.log

      .

       

       

      addisctl.sh: exiting with status 0

       

       

       

       

      .end std out.

       

       

      .end err out.

       

       

      ****************************************************

       

       

       

       

       

       

      [Service Control Execution Report]

      The report format is:

        <Service>                                    <Script>         <Status>

       

       

        Oracle Apache Server PROD_oraapp             adapcctl.sh      Started

        OracleTNSListener80APPS_PROD_oraapp          adalnctl.sh      Started

        OracleConcMgrPROD_oraapp                     adcmctl.sh       Started

        OracleFormsServer-Forms60PROD_oraapp         adfrmctl.sh      Started

        OracleReportServer-Rep60_PROD                adrepctl.sh      Started

        Oracle Metrics Client PROD_oraapp            adfmcctl.sh      Started

        Oracle Metrics Server PROD_oraapp            adfmsctl.sh      Started

        Oracle Fulfillment Server PROD_oraapp        jtffmctl.sh      Started

        Oracle Discoverer services PROD_oraapp       addisctl.sh      Started

        Oracle Restricted Apache Server PROD_oraapp  adaprstctl.sh    Disabled

        Oracle Apache Server PROD_oraapp for PL/SQL  adapcctl.sh      Disabled

        Oracle TCF SocketServer PROD_oraapp          adtcfctl.sh      Disabled

        Oracle ICSM PROD_oraapp                      ieoicsm.sh       Disabled

        Oracle iProcurement Bulk Loader PROD_oraapp  icxblkctl.sh     Disabled

       

       

       

       

      ServiceControl is exiting with status 0

       

       

       

       

      Is there anything else I should be looking for ?

      -- permissions of other files or directories ?

      -- any other issues which could happen ?



      Thank You.

        • 1. Re: Concurrent Manager suddenly doesn't work and other applications after using wrong user to start and stop
          Asif Muhammad

          Hi,

           

          Finding the files and changing permissions individually from root to applmgr would not completely solve, as sometimes there may directory affected.

           

          I suggest you change the ownership of the APPS and INST base directory with recursive parameter to APPLMGR user  logged in as root user, then run autoconfig.

           

          Afterwards try bouncing back the the System and let us know if it works.

           

          Thanks &

          Best Regards,

          • 2. Re: Concurrent Manager suddenly doesn't work and other applications after using wrong user to start and stop
            984556

            Thank you Asif for the reply.

             

            The directory permission for APPS directory was right which APPLMGR user applprod and dba user group

            root@oraapp:/> ls -la | grep oraapp

            drwxrwsrwx  11 applprod dba             512 29 ▒▒▒ 2011  oraapp

             

             

            However upon extensive searching and looking into I have found only the following files under the directory

            /oraapp/prodcomn/admin/log/PROD_oraapp with root permissions so I changed them to chown applprod:dba PROD_0914.mgr *.log

             

            -rw-r--r--   1 root     dba            6032 14 ▒▒▒ 07:25 09140724.log

            -rw-r--r--   1 root     dba            5909 14 ▒▒▒ 10:28 09141028.log

            -rw-r--r--   1 root     dba            6032 14 ▒▒▒ 10:35 09141034.log

            -rw-r--r--   1 root     dba              73 14 ▒▒▒ 07:25 Errors135.log

            -rw-r--r--   1 root     dba              73 14 ▒▒▒ 10:35 Errors136.log

            -rw-r--r--   1 root     dba            9224 14 ▒▒▒ 10:29 Events135.log

            -rw-r--r--   1 root     dba            8958 14 ▒▒▒ 10:37 Events136.log

            -rw-r--r--   1 root     dba            6032 14 ▒▒▒ 07:25 09140724.log

            -rw-r--r--   1 root     dba            5909 14 ▒▒▒ 10:28 09141028.log

            -rw-r--r--   1 root     dba            6032 14 ▒▒▒ 10:35 09141034.log

            -rw-r--r--   1 root     dba          730717 14 ▒▒▒ 12:14 PROD_0914.mgr

             

            After this I have stopped the application and started again and the concurrent manager is running.


            I have not run AUTOCONFIG yet as this is production system and would require to make a backup ( take downtime , shutdown ) before I run autoconfig even though autoconfig will not impact but to be on safe side and be cautious.


            Thanks for the reply, if I discover anything else I will post here:


            • 3. Re: Concurrent Manager suddenly doesn't work and other applications after using wrong user to start and stop
              Asif Muhammad

              Hi,

               

              The reason behind this should be obviously a permission issue, since root user has run on the scripts and therefore subsequent run from applmgr user is unable to access the respective files.

               

              Thanks for the update!!!

              Best Regards