13 Replies Latest reply on Feb 27, 2016 12:14 PM by Srini Chavali-Oracle

    Internal Server Error. OAM

    user5500543

      Hello everyone,

      I have Oracle ebs 12.1 with 11g database. Due to abnormal shutdown of my server several times due to technical issue, Now now the oracle ebs services start with status 4 and Oracle OAM show the Internal Server Error and Application and database listener takes very long time to shutdown with errors.

       

      Kindly Help me to resolve the issue.

       

      Regards,

      M.T

        • 1. Re: Internal Server Error. OAM
          user5500543

          The output of adstpall.sh script.

          [oracle@vision scripts]$ ./adstpall.sh apps/apps

          You are running adstpall.sh version 120.10

          The logfile for this session is located at /oracle/inst/apps/PROD_vision/logs/appl/admin/log/adstpall.log

          Executing service control script:

          /oracle/inst/apps/PROD_vision/admin/scripts/jtffmctl.sh stop

          script returned:

          ****************************************************

          You are running jtffmctl.sh version 120.3

          Shutting down Fulfillment Server for PROD on port 9300 ...

          jtffmctl.sh: exiting with status 0

          .end std out.

          .end err out.

          ****************************************************

          Executing service control script:

          /oracle/inst/apps/PROD_vision/admin/scripts/adcmctl.sh stop

          script returned:

          ****************************************************

          ERROR : Timed out( 1000000 ): Interrupted Exception

          You are running adcmctl.sh version 120.17.12010000.3

          Shutting down concurrent managers for PROD ...

          ORACLE Password:

          ****************************************************

          Executing service control script:

          /oracle/inst/apps/PROD_vision/admin/scripts/adoafmctl.sh stop

          script returned:

          ****************************************************

          You are running adoafmctl.sh version 120.8

          Stopping OPMN managed OAFM OC4J instance ...

          adoafmctl.sh: exiting with status 0

          adoafmctl.sh: check the logfile /oracle/inst/apps/PROD_vision/logs/appl/admin/log/adoafmctl.txt for more information ... 

          .end std out.

          .end err out.

          ***************************************************

          Executing service control script:

          /oracle/inst/apps/PROD_vision/admin/scripts/adformsctl.sh stop

          script returned:

          ***************************************************

          You are running adformsctl.sh  version 120.16

          Stopping OPMN managed FORMS OC4J instance  ..

          adformsctl.sh: exiting with status 0

          adformsctl.sh: check the logfile /oracle/inst/apps/PROD_vision/logs/appl/admin/log/adformsctl.txt for more information ... 

          .end std out.

          .end err out.

          ****************************************************

          Executing service control script:

          /oracle/inst/apps/PROD_vision/admin/scripts/adoacorectl.sh stop

          script returned:

          ****************************************************

          ERROR : Timed out( 100000 ): Interrupted Exception

          You are running adoacorectl.sh version 120.13

          Stopping OPMN managed OACORE OC4J instance ...

          ****************************************************

          Executing service control script:

          /oracle/inst/apps/PROD_vision/admin/scripts/adapcctl.sh stop

          script returned:

          ****************************************************

          You are running adapcctl.sh version 120.7.12010000.2

          Stopping OPMN managed Oracle HTTP Server (OHS) instance ...

          adapcctl.sh: exiting with status 0

          adapcctl.sh: check the logfile /oracle/inst/apps/PROD_vision/logs/appl/admin/log/adapcctl.txt for more information ... 

          .end std out.

          .end err out.

          ****************************************************

          Executing service control script:

          /oracle/inst/apps/PROD_vision/admin/scripts/adalnctl.sh stop

          script returned:

          ****************************************************

          adalnctl.sh version 120.3

          Shutting down listener process APPS_PROD.

          adalnctl.sh: exiting with status 0

          adalnctl.sh: check the logfile /oracle/inst/apps/PROD_vision/logs/appl/admin/log/adalnctl.txt for more information ... 

          .end std out.

          .end err out.

          ****************************************************

          Executing service control script:

          /oracle/inst/apps/PROD_vision/admin/scripts/adopmnctl.sh stop

          script returned:

          ****************************************************

          You are running adopmnctl.sh version 120.6

          Stopping Oracle Process Manager (OPMN)  and the managed processes ...

          adopmnctl.sh: exiting with status 0

          adopmnctl.sh: check the logfile /oracle/inst/apps/PROD_vision/logs/appl/admin/log/adopmnctl.txt for more information ... 

          .end std out.

          .end err out.

          ****************************************************

          adstpall.sh:Exiting with status 2

          adstpall.sh: check the logfile /oracle/inst/apps/PROD_vision/logs/appl/admin/log/adstpall.log for more information ... 

           

          #### And Listener didn't shutdown normal, Give the Following ERROR.

           

          LSNRCTL> stop PROD

          Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=vision.suraj.com)(PORT=1521)))

          TNS-12547: TNS:lost contact

          TNS-12560: TNS:protocol adapter error

            TNS-00517: Lost contact

             Linux Error: 104: Connection reset by peer

           

          Regards,

          M.T

          • 2. Re: Internal Server Error. OAM
            Srini Chavali-Oracle

            Bring up the database and database listener, re-run autoconfig on both database and apps tiers, then restart all services.

            • 3. Re: Internal Server Error. OAM
              user5500543

              Same error after running autoconfig on both db and apps tier

              • 4. Re: Internal Server Error. OAM
                user5500543

                Executing service control script:

                /oracle/inst/apps/PROD_vision/admin/scripts/adoacorectl.sh stop

                script returned:

                ****************************************************

                ERROR : Timed out( 100000 ): Interrupted Exception

                You are running adoacorectl.sh version 120.13

                Stopping OPMN managed OACORE OC4J instance ...

                • 5. Re: Internal Server Error. OAM
                  Srini Chavali-Oracle

                  Review the actual autoconfig logs on both db and app tiers and confirm that they completed successfully without any errors being recorded in the logs files.

                   

                  Are there any errors in the server logs or the database alert log ?

                  • 6. Re: Internal Server Error. OAM
                    user5500543

                    No error in db and app tier autoconfig log although there is errors server log and alert log of database described upper.

                    • 7. Re: Internal Server Error. OAM
                      Srini Chavali-Oracle

                      Pl post the error messages recorded in the server / system log and the database alert log. The "upper" messages are from the EBS startup script, not from system or alert logs

                      • 8. Re: Internal Server Error. OAM
                        user5500543

                        Sir,

                        This is in alert log error of Database.

                        LSNRCTL> stop PROD

                        Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=vision.suraj.com)(PORT=1521)))

                        TNS-12547: TNS:lost contact

                        TNS-12560: TNS:protocol adapter error

                          TNS-00517: Lost contact

                           Linux Error: 104: Connection reset by peer

                        • 9. Re: Internal Server Error. OAM
                          user5500543

                          Operating system is Oracle linux 4 32 bit. where i should check the Linux logs?

                          • 10. Re: Internal Server Error. OAM
                            Srini Chavali-Oracle

                            This is the error from the listener, not the database alert log.

                             

                            Linux system log is usually /var/log/messages - Linux Log Files Location And How Do I View Logs Files on Linux?

                            • 11. Re: Internal Server Error. OAM
                              user5500543

                              I checked /var/log/messages file which contain the following text  to many times

                               

                              Feb 27 09:16:54 vision avahi-daemon[3570]: Invalid query packet.

                              Feb 27 09:16:54 vision avahi-daemon[3570]: Invalid response packet from host 192.168.3.248.

                              Feb 27 09:16:55 vision avahi-daemon[3570]: Invalid response packet from host 192.168.3.248.

                              Feb 27 09:17:03 vision avahi-daemon[3570]: Invalid query packet.

                              Feb 27 09:17:03 vision avahi-daemon[3570]: Invalid response packet from host 192.168.3.248.

                              • 12. Re: Internal Server Error. OAM
                                user5500543

                                and this error too..

                                 

                                 

                                 

                                Feb 27 09:04:11 vision kernel: ACPI Error (psparse-0537): Method parse/execution failed [\_SB_.PMI0._GHL] (Node f7d50450), AE_SUPPORT

                                Feb 27 09:04:11 vision kernel: ACPI Error (psparse-0537): Method parse/execution failed [\_SB_.PMI0._PMC] (Node f7d504a0), AE_SUPPORT

                                • 13. Re: Internal Server Error. OAM
                                  Srini Chavali-Oracle

                                  Someone with Linux expertise will have to review these and determine if these messages need to be addressed - pl post these in the Linux forums. Are there any errors in the database alert log ?