1 2 Previous Next 16 Replies Latest reply: May 1, 2013 10:04 AM by 1006406 RSS

    OBIEE coreapplication_obisch1 will not start

    1006406
      Upon installation it was found that restart of the services (opmnctl stopall) and restart (opmnctl startall) would restart all services BUT coreapplication_obisch1. This is a weird issue because if we reboot and start services all is fine. However its the restart that gives us the issues. I have pasted contents of the nqscheduler.log:

      [2013-04-30T15:14:34.000-05:00] [OracleBISchedulerComponent] [NOTIFICATION:1] [] [] [ecid: 004qtaaORqF6iK3Lzmw0yW0001_F000000] [tid: e2463720] Verifying Scheduler's backend database configuration [[

      ]]
      [2013-04-30T15:14:34.000-05:00] [OracleBISchedulerComponent] [NOTIFICATION:1] [] [] [ecid: 004qtaaORqF6iK3Lzmw0yW0001_F000000] [tid: e092f700] [16020] Metadata Database Type: Oracle 11g [[
      Data Source Name: (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=xxxxx.xxxxxl.com)(PORT=1521)))(CONNECT_DATA=(SERVICE_NAME=xxxxxxl)))
      Data Source Type: Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64b
      ]]
      [2013-04-30T15:14:34.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: 004qtaaORqF6iK3Lzmw0yW0001_F000000] [tid: e092f700] [nQSError: 17011] SQL statement execution failed. [[
      [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
      Process ID: 29306
      Session ID: 204 Serial number: 52653

      Thanks in advance for any help. i have been searching forums for about last 6 hours with no indication of what the deal is.

      Edited by: 1003403 on Apr 30, 2013 1:24 PM
        • 1. Re: OBIEE coreapplication_obisch1 will not start
          Srini VEERAVALLI
          The issue is
          Oracle Error code: 3135, message: ORA-03135: connection lost contact
          Try to use hostname:port/TNSname
          make sure you got valid user/pwd

          Update back
          • 2. Re: OBIEE coreapplication_obisch1 will not start
            1006406
            Sorry not a DBA here, sysadmin acting as DBA. Contents of my TNSNAMES.ORA
            cat /data/oracle/fusion/Oracle_BI1/network/admin/tnsnames.ora
            <alias>= [ (DESCRIPTION_LIST =  # Optional depending on whether u have
            # one or more descriptions
            XXXPRDL =
            (DESCRIPTION =
            (ADDRESS = (PROTOCOL = TCP)(HOST = XXXXXX-vip.xxxx.com)(PORT = 1521))
            (ADDRESS = (PROTOCOL = TCP)(HOST = XXXXXX-vip.xxxx.com)(PORT = 1521))
            (failover=on)
            (LOAD_BALANCE = yes)
            (CONNECT_DATA =
            (SERVER = DEDICATED)
            (SERVICE_NAME = xxxprdl)
            (FAILOVER_MODE=(TYPE=select)(METHOD=basic))
            )
            )

            When installing i used following format hostname:port/TNS and i was able to successfully install. As far as user, the only two I am aware of are th BIPLATFORM and the MDS. Those were defined at installation.

            Edited by: 1003403 on Apr 30, 2013 1:49 PM
            • 3. Re: OBIEE coreapplication_obisch1 will not start
              SunilSharma
              it has got nothing to do with you. Just check the DB team to check the DB is up or not(also the sqlnet.ora file) on which u have the BIPLATFORM AND MDS schema's installed

              refer this

              http://www.dba-oracle.com/t_ora_03135_connection_lost_contact.htm

              One solution for the ORA-03135 error is to increase the value of thesqlnet.ora:expire_time parameter in the sqlnet.ora file :

              SQLNET.INBOUND_CONNECT_TIMEOUT = 300
              SQLNET.SEND_TIMEOUT = 300
              SQLNET.RECV_TIMEOUT = 300

              mark if it helps
              • 4. Re: OBIEE coreapplication_obisch1 will not start
                1006406
                I have altered the sqlnet.ora with the suggested parameters.
                [oracle@bipbac01 ~]$ /data/oracle/fusion/instances/instance1/bin/opmnctl status

                Processes in Instance: instance1
                --------------------------------------------------------------+---------
                ias-component | process-type | pid | status
                --------------------------------------------------------------+---------
                essbasestudio1 | EssbaseStudio | 2651 | Alive
                essbaseserver1 | Essbase | 2650 | Alive
                coreapplication_obiccs1 | OracleBIClusterCo~ | 2657 | Alive
                coreapplication_obisch1 | OracleBIScheduler~ | N/A | Down
                coreapplication_obijh1 | OracleBIJavaHostC~ | 2649 | Alive
                coreapplication_obips1 | OracleBIPresentat~ | 2652 | Alive
                coreapplication_obis1 | OracleBIServerCom~ | 2653 | Alive

                root@xxxxxxx01:/data/oracle/fusion/Oracle_BI1/network/admin # su oracle -c "/data/oracle/fusion/instances/instance1/bin/opmnctl startproc ias-component=coreapplication_obisch1"
                opmnctl startproc: starting opmn managed processes...
                ================================================================================
                opmn id=bipbac01:9501
                Response: 0 of 1 processes started.

                ias-instance id=instance1
                ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
                --------------------------------------------------------------------------------
                ias-component/process-type/process-set:
                coreapplication_obisch1/OracleBISchedulerComponent/coreapplication_obisch1/

                Error
                --> Process (index=1,uid=1613826049,pid=3415)
                failed to start a managed process after the maximum retry limit
                Log:
                /data/oracle/fusion/instances/instance1/diagnostics/logs/OracleBISchedulerComponent/coreapplication_obisch1/console~coreapplication_obisch1~1.log

                Log show similar but slightly different message:0pN000000] [tid: 3f3a7720] Verifying Scheduler's backend database configuration [[

                ]]
                [2013-04-30T16:03:10.000-05:00] [OracleBISchedulerComponent] [NOTIFICATION:1] [] [] [ecid: 004qtdKCHLo6iK3Lzmw0yW000
                0pN000000] [tid: 3d873700] [16020] Metadata Database Type: Oracle 11g [[
                Data Source Name: (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=poral11.fni-stl.com)(PORT=1521)))(CONNECT_
                DATA=(SERVICE_NAME=bacprdl)))
                Data Source Type: Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64b
                ]]
                [2013-04-30T16:03:10.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: 004qtdKCHLo6iK3Lzmw0yW0000pN0000
                00] [tid: 3d873700] [nQSError: 46066] Operation cancelled. [[
                PRIMARY_POOL RetrieveColumnInfo from table S_NQ_JOB Exchange
                ]]
                [2013-04-30T16:03:10.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: 004qtdKCHLo6iK3Lzmw0yW0000pN0000
                00] [tid: 3d873700] [nQSError: 17011] SQL statement execution failed. [[
                [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
                Process ID: 17845
                Session ID: 13 Serial number: 10745
                at OCI call OCIStmtExecute: SELECT JOB_ID , RELATIVE_ORDER , JOB_PARAM , DELETE_FLG FROM S_NQ_JOB_PARAM WHERE 1 = 0.
                ]]
                • 5. Re: OBIEE coreapplication_obisch1 will not start
                  1006406
                  I will update with values you specified and try again
                  • 6. Re: OBIEE coreapplication_obisch1 will not start
                    1006406
                    Same result with the options:
                    SQLNET.INBOUND_CONNECT_TIMEOUT = 300
                    SQLNET.SEND_TIMEOUT = 300
                    SQLNET.RECV_TIMEOUT = 300
                    • 7. Re: OBIEE coreapplication_obisch1 will not start
                      SunilSharma
                      try to start the individual component

                      ./opmnctl startproc ias-component=coreapplication_obisch1


                      and see if it starts. Also share the log file from this path /data/oracle/fusion/instances/instance1/diagnostics/logs/OracleBISchedulerComponent/coreapplication_obisch1/nqscheduler.log

                      and paste it here
                      • 8. Re: OBIEE coreapplication_obisch1 will not start
                        SunilSharma
                        set this too SQLNET.EXPIRE_TIME =5 or 10 or 15

                        see if it helps
                        • 9. Re: OBIEE coreapplication_obisch1 will not start
                          1006406
                          Even reboot of server fails to start the scheduler process now. After reboot i attempted several times to start scheduler process outside of the "opmnctl startall" command:
                          root@xxxxxx01:~ # su oracle -c "/data/oracle/fusion/instances/instance1/bin/opmnctl startproc ias-component=coreapplication_obisch1"
                          opmnctl startproc: starting opmn managed processes...
                          ================================================================================
                          opmn id=bipbac01:9501
                          Response: 0 of 1 processes started.

                          ias-instance id=instance1
                          ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
                          --------------------------------------------------------------------------------
                          ias-component/process-type/process-set:
                          coreapplication_obisch1/OracleBISchedulerComponent/coreapplication_obisch1/

                          Error
                          --> Process (index=1,uid=1613826058,pid=3063)
                          failed to start a managed process after the maximum retry limit
                          Log:
                          /data/oracle/fusion/instances/instance1/diagnostics/logs/OracleBISchedulerComponent/coreapplication_obisch1/console~coreapplication_obisch1~1.log

                          Here is log output just from last failed attempt to start:
                          
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\NumGlobalRetries not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\MinGlobalSleepSecs not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\MaxGlobalSleepSecs not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\NumRequestRetries not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\MinRequestSleepSecs not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\MaxRequestSleepSecs not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\NumDeliveryRetries not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\MinDeliverySleepSecs not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\MaxDeliverySleepSecs not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\Debug not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\KeepErrorLogFiles not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\LogMailContent not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\MaxRowsTimesColumns not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\Generate7BitPlainText not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value iBots\ForceUTF8 not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value Workflow\Server not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value Workflow\System not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value Workflow\Service not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value Mail\SmtpCaCertificateFile not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value Mail\SmtpCaCertificateDirectory not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [67004] Configuration value Mail\SmtpCipherList not set.
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [NOTIFICATION:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] Verifying Scheduler's backend database configuration [[

                          ]]
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [NOTIFICATION:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 10945700] [16020] Metadata Database Type: Oracle 11g [[
                          Data Source Name: (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=xxxxx.xxxxxxl.com)(PORT=1521)))(CONNECT_DATA=(SERVICE_NAME=xxxprdl)))
                          Data Source Type: Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64b
                          ]]
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 10945700] [nQSError: 17011] SQL statement execution failed. [[
                          [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
                          Process ID: 2820
                          Session ID: 232 Serial number: 19143
                          at OCI call OCIStmtExecute: SELECT JOB_ID , RELATIVE_ORDER , JOB_PARAM , DELETE_FLG FROM S_NQ_JOB_PARAM WHERE 1 = 0.
                          ]]
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [nQSError: 17011] SQL statement execution failed. [[
                          [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
                          Process ID: 2820
                          Session ID: 232 Serial number: 19143
                          at OCI call OCIStmtExecute: SELECT JOB_ID , RELATIVE_ORDER , JOB_PARAM , DELETE_FLG FROM S_NQ_JOB_PARAM WHERE 1 = 0.
                          ]]
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: 004quT_iB_d6iK3Lzmw0yW0000oJ000000] [tid: 14b5f720] [[
                          Current Table: S_NQ_JOB_PARAM.
                          [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
                          Process ID: 2820
                          Session ID: 232 Serial number: 19143
                          at OCI call OCIStmtExecute: SELECT JOB_ID , RELATIVE_ORDER , JOB_PARAM , DELETE_FLG FROM S_NQ_JOB_PARAM WHERE 1 = 0.. Errors were encountered while initializing Scheduler's backend database, check database configuration.

                          ]]
                          [2013-05-01T07:38:39.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: ] [tid: 14b5f720] [68008] Scheduler Error: [[
                          Current Table: S_NQ_JOB_PARAM.
                          [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
                          Process ID: 2820
                          Session ID: 232 Serial number: 19143
                          at OCI call OCIStmtExecute: SELECT JOB_ID , RELATIVE_ORDER , JOB_PARAM , DELETE_FLG FROM S_NQ_JOB_PARAM WHERE 1 = 0.. Errors were encountered while initializing Scheduler's backend database, check database configuration.

                          ]]
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\NumGlobalRetries not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\MinGlobalSleepSecs not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\MaxGlobalSleepSecs not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\NumRequestRetries not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\MinRequestSleepSecs not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\MaxRequestSleepSecs not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\NumDeliveryRetries not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\MinDeliverySleepSecs not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\MaxDeliverySleepSecs not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\Debug not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\KeepErrorLogFiles not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\LogMailContent not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\MaxRowsTimesColumns not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\Generate7BitPlainText not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value iBots\ForceUTF8 not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value Workflow\Server not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value Workflow\System not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value Workflow\Service not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value Mail\SmtpCaCertificateFile not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value Mail\SmtpCaCertificateDirectory not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [67004] Configuration value Mail\SmtpCipherList not set.
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [NOTIFICATION:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] Verifying Scheduler's backend database configuration [[

                          ]]
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [NOTIFICATION:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 55f47700] [16020] Metadata Database Type: Oracle 11g [[
                          Data Source Name: (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=xxxxx1.fni-stl.com)(PORT=1521)))(CONNECT_DATA=(SERVICE_NAME=xxxprdl)))
                          Data Source Type: Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64b
                          ]]
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 55f47700] [nQSError: 46066] Operation cancelled. [[
                          PRIMARY_POOL RetrieveColumnInfo from table S_NQ_JOB Exchange
                          ]]
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 55f47700] [nQSError: 17011] SQL statement execution failed. [[
                          [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
                          Process ID: 2910
                          Session ID: 232 Serial number: 19151
                          at OCI call OCIStmtExecute: SELECT JOB_ID , RELATIVE_ORDER , JOB_PARAM , DELETE_FLG FROM S_NQ_JOB_PARAM WHERE 1 = 0.
                          ]]
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [nQSError: 17011] SQL statement execution failed. [[
                          [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
                          Process ID: 2910
                          Session ID: 232 Serial number: 19151
                          at OCI call OCIStmtExecute: SELECT JOB_ID , RELATIVE_ORDER , JOB_PARAM , DELETE_FLG FROM S_NQ_JOB_PARAM WHERE 1 = 0.
                          ]]
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 559c0700] [nQSError: 17011] SQL statement execution failed. [[
                          [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
                          Process ID: 2916
                          Session ID: 232 Serial number: 19153
                          at OCI call OCIStmtExecute: SELECT JOB_ID , INSTANCE_ID , RELATIVE_ORDER , ERROR_MSG_TEXT , DELETE_FLG FROM S_NQ_ERR_MSG WHERE 1 = 0.
                          ]]
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [nQSError: 17011] SQL statement execution failed. [[
                          [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
                          Process ID: 2916
                          Session ID: 232 Serial number: 19153
                          at OCI call OCIStmtExecute: SELECT JOB_ID , INSTANCE_ID , RELATIVE_ORDER , ERROR_MSG_TEXT , DELETE_FLG FROM S_NQ_ERR_MSG WHERE 1 = 0.
                          ]]
                          [2013-05-01T07:38:44.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: 004quTa2Iqi6iK3Lzmw0yW0000oV000000] [tid: 61924720] [[
                          Current Table: S_NQ_JOB_PARAM.
                          [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
                          Process ID: 2910
                          Session ID: 232 Serial number: 19151
                          at OCI call OCIStmtExecute: SELECT JOB_ID , RELATIVE_ORDER , JOB_PARAM , DELETE_FLG FROM S_NQ_JOB_PARAM WHERE 1 = 0.
                          Current Table: S_NQ_ERR_MSG.
                          [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
                          Process ID: 2916
                          Session ID: 232 Serial number: 19153
                          at OCI call OCIStmtExecute: SELECT JOB_ID , INSTANCE_ID , RELATIVE_ORDER , ERROR_MSG_TEXT , DELETE_FLG FROM S_NQ_ERR_MSG WHERE 1 = 0.. Errors were encountered while initializing Scheduler's backend database, check database configuration.

                          ]]
                          [2013-05-01T07:38:45.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: ] [tid: 61924720] [68008] Scheduler Error: [[
                          Current Table: S_NQ_JOB_PARAM.
                          [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
                          Process ID: 2910
                          Session ID: 232 Serial number: 19151
                          at OCI call OCIStmtExecute: SELECT JOB_ID , RELATIVE_ORDER , JOB_PARAM , DELETE_FLG FROM S_NQ_JOB_PARAM WHERE 1 = 0.
                          Current Table: S_NQ_ERR_MSG.
                          [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
                          Process ID: 2916
                          Session ID: 232 Serial number: 19153
                          at OCI call OCIStmtExecute: SELECT JOB_ID , INSTANCE_ID , RELATIVE_ORDER , ERROR_MSG_TEXT , DELETE_FLG FROM S_NQ_ERR_MSG WHERE 1 = 0.. Errors were encountered while initializing Scheduler's backend database, check database configuration.

                          ]]

                          Edited by: 1003403 on May 1, 2013 5:41 AM
                          • 10. Re: OBIEE coreapplication_obisch1 will not start
                            SunilSharma
                            Did you tried to change the SQLNET.EXPIRE_TIME =5 or 10 or 15 in sqlnet.ora file. You must change this file with the parameters on which your DB is there.
                            • 11. Re: OBIEE coreapplication_obisch1 will not start
                              1006406
                              [oracle@xxxxxx01 ~]$ tail -10 /data/oracle/fusion/Oracle_BI1/network/admin/sqlnet.ora
                              #
                              #Purpose: Use parameter SDP.PF_INET_SDP to specify the protocol family or
                              # address family constant for the SDP protocol on your system.
                              #
                              #Supported since: 11.0
                              SQLNET.INBOUND_CONNECT_TIMEOUT = 300
                              SQLNET.SEND_TIMEOUT = 300
                              SQLNET.RECV_TIMEOUT = 300
                              SQLNET.EXPIRE_TIME = 15
                              • 12. Re: OBIEE coreapplication_obisch1 will not start
                                SunilSharma
                                1003403 wrote:
                                [oracle@xxxxxx01 ~]$ tail -10 /data/oracle/fusion/Oracle_BI1/network/admin/sqlnet.ora
                                #
                                #Purpose: Use parameter SDP.PF_INET_SDP to specify the protocol family or
                                # address family constant for the SDP protocol on your system.
                                #
                                #Supported since: 11.0
                                SQLNET.INBOUND_CONNECT_TIMEOUT = 300
                                SQLNET.SEND_TIMEOUT = 300
                                SQLNET.RECV_TIMEOUT = 300
                                SQLNET.EXPIRE_TIME = 15
                                As i told you earlier you need to do the above changes on DB not in a file where you have installed the OBIEE. It wont reflect in the DB if you change the sqlnet.ora file related to OBIEE install.

                                If you have DBA ask them to check the same and update the above parameters. What is your database instance name or SID?
                                • 13. Re: OBIEE coreapplication_obisch1 will not start
                                  1006406
                                  ok that makes a bit more sense then. So the parameters i have been changing locally have no affect? oracle sid is bacprdl.

                                  I have updated sqlnet.ora on the Server hosting the Oracle DB.
                                  poral11:~ # head -5 /data/usr3/app/oracle/11gR2-2/network/admin/sqlnet.ora
                                  SQLNET.INBOUND_CONNECT_TIMEOUT = 300
                                  SQLNET.SEND_TIMEOUT = 300
                                  SQLNET.RECV_TIMEOUT = 300
                                  sqlnet.expire_time=15
                                  NAMES.DIRECTORY_PATH= (TNSNAMES, EZCONNECT)

                                  Tried to restart the scheduler:
                                  root@xxxx01:~ # su oracle -c "/data/oracle/fusion/instances/instance1/bin/opmnctl startproc ias-component=coreapplication_obisch1"
                                  opmnctl startproc: starting opmn managed processes...
                                  ================================================================================
                                  opmn id=bipbac01:9501
                                  Response: 0 of 1 processes started.

                                  ias-instance id=instance1
                                  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
                                  --------------------------------------------------------------------------------
                                  ias-component/process-type/process-set:
                                  coreapplication_obisch1/OracleBISchedulerComponent/coreapplication_obisch1/

                                  Error
                                  --> Process (index=1,uid=1613826066,pid=8136)
                                  failed to start a managed process after the maximum retry limit
                                  Log:
                                  /data/oracle/fusion/instances/instance1/diagnostics/logs/OracleBISchedulerComponent/coreapplication_obisch1/console~coreapplication_obisch1~1.log

                                  LOG
                                  2013-05-01T08:39:56.000-05:00] [OracleBISchedulerComponent] [NOTIFICATION:1] [] [] [ecid: 004quX0tije6iK3Lzmw0yW0001yu000000] [tid: e8159720] Verifying Scheduler's backend database configuration [[

                                  ]]
                                  [2013-05-01T08:39:56.000-05:00] [OracleBISchedulerComponent] [NOTIFICATION:1] [] [] [ecid: 004quX0tije6iK3Lzmw0yW0001yu000000] [tid: da06d700] [16020] Metadata Database Type: Oracle 11g [[
                                  Data Source Name: (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=poral11.xxxxxxxx.com)(PORT=1521)))(CONNECT_DATA=(SERVICE_NAME=bacprdl)))
                                  Data Source Type: Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64b
                                  ]]
                                  [2013-05-01T08:39:56.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: 004quX0tije6iK3Lzmw0yW0001yu000000] [tid: da06d700] [nQSError: 46066] Operation cancelled. [[
                                  PRIMARY_POOL RetrieveColumnInfo from table S_NQ_JOB Exchange
                                  ]]
                                  [2013-05-01T08:39:56.000-05:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: 004quX0tije6iK3Lzmw0yW0001yu000000] [tid: da06d700] [nQSError: 17011] SQL statement execution failed. [[
                                  [nQSError: 17001] Oracle Error code: 3135, message: ORA-03135: connection lost contact
                                  Process ID: 15809
                                  Session ID: 227 Serial number: 55615

                                  Edited by: 1003403 on May 1, 2013 6:47 AM
                                  • 14. Re: OBIEE coreapplication_obisch1 will not start
                                    1006406
                                    Ok last few times i just restarted the processes via startall, were successful:
                                    root@bipbac01:~ # su oracle -c "/data/oracle/fusion/instances/instance1/bin/opmnctl startall"
                                    opmnctl startall: starting opmn and all managed processes...
                                    root@bipbac01:~ # su oracle -c "/data/oracle/fusion/instances/instance1/bin/opmnctl status"

                                    Processes in Instance: instance1
                                    --------------------------------------------------------------+---------
                                    ias-component | process-type | pid | status
                                    --------------------------------------------------------------+---------
                                    essbasestudio1 | EssbaseStudio | 10122 | Alive
                                    essbaseserver1 | Essbase | 10123 | Alive
                                    coreapplication_obiccs1 | OracleBIClusterCo~ | 10121 | Alive
                                    coreapplication_obisch1 | OracleBIScheduler~ | 10120 | Alive
                                    coreapplication_obijh1 | OracleBIJavaHostC~ | 10119 | Alive
                                    coreapplication_obips1 | OracleBIPresentat~ | 10118 | Alive
                                    coreapplication_obis1 | OracleBIServerCom~ | 10117 | Alive

                                    This may have fixed issue, let me do a little more testing.

                                    Thank you so much for your assistance so far.

                                    Edited by: 1003403 on May 1, 2013 7:01 AM
                                    1 2 Previous Next