13 Replies Latest reply on Aug 12, 2008 11:09 AM by KdeGraaf

    Error after hard reboot

    KdeGraaf
      Hi all.

      I have R12.0.4 installed on CentOS 5.2
      After a hard reboot Oracle won't startup anymore.

      This what I see after running /Oracle/VIS/inst/apps/VIS_linux12/admin/scripts/adstrtal.sh
      I do it as the user applmgr, and it always worked fine.
      You are running adstrtal.sh version 120.13.12000000.3
      
      
      Enter the APPS username: apps
      
      Enter the APPS password: 
      Executing service control script:
      /Oracle/VIS/inst/apps/VIS_linux12/admin/scripts/adopmnctl.sh start
      script returned:
      ****************************************************
      
      You are running adopmnctl.sh version 120.4.12000000.3
      
      Starting Oracle Process Manager (OPMN) ...
      
      adopmnctl.sh: exiting with status 0
      
      adopmnctl.sh: check the logfile /Oracle/VIS/inst/apps/VIS_linux12/logs/appl/admin/log/adopmnctl.txt for more information ...  
      
      
      .end std out.
      
      .end err out.
      
      ****************************************************
      
      
      Executing service control script:
      /Oracle/VIS/inst/apps/VIS_linux12/admin/scripts/adapcctl.sh start
      script returned:
      ****************************************************
      
      You are running adapcctl.sh version 120.6.12000000.2
      
      Starting OPMN managed Oracle HTTP Server (OHS) instance ...
      
      adapcctl.sh: exiting with status 150
      
      adapcctl.sh: check the logfile /Oracle/VIS/inst/apps/VIS_linux12/logs/appl/admin/log/adapcctl.txt for more information ...  
      
      
      .end std out.
      
      .end err out.
      
      ****************************************************
      
      
      Executing service control script:
      /Oracle/VIS/inst/apps/VIS_linux12/admin/scripts/adoacorectl.sh start
      script returned:
      ****************************************************
      
      You are running adoacorectl.sh version 120.11.12000000.2
      
      Starting OPMN managed OACORE OC4J instance  ...
      
      adoacorectl.sh: exiting with status 150
      
      adoacorectl.sh: check the logfile /Oracle/VIS/inst/apps/VIS_linux12/logs/appl/admin/log/adoacorectl.txt for more information ...  
      
      
      .end std out.
      
      .end err out.
      
      ****************************************************
      
      
      Executing service control script:
      /Oracle/VIS/inst/apps/VIS_linux12/admin/scripts/adformsctl.sh start
      script returned:
      ****************************************************
      
      You are running adformsctl.sh  version 120.12.12000000.3
      
      Starting OPMN managed FORMS OC4J instance  ...
      
      adformsctl.sh: exiting with status 150
      
      adformsctl.sh: check the logfile /Oracle/VIS/inst/apps/VIS_linux12/logs/appl/admin/log/adformsctl.txt for more information ...  
      
      
      .end std out.
      
      .end err out.
      
      ****************************************************
      
      
      Executing service control script:
      /Oracle/VIS/inst/apps/VIS_linux12/admin/scripts/adoafmctl.sh start
      script returned:
      ****************************************************
      
      You are running adoafmctl.sh version 120.6.12000000.2
      
      Starting OPMN managed OAFM OC4J instance  ...
      
      adoafmctl.sh: exiting with status 150
      
      adoafmctl.sh: check the logfile /Oracle/VIS/inst/apps/VIS_linux12/logs/appl/admin/log/adoafmctl.txt for more information ...  
      
      
      .end std out.
      
      .end err out.
      
      ****************************************************
      
      
      Executing service control script:
      /Oracle/VIS/inst/apps/VIS_linux12/admin/scripts/adalnctl.sh start
      script returned:
      ****************************************************
      
      adalnctl.sh version 120.3
      
      Checking for FNDFS executable.
      Starting listener process APPS_VIS.
      
      adalnctl.sh: exiting with status 0
      
      
      adalnctl.sh: check the logfile /Oracle/VIS/inst/apps/VIS_linux12/logs/appl/admin/log/adalnctl.txt for more information ...  
      
      
      .end std out.
      
      .end err out.
      
      ****************************************************
      
      
      Executing service control script:
      /Oracle/VIS/inst/apps/VIS_linux12/admin/scripts/adcmctl.sh start
      script returned:
      ****************************************************
      
      You are running adcmctl.sh version 120.14
      
      Starting concurrent manager for VIS ...
      Starting VIS_0807@VIS Internal Concurrent Manager
      Default printer is noprint
      
      adcmctl.sh: exiting with status 0
      
      
      adcmctl.sh: check the logfile /Oracle/VIS/inst/apps/VIS_linux12/logs/appl/admin/log/adcmctl.txt for more information ...  
      
      
      .end std out.
      
      .end err out.
      
      ****************************************************
      
      
      Executing service control script:
      /Oracle/VIS/inst/apps/VIS_linux12/admin/scripts/jtffmctl.sh start
      script returned:
      ****************************************************
      
      You are running jtffmctl.sh version 120.3
      
      Validating Fulfillment patch level via /Oracle/VIS/apps/apps_st/comn/java/classes
      Fulfillment patch level validated.
      Starting Fulfillment Server for VIS on port 9300 ...
      
      jtffmctl.sh: exiting with status 0
      
      
      .end std out.
      
      .end err out.
      
      ****************************************************
      
      
      
      adstrtal.sh: Exiting with status 4
      
      adstrtal.sh: check the logfile /Oracle/VIS/inst/apps/VIS_linux12/logs/appl/admin/log/adstrtal.log for more information ...  
      this is the status:
      [root@linux12 scripts]# ./adopmnctl.sh status
      
      You are running adopmnctl.sh version 120.4.12000000.3
      
      Checking status of OPMN managed processes...
      
      Processes in Instance: VIS_linux12.linux12.localdomain
      -------------------+--------------------+---------+---------
      ias-component      | process-type       |     pid | status  
      -------------------+--------------------+---------+---------
      OC4J               | oafm               |     N/A | Down    
      OC4J               | forms              |     N/A | Down    
      OC4J               | oacore             |     N/A | Down    
      HTTP_Server        | HTTP_Server        |     N/A | Alive
      What should I do?
        • 1. Re: Error after hard reboot
          Hussein Sawwan-Oracle
          Any additional information in the log files (i.e. adopmnctl.txt, adapcctl.txt, adoacorectl.txt ..etc)?

          Did you try to run AutoConfig on the Application tier and see if it runs successfully?

          Note: 387859.1 - Using AutoConfig to Manage System Configurations in Oracle E-Business Suite Release 12
          https://metalink.oracle.com/metalink/plsql/ml2_documents.showDocument?p_database_id=NOT&p_id=387859.1

          Please note that Oracle E-Business Suite R12 is not certified on CentOS.

          Oracle's Certification Matrices
          http://www.oracle.com/technology/support/metalink/index.html
          • 2. Re: Error after hard reboot
            KdeGraaf
            Hi hsawwan,

            This is from adapcctl.txt:
            08/07/08-23:57:16 :: adapcctl.sh version 120.6.12000000.2
            08/07/08-23:57:16 :: adapcctl.sh: starting OPMN if it is not running 
            
            opmnctl: opmn is already running.
            
            08/07/08-23:57:16 :: adapcctl.sh: starting OPMN managed OHS instance 
            
            opmnctl: starting opmn managed processes...
            ================================================================================
            opmn id=linux12.localdomain:6200
                no processes or applications matched this request
            
            08/07/08-23:57:16 :: adapcctl.sh: exiting with status 150 
            Going to check the metalink note now.
            • 3. Re: Error after hard reboot
              KdeGraaf
              Hi,

              I did run the autoconfig. Restarted the server but it is still not working.
              08/08/08-09:10:59 :: adoacorectl.sh version 120.11.12000000.2
              
              
              08/08/08-09:10:59 :: adoacorectl.sh: starting OPMN if it is not running 
              
              opmnctl: opmn is already running.
              
              08/08/08-09:10:59 :: adoacorectl.sh: Starting OPMN managed OACORE OC4J instance  
              
              opmnctl: starting opmn managed processes...
              ================================================================================
              opmn id=linux12.localdomain:6200
                  0 of 1 processes started.
              
              ias-instance id=VIS_linux12.linux12.localdomain
              ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
              --------------------------------------------------------------------------------
              ias-component/process-type/process-set:
                  OC4J/oacore/default_group/
              
              Error
              --> Process (index=1,uid=1403143385,pid=4380)
                  failed to start a managed process after the maximum retry limit
                  Log:
                  /Oracle/VIS/inst/apps/VIS_linux12/logs/ora/10.1.3/opmn/OC4J~oacore~default_group~1
              
              
              08/08/08-09:11:50 :: adoacorectl.sh: exiting with status 204
              Maybe this status 204 is because yesterday evening I did run root.sh, could that be possible?
              • 4. Re: Error after hard reboot
                Hussein Sawwan-Oracle
                opmnctl: opmn is already running.
                This indicates that the process is already running. Did you try to stop all the application services and kill the orphan processes from the OS?
                • 5. Re: Error after hard reboot
                  KdeGraaf
                  Hi hsawwan,

                  I rebooted the server so I think all application services all killed then.
                  I always start oracle with this script:
                  su oracle /Oracle/VIS/db/tech_st/10.2.0/appsutil/scripts/VIS_linux12/addbctl.sh start
                  su oracle /Oracle/VIS/db/tech_st/10.2.0/appsutil/scripts/VIS_linux12/addlnctl.sh start VIS
                  su applmgr /Oracle/VIS/inst/apps/VIS_linux12/admin/scripts/adstrtal.sh
                  • 6. Re: Error after hard reboot
                    Hussein Sawwan-Oracle
                    Please verify that you have no active processes by issuing the following (after you shutdown the services):
                    $ ps -ef | grep -i applmgr
                    Assuming applmgr is the owner of the application tier files.
                    • 7. Re: Error after hard reboot
                      KdeGraaf
                      This is the result:

                      [applmgr@linux12 root]$ ps -ef | grep -i applmgr
                      root 3961 3938 0 12:31 pts/1 00:00:00 su applmgr
                      applmgr 3962 3961 1 12:31 pts/1 00:00:00 bash
                      applmgr 3988 3962 0 12:31 pts/1 00:00:00 ps -ef
                      applmgr 3989 3962 0 12:31 pts/1 00:00:00 grep -i applmgr
                      • 8. Re: Error after hard reboot
                        Hussein Sawwan-Oracle
                        Do you get the same messages when starting the services now (i.e. opmnctl: opmn is already running)?

                        Could you please post the contents of the hosts file.
                        • 9. Re: Error after hard reboot
                          KdeGraaf
                          Content of hosts:
                          # Do not remove the following line, or various programs
                          # that require network functionality will fail.
                          127.0.0.1     localhost.localdomain     localhost
                          10.0.0.20     linux12.localdomain     linux12
                          ::1     localhost6.localdomain6     localhost6
                          10.0.0.10     demo1     demo1
                          10.0.0.15     demo2     demo2
                          10.0.0.180     mark     mark
                          10.0.0.170     klaas     klaas
                          10.0.0.160     jacob     jacob
                          10.0.0.150     richard     richard
                          10.0.0.30     share01     share01
                          10.0.0.25     demo12     demo12
                          10.0.0.5     printer     printer
                          Starting Oracle now....
                          • 10. Re: Error after hard reboot
                            KdeGraaf
                            And the log:
                            08/08/08-13:33:46 :: adapcctl.sh version 120.6.12000000.2
                            08/08/08-13:33:46 :: adapcctl.sh: starting OPMN if it is not running 
                            
                            opmnctl: opmn is already running.
                            
                            08/08/08-13:33:46 :: adapcctl.sh: starting OPMN managed OHS instance 
                            
                            opmnctl: starting opmn managed processes...
                            ================================================================================
                            opmn id=linux12.localdomain:6200
                                no processes or applications matched this request
                            
                            08/08/08-13:33:46 :: adapcctl.sh: exiting with status 150 
                            • 11. Re: Error after hard reboot
                              KdeGraaf
                              Hi hsawwan,

                              Is my hosts file correct? And other suggestions on what to do?


                              Thanks
                              • 12. Re: Error after hard reboot
                                Hussein Sawwan-Oracle
                                Is my hosts file correct?
                                I can see that it is correct.
                                And other suggestions on what to do?
                                I would suggest you review the installed packages. Have you encountered any error during the installation? Do you have all pre-req. packages installed?
                                • 13. Re: Error after hard reboot
                                  KdeGraaf
                                  The installed finshed perfect with no errors. And I have installed all te required packeges installed. Higher versions except for openmotif, for that I have installed the version listed in MetalinkNote 402310.1