1 2 Previous Next 23 Replies Latest reply: Mar 7, 2013 12:06 PM by user6418608 RSS

    Oracle11g R2 RAC ASM is not starting Why?

    879152
      Hi,

      I have install oracle 11g r2 rac with asm in two nodes. OS is hp-Unix.
      For creating spfile in asm:
      Rac was up and running, today I have create pfile from memory and then create spfile from pfile in +DATA location.
      After reboot rac server asm is not starting.

      Connected to an idle instance.
      SQL> startup
      ORA-01078: failure in processing system parameters
      ORA-29701: unable to connect to Cluster Synchronization Service
      SQL>

      another way: ./asmcmd

      grid@dcpdb1 [u01/app/11.2.0/grid/bin]# ./asmcmd
      Connected to an idle instance.
      ASMCMD> startup
      ORA-01078: failure in processing system parameters
      ORA-29701: unable to connect to Cluster Synchronization Service
      Connected to an idle instance.
      ASMCMD>

      ## ./asmca
      grid@dcpdb1 [u01/app/11.2.0/grid/bin]# ./asmca
      Unable to get the local node, Possibly Oracle Grid Infrastructure might be down
      grid@dcpdb1 [u01/app/11.2.0/grid/bin]#

      grid@dcpdb1 [u01/app/11.2.0/grid/bin]# ./crs_stat -t
      CRS-0184: Cannot communicate with the CRS daemon.

      How can I start asm instance. pls help.

      Thanks
      Solaiman
        • 1. Re: Oracle11g R2 RAC ASM is not starting Why?
          Mihael
          First try to start clusterware on each node :

          crsctl start crs
          • 2. Re: Oracle11g R2 RAC ASM is not starting Why?
            661846
            hi .. try this ... start services first ..


            [oracle@ ~]$ export ORACLE_HOME="yourlocation"
            [oracle@ ~]$ export ORACLE_SID=+ASM
            [oracle@ ~]$ sqlplus "/as sysasm"


            [oracle@56gdtsg-+ASM bin] ./crsctl start resource ora.cssd
            CRS-2672: Attempting to start 'ora.cssd' on 'oel5u4'
            CRS-2679: Attempting to clean 'ora.diskmon' on 'oel5u4'
            CRS-2681: Clean of 'ora.diskmon' on 'oel5u4' succeeded
            CRS-2672: Attempting to start 'ora.diskmon' on 'oel5u4'
            CRS-2676: Start of 'ora.diskmon' on 'oel5u4' succeeded
            CRS-2676: Start of 'ora.cssd' on 'oel5u4' succeeded
            [oracle@oel5u4-+ASM bin] ./crs_stat -t
            Name Type Target State Host
            ------------------------------------------------------------
            ora.DATA.dg ora....up.type OFFLINE OFFLINE
            ora.REC.dg ora....up.type OFFLINE OFFLINE
            ora....VERR.lsnr ora....er.type ONLINE ONLINE oel5u4
            ora.asm ora.asm.type OFFLINE OFFLINE
            ora.cssd ora.cssd.type ONLINE ONLINE oel5u4
            ora.diskmon ora....on.type ONLINE ONLINE oel5u4
            ora.orcl.db ora....se.type OFFLINE OFFLINE
            [oracle@56gdtsg-+ASM bin] sqlplus / as sysasm

            SQL*Plus: Release 11.2.0.1.0 Production on
            Copyright (c) 1982, 2009, Oracle. All rights reserved.

            Connected to an idle instance.


            SQL> startup
            ASM instance started

            Total System Global Area xxxxxxx bytes
            Fixed Size xxxxxxbytes
            Variable Size xxxxxxxxbytes
            ASM Cache xxxxxxxbytes
            ASM diskgroups mounted

            Edited by: Jega on Mar 5, 2013 3:11 PM
            • 3. Re: Oracle11g R2 RAC ASM is not starting Why?
              879152
              Hi,
              Thanks for reply.


              As root user: in node 1

              root@dcpdb1 [u01/app/11.2.0/grid/bin]# ./crsctl start crs
              CRS-4640: Oracle High Availability Services is already active
              CRS-4000: Command Start failed, or completed with errors.

              As grid user: node 1
              grid@dcpdb1 [u01/app/11.2.0/grid/bin]# ./crsctl start crs
              CRS-4563: Insufficient user privileges.

              CRS-4000: Command Start failed, or completed with errors.

              Pls reply.
              • 4. Re: Oracle11g R2 RAC ASM is not starting Why?
                661846
                use grid or oracle user
                • 6. Re: Oracle11g R2 RAC ASM is not starting Why?
                  879152
                  Hi Jega,

                  Thanks. but it is not working.

                  grid@dcpdb1 [u01/app/11.2.0/grid/bin]# export GRID_HOME=/u01/app/11.2.0/grid
                  grid@dcpdb1 [u01/app/11.2.0/grid/bin]# export ORACLE_BASE=/u01/app/grid
                  grid@dcpdb1 [u01/app/11.2.0/grid/bin]# export ORACLE_HOME=$GRID_HOME
                  grid@dcpdb1 [u01/app/11.2.0/grid/bin]# export ORACLE_SID=+ASM1
                  grid@dcpdb1 [u01/app/11.2.0/grid/bin]# cd $ORACLE_HOME/bin
                  grid@dcpdb1 [u01/app/11.2.0/grid/bin]# ./crsctl start resource ora.cssd
                  CRS-4535: Cannot communicate with Cluster Ready Services
                  CRS-4000: Command Start failed, or completed with errors.
                  grid@dcpdb1 [u01/app/11.2.0/grid/bin]# ./crs_stat -t
                  CRS-0184: Cannot communicate with the CRS daemon.

                  grid@dcpdb1 [u01/app/11.2.0/grid/bin]# ./sqlplus " / as sysasm"

                  SQL*Plus: Release 11.2.0.1.0 Production on Tue Mar 5 13:19:10 2013

                  Copyright (c) 1982, 2009, Oracle. All rights reserved.

                  Connected to an idle instance.

                  SQL> startup
                  ORA-01078: failure in processing system parameters
                  ORA-29701: unable to connect to Cluster Synchronization Service
                  SQL>

                  Pls reply.
                  • 7. Re: Oracle11g R2 RAC ASM is not starting Why?
                    Mihael
                    As root user: in node 1

                    root@dcpdb1 [u01/app/11.2.0/grid/bin]# ./crsctl start crs
                    CRS-4640: Oracle High Availability Services is already active
                    CRS-4000: Command Start failed, or completed with errors.
                    First check as root :

                    crsctl check crs
                    • 8. Re: Oracle11g R2 RAC ASM is not starting Why?
                      661846
                      Please check crsd.log from GI_HOME/log/nodename/crsd and also paste the last lines of output of alert_nodename.log from GI_HOME/log/nodename.
                      • 9. Re: Oracle11g R2 RAC ASM is not starting Why?
                        879152
                        Hi,

                        As root user on node 1:

                        root@dcpdb1 [u01/app/11.2.0/grid/bin]# ./crsctl check crs
                        CRS-4638: Oracle High Availability Services is online
                        CRS-4535: Cannot communicate with Cluster Ready Services
                        CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
                        CRS-4533: Event Manager is online

                        As root user on node 2:
                        # ./crsctl check crs
                        CRS-4638: Oracle High Availability Services is online
                        CRS-4535: Cannot communicate with Cluster Ready Services
                        CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
                        CRS-4533: Event Manager is online
                        #
                        • 10. Re: Oracle11g R2 RAC ASM is not starting Why?
                          879152
                          Hi Jega,

                          crsd.log last couple of lines:

                          2013-03-04 13:07:09.628: [    AGFW][56] Agfw Proxy Server received the message: AGENT_SUICIDE[Proxy] ID 20486:1880
                          2013-03-04 13:07:09.628: [    AGFW][56] Suicide request received from /u01/app/11.2.0/grid/bin/oraagent_grid
                          2013-03-04 13:07:09.628: [    AGFW][56] Agfw Proxy Server replying to the message: AGENT_SUICIDE[Proxy] ID 20486:1880
                          2013-03-04 13:07:09.634: [ CRSCOMM][53][FFAIL] Ipc: Couldnt clscreceive message, no message: 11
                          2013-03-04 13:07:09.634: [ CRSCOMM][53] Ipc: Client disconnected.
                          2013-03-04 13:07:09.634: [ CRSCOMM][53][FFAIL] IpcL: Listener got clsc error 11 for memNum. 2
                          2013-03-04 13:07:09.634: [ CRSCOMM][53] IpcL: connection to member 2 has been removed
                          2013-03-04 13:07:09.634: [CLSFRAME][53] Removing IPC Member:Relative
                          2013-03-04 13:07:09.634: [CLSFRAME][53] Disconnected from AGENT process: Relative
                          2013-03-04 13:07:09.635: [   CRSPE][61] Disconnected from server:
                          2013-03-04 13:07:09.635: [    AGFW][56] Agfw Proxy Server received process disconnected notification, count=1
                          2013-03-04 13:07:09.635: [    AGFW][56] /u01/app/11.2.0/grid/bin/oraagent_grid disconnected.
                          2013-03-04 13:07:09.635: [    AGFW][56] Agent /u01/app/11.2.0/grid/bin/oraagent_grid[2877] stopped!
                          2013-03-04 13:07:09.635: [ CRSCOMM][56] IpcL: removeConnection: Member 2 does not exist.


                          aler_+ASM1.log last line

                          Instance shutdown complete
                          • 11. Re: Oracle11g R2 RAC ASM is not starting Why?
                            Mihael
                            Yes, put here crs log located at <GI home>/log/hostname/crsd
                            • 12. Re: Oracle11g R2 RAC ASM is not starting Why?
                              Mihael
                              Check CSS logs also : <GI home>/log/hostname/cssd
                              • 13. Re: Oracle11g R2 RAC ASM is not starting Why?
                                879152
                                Hi,

                                in <GI home>/log/hostname/cssd
                                there is no css log.
                                • 14. Re: Oracle11g R2 RAC ASM is not starting Why?
                                  879152
                                  Hi,

                                  If not possible to start asm, pls help the way to create asm again.
                                  1 2 Previous Next