This discussion is archived
7 Replies Latest reply: Dec 18, 2012 9:34 PM by 972755 RSS

rac resource status is unknown only vip and asm is running fine

972755 Newbie
Currently Being Moderated
i have just install oracle 10g clusterware and oracle software on RHEL 5
only asm and vip is working fine ..rest of the resource not working status is unknown

[oracle@rac1 bin]$ ./crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE UNKNOWN rac1
ora.rac1.gsd application ONLINE UNKNOWN rac1
ora.rac1.ons application ONLINE UNKNOWN rac1
ora.rac1.vip application ONLINE ONLINE rac1
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE UNKNOWN rac2
ora.rac2.gsd application ONLINE UNKNOWN rac2
ora.rac2.ons application ONLINE UNKNOWN rac2
ora.rac2.vip application ONLINE ONLINE rac2



i tried to start is manually but its return error like this

[oracle@rac1 bin]$ ./crs_stop ora.rac1.LISTENER_RAC1.lsnr -f
Attempting to stop `ora.rac1.LISTENER_RAC1.lsnr` on member `rac1`
Stop of `ora.rac1.LISTENER_RAC1.lsnr` on member `rac1` succeeded.
[oracle@rac1 bin]$ ./crs_start ora.rac1.LISTENER_RAC1.lsnr -f
Attempting to start `ora.rac1.LISTENER_RAC1.lsnr` on member `rac1`
`ora.rac1.LISTENER_RAC1.lsnr` on member `rac1` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
CRS-0215: Could not start resource 'ora.rac1.LISTENER_RAC1.lsnr'.

[oracle@rac1 bin]$ ./crs_start ora.rac1.LISTENER_RAC1.lsnr -f
CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.rac1.LISTENER_RAC1.lsnr'

CRS-0223: Resource 'ora.rac1.LISTENER_RAC1.lsnr' has placement error.

[oracle@rac1 bin]$ ./crs_start ora.rac2.LISTENER_RAC2.lsnr -f
CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.rac2.LISTENER_RAC2.lsnr'

CRS-0223: Resource 'ora.rac2.LISTENER_RAC2.lsnr' has placement error.



i reboot the system 3 times but problem is same plz help me to solve this problem...
  • 1. Re: rac resource status is unknown only vip and asm is running fine
    979309 Newbie
    Currently Being Moderated
    Hi

    The first step is always check the log files. Have you look at log directories?

    Cluster Ready Services Daemon (CRSD) Log Files
    $GRID_HOME/log/host_name/crsd

    Cluster Synchronization Services (CSS)
    $GRID_HOME/log/host_name/cssd

    Oracle Cluster Registry records
    $GRID_HOME/log/host_name/crsd

    Oracle Grid Naming Service (GNS)
    $GRID_HOME/log/host_name/gnsd

    Oracle High Availability Services Daemon (OHASD)
    $GRID_HOME/log/host_name/ohasd

    Event Manager (EVM) information generated by evmd
    $GRID_HOME/log/host_name/evmd


    Do you changed any IP ADDRESS or HOSTNAMES?

    More information: http://docs.oracle.com/cd/E14072_01/rac.112/e10717/troubleshoot.htm


    Victor

    Edited by: 976306 on Dec 18, 2012 3:53 AM

    Edited by: 976306 on Dec 18, 2012 3:53 AM

    Edited by: 976306 on Dec 18, 2012 3:53 AM

    Edited by: 976306 on Dec 18, 2012 3:54 AM
  • 2. Re: rac resource status is unknown only vip and asm is running fine
    Victor Armbrust Oracle ACE
    Currently Being Moderated
    Sorry, Just post with my incorret user.



    Hi

    The first step is always check the log files. Have you look at log directories?

    Cluster Ready Services Daemon (CRSD) Log Files
    $GRID_HOME/log/host_name/crsd

    Cluster Synchronization Services (CSS)
    $GRID_HOME/log/host_name/cssd

    Oracle Cluster Registry records
    $GRID_HOME/log/host_name/crsd

    Oracle Grid Naming Service (GNS)
    $GRID_HOME/log/host_name/gnsd

    Oracle High Availability Services Daemon (OHASD)
    $GRID_HOME/log/host_name/ohasd

    Event Manager (EVM) information generated by evmd
    $GRID_HOME/log/host_name/evmd


    Do you changed any IP ADDRESS or HOSTNAMES?

    More information: http://docs.oracle.com/cd/E14072_01/rac.112/e10717/troubleshoot.htm


    Victor
  • 3. Re: rac resource status is unknown only vip and asm is running fine
    972755 Newbie
    Currently Being Moderated
    Hi thanks for reply ...i have diff directory structure bocz i m using oracle 10g ,and i check the logs but i m not getting any use full information for logs,later i stop and start resource manually some time all the resource come online ..but every time after server reboot i have to make all the resource manually online ..by crs_start and i have not change anything after instillation,why all the resource not come online automatically ....plz help me to solve this ....
  • 4. Re: rac resource status is unknown only vip and asm is running fine
    Victor Armbrust Oracle ACE
    Currently Being Moderated
    Ok. Is there nothing on $CRS_HOME/log or $ORACLE_HOME/log (crs/log) ?
    What about $CRS_HOME/crs/<node_name>/alert.log?

    Can you please post the output for ocrcheck?
  • 5. Re: rac resource status is unknown only vip and asm is running fine
    861120 Explorer
    Currently Being Moderated
    Hi

    crs_start -all should not be used in managing CRS/RAC database resources.

    Do not use Oracle Clusterware commands prefixed with crs_ (except for crs_stat) on resources that have names beginning with the prefix ora unless Oracle Support Services asks you to. Instead, use the Server Control (SRVCTL) utility on Oracle resources.

    Please Try it and post the resuls:

    srvctl stop nodeapps -n <node name>
    srvctl start nodeapps -n <node name>
  • 6. Re: rac resource status is unknown only vip and asm is running fine
    972755 Newbie
    Currently Being Moderated
    /opt/app/crs/log/rac1/alertrac1.log output..

    [cssd(5441)]CRS-1605:CSSD voting file is online: /dev/raw/raw2. Details in /opt/app/crs/log/rac1/cssd/ocssd.log.
    2012-12-19 05:17:02.561
    [cssd(5441)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 .
    2012-12-19 05:17:03.998
    [crsd(4718)]CRS-1012:The OCR service started on node rac1.
    2012-12-19 05:17:04.028
    [evmd(5327)]CRS-1401:EVMD started on node rac1.
    2012-12-19 05:17:12.456
    [crsd(4718)]CRS-1201:CRSD started on node rac1.
    2012-12-19 05:17:23.668
    [cssd(5441)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 rac2 .
    2012-12-19 07:23:46.211
    [cssd(5216)]CRS-1605:CSSD voting file is online: /dev/raw/raw2. Details in /opt/app/crs/log/rac1/cssd/ocssd.log.
    2012-12-19 07:23:49.399
    [cssd(5216)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 .
    2012-12-19 07:23:50.458
    [crsd(4709)]CRS-1012:The OCR service started on node rac1.
    2012-12-19 07:23:50.490
    [evmd(5098)]CRS-1401:EVMD started on node rac1.
    2012-12-19 07:23:55.776
    [crsd(4709)]CRS-1201:CRSD started on node rac1.
    2012-12-19 07:25:00.583
    [cssd(5216)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 rac2 .
    2012-12-20 00:09:11.199
    [cssd(5286)]CRS-1605:CSSD voting file is online: /dev/raw/raw2. Details in /opt/app/crs/log/rac1/cssd/ocssd.log.
    2012-12-20 00:09:14.907
    [cssd(5286)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 .
    2012-12-20 00:09:16.446
    [evmd(5128)]CRS-1401:EVMD started on node rac1.
    2012-12-20 00:09:16.459
    [crsd(4756)]CRS-1012:The OCR service started on node rac1.
    2012-12-20 00:10:02.406
    [crsd(4756)]CRS-1201:CRSD started on node rac1.
    2012-12-20 00:10:39.220
    [cssd(5286)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 rac2 .


    /opt/app/crs/log/rac1/crsd/crsd.log output:-


    2012-12-20 00:09:15.606: [    CRSD][7390912]0Daemon Version: 10.2.0.1.0 Active Version: 10.2.0.1.0
    2012-12-20 00:09:15.606: [    CRSD][7390912]0Active Version and Software Version are same
    2012-12-20 00:09:15.606: [ CRSMAIN][7390912]0Initializing OCR
    2012-12-20 00:09:15.801: [  OCRRAW][7390912]proprioo: for disk 0 (/dev/raw/raw1), id match (1), my id set (1669906634,1028247821) total id sets (1), 1st set (1669906634,1028247821), 2nd set (0,0) my votes (2), total votes (2)
    2012-12-20 00:09:16.264: [  OCRMAS][3065346960]th_master:12: I AM THE NEW OCR MASTER at incar 1. Node Number = 1
    2012-12-20 00:09:16.310: [  OCRRAW][3065346960]proprioo: for disk 0 (/dev/raw/raw1), id match (1), my id set (1669906634,1028247821) total id sets (1), 1st set (1669906634,1028247821), 2nd set (0,0) my votes (2), total votes (2)
    2012-12-20 00:09:16.524: [    CRSD][7390912]0ENV Logging level for Module: allcomp 0
    2012-12-20 00:09:16.528: [    CRSD][7390912]0ENV Logging level for Module: default 0
    2012-12-20 00:09:16.534: [    CRSD][7390912]0ENV Logging level for Module: COMMCRS 0
    2012-12-20 00:09:16.536: [    CRSD][7390912]0ENV Logging level for Module: COMMNS 0
    2012-12-20 00:09:16.549: [    CRSD][7390912]0ENV Logging level for Module: CRSUI 0
    2012-12-20 00:09:16.556: [    CRSD][7390912]0ENV Logging level for Module: CRSCOMM 0
    2012-12-20 00:09:16.559: [    CRSD][7390912]0ENV Logging level for Module: CRSRTI 0
    2012-12-20 00:09:16.562: [    CRSD][7390912]0ENV Logging level for Module: CRSMAIN 0
    2012-12-20 00:09:16.564: [    CRSD][7390912]0ENV Logging level for Module: CRSPLACE 0
    2012-12-20 00:09:16.567: [    CRSD][7390912]0ENV Logging level for Module: CRSAPP 0
    2012-12-20 00:09:16.570: [    CRSD][7390912]0ENV Logging level for Module: CRSRES 0
    2012-12-20 00:09:16.573: [    CRSD][7390912]0ENV Logging level for Module: CRSOCR 0
    2012-12-20 00:09:16.576: [    CRSD][7390912]0ENV Logging level for Module: CRSTIMER 0
    2012-12-20 00:09:16.582: [    CRSD][7390912]0ENV Logging level for Module: CRSEVT 0
    2012-12-20 00:09:16.586: [    CRSD][7390912]0ENV Logging level for Module: CRSD 0
    2012-12-20 00:09:16.590: [    CRSD][7390912]0ENV Logging level for Module: CLUCLS 0
    2012-12-20 00:09:16.593: [    CRSD][7390912]0ENV Logging level for Module: OCRRAW 0
    2012-12-20 00:09:16.596: [    CRSD][7390912]0ENV Logging level for Module: OCROSD 0
    2012-12-20 00:09:16.600: [    CRSD][7390912]0ENV Logging level for Module: CSSCLNT 0
    2012-12-20 00:09:16.603: [    CRSD][7390912]0ENV Logging level for Module: OCRAPI 0
    2012-12-20 00:09:16.606: [    CRSD][7390912]0ENV Logging level for Module: OCRUTL 0
    2012-12-20 00:09:16.609: [    CRSD][7390912]0ENV Logging level for Module: OCRMSG 0
    2012-12-20 00:09:16.613: [    CRSD][7390912]0ENV Logging level for Module: OCRCLI 0
    2012-12-20 00:09:16.651: [    CRSD][7390912]0ENV Logging level for Module: OCRCAC 0
    2012-12-20 00:09:16.671: [    CRSD][7390912]0ENV Logging level for Module: OCRSRV 0
    2012-12-20 00:09:16.678: [    CRSD][7390912]0ENV Logging level for Module: OCRMAS 0
    2012-12-20 00:09:16.678: [ CRSMAIN][7390912]0Filename is /opt/app/crs/crs/init/rac1.pid
    2012-12-20 00:09:16.956: [ CRSMAIN][7390912]0Using Authorizer location: /opt/app/crs/crs/auth/
    2012-12-20 00:09:17.080: [ CRSMAIN][7390912]0Initializing RTI
    2012-12-20 00:09:17.085: [CRSTIMER][2845059984]0Timer Thread Starting.
    [  clsdmt][2866039696]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=rac1DBG_CRSD))
    2012-12-20 00:09:17.236: [  CRSRES][7390912]0Parameter SECURITY = 1, running in USER Mode
    2012-12-20 00:09:17.236: [ CRSMAIN][7390912]0Initializing EVMMgr
    2012-12-20 00:09:17.475: [ COMMCRS][2834570128]clsc_connect: (0xa4e7cc8) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=SYSTEM.evm.acceptor.auth))

    2012-12-20 00:09:18.437: [ COMMCRS][2834570128]clsc_connect: (0xa45b6b8) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=SYSTEM.evm.acceptor.auth))

    2012-12-20 00:09:18.888: [ COMMCRS][2834570128]clsc_connect: (0xa45af68) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=SYSTEM.evm.acceptor.auth))

    2012-12-20 00:09:19.575: [ COMMCRS][2834570128]clsc_connect: (0xa456f50) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=SYSTEM.evm.acceptor.auth))

    2012-12-20 00:09:20.029: [ COMMCRS][2834570128]clsc_connect: (0xa45b330) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=SYSTEM.evm.acceptor.auth))

    2012-12-20 00:09:47.675: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [172339896] retval lht [-27] Signal CV.
    2012-12-20 00:09:55.947: [ CRSMAIN][7390912]0CRSD locked during state recovery, please wait.
    2012-12-20 00:10:01.118: [ CRSMAIN][7390912]0CRSD recovered, unlocked.
    2012-12-20 00:10:01.127: [ CRSMAIN][7390912]0QS socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
    2012-12-20 00:10:02.329: [ CRSMAIN][7390912]0CRSD UI socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=CRSD_UI_SOCKET))
    2012-12-20 00:10:02.400: [ CRSMAIN][7390912]0E2E socket on: (ADDRESS=(PROTOCOL=tcp)(HOST=rac1-priv)(PORT=49896))
    2012-12-20 00:10:02.401: [ CRSMAIN][7390912]0Starting Threads
    2012-12-20 00:10:02.406: [ CRSMAIN][7390912]0CRS Daemon Started.
    2012-12-20 00:10:09.239: [  CRSRES][2740161424]0startRunnable: setting CLI values
    2012-12-20 00:10:09.612: [  CRSRES][2729671568]0startRunnable: setting CLI values
    2012-12-20 00:10:10.089: [  CRSRES][2740161424]0Attempting to start `ora.rac1.vip` on member `rac1`
    2012-12-20 00:10:10.147: [  CRSRES][2729671568]0Attempting to start `ora.rac2.vip` on member `rac1`
    2012-12-20 00:10:25.883: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:25.895: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:25.907: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:25.929: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.009: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.036: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.077: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.099: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.112: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.124: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.138: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.156: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.181: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.197: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.213: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.225: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.239: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.253: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.265: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.275: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.288: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.299: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.312: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.324: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.335: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.351: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.366: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.379: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.389: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.400: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.414: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.426: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.438: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.449: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.460: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.473: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.486: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.500: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.513: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.523: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.537: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.551: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.563: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.574: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.587: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.607: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.620: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.636: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.650: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.662: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.680: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:26.694: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [176455408] retval lht [-27] Signal CV.
    2012-12-20 00:10:40.640: [  CRSRES][2740161424]0Start of `ora.rac1.vip` on member `rac1` succeeded.
    2012-12-20 00:10:42.653: [  CRSRES][2729671568]0Start of `ora.rac2.vip` on member `rac1` succeeded.
    2012-12-20 00:10:44.290: [  CRSRES][2740161424]0startRunnable: setting CLI values
    2012-12-20 00:10:44.600: [  CRSRES][2729671568]0StopResource: setting CLI values
    2012-12-20 00:10:44.601: [  CRSRES][2740161424]0Attempting to start `ora.rac1.ASM1.asm` on member `rac1`
    2012-12-20 00:10:44.669: [  CRSRES][2729671568]0Attempting to stop `ora.rac2.vip` on member `rac1`
    2012-12-20 00:10:46.051: [  CRSRES][2729671568]0Stop of `ora.rac2.vip` on member `rac1` succeeded.
    2012-12-20 00:10:46.154: [ COMMCRS][2696936336]clsc_send_msg: (0xa84ecb0) NS err (12571, 12560), transport (530, 111, 0)

    2012-12-20 00:10:46.154: [ CRSCOMM][2729671568]0CLSC connection failed, ret = 9
    2012-12-20 00:10:46.154: [  CRSEVT][2729671568]0invokepeer ret 200
    2012-12-20 00:10:46.302: [  CRSRES][2729671568]0Remote start never sent to rac2: X_E2E_NotSent : Failed to connect to node: rac2
    (File: caa_CmdRTI.cpp, line: 492

    2012-12-20 00:10:46.303: [  CRSRES][2729671568][ALERT]0Remote start for `ora.rac2.vip` failed on member `rac2`
    2012-12-20 00:10:46.446: [  CRSEVT][2740161424]0CAAMonitorHandler :: 0:Action Script /opt/app/oracle/product/db_1/bin/racgwrap(start) timed out for ora.rac1.ASM1.asm! (timeout=600)
    2012-12-20 00:10:46.446: [  CRSAPP][2740161424]0StartResource error for ora.rac1.ASM1.asm error code = -2
    2012-12-20 00:10:46.558: [  CRSRES][2729671568]0startRunnable: setting CLI values
    2012-12-20 00:10:46.625: [  CRSEVT][2740161424]0CAAMonitorHandler :: 0:Action Script /opt/app/oracle/product/db_1/bin/racgwrap(stop) timed out for ora.rac1.ASM1.asm! (timeout=600)
    2012-12-20 00:10:46.626: [  CRSAPP][2740161424]0StopResource error for ora.rac1.ASM1.asm error code = -2
    2012-12-20 00:10:46.665: [  CRSRES][2729671568]0Attempting to start `ora.rac2.vip` on member `rac1`
    2012-12-20 00:10:46.750: [  CRSRES][2740161424]0X_OP_StopResourceFailed : Stop Resource failed
    (File: rti.cpp, line: 1698

    2012-12-20 00:10:46.750: [  CRSRES][2740161424][ALERT]0`ora.rac1.ASM1.asm` on member `rac1` has experienced an unrecoverable failure.
    2012-12-20 00:10:46.750: [  CRSRES][2740161424]0Human intervention required to resume its availability.
    2012-12-20 00:10:46.938: [  CRSRES][2740161424]0startRunnable: setting CLI values
    2012-12-20 00:10:46.978: [  CRSRES][2740161424]0Attempting to start `ora.rac1.LISTENER_RAC1.lsnr` on member `rac1`
    2012-12-20 00:10:47.541: [  CRSEVT][2740161424]0CAAMonitorHandler :: 0:Action Script /opt/app/oracle/product/db_1/bin/racgwrap(start) timed out for ora.rac1.LISTENER_RAC1.lsnr! (timeout=600)
    2012-12-20 00:10:47.541: [  CRSAPP][2740161424]0StartResource error for ora.rac1.LISTENER_RAC1.lsnr error code = -2
    2012-12-20 00:10:47.807: [  CRSEVT][2740161424]0CAAMonitorHandler :: 0:Action Script /opt/app/oracle/product/db_1/bin/racgwrap(stop) timed out for ora.rac1.LISTENER_RAC1.lsnr! (timeout=600)
    2012-12-20 00:10:47.807: [  CRSAPP][2740161424]0StopResource error for ora.rac1.LISTENER_RAC1.lsnr error code = -2
    2012-12-20 00:10:48.181: [  CRSRES][2740161424]0X_OP_StopResourceFailed : Stop Resource failed
    (File: rti.cpp, line: 1698

    2012-12-20 00:10:48.181: [  CRSRES][2740161424][ALERT]0`ora.rac1.LISTENER_RAC1.lsnr` on member `rac1` has experienced an unrecoverable failure.
    2012-12-20 00:10:48.181: [  CRSRES][2740161424]0Human intervention required to resume its availability.
    2012-12-20 00:10:50.692: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [177094664] retval lht [-27] Signal CV.
    2012-12-20 00:11:00.139: [  CRSRES][2729671568]0Start of `ora.rac2.vip` on member `rac1` succeeded.
    2012-12-20 00:11:00.257: [  CRSRES][2729671568]0StopResource: setting CLI values
    2012-12-20 00:11:00.269: [  CRSRES][2729671568]0Attempting to stop `ora.rac2.vip` on member `rac1`
    2012-12-20 00:11:00.882: [  CRSRES][2729671568]0Stop of `ora.rac2.vip` on member `rac1` succeeded.
    2012-12-20 00:11:00.938: [  CRSRES][2729671568]0Attempting to start `ora.rac2.vip` on member `rac2`
    2012-12-20 00:11:23.937: [  CRSRES][2729671568]0Start of `ora.rac2.vip` on member `rac2` failed.
    2012-12-20 00:11:24.051: [  CRSRES][2729671568]0startRunnable: setting CLI values
    2012-12-20 00:11:24.067: [  CRSRES][2729671568]0Attempting to start `ora.rac2.vip` on member `rac1`
    2012-12-20 00:11:36.257: [  OCRSRV][3044367248]th_select_handler: Failed to retrieve procctx from ht. constr = [177090520] retval lht [-27] Signal CV.
    2012-12-20 00:11:43.061: [  CRSAPP][2729671568]0StartResource error for ora.rac2.vip error code = 1
    2012-12-20 00:11:46.191: [  CRSAPP][2740161424]0CheckResource error for ora.rac1.vip error code = 1
    2012-12-20 00:11:46.196: [  CRSRES][2740161424]0In stateChanged, ora.rac1.vip target is ONLINE
    2012-12-20 00:11:46.197: [  CRSRES][2740161424]0ora.rac1.vip on rac1 went OFFLINE unexpectedly
    2012-12-20 00:11:46.197: [  CRSRES][2740161424]0StopResource: setting CLI values
    2012-12-20 00:11:46.211: [  CRSRES][2740161424]0Attempting to stop `ora.rac1.vip` on member `rac1`
    2012-12-20 00:11:46.422: [  CRSRES][2729671568]0Start of `ora.rac2.vip` on member `rac1` failed.
    2012-12-20 00:11:46.815: [  CRSRES][2686446480]0startRunnable: setting CLI values
    2012-12-20 00:11:46.848: [  CRSRES][2729671568]0startRunnable: setting CLI values
    2012-12-20 00:11:47.139: [  CRSRES][2686446480]0Attempting to start `ora.rac1.ons` on member `rac1`
    2012-12-20 00:11:47.163: [  CRSRES][2729671568]0Attempting to start `ora.rac1.gsd` on member `rac1`
    2012-12-20 00:11:47.266: [  CRSRES][2675956624]0Attempting to start `ora.rac2.gsd` on member `rac2`
    2012-12-20 00:11:47.571: [  CRSRES][2665466768]0Attempting to start `ora.rac2.ons` on member `rac2`
    2012-12-20 00:11:49.679: [  CRSEVT][2686446480]0CAAMonitorHandler :: 0:Action Script /opt/app/crs/bin/racgwrap(start) timed out for ora.rac1.ons! (timeout=600)
    2012-12-20 00:11:49.680: [  CRSAPP][2686446480]0StartResource error for ora.rac1.ons error code = -2
    2012-12-20 00:11:49.710: [  CRSEVT][2729671568]0CAAMonitorHandler :: 0:Action Script /opt/app/crs/bin/racgwrap(start) timed out for ora.rac1.gsd! (timeout=600)
    2012-12-20 00:11:49.710: [  CRSAPP][2729671568]0StartResource error for ora.rac1.gsd error code = -2
    2012-12-20 00:11:49.794: [  CRSEVT][2686446480]0CAAMonitorHandler :: 0:Action Script /opt/app/crs/bin/racgwrap(stop) timed out for ora.rac1.ons! (timeout=600)
    2012-12-20 00:11:49.794: [  CRSAPP][2686446480]0StopResource error for ora.rac1.ons error code = -2
    2012-12-20 00:11:49.813: [  CRSRES][2686446480]0X_OP_StopResourceFailed : Stop Resource failed
    (File: rti.cpp, line: 1698

    2012-12-20 00:11:49.813: [  CRSRES][2686446480][ALERT]0`ora.rac1.ons` on member `rac1` has experienced an unrecoverable failure.
    2012-12-20 00:11:49.813: [  CRSRES][2686446480]0Human intervention required to resume its availability.
    2012-12-20 00:11:49.839: [  CRSEVT][2729671568]0CAAMonitorHandler :: 0:Action Script /opt/app/crs/bin/racgwrap(stop) timed out for ora.rac1.gsd! (timeout=600)
    2012-12-20 00:11:49.839: [  CRSAPP][2729671568]0StopResource error for ora.rac1.gsd error code = -2
    2012-12-20 00:11:49.865: [  CRSRES][2729671568]0X_OP_StopResourceFailed : Stop Resource failed
    (File: rti.cpp, line: 1698

    2012-12-20 00:11:49.865: [  CRSRES][2729671568][ALERT]0`ora.rac1.gsd` on member `rac1` has experienced an unrecoverable failure.
    2012-12-20 00:11:49.865: [  CRSRES][2729671568]0Human intervention required to resume its availability.
    2012-12-20 00:11:50.076: [  CRSRES][2740161424]0Stop of `ora.rac1.vip` on member `rac1` succeeded.
    2012-12-20 00:11:50.079: [  CRSRES][2740161424]0ora.rac1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
    2012-12-20 00:11:50.103: [  CRSRES][2740161424]0ora.rac1.vip failed on rac1 relocating.
    2012-12-20 00:11:50.520: [  CRSRES][2740161424]0Attempting to start `ora.rac1.vip` on member `rac2`
    2012-12-20 00:11:50.773: [  CRSRES][2675956624][ALERT]0`ora.rac2.gsd` on member `rac2` has experienced an unrecoverable failure.
    2012-12-20 00:11:50.774: [  CRSRES][2675956624]0Human intervention required to resume its availability.
    2012-12-20 00:11:50.810: [  CRSRES][2665466768][ALERT]0`ora.rac2.ons` on member `rac2` has experienced an unrecoverable failure.
    2012-12-20 00:11:50.810: [  CRSRES][2665466768]0Human intervention required to resume its availability.
    2012-12-20 00:12:13.625: [  CRSRES][2740161424]0Start of `ora.rac1.vip` on member `rac2` failed.
    2012-12-20 00:12:13.994: [  CRSRES][2686446480]0startRunnable: setting CLI values
    2012-12-20 00:12:26.925: [ COMMCRS][2824080272]clsc_receive: (0xa975368) Lock release 1 failed, rc 2

    2012-12-20 00:12:26.925: [ COMMCRS][2824080272]clsc_receive: (0xa975368) error 2

    2012-12-20 00:12:33.062: [  CRSAPP][2686446480]0StartResource error for ora.rac2.vip error code = 1



    [root@rac1 bin]# ./crsctl check crs
    CSS appears healthy
    CRS appears healthy
    EVM appears healthy
    [root@rac1 bin]#



    current output of crs_stat

    [root@rac1 bin]# ./crs_stat -t
    Name Type Target State Host
    ------------------------------------------------------------
    ora....SM1.asm application ONLINE UNKNOWN rac1
    ora....C1.lsnr application ONLINE UNKNOWN rac1
    ora.rac1.gsd application ONLINE UNKNOWN rac1
    ora.rac1.ons application ONLINE UNKNOWN rac1
    ora.rac1.vip application ONLINE OFFLINE
    ora....SM2.asm application ONLINE OFFLINE
    ora....C2.lsnr application ONLINE OFFLINE
    ora.rac2.gsd application ONLINE UNKNOWN rac2
    ora.rac2.ons application ONLINE UNKNOWN rac2
    ora.rac2.vip application ONLINE OFFLINE
  • 7. Re: rac resource status is unknown only vip and asm is running fine
    972755 Newbie
    Currently Being Moderated
    hi i tried srvctl but the problem still same...


    [root@rac2 bin]# ./srvctl start nodeapps -n rac2
    rac2:ora.rac2.vip:Interface eth0 checked failed (host=rac2)
    rac2:ora.rac2.vip:Invalid parameters, or failed to bring up VIP (host=rac2)
    rac2:ora.rac2.vip:Interface eth0 checked failed (host=rac2)
    rac2:ora.rac2.vip:Invalid parameters, or failed to bring up VIP (host=rac2)
    CRS-1006: No more members to consider
    CRS-0215: Could not start resource 'ora.rac2.vip'.
    rac2:ora.rac2.vip:Interface eth0 checked failed (host=rac2)
    rac2:ora.rac2.vip:Invalid parameters, or failed to bring up VIP (host=rac2)
    rac2:ora.rac2.vip:Interface eth0 checked failed (host=rac2)
    rac2:ora.rac2.vip:Invalid parameters, or failed to bring up VIP (host=rac2)
    CRS-0215: Could not start resource 'ora.rac2.LISTENER_RAC2.lsnr'.
    [root@rac2 bin]#

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points