6 Replies Latest reply: Nov 3, 2012 2:57 PM by 685299 RSS

    Nodeapps status shows VIP is running on One Node Only

    540301
      Hi DBAs,

      I have a 2 node RAC (10.2.0.4) running on AIX 5.3 64 bit. Once I ran 'srvctl status nodeapps -n hostdb01' , I am getting the following output which seems to be fine.

      VIP is running on node: hostdb01
      GSD is running on node: hostdb01
      PRKO-2016 : Error in checking condition of listener on node: hostdb01
      ONS daemon is running on node: hostdb01


      But when I ran the above command from other node 'srvctl status nodeapps -n hostdb02' , I am getting following output

      VIP is running on node: hostdb01
      GSD is running on node: hostdb02
      PRKO-2016 : Error in checking condition of listener on node: hostdb02
      ONS daemon is running on node: hostdb02

      Is it a normal behavior or VIP for second node should be running on both nodes separately? If It need to be fix then please advise so.

      Thanks
      -Samar-
        • 1. Re: Nodeapps status shows VIP is running on One Node Only
          Satishbabu Gunukula
          Hi,

          Check the status using

          crs_stat -t

          If any applications are UNKNOWN/OFFLINE state then run below command to get complete name of the application.

          crs_stat

          Try to stop and start the application using below commands

          crs_stop <application name>
          crs_start <application name>
          for ex:- crs_stop ora.rac1.gsd

          If you still receive any errors run below commands in order for clean stop and start. Some times individual application stop and start will not work properly.

          crs_stop –all
          crs_start –all

          Regards
          Satishbabu Gunukula
          http://oracleracexpert.blogspot.com/
          • 2. Re: Nodeapps status shows VIP is running on One Node Only
            540301
            Hi,


            I check only the problem is in 2 following services using crs_ctl -t


            NAME=ora.hostdb02.ORALS01_hostdb02.lsnr
            TYPE=application
            TARGET=ONLINE
            STATE=OFFLINE



            NAME=ora.hostdb02.vip
            TYPE=application
            TARGET=ONLINE
            STATE=ONLINE on hostdb01

            I try to start the lsnr but getting error

            lsnrctl start ORALS01_hostdb02

            LSNRCTL for IBM/AIX RISC System/6000: Version 10.2.0.4.0 - Production on 10-AUG-2009 21:27:43

            Copyright (c) 1991, 2007, Oracle. All rights reserved.

            Starting /oracle/product/10.2.0/db_1/bin/tnslsnr: please wait...

            TNSLSNR for IBM/AIX RISC System/6000: Version 10.2.0.4.0 - Production
            System parameter file is /oracle/product/10.2.0/db_1/network/admin/listener.ora
            Log messages written to /oracle/product/10.2.0/db_1/network/log/orals01_hostdb02.log
            Error listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=hostdb02-vip)(PORT=49125)(IP=FIRST)))
            TNS-12545: Connect failed because target host or object does not exist
            TNS-12560: TNS:protocol adapter error
            TNS-00515: Connect failed because target host or object does not exist
            IBM/AIX RISC System/6000 Error: 68: Can't assign requested address

            Listener failed to start. See the error message(s) above...



            The ping to hostdb02-vip is working though.

            Regards
            -Samar-
            • 3. Re: Nodeapps status shows VIP is running on One Node Only
              Satishbabu Gunukula
              Can you drop and recreate the listener with port 1521 for testing purpose and later you can change what ever the port you want.

              Why you are not using default port 1521?

              Also publish listener,tnsnames.ora files.

              Once you are done with above steps run below commands and let me know if you see any errors.

              crs_stop –all
              crs_start –all

              Thanks
              Satishbabu Gunukula
              http://oracleracexpert.blogspot.com/
              • 4. Re: Nodeapps status shows VIP is running on One Node Only
                Surachart Opun
                From your error:
                please check hostdb02-vip in /etc/hosts file

                By the way, Could you post /oracle/product/10.2.0/db_1/network/admin/listener.ora ?

                check hostdb02-vip host:
                $ ping hostdb02-vip

                If you don't map in /etc/hosts file, that made listener not know about IP Address of "hostdb02-vip"
                Check it ...
                • 5. Re: Nodeapps status shows VIP is running on One Node Only
                  599025
                  Perform the below steps and let kow...

                  From hostdb01
                  --------------------

                  crs_stop ora.hostdb02.vip

                  If its not stopped use -f option

                  FROM hostdb02
                  ---------------------

                  crs_start ora.hostdb02.vip

                  check the vip status:

                  crs_stat ora.hostdb02.vip

                  If vip is not started in host2

                  ping the vip in host2 (check the vip configuration)

                  If vip is started in host 2, start the listener in host 2...
                  • 6. Re: Nodeapps status shows VIP is running on One Node Only
                    685299
                    please check your /etc/hosts file the listener file is trying to start
                    using the wrong hostname.