1 2 Previous Next 16 Replies Latest reply on Mar 6, 2014 9:54 AM by FreddieEssex

    Several RAC Doubts - After Installation

    karthiksingh_dba

      Dear Legends,

       

      I'm new to RAC Installation. I hope I have successfully installed in VMWARE Workstation with 2 nodes. To Ensure that Installation is successful I did some checks and Environment Details as follows

       

      Host: Windows Server 2008

      Guest : OEL 5.7 64 bit

      RAC1 Details: Primary

      HOSTNAME: verac1.host.net

      URL: verac1.host.net

      PORT: 1521

      SID: orcl1

       

      RAC2 Details:

      HOSTNAME: verac2.host.net

      URL: verac2.host.net

      PORT: 1521

      SID: orcl2

       

      My Questions/Doubts:

       

      1. TNSNAMES.ORA

       

      Why there is a change in the TNSNAMES.ora file for the parameter "HOST" and "SERVICE_NAME"? Is that the RAC correctly installed?

       

      In the VERAC1 and VERAC2  /u01/app/oracle/product/11.2.0/db_1/network/admin/tnsnames.ora file

       

      ORCL =

        (DESCRIPTION =

          (ADDRESS = (PROTOCOL = TCP)(HOST = verac-scan)(PORT = 1521))

          (CONNECT_DATA =

            (SERVER = DEDICATED)

            (SERVICE_NAME = orcl.host.net)

          )

        )

       

      I'm not able to connect with the above TNS,

       

      but I'm able to connect to the DB with following Details

      URL: verac1.host.net

      Port: 1521

      SID: orcl1

       

      URL: verac2.host.net

      Port: 1521

      SID: orcl2

       

      2. DB Status

       

      When I checked the DB Status at my morning time via sqlplus in VERAC1 it shows ORACLE NOT AVAILABLE but while at the same time I checked in SQL DEVELOPER I'm able to open.

      Then by Afternoon while checking the DB Status via sqlplus it shows OPEN - Terribly confused here. During this time VERAC2 is UP and Available. May I know how to check this or let me know your suggestions.

       

      3. EM

       

      When I tried to access RAC1's EM (https://verac1.host.net:1158/em) everything is working fine and at the same time I tried to login RAC2's EM (https://verac2.host.net:1158/em) it was not able to load the page. I just want to understand here that I'm right or wrong

      - Only the Primary (RAC1/VERAC1) nodes will be holding the EM Configuration - I think all the Nodes will have all the EM/DB Console files

      - If the Primary Node is Down then we can able to access other Nodes EM ?

       

      4. SIZE

       

      When I checked the DB Size in both Nodes it shows only 2GB Total, Used and 0 for Free.

      - I hope this will be auto extending the Tablespaces ?

      - And this will be using the ASM Disks right?

       

      5. CRSCTL

       

      [oracle@verac1 ~]$ crsctl check cluster

      -bash: crsctl: command not found

       

      but when I navigate into $GRID_HOME/bin/ and then if I execute the crsctl it works. May I know why?

       

      [oracle@verac1 bin]$ ./crsctl check cluster -all

      **************************************************************

      verac1:

      CRS-4537: Cluster Ready Services is online

      CRS-4529: Cluster Synchronization Services is online

      CRS-4533: Event Manager is online

      **************************************************************

      verac2:

      CRS-4537: Cluster Ready Services is online

      CRS-4529: Cluster Synchronization Services is online

      CRS-4533: Event Manager is online

      **************************************************************

       

      Kindly Please let me know your valuable suggestions. Also Please refer some famous links for getting familiarized in RAC.

       

      Thanks,

      Karthik

        • 1. Re: Several RAC Doubts - After Installation
          Antonyro-Oracle

          Yes,in 11gR2 RAC,client uses SCAN To connect to the database.

          http://www.oracle.com/technetwork/database/clustering/overview/scan-129069.pdf

          2)You need to check the environment variables set properly(ORACLE_HOME,SID)

          3)Since you are using EM Console,you have to configure it properly from oracle home

          You can see the status by emctl status dbconsole.

          4)

           

          5)

          This is because of the environment variable setting.You should enure the PATH varible has GRID_HOME/bin entries.

           

          Regards

          Robin

          • 2. Re: Several RAC Doubts - After Installation
            vkatta

            Here are some basic commands for RAC administration

            ORACLE-DBA-BAY: 11gR2 Rac Administration

            1 person found this helpful
            • 3. Re: Several RAC Doubts - After Installation
              Ravinder Rathi-Oracle

              Hi Karthik,

               

              For basic RAC Architecture knowledge please refer the below links:

               

              http://www.datadisk.co.uk/html_docs/rac/architecture.htm

              RAC - Cheatsheet

               

               

               

              For more RAC knowledge, suggest you to please go through the below MOS Document:

               

              RAC: Frequently Asked Questions (Doc ID 220970.1)

              • 4. Re: Several RAC Doubts - After Installation
                BPeaslandDBA

                1. TNSNAMES.ORA

                 

                Why there is a change in the TNSNAMES.ora file for the parameter "HOST" and "SERVICE_NAME"? Is that the RAC correctly installed?

                 

                It was changed because your connections should now be using the newer SCAN Listener. The info looks correct. You should verify your scan listeners are running:

                 

                srvctl status scan_listener

                 

                2. DB Status

                 

                When I checked the DB Status at my morning time via sqlplus in VERAC1 it shows ORACLE NOT AVAILABLE but while at the same time I checked in SQL DEVELOPER I'm able to open.

                Then by Afternoon while checking the DB Status via sqlplus it shows OPEN - Terribly confused here. During this time VERAC2 is UP and Available. May I know how to check this or let me know your suggestions.


                What did you use to check the DB Status? Can you post the exact details? There are lots of ways to do this.


                3. EM

                 

                When I tried to access RAC1's EM..


                Me personally, I only use the centralized EM version. Either EM12c Cloud Control or EM11g Grid Control. I won't use DB Control for RAC environments.


                4. SIZE

                 

                When I checked the DB Size in both Nodes it shows only 2GB Total, Used and 0 for Free.

                - I hope this will be auto extending the Tablespaces ?

                - And this will be using the ASM Disks right?


                Please show how you checked the DB size. What SQL statements or commands did you issue?

                Tablespaces don't autoextend. Datafiles do. You can query DBA_DATA_FILES to see if the files for the tablespaces will autoextend or not, and by how much.


                5. CRSCTL

                [oracle@verac1 ~]$ crsctl check cluster

                -bash: crsctl: command not found

                 

                but when I navigate into $GRID_HOME/bin/ and then if I execute the crsctl it works. May I know why?



                Because you don't have $GRID_HOME/bin in your $PATH environment variable. For bash shell, that would be:

                 

                export GRID_HOME=/path_to_grid_home

                export PATH=$GRID_HOME/bin:$PATH

                 

                That being said, I never put $GRID_HOME/bin in my PATH. I don't want to accidentally run GI utilities. So I explicitly 'cd' to $GRID_HOME/bin when I run to run utilities there.

                 

                HTH,

                Brian


                1 person found this helpful
                • 5. Re: Several RAC Doubts - After Installation
                  karthiksingh_dba

                  Thanks for your valuable response.

                   

                  1. TNSNAMES.ORA

                    I checked and the output as follows. I hope everything is okay.

                   

                  srvctl status scan_listener

                   

                  [oracle@verac1 ~]$ srvctl status scan_listener

                  SCAN Listener LISTENER_SCAN1 is enabled

                  SCAN listener LISTENER_SCAN1 is running on node verac2

                  SCAN Listener LISTENER_SCAN2 is enabled

                  SCAN listener LISTENER_SCAN2 is running on node verac1

                  SCAN Listener LISTENER_SCAN3 is enabled

                  SCAN listener LISTENER_SCAN3 is running on node verac1

                  [oracle@verac1 ~]$

                   

                  2. DB Status

                   

                  What did you use to check the DB Status? Can you post the exact details? There are lots of ways to do this.

                   

                  - Using sqlplus logged in as "/ as sysdba" and it shows that it connected to an idle instance.

                  - Queried select status from v$instance; and it said ORACLE NOT AVAILABLE at that time. Currently issue is not prevailing.



                  3. EM

                  Me personally, I only use the centralized EM version. Either EM12c Cloud Control or EM11g Grid Control. I won't use DB Control for RAC environments.

                   

                  I'm not getting you here. Do I need to use the Grid Control means? EM?

                   


                  4. SIZE

                   

                  When I checked the DB Size in both Nodes it shows only 2GB Total, Used and 0 for Free.

                  - I hope this will be auto extending the Tablespaces ?

                  - And this will be using the ASM Disks right?


                  Please show how you checked the DB size. What SQL statements or commands did you issue?

                  Tablespaces don't autoextend. Datafiles do. You can query DBA_DATA_FILES to see if the files for the tablespaces will autoextend or not, and by how much.


                  For checking the DB size

                  select    round(sum(used.bytes) / 1024 / 1024 / 1024 ) || ' GB' "Database Size"

                  ,    round(sum(used.bytes) / 1024 / 1024 / 1024 ) -

                      round(free.p / 1024 / 1024 / 1024) || ' GB' "Used space"

                  ,    round(free.p / 1024 / 1024 / 1024) || ' GB' "Free space"

                  from    (select    bytes

                      from    v$datafile

                      union    all

                      select    bytes

                      from     v$tempfile

                      union     all

                      select     bytes

                      from     v$log) used

                  ,    (select sum(bytes) as p

                      from dba_free_space) free

                  group by free.p

                  /


                  and for TABLESPACE


                  SELECT *

                  FROM

                  ( SELECT

                      c.tablespace_name,

                      ROUND(a.bytes/1048576,2)                    MB_Allocated,

                      ROUND(b.bytes/1048576,2)                    MB_Free,

                      ROUND((a.bytes-b.bytes)/1048576,2)          MB_Used,

                      ROUND(b.bytes/a.bytes * 100,2)              tot_Pct_Free,

                      ROUND((a.bytes-b.bytes)/a.bytes,2) * 100    tot_Pct_Used

                    FROM

                      ( SELECT

                          tablespace_name,

                          SUM(a.bytes) bytes

                        FROM

                          sys.DBA_DATA_FILES a

                        GROUP BY

                          tablespace_name

                      ) a,

                      ( SELECT

                          a.tablespace_name,

                          NVL(SUM(b.bytes),0) bytes

                        FROM

                          sys.DBA_DATA_FILES a,

                          sys.DBA_FREE_SPACE b

                        WHERE

                          a.tablespace_name = b.tablespace_name

                          AND a.file_id = b.file_id

                        GROUP BY

                          a.tablespace_name

                      ) b,

                      sys.DBA_TABLESPACES c

                    WHERE

                      a.tablespace_name = b.tablespace_name(+)

                      AND a.tablespace_name = c.tablespace_name

                    )

                  WHERE

                    tot_Pct_Used >=0

                  ORDER BY

                    tablespace_name;

                   

                  TABLESPACE SIZE

                   

                  TABLESPACE_NAME  MB_ALLOCATED  MB_FREE  MB_USED  TOT_PCT_FREE  TOT_PCT_USED

                  EXAMPLE                   100                      21.25           78.75          21.25                   79

                  SYSAUX                      790                     45.88          744.13           5.81                    94

                  SYSTEM                      690                      0.31          689.69           0.05                   100

                  UNDOTBS1                   105                     87.75           17.25           83.57                  16

                  UNDOTBS2                     50                     28.75           21.25           57.5                    43

                  USERS                            5                        0.94            4.06           18.75                   81

                   

                  AUTOEXTEND DETAILS

                   

                  TABLESPACE_NAME   FILE_NAME                                                 AUTOEXTENSIBLE     MAXBYTES     INCREMENT_BY

                  USERS                        +DATA/orcl/datafile/users.259.840670107        YES                          34359721984    160

                  UNDOTBS1                  +DATA/orcl/datafile/undotbs1.258.840670107   YES                          34359721984    640

                  SYSAUX                      +DATA/orcl/datafile/sysaux.257.840670107      YES                          34359721984    1280

                  SYSTEM                     +DATA/orcl/datafile/system.256.840670105      YES                          34359721984    1280

                  EXAMPLE                   +DATA/orcl/datafile/example.264.840670235     YES                          34359721984    80

                  UNDOTBS2                 +DATA/orcl/datafile/undotbs2.265.840670453    YES                          34359721984    3200

                   

                  Thanks,

                  Karthik

                   

                  Message was edited by: karthiksingh_dba

                  • 6. Re: Several RAC Doubts - After Installation
                    karthiksingh_dba

                    Hi,

                     

                    Then I have some more questions.

                     

                    6. NETWORK

                    Since I'm not able to ping with the outside world so I could not able to receive any Notifications even mailx is not sending any mails. Is there any way to fix this?

                     

                    7. START/STOP SEQUENCE

                    Is there any START and STOP Sequence in RAC? May I follow the below steps?

                    Stop on each node :

                    emctl stop dbconsole

                    srvctl stop database -d db_name

                    srvctl stop asm -n node_name

                    srvctl stop nodeapps -n node_name --> in 11.2 stops only ONS and eONS because of some dependencies.

                    crsctl stop crs --root


                    Or stop csr on all nodes of clusterware:

                    crsctl stop cluster -all

                     

                    Thanks,

                    Karthik

                    • 7. Re: Several RAC Doubts - After Installation
                      karthiksingh_dba

                      Hi,

                       

                      And then Just now I noticed I have 4 ASM DISKS but I think it is not mounted. Am I wrong here?

                       

                      8. DISK/MOUNT POINTS

                      [root@verac1 ~]# oracleasm listdisks

                      DATA1

                      DATA2

                      DATA3

                      DATA4

                       

                      But while checking the Space I noted that it is not mounted.

                      [root@verac1 ~]# df -h

                      Filesystem            Size  Used Avail Use% Mounted on

                      /dev/sda1             9.5G  4.0G  5.1G  45% /

                      /dev/sda3              16G   14G  1.5G  91% /u01

                      tmpfs                 1.5G  882M  606M  60% /dev/shm

                       

                      [root@verac1 ~]# mount

                      /dev/sda1 on / type ext3 (rw)

                      proc on /proc type proc (rw)

                      sysfs on /sys type sysfs (rw)

                      devpts on /dev/pts type devpts (rw,gid=5,mode=620)

                      /dev/sda3 on /u01 type ext3 (rw)

                      tmpfs on /dev/shm type tmpfs (rw)

                      none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)

                      sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)

                      oracleasmfs on /dev/oracleasm type oracleasmfs (rw)

                      nfsd on /proc/fs/nfsd type nfsd (rw)

                       

                      Partitions Details

                       

                      [root@verac1 ~]# fdisk -l

                       

                      Disk /dev/sda: 32.2 GB, 32212254720 bytes

                      255 heads, 63 sectors/track, 3916 cylinders

                      Units = cylinders of 16065 * 512 = 8225280 bytes

                       

                         Device Boot      Start         End      Blocks   Id  System

                      /dev/sda1   *           1        1275    10241406   83  Linux

                      /dev/sda2            1276        1785     4096575   82  Linux swap / Solaris

                      /dev/sda3            1786        3916    17117257+  83  Linux

                       

                      Disk /dev/sdb: 5368 MB, 5368709120 bytes

                      181 heads, 40 sectors/track, 1448 cylinders

                      Units = cylinders of 7240 * 512 = 3706880 bytes

                       

                         Device Boot      Start         End      Blocks   Id  System

                      /dev/sdb1               1        1448     5241740   83  Linux

                       

                      Disk /dev/sdc: 5368 MB, 5368709120 bytes

                      181 heads, 40 sectors/track, 1448 cylinders

                      Units = cylinders of 7240 * 512 = 3706880 bytes

                       

                         Device Boot      Start         End      Blocks   Id  System

                      /dev/sdc1               1        1449     5241856   83  Linux

                       

                      Disk /dev/sdd: 5368 MB, 5368709120 bytes

                      181 heads, 40 sectors/track, 1448 cylinders

                      Units = cylinders of 7240 * 512 = 3706880 bytes

                       

                         Device Boot      Start         End      Blocks   Id  System

                      /dev/sdd1               1        1448     5241740   83  Linux

                       

                      Disk /dev/sde: 5368 MB, 5368709120 bytes

                      181 heads, 40 sectors/track, 1448 cylinders

                      Units = cylinders of 7240 * 512 = 3706880 bytes

                       

                         Device Boot      Start         End      Blocks   Id  System

                      /dev/sde1               1        1448     5241740   83  Linux

                       

                      Do I need to mount it under /u01?

                       

                      Thanks,

                      Karthik

                      • 8. Re: Several RAC Doubts - After Installation
                        BPeaslandDBA

                        6. NETWORK

                        Since I'm not able to ping with the outside world so I could not able to receive any Notifications even mailx is not sending any mails. Is there any way to fix this?


                        Why can't you ping the outside world? You should be able to. I'm not a network expert, but every time I've set up a VM, it got network info from the host and pings from the VM were essentially passed to the host. I'm afraid I can't help you in this area, but fixing those pings should help your issues.


                        7. START/STOP SEQUENCE

                        Is there any START and STOP Sequence in RAC? May I follow the below steps?


                        This will make it easy...to stop everything:


                        $GRID_HOME/bin/crsctl stop crs


                        To start everything:


                        $GRID_HOME/bin/crsctl start crs


                        You will need to run the above as root.


                        Unless you used a different configuration option, the database will SHUTDOWN IMMEDIATE and STARTUP OPEN. You can verify with:


                        srvctl config database -d db_name


                        It will show you the startup/shutdown options CRS will perform on the database instances when CRS goes down or up.


                        HTH,

                        Brian



                        1 person found this helpful
                        • 9. Re: Several RAC Doubts - After Installation
                          BPeaslandDBA

                          And then Just now I noticed I have 4 ASM DISKS but I think it is not mounted. Am I wrong here?

                           

                          8. DISK/MOUNT POINTS

                          [root@verac1 ~]# oracleasm listdisks

                          DATA1

                          DATA2

                          DATA3

                          DATA4


                          Unfortunately, I don't use ASM. My ASM experience is very limited so I hope someone else can answer your ASM question.


                          Cheers,

                          Brian

                          • 10. Re: Several RAC Doubts - After Installation
                            FreddieEssex

                            Hi,

                             

                            You wouldn't see ASM diskgroups mounted as they are not filesystems.

                             

                            You would not expect them to be listed when you run the df -h command.

                             

                            To check for space etc query the v$asm_diskgroup view.

                            1 person found this helpful
                            • 11. Re: Several RAC Doubts - After Installation
                              SridharPonnada

                              Hope... you are following this DOC

                               

                              Note 810394.1: RAC and Oracle Clusterware Best Practices and Starter Kit (Platform Independent)

                              • 12. Re: Several RAC Doubts - After Installation
                                karthiksingh_dba

                                6. NETWORK

                                Since I'm not able to ping with the outside world so I could not able to receive any Notifications even mailx is not sending any mails. Is there any way to fix this?


                                Why can't you ping the outside world? You should be able to. I'm not a network expert, but every time I've set up a VM, it got network info from the host and pings from the VM were essentially passed to the host. I'm afraid I can't help you in this area, but fixing those pings should help your issues.

                                Note sure Why I'm not able to ping the outside world? But If I disable the eth1(Private) for RAC then I'm able to ping the outside network.


                                7. START/STOP SEQUENCE

                                Is there any START and STOP Sequence in RAC? May I follow the below steps?


                                This will make it easy...to stop everything:


                                $GRID_HOME/bin/crsctl stop crs


                                To start everything:


                                $GRID_HOME/bin/crsctl start crs


                                Is this One of the Recommended Method?

                                Thanks,

                                Karthik

                                • 13. Re: Several RAC Doubts - After Installation
                                  karthiksingh_dba
                                  7. START/STOP SEQUENCE

                                  In the Stopping sequence I tried both

                                   

                                  crsctl stop crs in verac1 node and it stopped

                                  -listener

                                  -db

                                  -asm

                                   

                                  I hope this command to be used specifically in all nodes or we need to specify the nodes or all command. Now here my doubt is Will the EM wont be down? We have to bring it down manually?

                                  Then again I brought it up and then using the below command

                                   

                                  crsctl stop cluster -all and it stopped everything in both the nodes.

                                   

                                  Using this command it shows or Opens the EM login page but it did not allowed me to login saying that Invalid Login.

                                  Thanks again for all to help me for learning a lot.

                                   

                                  Thanks,

                                  Karthik

                                  • 14. Re: Several RAC Doubts - After Installation
                                    FreddieEssex

                                    Hi,

                                     

                                    crsctl stop/start crs only stops or starts crs on your local node.

                                    crsctl stop/start cluster -all will stop CRS on all nodes so you only need to run it fro one of your RAC nodes.

                                     

                                    I would imagine that your EM is not configured as a resource in CRS and is therefore independant and something you would need to stop/start separately from CRS.

                                     

                                    I would also think that the invalid login is likely to be because your database is down.

                                    1 person found this helpful
                                    1 2 Previous Next