11 Replies Latest reply: Dec 26, 2012 1:51 AM by 981663 RSS

    Clusterware (Unable to determine the sharedness of) in VMware 2.0x server

    445907
      Hi!
      Before of all solution is in my last post so I put the star to someone so others can see this is solved!
      Ok let's go with the problem...

      RAC 10.2, on RHEL 5.3 EE, in VmWare server 2.01. I'm trying to avoid deprecated RHEL 4.X raw devices service and to test ASM for DB instance.

      Funny part is at the very of begining of clusterware part in a way that I can "clufvy" one by one node (on both nodes), but when check them together on any node I got error!!

      I try to make "dev/sdb1" for crs and "dev/sdc1" for voting disks. "dev/sdd1" and "dev/sde1" are prepared for ASM (which I was able to mount with asmlib).

      Here is brief description of situation and resulting outputs. This is test environment so some ownership may be overmaximized (in searching for solution of the problem).

      Ownership:
      [oracle@ishacrac2x ~]$ ls -l /dev/sd*
      brw-r----- 1 root   disk 8,  0 Jun 15  2009 /dev/sda
      brw-r----- 1 root   disk 8,  1 Jun 14 22:16 /dev/sda1
      brw-r----- 1 root   disk 8,  2 Jun 15  2009 /dev/sda2
      brw-rw---- 1 oracle dba  8, 16 Jun 15  2009 /dev/sdb
      brw------- 1 oracle dba  8, 17 Jun 14 22:16 /dev/sdb1
      brw-rw---- 1 oracle dba  8, 32 Jun 15  2009 /dev/sdc
      brw------- 1 oracle dba  8, 33 Jun 14 22:16 /dev/sdc1
      brw-rw---- 1 oracle dba  8, 48 Jun 15  2009 /dev/sdd
      brw------- 1 oracle dba  8, 49 Jun 14 22:16 /dev/sdd1
      brw-rw---- 1 oracle dba  8, 64 Jun 15  2009 /dev/sde
      brw------- 1 oracle dba  8, 65 Jun 14 22:16 /dev/sde1

      [root@ishacrac2x ~]# fdisk -l

      Disk /dev/sda: 6442 MB, 6442450944 bytes
      255 heads, 63 sectors/track, 783 cylinders
      Units = cylinders of 16065 * 512 = 8225280 bytes

         Device Boot      Start         End      Blocks   Id  System
      /dev/sda1   *           1         652     5237158+  83  Linux
      /dev/sda2             653         783     1052257+  82  Linux swap / Solaris

      Disk /dev/sdb: 4294 MB, 4294967296 bytes
      255 heads, 63 sectors/track, 522 cylinders
      Units = cylinders of 16065 * 512 = 8225280 bytes

         Device Boot      Start         End      Blocks   Id  System
      /dev/sdb1               1         522     4192933+  83  Linux

      Disk /dev/sdc: 4294 MB, 4294967296 bytes
      255 heads, 63 sectors/track, 522 cylinders
      Units = cylinders of 16065 * 512 = 8225280 bytes

         Device Boot      Start         End      Blocks   Id  System
      /dev/sdc1               1         522     4192933+  83  Linux

      Disk /dev/sdd: 42.9 GB, 42949672960 bytes
      255 heads, 63 sectors/track, 5221 cylinders
      Units = cylinders of 16065 * 512 = 8225280 bytes

         Device Boot      Start         End      Blocks   Id  System
      /dev/sdd1               1        5221    41937651   83  Linux

      Disk /dev/sde: 42.9 GB, 42949672960 bytes
      255 heads, 63 sectors/track, 5221 cylinders
      Units = cylinders of 16065 * 512 = 8225280 bytes

         Device Boot      Start         End      Blocks   Id  System
      /dev/sde1               1        5221    41937651   83  Linux
      Checkin on node 2 node 1:
      [oracle@ishacrac2x ~]$ export MYNODES=*ishacrac1x*
      [oracle@ishacrac2x ~]$ export MYSHARED=/dev/sdb1,/dev/sdc1,/dev/sdd1,/dev/sde1
      [oracle@ishacrac2x ~]$ /u01/install/clusterware/cluvfy/runcluvfy.sh comp ssa -n $MYNODES -s $MYSHARED
      Verifying shared storage accessibility

      Checking shared storage accessibility...

      "/dev/sdb1" is shared.

      "/dev/sdc1" is shared.

      "/dev/sdd1" is shared.

      "/dev/sde1" is shared.

      Shared storage check was successful on nodes "ishacrac1x".
      Checkin on node 2 node 2:
      [oracle@ishacrac2x ~]$ export MYNODES=*ishacrac2x*
      [oracle@ishacrac2x ~]$ /u01/install/clusterware/cluvfy/runcluvfy.sh comp ssa -n $MYNODES -s $MYSHARED

      Verifying shared storage accessibility

      Checking shared storage accessibility...

      "/dev/sdb1" is shared.

      "/dev/sdc1" is shared.

      "/dev/sdd1" is shared.

      "/dev/sde1" is shared.

      Shared storage check was successful on nodes "ishacrac2x".

      Verification of shared storage accessibility was successful.
      But when I try together then, verify failed!!! Here is an output:
      [oracle@ishacrac2x ~]$ export MYNODES=*ishacrac2x,ishacrac1x*
      [oracle@ishacrac2x ~]$ /u01/install/clusterware/cluvfy/runcluvfy.sh comp ssa -n $MYNODES -s $MYSHARED

      Verifying shared storage accessibility

      Checking shared storage accessibility...

      ERROR:  /dev/sdb1
      Unable to determine the sharedness of /dev/sdb on nodes:
              ishacrac2x,ishacrac1x

      ERROR:  /dev/sdc1
      Unable to determine the sharedness of /dev/sdc on nodes:
              ishacrac2x,ishacrac1x

      ERROR:  /dev/sdd1
      Unable to determine the sharedness of /dev/sdd on nodes:
              ishacrac2x,ishacrac1x

      ERROR:  /dev/sde1
      Unable to determine the sharedness of /dev/sde on nodes:
              ishacrac2x,ishacrac1x

      Shared storage check failed on nodes "ishacrac2x,ishacrac1x".

      Verification of shared storage accessibility was unsuccessful on all the nodes.
      And again without environment variables:
      [oracle@ishacrac2x ~]$ /u01/install/clusterware/cluvfy/runcluvfy.sh comp ssa -n ishacrac2x,ishacrac1x -s $MYSHARED

      Verifying shared storage accessibility

      Checking shared storage accessibility...

      ERROR:  /dev/sdb1
      Unable to determine the sharedness of /dev/sdb on nodes:
              ishacrac2x,ishacrac1x

      ERROR:  /dev/sdc1
      Unable to determine the sharedness of /dev/sdc on nodes:
              ishacrac2x,ishacrac1x

      ERROR:  /dev/sdd1
      Unable to determine the sharedness of /dev/sdd on nodes:
              ishacrac2x,ishacrac1x

      ERROR:  /dev/sde1
      Unable to determine the sharedness of /dev/sde on nodes:
              ishacrac2x,ishacrac1x

      Shared storage check failed on nodes "ishacrac2x,ishacrac1x".

      Verification of shared storage accessibility was unsuccessful on all the nodes.
      The same is on other node (node 1)!

      All other looks god (packages, user equivalence, network...):
      [oracle@ishacrac2x ~]$ /u01/install/clusterware/runcluvfy.sh stage -pre crsinst -n ishacrac1x,ishacrac2x -verbose -osdba dba -orainv dba
      Performing pre-checks for cluster services setup

      Checking node reachability...

      Check: Node reachability from node "ishacrac1x"
        Destination Node                      Reachable?             
        ------------------------------------  ------------------------
        ishacrac1x                            yes                    
        ishacrac2x                            yes                    
      Result: Node reachability check passed from node "ishacrac1x".


      Checking user equivalence...

      Check: User equivalence for user "oracle"
        Node Name                             Comment                
        ------------------------------------  ------------------------
        ishacrac2x                            passed                 
        ishacrac1x                            passed                 
      Result: User equivalence check passed for user "oracle".

      Checking administrative privileges...

      Check: Existence of user "oracle"
        Node Name     User Exists               Comment                
        ------------  ------------------------  ------------------------
        ishacrac2x    yes                       passed                 
        ishacrac1x    yes                       passed                 
      Result: User existence check passed for "oracle".

      Check: Existence of group "dba"
        Node Name     Status                    Group ID               
        ------------  ------------------------  ------------------------
        ishacrac2x    exists                    500                    
        ishacrac1x    exists                    500                    
      Result: Group existence check passed for "dba".

      Check: Membership of user "oracle" in group "dba" [as Primary]
        Node Name         User Exists   Group Exists  User in Group  Primary       Comment    
        ----------------  ------------  ------------  ------------  ------------  ------------
        ishacrac2x        yes           yes           yes           yes           passed     
        ishacrac1x        yes           yes           yes           yes           passed     
      Result: Membership check for user "oracle" in group "dba" [as Primary] passed.

      Administrative privileges check passed.

      Checking node connectivity...


      Interface information for node "ishacrac2x"
        Interface Name                  IP Address                      Subnet         
        ------------------------------  ------------------------------  ----------------
        eth0                            192.168.168.192                 192.168.168.0  
        eth1                            100.100.100.192                 100.100.100.0  


      Interface information for node "ishacrac1x"
        Interface Name                  IP Address                      Subnet         
        ------------------------------  ------------------------------  ----------------
        eth0                            192.168.168.191                 192.168.168.0  
        eth1                            100.100.100.191                 100.100.100.0  


      Check: Node connectivity of subnet "192.168.168.0"
        Source                          Destination                     Connected?     
        ------------------------------  ------------------------------  ----------------
        ishacrac2x:eth0                 ishacrac1x:eth0                 yes            
      Result: Node connectivity check passed for subnet "192.168.168.0" with node(s) ishacrac2x,ishacrac1x.

      Check: Node connectivity of subnet "100.100.100.0"
        Source                          Destination                     Connected?     
        ------------------------------  ------------------------------  ----------------
        ishacrac2x:eth1                 ishacrac1x:eth1                 yes            
      Result: Node connectivity check passed for subnet "100.100.100.0" with node(s) ishacrac2x,ishacrac1x.

      Suitable interfaces for VIP on subnet "100.100.100.0":
      ishacrac2x eth1:100.100.100.192
      ishacrac1x eth1:100.100.100.191

      Suitable interfaces for the private interconnect on subnet "192.168.168.0":
      ishacrac2x eth0:192.168.168.192
      ishacrac1x eth0:192.168.168.191

      Result: Node connectivity check passed.


      Checking system requirements for 'crs'...

      Check: Total memory
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        ishacrac2x    530.76MB (543500KB)       512MB (524288KB)          passed   
        ishacrac1x    530.76MB (543500KB)       512MB (524288KB)          passed   
      Result: Total memory check passed.

      Check: Free disk space in "/tmp" dir
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        ishacrac2x    1.33GB (1391572KB)        400MB (409600KB)          passed   
        ishacrac1x    820.52MB (840216KB)       400MB (409600KB)          passed   
      Result: Free disk space check passed.

      Check: Swap space
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        ishacrac2x    1GB (1052248KB)           1GB (1048576KB)           passed   
        ishacrac1x    1GB (1052248KB)           1GB (1048576KB)           passed   
      Result: Swap space check passed.

      Check: System architecture
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        ishacrac2x    i686                      i686                      passed   
        ishacrac1x    i686                      i686                      passed   
      Result: System architecture check passed.

      Check: Kernel version
        Node Name     Available                 Required                  Comment  
        ------------  ------------------------  ------------------------  ----------
        ishacrac2x    2.6.18-128.el5            2.4.21-15EL               passed   
        ishacrac1x    2.6.18-128.el5            2.4.21-15EL               passed   
      Result: Kernel version check passed.

      Check: Package existence for "make-3.79"
        Node Name                       Status                          Comment        
        ------------------------------  ------------------------------  ----------------
        ishacrac2x                      make-3.81-3.el5                 passed         
        ishacrac1x                      make-3.81-3.el5                 passed         
      Result: Package existence check passed for "make-3.79".

      Check: Package existence for "binutils-2.14"
        Node Name                       Status                          Comment        
        ------------------------------  ------------------------------  ----------------
        ishacrac2x                      binutils-2.17.50.0.6-9.el5      passed         
        ishacrac1x                      binutils-2.17.50.0.6-9.el5      passed         
      Result: Package existence check passed for "binutils-2.14".

      Check: Package existence for "gcc-3.2"
        Node Name                       Status                          Comment        
        ------------------------------  ------------------------------  ----------------
        ishacrac2x                      gcc-4.1.2-44.el5                passed         
        ishacrac1x                      gcc-4.1.2-44.el5                passed         
      Result: Package existence check passed for "gcc-3.2".

      Check: Package existence for "glibc-2.3.2-95.27"
        Node Name                       Status                          Comment        
        ------------------------------  ------------------------------  ----------------
        ishacrac2x                      glibc-2.5-34                    passed         
        ishacrac1x                      glibc-2.5-34                    passed         
      Result: Package existence check passed for "glibc-2.3.2-95.27".

      Check: Package existence for "compat-db-4.0.14-5"
        Node Name                       Status                          Comment        
        ------------------------------  ------------------------------  ----------------
        ishacrac2x                      compat-db-4.2.52-5.1            passed         
        ishacrac1x                      compat-db-4.2.52-5.1            passed         
      Result: Package existence check passed for "compat-db-4.0.14-5".

      Check: Package existence for "compat-gcc-7.3-2.96.128"
        Node Name                       Status                          Comment        
        ------------------------------  ------------------------------  ----------------
        ishacrac2x                      compat-gcc-7.3-2.96.128         passed         
        ishacrac1x                      compat-gcc-7.3-2.96.128         passed         
      Result: Package existence check passed for "compat-gcc-7.3-2.96.128".

      Check: Package existence for "compat-gcc-c++-7.3-2.96.128"
        Node Name                       Status                          Comment        
        ------------------------------  ------------------------------  ----------------
        ishacrac2x                      compat-gcc-c++-7.3-2.96.128     passed         
        ishacrac1x                      compat-gcc-c++-7.3-2.96.128     passed         
      Result: Package existence check passed for "compat-gcc-c++-7.3-2.96.128".

      Check: Package existence for "compat-libstdc++-7.3-2.96.128"
        Node Name                       Status                          Comment        
        ------------------------------  ------------------------------  ----------------
        ishacrac2x                      compat-libstdc++-7.3-2.96.128   passed         
        ishacrac1x                      compat-libstdc++-7.3-2.96.128   passed         
      Result: Package existence check passed for "compat-libstdc++-7.3-2.96.128".

      Check: Package existence for "compat-libstdc++-devel-7.3-2.96.128"
        Node Name                       Status                          Comment        
        ------------------------------  ------------------------------  ----------------
        ishacrac2x                      compat-libstdc++-devel-7.3-2.96.128  passed         
        ishacrac1x                      compat-libstdc++-devel-7.3-2.96.128  passed         
      Result: Package existence check passed for "compat-libstdc++-devel-7.3-2.96.128".

      Check: Package existence for "openmotif-2.2.3"
        Node Name                       Status                          Comment        
        ------------------------------  ------------------------------  ----------------
        ishacrac2x                      openmotif-2.3.1-2.el5           passed         
        ishacrac1x                      openmotif-2.3.1-2.el5           passed         
      Result: Package existence check passed for "openmotif-2.2.3".

      Check: Package existence for "setarch-1.3-1"
        Node Name                       Status                          Comment        
        ------------------------------  ------------------------------  ----------------
        ishacrac2x                      setarch-2.0-1.1                 passed         
        ishacrac1x                      setarch-2.0-1.1                 passed         
      Result: Package existence check passed for "setarch-1.3-1".

      Check: Group existence for "dba"
        Node Name     Status                    Comment                
        ------------  ------------------------  ------------------------
        ishacrac2x    exists                    passed                 
        ishacrac1x    exists                    passed                 
      Result: Group existence check passed for "dba".

      Check: Group existence for "dba"
        Node Name     Status                    Comment                
        ------------  ------------------------  ------------------------
        ishacrac2x    exists                    passed                 
        ishacrac1x    exists                    passed                 
      Result: Group existence check passed for "dba".

      Check: User existence for "nobody"
        Node Name     Status                    Comment                
        ------------  ------------------------  ------------------------
        ishacrac2x    exists                    passed                 
        ishacrac1x    exists                    passed                 
      Result: User existence check passed for "nobody".

      System requirement passed for 'crs'

      Pre-check for cluster services setup was successful.
      As a result, runInstaller has an error "Unable to determine the sharedness of /dev/sdx" like shown on the picture http://i44.tinypic.com/22zs7n.jpg .

      Any help or guide how to avoid that? THX a lot.

      THX
        • 1. Re: Installer problem on clusterware (Unable to determine the sharedness of
          Surachart Opun
          not sure!

          - You Sure! you see /dev/sdb1 and /dev/sdc1 devices and permissions on node 2 like node 1?
          • 3. Re: Installer problem on clusterware (Unable to determine the sharedness of)
            696867
            Your sharedness check reveals that both machines can access the mountpoints, but not simultaneously. In other words your access check check passes but not the sharedness. I gather those mountpoints are on vmware devices, they are not physical devices and therefore are files on the host operating system. This got to be a locking issue with the virtual devices, worth taking a look into your VMX file. Would be nice to see what your scsi adapter/controller used for those shared devices is setup like as well as the individual drives.

            Here is an example of how it should be in your VMX file:

            scsi1.present = “TRUE”
            scsi1.sharedBus = “virtual”
            scsi1.virtualDev = “lsilogic”
            scsi1:0.present = “TRUE”
            scsi1:0.fileName = “/data/vmware/shared/datastore/Disk1.vmdk”
            disk.locking = “false”

            If this is how your virtual scsi drives are already configured, you may be dealing with a timeout issue.

            Let me know if this helped!
            • 4. Re: Installer problem on clusterware (Unable to determine the sharedness of)
              445907
              Hi!

              THX for your post.

              My situation is:
              disk.locking = "FALSE"
              diskLib.dataCacheMaxSize = "0"
              diskLib.dataCacheMaxReadAheadSize = "0"
              diskLib.dataCacheMinReadAheadSize = "0"
              diskLib.dataCachePageSize = "4096"
              diskLib.maxUnsyncedWrites = "0"

              scsi1.present = "TRUE"
              scsi1.sharedBus = "VIRTUAL"
              scsi1.virtualDev = "lsilogic"

              scsi1:0.present = "TRUE"
              scsi1:0.fileName = "z:\Virtual Machines\shared\ocr.vmdk"
              scsi1:0.writeThrough = "TRUE"
              scsi1:0.mode = "independent-persistent"
              scsi1:0.deviceType = "disk"
              scsi1:0.redo = ""

              scsi1:1.present = "TRUE"
              scsi1:1.fileName = "z:\Virtual Machines\shared\voting.vmdk"
              scsi1:1.writeThrough = "TRUE"
              scsi1:1.mode = "independent-persistent"
              scsi1:1.deviceType = "disk"
              scsi1:1.redo = ""

              scsi1:2.present = "TRUE"
              scsi1:2.fileName = "z:\Virtual Machines\shared\data.vmdk"
              scsi1:2.writeThrough = "TRUE"
              scsi1:2.mode = "independent-persistent"
              scsi1:2.deviceType = "disk"
              scsi1:2.redo = ""

              scsi1:3.present = "TRUE"
              scsi1:3.fileName = "z:\Virtual Machines\shared\bckp.vmdk"
              scsi1:3.writeThrough = "TRUE"
              scsi1:3.mode = "independent-persistent"
              scsi1:3.deviceType = "disk"
              scsi1:3.redo = ""

              scsi1.pciSlotNumber = "35"
              As you can see, disk.locking = "FALSE" was declared on the front of the "custom" part.

              Then I tried to add "disk.locking = "FALSE"" after each declaration of the disk. Example:
              scsi1:0.present = "TRUE"
              scsi1:0.fileName = "z:\Virtual Machines\shared\ocr.vmdk"
              scsi1:0.writeThrough = "TRUE"
              scsi1:0.mode = "independent-persistent"
              scsi1:0.deviceType = "disk"
              scsi1:0.redo = ""
              disk.locking = “FALSE”

              scsi1:1.present = "TRUE"
              scsi1:1.fileName = "z:\Virtual Machines\shared\voting.vmdk"
              scsi1:1.writeThrough = "TRUE"
              scsi1:1.mode = "independent-persistent"
              scsi1:1.deviceType = "disk"
              scsi1:1.redo = ""
              disk.locking = “FALSE”

              scsi1:2.present = "TRUE"
              scsi1:2.fileName = "z:\Virtual Machines\shared\data.vmdk"
              scsi1:2.writeThrough = "TRUE"
              scsi1:2.mode = "independent-persistent"
              scsi1:2.deviceType = "disk"
              scsi1:2.redo = ""
              disk.locking = “FALSE”

              scsi1:3.present = "TRUE"
              scsi1:3.fileName = "z:\Virtual Machines\shared\bckp.vmdk"
              scsi1:3.writeThrough = "TRUE"
              scsi1:3.mode = "independent-persistent"
              scsi1:3.deviceType = "disk"
              scsi1:3.redo = ""
              disk.locking = “FALSE”
              But then I got In VmWare log following message:
              Message from teb-ias.teb-ing.hr: 
              File "z:\Virtual Machines\ishacrac1x\ishacrac1x.vmx" line 108: Variable "disk.locking" is already defined.
              File "z:\Virtual Machines\ishacrac1x\ishacrac1x.vmx" line 116: Variable "disk.locking" is already defined.
              File "z:\Virtual Machines\ishacrac1x\ishacrac1x.vmx" line 124: Variable "disk.locking" is already defined.
              It is more then obvious that disk.locking = “FALSE” should appear only once!

              Unfortunately nothing get better when I started the VmWare engines...

              Could you specify where exactly should I place (once I suppose!?) then declaration in .vmx file ? Is there anything wrong with some of mine .vmx settings? I know that this may not be the topic for this forum...but I need to clarify where should I go if oracle looks OK...probably VmWare forum....where I read most of the topics on this subject.

              P.S.
              Now I noticed that you are mentioning something about "....a timeout issue". I have no experience about that .... so this may be a lead but still in the fog regardles I may know what is making that fog
              ;-)

              THX
              • 5. Re: Installer problem on clusterware (Unable to determine the sharedness of)
                696867
                What you have under "My situation is:" looks good.

                If that is how you had it and ran into the sharedness check fail, I wonder how you configured your block devices?

                Take a look at this link: http://download.oracle.com/docs/cd/B28359_01/install.111/b28263/storage.htm#insertedID4

                Are you sure that is how you did it?

                Cheers!
                • 6. Re: Installer problem on clusterware (Unable to determine the sharedness of)
                  445907
                  Hi!

                  THX for your quick info. This is really more then expected
                  ;-)

                  Frankly I'd like to install clusterware on shared disks but without using raw services. There is metalink note 465001.1 (Configuring raw devices (singlepath) for Oracle Clusterware 10g Release 2 (10.2.0) on RHEL5/OEL5). Unfortunatelely l cannot follow that because
                  /sbin/scsi_id -g -s /block/sdb/sdb1
                  returns empty output.
                  For that I found an explanation but then later I run in the initial problem (what started this thread). As you can see sdb, sdb1, sdc, sdc1 are ownby oracle:dba and I think this is enough that in clusterware instalaction (please look at the picture in previous post) I should be able to declare /dev/sdb1 as disk for ocr. Unfortunately I'm not able and this is my problem.

                  Regards,
                  Damir Vadas
                  • 7. Re: Installer problem on clusterware (Unable to determine the sharedness of)
                    445907
                    Hi!

                    All the time in manuals i get message like :
                    "check for the ownership and permission of the ocr file for oracle user:group"

                    Now makes me wonder...I have created just empty sdb1 partition (oracle_dba ownership on it and parent disk)...but no file in it. Could you clear out that I should format partition or what....what "file" do they mean all the time?

                    I see checking like:
                    "cluvfy comp cfs -f /uxx –n..."

                    uxx is some mount? Do I need that if I'd like to avoid OCFS2 usage?

                    You see to many fog and no wind in future...

                    THX for clarification
                    • 8. Re: Installer problem on clusterware (Unable to determine the sharedness of)
                      445907
                      Does any one has knowledge if

                      scsi1:2.writeThrough = "TRUE"

                      is OK for shared disks in vmware server VM?

                      THX
                      • 9. Re: Installer problem on clusterware (Unable to determine the sharedness of)
                        445907
                        Hi all,

                        after consultation with some Linux and Oracle RAC freaks, who recheck some crucial points of installation and found nothing suspicious, conclusion was that all is properly setup except obvious problems that VMware 2.0.1 server and its parameters for shared disks has with new Oracle RAC! Not so strange if you have in mind that Oracle is forcing it's own OS, virtualization ... and step by step is doing what once cost Microsoft a lot-hiding facts. In this case it is VMware ....

                        Recommendation was to google on "vmware shared disks" based patterns...what brought me nowhere .... unfortunatelly.

                        Let me remind you that in my case I had a problem that propagation (when checking was with both nodes at once) was not correctly interpreted by runclfvy and Oracle clusterware installer itself in a moment when user has to set crs shared disks (no OCFS2 in my case).

                        So I got an idea to install clusterware on one node and then with "addnode.sh" add second node. This idea was successful and brought me to the REAL working solution!

                        So to all the people who are stacked on RAC installation with VMware 2.x server this is solution-add one by one node at the time!

                        Thank you all for helping me out

                        Regards,
                        Damir Vadas
                        • 10. Re: Installer problem on clusterware (Unable to determine the sharedness of)
                          surajvishwa11
                          Hi Damir Vadas ,

                          I have gone through this thread and I have exactly same problem and haven't got any solution yet. Can you please get me some step by step installation process on single node and adding the other one. I have same env as you mentioned in this thread.

                          Thanks,
                          Suraj
                          • 11. Re: Clusterware (Unable to determine the sharedness of) in VMware 2.0x server
                            981663
                            I had encountered the same problem, the solution is very simple, just append one line code to vmware machine configuration file <vm name>.vmx:

                            scsi1.sharedBus = "virtual"

                            while the process of finding the solution is ... so, wish that would help.