0 Replies Latest reply: Apr 24, 2014 8:58 AM by bhudson RSS

    SFCFSHA 5.1SP1RP4 issue with LDOMs 3.1.1.0.5 on Solaris 10 (150400-11)

    bhudson

      Can anyone with experience using Symantec (Veritas) SFCFSHA 5.1SP1RP4 on Solaris 10 and LDOMs 3.1 assist with the following issue:

       

      Environment:

      • T5-2 running SFCFSHA (cluster file system mounted to /domains on the primary/secondary I/O domains)
      • T4-4 running SFCFSHA (cluster file system mounted to /domains on the primary/secondary I/O domains)
      • 2 x LDoms each running SFCFSHA with:
        • independent boot drive (mkfile from from /domains using mpgroups)...no issues here
        • single shared LUN via HBAs from primary/secondary domains (8 total paths: 4 from primary, 4 from secondary)

      Issue:

      A clustered file system is created as a Veritas service group running on the LDOMs from the shared LUN (again no issues). When the LDOMs are running on the same host/primary (T5-2 or T4-4...doesn't matter), a stop of the CFS service group on LDOM-1 and then a stop of the default "cvm" service group on the same LDOM-1 causes the clustered file system (service group) to fail on LDOM-2. However, the same issue is not seen when either LDOM-1 or LDOM-2 is migrated to the alternate host (e.g. LDOM-1 on T5-2 and LDOM-2 on T4-4 or visa versa).


      Additional Info:

      When only 4 paths are used for the LUN for each LDOM, (2 from primary, 2 from secondary), the expected behavior of stopping the service groups for the clustered file system and the cvm service group on LDOM-1 does not fault the clustered file system service group on LDOM-2 (whether running on the same machine or not...T5-2 or T4-4).


      Working output:

      [root@alftiap04xu]# vxlist path | grep ams_23000_109

      path c2t50060E8010261851d122s2   ams_23000_109   -          c2    0B      109 ams_23000

      path c2t50060E8010261854d122s2   ams_23000_109   -          c2    1A      109 ams_23000

      path c9t50060E8010261850d122s2   ams_23000_109   -          c9    0A      109 ams_23000

      path c9t50060E8010261855d122s2   ams_23000_109   -          c9    1B      109 ams_23000

      [root@alftiap04xu]# ssh alftiap04xu-sec '/opt/VRTSsfmh/bin/vxlist path | grep ams_23000_109'

      path c5t50060E8010261850d122s2  ams_23000_109  -         c5  0A  109 ams_23000

      path c5t50060E8010261855d122s2  ams_23000_109  -         c5  1B  109 ams_23000

      path c7t50060E8010261851d122s2  ams_23000_109  -         c7  0B  109 ams_23000

      path c7t50060E8010261854d122s2  ams_23000_109  -         c7  1A  109 ams_23000

      [root@alftiap04xu]# ldm ls -o disk primary | grep Sand-d1

                           Sand-d1path_0                                  /dev/dsk/c9t50060E8010261855d122s2

                           Sand-d1path_1                                  /dev/dsk/c9t50060E8010261850d122s2

                           Sand-d1path_2                                  /dev/dsk/c2t50060E8010261854d122s2

                           Sand-d1path_3                                  /dev/dsk/c2t50060E8010261851d122s2

      [root@alftiap04xu]# ldm ls -o disk secondary | grep Sand-d1

                           Sand-d1path_0                                  /dev/dsk/c7t50060E8010261851d122s2

                           Sand-d1path_1                                  /dev/dsk/c7t50060E8010261854d122s2

                           Sand-d1path_2                                  /dev/dsk/c5t50060E8010261855d122s2

                           Sand-d1path_3                                  /dev/dsk/c5t50060E8010261850d122s2

      [root@alftiap04xu]# ldm ls -o disk alftisand01xd

      NAME

      alftisand01xd

       

       

      DISK

          NAME             VOLUME                      TOUT ID   DEVICE  SERVER         MPGROUP

          vdisk0           alftisand01xd@primary-vds0       0    disk@0  primary        alftisand01xd-d0

          Sand-d1p0        Sand-d1path_0@primary-vds0       1    disk@1  primary

          Sand-d1p1        Sand-d1path_1@primary-vds0       2    disk@2  primary

          Sand-d1sp0       Sand-d1path_0@secondary-vds0      3    disk@3  secondary

          Sand-d1sp1       Sand-d1path_1@secondary-vds0      4    disk@4  secondary

       

       

      [root@alftiap04xu]# ldm ls -o disk alftisand02xd

      NAME

      alftisand02xd

       

       

      DISK

          NAME             VOLUME                      TOUT ID   DEVICE  SERVER         MPGROUP

          vdisk0           alftisand02xd@primary-vds0       0    disk@0  primary        alftisand02xd-d0

          Sand-d1p0        Sand-d1path_2@primary-vds0       1    disk@1  primary

          Sand-d1p1        Sand-d1path_3@primary-vds0       2    disk@2  primary

          Sand-d1sp0       Sand-d1path_2@secondary-vds0      3    disk@3  secondary

          Sand-d1sp1       Sand-d1path_3@secondary-vds0      4    disk@4  secondary

       

       

      [root@alftiap04xu]#