4 Replies Latest reply: Jan 30, 2012 11:24 PM by user4027740 RSS

    2540-M2 configuration on SG-XPCIE2FC-QF4 port 1

    user4027740
      Hello..

      One of my M5000 is running with two of SG-XPCIE2FC-QF4 card. Port 0 is directly connected (without SAN switches) to a 2008 model 2540 storage and now I need to attach my newly bought 2540-M2 to port 1 of these FC HBAs. I mapped the LUNs to the correct storage domains using CAM. In Solaris, even if I do devfsadm any number times nothing comes up in format! Any idea? Does the port 1 support 2540-M2? Need some patches? Please help...
        • 1. Re: 2540-M2 configuration on SG-XPCIE2FC-QF4 port 1
          Nik
          Hi.

          Please show result of commands:

          cfgadm -al -o show_FCP_dev

          ( Check format for new deviices after this)

          luxadm -e port
          luxadm -e dump_map <for every port from previos result>


          Regards.
          • 2. Re: 2540-M2 configuration on SG-XPCIE2FC-QF4 port 1
            user4027740
            Thanks for your reply...
            After many map-umapps to the default storage domain finally I could get the LUNS visible to Solaris. Now the issues is that port 1 on HBA (on the slot 2 PCI-E) is showing NOT CONNECTED! I have replaced fiber cables and powered off-on the array but no use. I did not reboot the server, only did a devfsadm -v. Old LUNs are Active/Standby mode as it has two paths, but the new ones are having only one path and threfore no redundancy. Any clues? see below outputs..

            #cfgadm -al -o show_FCP_dev
            Ap_Id Receptacle Occupant Condition Information
            When Type Busy Phys_Id
            c1 connected configured unknown
            unavailable fc-private n /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0:fc
            c1::202400a0b839c57a,0 connected configured unknown
            unavailable disk n /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0:fc::202400a0b839c57a,0
            c1::202400a0b839c57a,1 connected configured unknown
            unavailable disk n /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0:fc::202400a0b839c57a,1
            c1::202400a0b839c57a,5 connected configured unknown
            unavailable disk n /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0:fc::202400a0b839c57a,5
            c1::202400a0b839c57a,31 connected configured unknown
            unavailable disk n /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0:fc::202400a0b839c57a,31
            c2 connected configured unknown
            unavailable fc-private n /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0,1/fp@0,0:fc
            c2::20360080e523efc2,0 connected configured unknown
            unavailable disk n /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0,1/fp@0,0:fc::20360080e523efc2,0
            c2::20360080e523efc2,1 connected configured unknown
            unavailable disk n /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0,1/fp@0,0:fc::20360080e523efc2,1
            c2::20360080e523efc2,2 connected configured unknown
            unavailable disk n /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0,1/fp@0,0:fc::20360080e523efc2,2
            c2::20360080e523efc2,31 connected configured unknown
            unavailable disk n /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0,1/fp@0,0:fc::20360080e523efc2,31
            c3 connected configured unknown
            unavailable fc-private n /devices/pci@1,700000/SUNW,qlc@0/fp@0,0:fc
            c3::202500a0b839c57a,0 connected configured unknown
            unavailable disk n /devices/pci@1,700000/SUNW,qlc@0/fp@0,0:fc::202500a0b839c57a,0
            c3::202500a0b839c57a,1 connected configured unknown
            unavailable disk n /devices/pci@1,700000/SUNW,qlc@0/fp@0,0:fc::202500a0b839c57a,1
            c3::202500a0b839c57a,5 connected configured unknown
            unavailable disk n /devices/pci@1,700000/SUNW,qlc@0/fp@0,0:fc::202500a0b839c57a,5
            c3::202500a0b839c57a,31 connected configured unknown
            unavailable disk n /devices/pci@1,700000/SUNW,qlc@0/fp@0,0:fc::202500a0b839c57a,31
            c4                             connected    unconfigured unknown
            unavailable  fc           n        /devices/pci@1,700000/SUNW,qlc@0,1/fp@0,0:fc

            #luxadm -e port
            /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0:devctl CONNECTED
            /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0,1/fp@0,0:devctl CONNECTED
            /devices/pci@1,700000/SUNW,qlc@0/fp@0,0:devctl CONNECTED
            */devices/pci@1,700000/SUNW,qlc@0,1/fp@0,0:devctl NOT CONNECTED*

            luxadm_-e_dump_map_-devices-pci@0,600000-pci@0-pci@9-SUNW,qlc@0,1-fp@0,0:devctl.out
            Pos AL_PA ID Hard_Addr Port WWN Node WWN Type
            0 e4 2 e4 20360080e523efc2 20060080e523efc2 0x0 (Disk device)
            1 1 7d 0 2101001b3230e8c2 2001001b3230e8c2 0x1f (Unknown Type,Host Bus Adapter)

            luxadm_-e_dump_map_-devices-pci@0,600000-pci@0-pci@9-SUNW,qlc@0-fp@0,0:devctl
            Pos AL_PA ID Hard_Addr Port WWN Node WWN Type
            0 ef 0 ef 202400a0b839c57a 200400a0b839c57a 0x0 (Disk device)
            1 1 7d 0 2100001b3210e8c2 2000001b3210e8c2 0x1f (Unknown Type,Host Bus Adapter)

            luxadm_-e_dump_map_-devices-pci@1,700000-SUNW,qlc@0-fp@0,0:devctl
            Pos AL_PA ID Hard_Addr Port WWN Node WWN Type
            0 e4 2 e4 202500a0b839c57a 200400a0b839c57a 0x0 (Disk device)
            1 1 7d 0 2100001b3210cbc3 2000001b3210cbc3 0x1f (Unknown Type,Host Bus Adapter)

            luxadm_probe.out
            No Network Array enclosures found in /dev/es

            Found Fibre Channel device(s):
            Node WWN:200400a0b839c57a Device Type:Disk device
            Logical Path:/dev/rdsk/c7t600A0B800039C57A0000030348798E6Ad0s2
            Node WWN:200400a0b839c57a Device Type:Disk device
            Logical Path:/dev/rdsk/c7t600A0B800039C57A0000030748798F30d0s2
            Node WWN:200400a0b839c57a Device Type:Disk device
            Logical Path:/dev/rdsk/c7t600A0B800039CA0E000002F948798F93d0s2
            Node WWN:20060080e523efc2  Device Type:Disk device
            Logical Path:/dev/rdsk/c7t60080E500023EFC2000004C84E857119d0s2
            Node WWN:20060080e523efc2  Device Type:Disk device
            Logical Path:/dev/rdsk/c7t60080E500023EFC2000004CB4E857181d0s2
            Node WWN:20060080e523efc2  Device Type:Disk device
            Logical Path:/dev/rdsk/c7t60080E500023EFC2000004CD4E8571BEd0s2
            (highlited are the new LUNs added)

            #format
            Searching for disks...done
            AVAILABLE DISK SELECTIONS:
            0. c0t0d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424> 72g
            /pci@0,600000/pci@0/pci@8/pci@0/scsi@1/sd@0,0
            1. c0t1d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
            /pci@0,600000/pci@0/pci@8/pci@0/scsi@1/sd@1,0
            2. c7t600A0B800039C57A0000030348798E6Ad0 <SUN-LCSM100_F-0670 cyl 38398 alt 2 hd 512 sec 64>
            /scsi_vhci/ssd@g600a0b800039c57a0000030348798e6a
            3. c7t600A0B800039C57A0000030748798F30d0 <SUN-LCSM100_F-0670 cyl 51198 alt 2 hd 128 sec 64>
            /scsi_vhci/ssd@g600a0b800039c57a0000030748798f30
            4. c7t600A0B800039CA0E000002F948798F93d0 <SUN-LCSM100_F-0670 cyl 51198 alt 2 hd 128 sec 64>
            /scsi_vhci/ssd@g600a0b800039ca0e000002f948798f93
            5. c7t60080E500023EFC2000004C84E857119d0 <SUN-LCSM100_F-0777-2.00TB> appsnew
            /scsi_vhci/ssd@g60080e500023efc2000004c84e857119
            6. c7t60080E500023EFC2000004CB4E857181d0 <SUN-LCSM100_F-0777 cyl 63998 alt 2 hd 256 sec 64> temp1new
            /scsi_vhci/ssd@g60080e500023efc2000004cb4e857181
            7. c7t60080E500023EFC2000004CD4E8571BEd0 <SUN-LCSM100_F-0777 cyl 63998 alt 2 hd 256 sec 64> temp2new
            /scsi_vhci/ssd@g60080e500023efc2000004cd4e8571be

            #luxadm display /dev/rdsk/c7t600A0B800039C57A0000030348798E6Ad0s2
            DEVICE PROPERTIES for disk: /dev/rdsk/c7t600A0B800039C57A0000030348798E6Ad0s2
            Vendor: SUN
            Product ID: LCSM100_F
            Revision: 0670
            Serial Num: SX73502942
            Unformatted capacity: 614400.000 MBytes
            Write Cache: Enabled
            Read Cache: Enabled
            Minimum prefetch: 0x3
            Maximum prefetch: 0x3
            Device Type: Disk device
            Path(s):

            /dev/rdsk/c7t600A0B800039C57A0000030348798E6Ad0s2
            /devices/scsi_vhci/ssd@g600a0b800039c57a0000030348798e6a:c,raw
            Controller /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0/fp@0,0
            Device Address 202400a0b839c57a,5
            Host controller port WWN 2100001b3210e8c2
            Class primary
            State ONLINE
            Controller /devices/pci@1,700000/SUNW,qlc@0/fp@0,0
            Device Address 202500a0b839c57a,5
            Host controller port WWN 2100001b3210cbc3
            Class secondary
            State STANDBY

            Whereas the new volumes have only one path;

            #luxadm display /dev/rdsk/c7t60080E500023EFC2000004CD4E8571BEd0s2
            DEVICE PROPERTIES for disk: /dev/rdsk/c7t60080E500023EFC2000004CD4E8571BEd0s2
            Vendor: SUN
            Product ID: LCSM100_F
            Revision: 0777
            Serial Num: SV12601017
            Unformatted capacity: 512000.000 MBytes
            Write Cache: Enabled
            Read Cache: Enabled
            Minimum prefetch: 0x3
            Maximum prefetch: 0x0
            Device Type: Disk device
            Path(s):

            /dev/rdsk/c7t60080E500023EFC2000004CD4E8571BEd0s2
            /devices/scsi_vhci/ssd@g60080e500023efc2000004cd4e8571be:c,raw
            Controller /devices/pci@0,600000/pci@0/pci@9/SUNW,qlc@0,1/fp@0,0
            Device Address 20360080e523efc2,0
            Host controller port WWN 2101001b3230e8c2
            Class primary
            State ONLINE
            • 3. Re: 2540-M2 configuration on SG-XPCIE2FC-QF4 port 1
              Nik
              Hi.
              Please show result of
              fcinfo hba-port

              What initiators registered on new arrays ?
              Lun mapped to default storage domain or separete domain ?


              Regards.
              • 4. Re: 2540-M2 configuration on SG-XPCIE2FC-QF4 port 1
                user4027740
                System reboot resolved the issue.