1 Reply Latest reply on Aug 2, 2018 4:22 PM by Dave Miner-Oracle

    [OCI] Strange iSCSI discovery behaviour

    Ramge Ralf

      Hello,

       

      I've run into an unexpected behaviour when trying to connect Solaris 11.4 from within a VM.Standard1.1 virtual machine setup. I'm not sure if this is unexpected behaviour or normal, so I chose to report it.

      I notice different behaviour before and after turning the iSCSI discovery off and on again. Datacenter is eu-frankfurt-1

       

      A complete (reproducable) example, pretty much self-explaining, can be found below. All steps are included, check the outputs of 'format' at the end.

      Would be cool if someone could check this outside of OCI.

       

      A simple, graceful reboot (init 6) fixes the situation, then all three iSCSI volumes are accessible again.

       

      Cheers,

       

      Ralf

       

      --- 8< ---

      root@ict-fra-repo-00-00:~# format

      Searching for disks...done

       

       

       

       

      AVAILABLE DISK SELECTIONS:

             0. c2d0 <QEMU HAR-QM0000-0001-48.83GB>

                /pci@0,0/pci-ide@1,1/ide@1/cmdk@0,0

      Specify disk (enter its number): ^D

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~# iscsiadm add discovery-address 169.254.2.2:3260

      root@ict-fra-repo-00-00:~# iscsiadm add discovery-address 169.254.2.3:3260

      root@ict-fra-repo-00-00:~# iscsiadm add discovery-address 169.254.2.4:3260

      root@ict-fra-repo-00-00:~#

       

      root@ict-fra-repo-00-00:~# iscsiadm list discovery-address -v 169.254.2.2:3260

      Discovery Address: 169.254.2.2:3260

              Target name: iqn.2015-12.com.oracleiaas:b8eba828-0205-465e-9f2d-6539929e4a21

                      Target address:     169.254.2.2:3260, 1

      root@ict-fra-repo-00-00:~# iscsiadm list discovery-address -v 169.254.2.3:3260

      Discovery Address: 169.254.2.3:3260

              Target name: iqn.2015-12.com.oracleiaas:402b18e1-1681-40c0-8346-c80c2160bc63

                      Target address:     169.254.2.3:3260, 1

      root@ict-fra-repo-00-00:~# iscsiadm list discovery-address -v 169.254.2.4:3260

      Discovery Address: 169.254.2.4:3260

              Target name: iqn.2015-12.com.oracleiaas:ae7bf05f-6aaf-40e4-9f35-284ed701081f

                      Target address:     169.254.2.4:3260, 1

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~# iscsiadm add static-config iqn.2015-12.com.oracleiaas:b8eba828-0205-465e-9f2d-6539929e4a21,169.254.2.2:3260

      root@ict-fra-repo-00-00:~# iscsiadm add static-config iqn.2015-12.com.oracleiaas:402b18e1-1681-40c0-8346-c80c2160bc63,169.254.2.3:3260

      root@ict-fra-repo-00-00:~# iscsiadm add static-config iqn.2015-12.com.oracleiaas:ae7bf05f-6aaf-40e4-9f35-284ed701081f,169.254.2.4:3260

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~# iscsiadm list static-config

      Static Configuration Target: iqn.2015-12.com.oracleiaas:b8eba828-0205-465e-9f2d-6539929e4a21,169.254.2.2:3260

      Static Configuration Target: iqn.2015-12.com.oracleiaas:402b18e1-1681-40c0-8346-c80c2160bc63,169.254.2.3:3260

      Static Configuration Target: iqn.2015-12.com.oracleiaas:ae7bf05f-6aaf-40e4-9f35-284ed701081f,169.254.2.4:3260

      root@ict-fra-repo-00-00:~#

       

      root@ict-fra-repo-00-00:~# format

      Searching for disks...done

       

       

       

       

      AVAILABLE DISK SELECTIONS:

             0. c2d0 <QEMU HAR-QM0000-0001-48.83GB>

                /pci@0,0/pci-ide@1,1/ide@1/cmdk@0,0

      Specify disk (enter its number): ^D

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~# iscsiadm modify discovery --static enable

      root@ict-fra-repo-00-00:~# devfsadm -c iscsi

      root@ict-fra-repo-00-00:~# format

      Searching for disks...done

       

       

       

       

      AVAILABLE DISK SELECTIONS:

             0. c2d0 <QEMU HAR-QM0000-0001-48.83GB>

                /pci@0,0/pci-ide@1,1/ide@1/cmdk@0,0

             1. c3t0d0 <ORACLE-BlockVolume-1.0-256.00GB>

                /iscsi/disk@0000iqn.2015-12.com.oracleiaas%3Ab8eba828-0205-465e-9f2d-6539929e4a210001,1

             2. c3t1d0 <ORACLE-BlockVolume-1.0-256.00GB>

                /iscsi/disk@0000iqn.2015-12.com.oracleiaas%3Aae7bf05f-6aaf-40e4-9f35-284ed701081f0001,1

             3. c3t2d0 <ORACLE-BlockVolume-1.0-256.00GB>

                /iscsi/disk@0000iqn.2015-12.com.oracleiaas%3A402b18e1-1681-40c0-8346-c80c2160bc630001,1

      Specify disk (enter its number): ^D

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~# iscsiadm modify discovery --static disable

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~# format

      Searching for disks...done

       

       

       

       

      AVAILABLE DISK SELECTIONS:

             0. c2d0 <QEMU HAR-QM0000-0001-48.83GB>

                /pci@0,0/pci-ide@1,1/ide@1/cmdk@0,0

      Specify disk (enter its number): ^D

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~# iscsiadm modify discovery --static enable

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~#

      root@ict-fra-repo-00-00:~# format

      Searching for disks...done

       

       

       

       

      AVAILABLE DISK SELECTIONS:

             0. c2d0 <QEMU HAR-QM0000-0001-48.83GB>

                /pci@0,0/pci-ide@1,1/ide@1/cmdk@0,0

             1. c3t2d0 <ORACLE-BlockVolume-1.0-256.00GB>

                /iscsi/disk@0000iqn.2015-12.com.oracleiaas%3Aae7bf05f-6aaf-40e4-9f35-284ed701081f0001,1

      Specify disk (enter its number): ^D

      root@ict-fra-repo-00-00:~#

       

       

      --- 8< ---

        • 1. Re: [OCI] Strange iSCSI discovery behaviour
          Dave Miner-Oracle

          I doubt it's specific to OCI, but probably a bug in dealing with multiple static target addresses.  I can reproduce it in OCI, though I find that disabling and enabling static again tends to restore all the targets.  It would take a bit more effort to try to reproduce outside OCI,  I tried a simple test against a ZS-3 with multiple target groups, but all on the same IP address, and couldn't reproduce it, hence my thought that it has to do with the multiple IP addresses.

           

          I didn't find an existing bug that appears to resemble this, so I filed:

          28445503 Disable/enable toggle of iscsi static discovery doesn't re-map all LUNs