[OCI] Strange iSCSI discovery behaviour

Ramge Ralf

    Hello,

     

    I've run into an unexpected behaviour when trying to connect Solaris 11.4 from within a VM.Standard1.1 virtual machine setup. I'm not sure if this is unexpected behaviour or normal, so I chose to report it.

    I notice different behaviour before and after turning the iSCSI discovery off and on again. Datacenter is eu-frankfurt-1

     

    A complete (reproducable) example, pretty much self-explaining, can be found below. All steps are included, check the outputs of 'format' at the end.

    Would be cool if someone could check this outside of OCI.

     

    A simple, graceful reboot (init 6) fixes the situation, then all three iSCSI volumes are accessible again.

     

    Cheers,

     

    Ralf

     

    --- 8< ---

    root@ict-fra-repo-00-00:~# format

    Searching for disks...done

     

     

     

     

    AVAILABLE DISK SELECTIONS:

           0. c2d0 <QEMU HAR-QM0000-0001-48.83GB>

              /pci@0,0/pci-ide@1,1/ide@1/cmdk@0,0

    Specify disk (enter its number): ^D

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~# iscsiadm add discovery-address 169.254.2.2:3260

    root@ict-fra-repo-00-00:~# iscsiadm add discovery-address 169.254.2.3:3260

    root@ict-fra-repo-00-00:~# iscsiadm add discovery-address 169.254.2.4:3260

    root@ict-fra-repo-00-00:~#

     

    root@ict-fra-repo-00-00:~# iscsiadm list discovery-address -v 169.254.2.2:3260

    Discovery Address: 169.254.2.2:3260

            Target name: iqn.2015-12.com.oracleiaas:b8eba828-0205-465e-9f2d-6539929e4a21

                    Target address:     169.254.2.2:3260, 1

    root@ict-fra-repo-00-00:~# iscsiadm list discovery-address -v 169.254.2.3:3260

    Discovery Address: 169.254.2.3:3260

            Target name: iqn.2015-12.com.oracleiaas:402b18e1-1681-40c0-8346-c80c2160bc63

                    Target address:     169.254.2.3:3260, 1

    root@ict-fra-repo-00-00:~# iscsiadm list discovery-address -v 169.254.2.4:3260

    Discovery Address: 169.254.2.4:3260

            Target name: iqn.2015-12.com.oracleiaas:ae7bf05f-6aaf-40e4-9f35-284ed701081f

                    Target address:     169.254.2.4:3260, 1

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~# iscsiadm add static-config iqn.2015-12.com.oracleiaas:b8eba828-0205-465e-9f2d-6539929e4a21,169.254.2.2:3260

    root@ict-fra-repo-00-00:~# iscsiadm add static-config iqn.2015-12.com.oracleiaas:402b18e1-1681-40c0-8346-c80c2160bc63,169.254.2.3:3260

    root@ict-fra-repo-00-00:~# iscsiadm add static-config iqn.2015-12.com.oracleiaas:ae7bf05f-6aaf-40e4-9f35-284ed701081f,169.254.2.4:3260

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~# iscsiadm list static-config

    Static Configuration Target: iqn.2015-12.com.oracleiaas:b8eba828-0205-465e-9f2d-6539929e4a21,169.254.2.2:3260

    Static Configuration Target: iqn.2015-12.com.oracleiaas:402b18e1-1681-40c0-8346-c80c2160bc63,169.254.2.3:3260

    Static Configuration Target: iqn.2015-12.com.oracleiaas:ae7bf05f-6aaf-40e4-9f35-284ed701081f,169.254.2.4:3260

    root@ict-fra-repo-00-00:~#

     

    root@ict-fra-repo-00-00:~# format

    Searching for disks...done

     

     

     

     

    AVAILABLE DISK SELECTIONS:

           0. c2d0 <QEMU HAR-QM0000-0001-48.83GB>

              /pci@0,0/pci-ide@1,1/ide@1/cmdk@0,0

    Specify disk (enter its number): ^D

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~# iscsiadm modify discovery --static enable

    root@ict-fra-repo-00-00:~# devfsadm -c iscsi

    root@ict-fra-repo-00-00:~# format

    Searching for disks...done

     

     

     

     

    AVAILABLE DISK SELECTIONS:

           0. c2d0 <QEMU HAR-QM0000-0001-48.83GB>

              /pci@0,0/pci-ide@1,1/ide@1/cmdk@0,0

           1. c3t0d0 <ORACLE-BlockVolume-1.0-256.00GB>

              /iscsi/disk@0000iqn.2015-12.com.oracleiaas%3Ab8eba828-0205-465e-9f2d-6539929e4a210001,1

           2. c3t1d0 <ORACLE-BlockVolume-1.0-256.00GB>

              /iscsi/disk@0000iqn.2015-12.com.oracleiaas%3Aae7bf05f-6aaf-40e4-9f35-284ed701081f0001,1

           3. c3t2d0 <ORACLE-BlockVolume-1.0-256.00GB>

              /iscsi/disk@0000iqn.2015-12.com.oracleiaas%3A402b18e1-1681-40c0-8346-c80c2160bc630001,1

    Specify disk (enter its number): ^D

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~# iscsiadm modify discovery --static disable

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~# format

    Searching for disks...done

     

     

     

     

    AVAILABLE DISK SELECTIONS:

           0. c2d0 <QEMU HAR-QM0000-0001-48.83GB>

              /pci@0,0/pci-ide@1,1/ide@1/cmdk@0,0

    Specify disk (enter its number): ^D

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~# iscsiadm modify discovery --static enable

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~#

    root@ict-fra-repo-00-00:~# format

    Searching for disks...done

     

     

     

     

    AVAILABLE DISK SELECTIONS:

           0. c2d0 <QEMU HAR-QM0000-0001-48.83GB>

              /pci@0,0/pci-ide@1,1/ide@1/cmdk@0,0

           1. c3t2d0 <ORACLE-BlockVolume-1.0-256.00GB>

              /iscsi/disk@0000iqn.2015-12.com.oracleiaas%3Aae7bf05f-6aaf-40e4-9f35-284ed701081f0001,1

    Specify disk (enter its number): ^D

    root@ict-fra-repo-00-00:~#

     

     

    --- 8< ---

      • 1. Re: [OCI] Strange iSCSI discovery behaviour
        Dave Miner-Oracle

        I doubt it's specific to OCI, but probably a bug in dealing with multiple static target addresses.  I can reproduce it in OCI, though I find that disabling and enabling static again tends to restore all the targets.  It would take a bit more effort to try to reproduce outside OCI,  I tried a simple test against a ZS-3 with multiple target groups, but all on the same IP address, and couldn't reproduce it, hence my thought that it has to do with the multiple IP addresses.

         

        I didn't find an existing bug that appears to resemble this, so I filed:

        28445503 Disable/enable toggle of iscsi static discovery doesn't re-map all LUNs