ZFS Storage cluster Infiniband Card Devices name difference on same PCIe slot
Hello All
During the initial ZFS 7420 Storage cluster configuration, I found the Infiniband devices name difference.
ZFS7420 Cluster(each header have a 4 Infiniband Card)
1. Node-A
configuration -> network -> devices show below
PCIe3 (IBP2/IBP3)
PCIe4 (IBP4/IBP5)
PCIe5 (IBP6/IBP7)
PCIe6 (IBP0/IBP1)
2. Node-B
configuration -> network -> devices show below
PCIe3(IBP4/IBP5)
PCIe4(IBP0/IBP1)
PCIe5(IBP2/IBP3)
PCIe6(IBP6/IBP7)
As I know, When ZFS cluster failver, ZFS network interface resoure trans to same IBP name.
But Inspite of same slot, ibp device name is different as above.
So It's not easy to IPMP fail-over configuration & Cablings.
During the initial ZFS 7420 Storage cluster configuration, I found the Infiniband devices name difference.
ZFS7420 Cluster(each header have a 4 Infiniband Card)
1. Node-A
configuration -> network -> devices show below
PCIe3 (IBP2/IBP3)
PCIe4 (IBP4/IBP5)
PCIe5 (IBP6/IBP7)
PCIe6 (IBP0/IBP1)
2. Node-B
configuration -> network -> devices show below
PCIe3(IBP4/IBP5)
PCIe4(IBP0/IBP1)
PCIe5(IBP2/IBP3)
PCIe6(IBP6/IBP7)
As I know, When ZFS cluster failver, ZFS network interface resoure trans to same IBP name.
But Inspite of same slot, ibp device name is different as above.
So It's not easy to IPMP fail-over configuration & Cablings.
1