Hi JC, we have similar configuration.
In our case, we do not use the 1Gb NICs for guest/LDOMs. We created VSW using the 10GbE NICS, either in iPMP or Link aggregation mode. You should enable, at the VSW VNET level, the intra-networking option of ldm. Speeds we have achieved (in this case, traffic between LDOMs does not leave the CDOM) were close to 16Gbps (using ipmp).
It also depends on the use of VLANs. Let me know if you need help with the LDM commands on how to setup the virtual switch and the VNETs.
We setup VSW and VNET but not sure about iPMP or link aggregation for the 10GbE NICS. Would be interested in learning about these scenarios, strategies, where recipies can be found for them. We also discovered the improved performance with cpu=whole-core approach when establishing guest ldoms.
Not sure whether you have overcome this issue?
Refer to the following Oracle doc on creating link aggregation.
While creating Virtual network, remember you need to give pvid if any vlan is involved.
Message was edited by: Soory
Hybrid mode is only for the 10 Gbit Ethernet circuits integrated into the T2 SPARC chip and T4 SPARC chip.
No other SPARC chips have the integrated 10 Gbit XAUI Ethernet ports. If you have T5 servers and you need fast DMA ethernet between a LDOM and the world outside the system, the new way to do this is with the SingleRoot InputOutput Virtualization ( SR-IOV ) that is now available. the Sun dual 10 GbE fiber card can support 64 SR-IOV connections.