Good one thanks - really appreciate the effort.@Craig Curtin Just did a quick test here in the afternoon with a fresh install of the Dell ESXi. Forgot to test the the ConnectX though but the broadcom port from the intergraded module did work fine.
I did not setup any VM's and my management network was on the 2x1G ports on the broadcom. Just to see if it would disable the port as soon as i removed it from a vSwitch. I do also not run vsphere on it just the buildin webinterface.
View attachment 25563
OK i have advanced a bit further i think - still have not stood up the Mellanox cards yet - that is the job for this afternoon.
However what i have discovered (i think) is that i might have a DAC compatibiity issue - as far as i knew i thought that a QSFP to SFP+ breakout cable would be a passive device - but i have tried the BIOS update process for the 82599 based Intel cards and i seem to be makig a bit of progress with this.
The thing that first put me onto it - was in the testing i stood up a Linux host with a dual port 520-da2 in it and connected that with a SFP+ AOC 10 metre cable back to my switch - came up the first time and did not think anything of it - then did some VLANning and it stayed up - but then tried a reboot and it would not come back up - went into DMESG and found the card had disabled the port because it did not like the SFP+ module.
So found the method using Ethtool to patch the BIOS on the card - https://forums.servethehome.com/ind...m-to-unlock-all-sfp-transceivers.24634/page-1 and performed that - and then it was working fine.
So thought this card was worth a try in the ESXi servers now it was patched and known to work - so moved it across and it appears to have brought up both links OK
Not definitive yet and have to perform more testing with the VLANs etc to see what happens - will also try a Mellanox card in the same box and let you know