Mine arrived a few days ago and includes both brackets.
yes, both brackets. the FP bracket is already attached and the plastic casing had a section that held the LP bracket. The SFP+ modules came installed in the card; no rubber dust caps though.
hmm... that's not good.I'm having a hell of a time getting these to work. Ordered 5, got them yesterday. Apparently they come with firmware version 5.0, so I flashed a few to 7.11, the latest.
My pfSense box wouldn't recognize the card at all until I changed a BIOS setting for PCIe bifurcation from Auto to x4x4. That card seems to be working fine now.
My FreeNAS box picked it up just fine, but it seems to drop connections at times.
I have the pfSense and FreeNAS box connected via SFP+ DAC cables to an H3C S5120 switch. I tried running iPerf tests between the boxes, and can barely reach 1Gbps speeds, let alone 10Gbps. Previously, with my Intel X520s, 10Gbps was achievable.
Tried installing another Chelsio card into my ESXi machine, but ESXi 6.5 refuses to load the driver, and I got nowhere.
Finally, swapped out my Intel X520 from my Windows 10 desktop, and installed the Chelsio card. Driver installed OK, but as soon as I connect my OM4 fiber cable, Windows BSODs, and now won't boot. Boots fine when the cable is disconnected, which obviously defeats the purpose of all of this.
At $20 a piece, I'm not sure this "deal" was worth it so far. If anyone has any pointers, I'm all ears!
The spec sheet doesn't say it has RoCE though it says it has iwarp. Iwarp is outdated afaik.There are different RDMA protocols, iwarp and roce v1/2. Iwarp is the official one and is used by intel (I think they have just two nics with that feature) and chelsio while roce v1 is a proprietary protocol from mellanox. Roce v2 is a more open source protocol and is available in connect-x 3 pro and some newer intel nics.
so you're able to get near 10Gbps performance?I will say that I purchased a 3rd one to put in my Windows 10 workstation (currently has a Connect-x2) JUST because of the great performance I saw in both my FreeNAS and PFSense boxes which both have the exact same 110-1088-30. Both of those are Optiplex 9010 i7s.
pfSense v2.3.4-RELEASE-p1
FreeNAS-11.0-U3 (c5dcf4416)
All tie into my beloved T1700G-28TQ with FS.com DACs.
I actually set down to do a couple of benchmarks. iPerf2, and a real world file transfer.so you're able to get near 10Gbps performance?
I have 9000 MTU set on my pfsense, freenas, ESXi, Windows Clients, and on my Switch. That is the extent of any tuning on my part (eh, a bit on the ConnectX-2 Card on the WinTel box).
I suspect if you increase the streams on your iPerf2 test, you'll saturate the link. If I recall, might have been a somewhat 'known' issue.
Finally, what about a DAC straight between FreeNAS-pfSense to test?
Does this card support SRIOV and RDMA (esp. for HyperV 2016)?
Sent from my SM-G950F using Tapatalk
Yes and yes.
N320E... i don't think they support RDMAOk, here's an update. I received my 4 Chelsio cards from this purchase. They are N320E cards, and the specs are here:
https://www.chelsio.com/assetlibrary/products/N320E Product Brief 090630.pdf
So, based on that information, the typical power consumption is 14W. So, that makes it 7~8W more than the Mellanox ConnectX-2 dual port.
Increasing the streams by adding -P 2 to 8 on iPerf had no impact. Same speeds.
I'll try a DAC between pfSense and FreeNAS, but a "direct connect" fiber between my workstation and FreeNAS yielded the same speeds. 9.5 Gbps from Win10 to FreeNAS, but only 2 Gbps from FreeNAS to Win10. This was observed in Samba file transfers too. 1 GB/s writes to FreeNAS, but only 180 MB/s reads. Super odd, considering these are HDDs, not SSDs. I'm happy with the write speeds, but would really like read speeds to be better.
Anyway, if I'm seeing these speeds with Intel NICs, I'm not sure the Chelsio would be better. Moreover, I don't think the Chelsio card is the problem. But I'm going to try again.