HP 649281-B21 ConnectX-3 VPI MCX354A-FCBT $35 + $8 shipping OBO ebay

LightKnight

New Member
Mar 6, 2018
3
9
3

nthu9280

Well-Known Member
Feb 3, 2016
1,584
437
83
San Antonio, TX
Positive experience with the seller. Great packaging. Just takes little longer to get you the total with shipping after accepting the offer. Alternatively, if you have FedEx account they can ship faster.


Sent from my Nexus 6 using Tapatalk
 
  • Like
Reactions: darkconz

LightKnight

New Member
Mar 6, 2018
3
9
3
Anyone find cheap cables that work with these cards and an Arista 7050QX? Or am I going to have to order $50 dual coded cables from fs.com?
 

i386

Well-Known Member
Mar 18, 2016
1,893
492
83
31
  • Like
Reactions: LightKnight

Thomas H

Member
Dec 2, 2017
61
21
8
49
I plan to purchase three of this and put each one computer. The NAS and server is in the same closet and to be connected using the fastest Infiniband. The NAS and workstation are in separate rooms with existing Cat 6 cables (and will limit my connection to 10GbE). They will be connected directly without a switch like so:

Workstation <<---- 10GbE ---->> NAS <<---- Infiniband ---->> Server

The parts are:
What adapters/cables do I need to connect NAS to workstation?
I already have an Intel 10Gb Network Adapter X520-SR2. Can I use it with the HP 649281-B21? Mixing brands so I can save on one.
Is flashing to Mellanox firmware necessary? Advantages/disadvantages?
 

Blinky 42

Active Member
Aug 6, 2015
559
200
43
44
PA, USA
@Thomas H Note that you won't be able to easily use your existing cat6 cable between the Workstation and NAS.
You would need to need to get SFP+ to Cat6 adapters which are far more expensive than buying a 10G copper card. You also won't be able to find a QSFP to Copper adapter. For lowest cost, I would suggest getting another 10G card with a SR module for the NAS and run fiber between the NAS and workstation. Otherwise you can get 2x 10G copper cards like Intel x540's and try and use your existing Cat6 run with them.
 

Thomas H

Member
Dec 2, 2017
61
21
8
49
@Thomas H Note that you won't be able to easily use your existing cat6 cable between the Workstation and NAS.
You would need to need to get SFP+ to Cat6 adapters which are far more expensive than buying a 10G copper card. You also won't be able to find a QSFP to Copper adapter. For lowest cost, I would suggest getting another 10G card with a SR module for the NAS and run fiber between the NAS and workstation. Otherwise you can get 2x 10G copper cards like Intel x540's and try and use your existing Cat6 run with them.
Hi Blinky, thanks for laying it out. It's making sense now. Coming from copper CAT5/6 1Gpbs Ethernet, I am starting to get a grasp of all the 10Gpbs+ terminology, cabling, adapters, etc. Unfortunately, my NAS server is a Lenovo ThinkServer TS440 with only two usable PCIe slots. I have a HBA on the x16 slot and I would like the HP 649281-B21 on the other x8 slot.

I was hoping there was an inexpensive QSFP to Cat6 adapter. It just seems ironic that I've ran Cat6 everywhere 'future proofing' hoping someday going to 10Gpbs but cannot utilize it due to cost and high power usage of 10GBASE-T. If feasible and I am going to run fiber between NAS and workstation, I would rather run an Infiniband cable for the higher speed.
 
Last edited:

_alex

Active Member
Jan 28, 2016
874
94
28
Bavaria / Germany
a combo of mellanox qsa + rj-45 sfp works to go from qsfp to rj-45 1gbe - at least on mellanox sx-switches. Not sure if this would also work on the hca, but ,should' if the hca can negotiate 1gb on the port.
 

trumee

Member
Jan 31, 2016
194
9
18
50
Yes, but it's cheaper and faster to buydirectly cards with a high/full profile bracket.

Cards with full profile bracket:
656089-001 HP 649281-B21 Infiniband FDR/EN 10/40GB 2P 544QSFP ADAPTER | eBay

HP 649281-B21 Infiniband FDR/EN 10/40GB 2P 544QSFP ADAPTER 656089-001 661685-001 | eBay
Thanks. I have a run of fiber between the NAS and desktop. My plan is to buy two of these for NAS and desktop. What optics (QSFP) do I need with this card?

Anybody aware whether these are supported in FreeBSD?
 

nikey22

New Member
Feb 19, 2018
14
0
1
48
wait a minute,

is the 649281-B21 card a 40Gbe card? Shouldn't it say QSFP+
Instead its labelled "649281-B21 HP Infiniband Dual Port FDR/EN 10/40GB 544QSFP Adapter "

if its QSFP, then it maxes out at 4Gb/s. If its QSFP+ then its a true 40Gb/s card.
 

i386

Well-Known Member
Mar 18, 2016
1,893
492
83
31
Actually it's a qsfp14 card :D
"HP Infiniband Dual Port FDR/EN 10/40GB 544QSFP Adapter" is hpes name for it.
 

nikey22

New Member
Feb 19, 2018
14
0
1
48
It'll do 14Gb/s?
so, if that's true, then its only slightly better than a single port 10Gbe SFP+ card.

I'm still unclear if it will ever be able to do 40Gb/s. Am I able to install QSFP+ transceivers in to get the 40Gb/s speed?
I'm just talking Ethernet, not IB.
I'm only interested in point-to-point as well.

Thanks.
 

i386

Well-Known Member
Mar 18, 2016
1,893
492
83
31
it can do up to 40gbit/s "standard" ethernet and up to 56gbit/s proprietary ethernet with mellanox switches