We have ordered two Quanta LB6M switches.
These will be used in an existing 7 node proxmox cluster using 65 400GB SSD's .
Disk i/o is very low.
Our goal is to set up an excellent ceph network with very low latency. [ not sure if latency is the right word]. we want no lags / delays / and 0 slow requests at ceph.
We are thinking of getting refurbished ConnectX-5 or ConnectX-4 cards from Mellanox.
I assume we'll need SFP28 cabling . [ or is it OK to use SFP+ 10G cable sonce the switch max is 10G?]
Questions:
1- Is there such a thing as standard SFP28 cabled to connect those?
2- Or do we need to get different transceivers for switch and card and use a sfp28 cable? [ or something like that , in learning mode on this subject]
3- suggestions on a different NIC to get ?
thanks for reading and best regards, Roberto.
These will be used in an existing 7 node proxmox cluster using 65 400GB SSD's .
Code:
data:
pools: 2 pools, 1088 pgs
objects: 137.66k objects, 498GiB
usage: 1.46TiB used, 24.1TiB / 25.5TiB avail
Our goal is to set up an excellent ceph network with very low latency. [ not sure if latency is the right word]. we want no lags / delays / and 0 slow requests at ceph.
We are thinking of getting refurbished ConnectX-5 or ConnectX-4 cards from Mellanox.
I assume we'll need SFP28 cabling . [ or is it OK to use SFP+ 10G cable sonce the switch max is 10G?]
Questions:
1- Is there such a thing as standard SFP28 cabled to connect those?
2- Or do we need to get different transceivers for switch and card and use a sfp28 cable? [ or something like that , in learning mode on this subject]
3- suggestions on a different NIC to get ?
thanks for reading and best regards, Roberto.