Intel DC P4610 3.2TB U.2 $170 OBO

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
C

ca3y6

Active Member
Apr 3, 2021
110
55
28
what offer did you try?

my threshold is much lower, around $32/TB but that’s also because I have too many SSDs and I am running out of ports to connect then too (ran out of usage long ago). Plus I am mostly running on windows which sucks at pooling drives.
 
  • Like
Reactions: Samir
C

ca3y6

Active Member
Apr 3, 2021
110
55
28
Samir said:
Time for you to build a NAS unit. ;)
Click to expand...
Actually I did. Upgraded all the drives in my synology NASes this summer. Was left with lots of spare HDD from this upgrade and the previous upgrade. Bought an old refurbished 4u 36 tray server, filled it, installed ubuntu, setup a big 350TB zfs array (linux is still a dog's breakfast if you are not already an expert, simple things are unnecessary complicated, undocumented and with bad defaults). Stuck it in a 1/4 rack in colocation I already rent, off all the time except once a week for an incremental backup (the 1 of 3-2-1).

But what to do with nvme SSDs? They would be wasted on a NAS, what is the point of having an array of SSD that can write 12GB/s if they are only accessible through a 1GB/s 10gbe connection? Faster networking is too expensive. My synologys already have SSD caching (obviously!). The only usage that makes sense to me is storage for VMs running on the same machine. So would have to build another machine. I am nearly there, I have all the components except the motherboard. But I have no usage for the new machine...

I am not an alcoholic, drug addict, I don't have schizophrenia or any other mental disease, but I have to start entertaining the idea that maybe I am a hoarder, like those people on TV who accumulate a mountain of garbage in their home. I am an SSD hoarder...
 
  • Like
Reactions: Samir and Hal
C

ca3y6

Active Member
Apr 3, 2021
110
55
28
Actually that’s a fair challenge. 40gbe and 100gbe switches seem to be expensive and power hungry beasts, but I can find fairly cheap 40gbe or 100gbe network cards on ebay. I guess I could set up some direct card to card connections.

Would that be optimal? I am struggling to get transfers rates higher than 1GB/s over SMB, even between a VM and its host on the same machine via a virtual hyper-v switch (with drives that can do well over 4GB/s locally). Maybe there are some SMB settings I can tweak.

Are there better ways to have fast transfer rates between machines?
 
  • Like
Reactions: Samir
C

Cruzader

Well-Known Member
Jan 1, 2021
685
692
93
ca3y6 said:
Actually that’s a fair challenge. 40gbe and 100gbe switches seem to be expensive and power hungry beasts, but I can find fairly cheap 40gbe or 100gbe network cards on ebay. I guess I could set up some direct card to card connections.
Click to expand...
My old sx6036 40gbe switches are 80-100$ area and was under 60w with half the ports in use.
100gbe can get expensive tho.
 
  • Like
Reactions: Samir
BackupProphet

BackupProphet

Well-Known Member
Jul 2, 2014
1,179
762
113
Stavanger, Norway
intellistream.ai
ca3y6 said:
I am struggling to get transfers rates higher than 1GB/s over SMB, even between a VM and its host on the same machine via a virtual hyper-v switch (with drives that can do well over 4GB/s locally). Maybe there are some SMB settings I can tweak.

Are there better ways to have fast transfer rates between machines?
Click to expand...
The answer is RDMA. NVMe-oF or NFSoRDMA gives me excellent performance. For Windows you can use SMB Direct with RDMA. I have not tried iSER yet.
I am a big fan of the Mellanox sx6036, with 2 active ports it idles around 35 watt. You can set the fans to very low speed. With the correct cables, you also get 56 Gbps, which is 40% more performance over 40G.

The only thing, in my experience ConnectX3 works best over infiniband with ipoib. I still struggle to get RoCE both v1 and v2 to perform reliably over ethernet with ConnectX3.
ConnectX4+ works great, I think most of the nics that support 50G also support 56G?

Mellanox sx6036 supports VPI mode, which means you can also split the switch for ethernet and infiniband traffic.
 
  • Like
Reactions: Samir, T_Minus, Whaaat and 2 others
C

ca3y6

Active Member
Apr 3, 2021
110
55
28
Do those support direct card to card connections? I am reading conflicting advice when googling it, with some people saying it does not, others say you need special software running, others saying no problem as long as they are on a different subnet.
 
  • Like
Reactions: Samir
M

Marsh

Moderator
May 12, 2013
2,666
1,515
113
Genuine question, what is the difference between Intel P4610 and Oracle F320 ( Samsung ) NVME?

Beside P4610 is U2 vs Samsun is AIC add-in-card?
 
You must log in or register to reply here.
Top Bottom