Multi-NVMe (m.2, u.2) adapters that do not require bifurcation

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

hyltcasper

Member
May 1, 2020
48
4
8
for the x16 card:
- Up to sixteen x1, eight x2, or four x4 NVMe direct-attach drive support
It works as you say in structures that do not contain an active switch chip, but here there is a pcie switch, the configuration can be done differently. The card I put the link to supports 32 u3 disks. But it has only 3 ports, it is not clear how the cable connections will be.
 

mattventura

Well-Known Member
Nov 9, 2022
522
266
63
Broadcom has HBA cards with up to 32 NVME drive support.
For example: Broadcom eHBA 9600-24i 24 Int. Ports PCIe SAS/SATA/NVMe Tri-Mode Storage Adapter | eBay
I think x16 can't provide enough bandwidth for 32 drives.
Also it is not clear how they connect 32 drives with only 3 ports.
Presumably, you have to use switches to connect more drives.

But don't buy tri-mode. They tend to just expose the NVMe drives as if they were SAS drives. Performs worse because you don't get the NVMe software stack. They have a few advantages, like being guaranteed* to support hotplug regardless of motherboard support, but overall it's mostly worse than a normal NVMe adapter.

*if you use intermediate switches that don't support HP, then you might not get HP capabilities.
 
  • Like
Reactions: RolloZ170

hyltcasper

Member
May 1, 2020
48
4
8
Presumably, you have to use switches to connect more drives.

But don't buy tri-mode. They tend to just expose the NVMe drives as if they were SAS drives. Performs worse because you don't get the NVMe software stack. They have a few advantages, like being guaranteed* to support hotplug regardless of motherboard support, but overall it's mostly worse than a normal NVMe adapter.

*if you use intermediate switches that don't support HP, then you might not get HP capabilities.
The guide says 'Up to sixteen x1, eight x2, or four x4 NVMe direct-attach drive support' on page 10. I assume direct-attach means nvme stack. Does it work? Is it fast enough?
 

scyto

New Member
Jun 22, 2024
4
0
1
Has anyone seen a U2 SSD PCIE adapter (for optane sized drives that can be mounted *ON* the card) that uses one of these switches, i can't find anything quite like that (i have a space constrained server i would like to use one in) i can only find ones that require bifurcation support on the motherboard.
 

xvmodvx

New Member
Oct 14, 2024
1
0
1
Sorry for asking a question I know you already answered, but I just read this entire forum and can't think clearly anymore

Even though of the site it says pcie3.0 it can use 4.0 if your system has it available? I'm pretty sure it's yes, but want to double check before I buy one right now. Thank you for posting this, I've been pissed debating what to do because I upgraded to a b760 from my old z87 without check bifurcation and now using it 95% of the time for proxmox and have no need for a GUI. Anyways thank you guys for all the info, I really appreciate it.
 

Branko

Member
Mar 21, 2022
44
23
8
Sorry for asking a question I know you already answered, but I just read this entire forum and can't think clearly anymore

Even though of the site it says pcie3.0 it can use 4.0 if your system has it available? I'm pretty sure it's yes, but want to double check before I buy one right now. Thank you for posting this, I've been pissed debating what to do because I upgraded to a b760 from my old z87 without check bifurcation and now using it 95% of the time for proxmox and have no need for a GUI. Anyways thank you guys for all the info, I really appreciate it.
Buy what? Many cards are mentioned in thread

And as a rule of thumb, you can always use lower PCI-E standard cards in motherboards with newer PCI-E slots,
just at slower speed.
 

AveryFreeman

consummate homelabber
Mar 17, 2017
425
57
28
43
Near Seattle
averyfreeman.com
Sorry for asking a question I know you already answered, but I just read this entire forum and can't think clearly anymore

Even though of the site it says pcie3.0 it can use 4.0 if your system has it available? I'm pretty sure it's yes, but want to double check before I buy one right now. Thank you for posting this, I've been pissed debating what to do because I upgraded to a b760 from my old z87 without check bifurcation and now using it 95% of the time for proxmox and have no need for a GUI. Anyways thank you guys for all the info, I really appreciate it.
In case that wasn't clear from the last reply, it only has to do with the PCIe standard, it doesn't have anything to do with the card's chipset or bus speed. You can safely buy any card you want.

If you get a PCIe 4.0 capable motherboard, any PCIe 3.0 card you use in it will work at PCIe 3.0 speeds, but there's no question whether or not it will work at all. It'll absolutely work.

Conversely, the opposite is also true: if your motherboard only supports PCIe 3.0, and you put a PCIe 4.0 card in it, it'll work at PCIe 3.0 speeds. No question that'll work, too.
 

ca3y6

Active Member
Apr 3, 2021
128
61
28
If you get a PCIe 4.0 capable motherboard, any PCIe 3.0 card you use in it will work at PCIe 3.0 speeds, but there's no question whether or not it will work at all. It'll absolutely work.
How about bifurcation on a supermicro motherboard? Can I mix PCIe 3 and 4 drives on a PCIe 4 16x slot with motherboard 4x4x4x4x bifurcation? Will they all work at PCIe 3 speed or will they each work at their respective max supported speed?
 

ChrisWreck

New Member
Oct 23, 2024
1
0
1
Will I be able to run U.3 disks (Micron 7400 Max) on the U.2 x16 4-port (PLX PEX 8747) card?

From what I've found, U.3 disks are backward compatible with U.2 ports. But not the other way around, a U.2 disk does not work in a U.3 port. Does this also apply when using an adapter with a switch chip, like this?
 
Last edited:

TangTasteTester

New Member
Jul 3, 2020
19
11
3
How about bifurcation on a supermicro motherboard? Can I mix PCIe 3 and 4 drives on a PCIe 4 16x slot with motherboard 4x4x4x4x bifurcation? Will they all work at PCIe 3 speed or will they each work at their respective max supported speed?
I do that currently. Mixing NVMe gens on a carrier device is okay and they will report as independent devices, as you'd expect. To achieve the best performance you should define the PCIe link as Gen 4 and not utilize the Auto Determination option. If the board should be left to auto determine the Gen speed then it is a possibility the link will be set lower.

This advice is true for other motherboard vendors as well. When possible, you should define the PCIe Link speed manually instead of Auto.
 
  • Like
Reactions: ca3y6

kryten

Member
Apr 10, 2023
77
12
8
So what would be the best straight forward solution to conecting 4x u.2 drives.

I currently have an intel R1000WF server thats works great and also has screw caddies. but there expensive and hard to come by
 

guiniol

Member
Oct 11, 2024
68
11
8
So what would be the best straight forward solution to conecting 4x u.2 drives.

I currently have an intel R1000WF server thats works great and also has screw caddies. but there expensive and hard to come by
I've been looking at this card: https://www.aliexpress.com/item/1005005671021299.html (recommended in this thread).
You can get cables that split a single SFF 8654 connector to two SFF 8639 connectors to connect to the U.2 drives. That gives you up to 8 with this card. If you can take advantage of a PCIE 4.0, there is also two port PCIE 4.0 version that would allow 4 U.2 drives.

I was about to ask if there's a PCIE 4.0 version of the 4 port card as I've been unable to find any, and also where does one get the cables as they get pretty expensive.
 

kryten

Member
Apr 10, 2023
77
12
8
if you click on the images where it says colour, the 2nd image shows it comes with 4 cables.

cheers