Search results

  1. J

    Epyc NVME 7443P

    Thanks. As is the case with most of this type of benchmarking, the devil is in the details . I would still like to compare the highpoint sw raid with raidix in a more apples to apples test. I was using raid0 vs raid6. I also used 8 drives vs 24 but mine were pci gen4. Windows NTFS vs xfs and...
  2. J

    Epyc NVME 7443P

    thanks for all of your responses. My question about "how did they get 55.8GB/s was more about the configuration that they used not their technology. ex. how many drives did they use and which type to get that throughput? Which testing software did they use and what were the parameters? I...
  3. J

    Epyc NVME 7443P

    have you done any testing with raidix yet? I am curious as to how the raidix folks got to 55.8GB/s. Have you thought about using the mellanox 516-cdat card instead of the IB card? the 516-cdat is pcie 4.0 and can do nvmeof and roce. Are you using an IB switch? Very interesting build and I...
  4. J

    U.3 connectors / MB connectors.

    the 1.6tb p5800x seem to be hard to find. I was able to purchase 2 of the 800GB p5800x a little bit easier. For some reason the 800s pop up and then go out of stock pretty quickly. Check provantage as they may show up there as available.
  5. J

    How to connect U.2 SSDs with the least amount of adapters to an AsRock Rack ROMED6U-2L2T?

    glad it worked out in the end. It is still strange that the other cable didn't work but that is what happens sometimes when you are on the bleeding edge!
  6. J

    Help with CX456A ( HP OEM)

    [root@localhost:/opt/mellanox/bin] ./mlxlink -d mt4123_pciconf0 -m Operational Info ---------------- State : Active Physical state : LinkUp Speed : 40G Width : 4x FEC : No...
  7. J

    Help with CX456A ( HP OEM)

    you can try the mxlink cmd if you think it might be the cables. I had an issue with a 200GE mellanox nic that would not sync up at the 200G rate with some generic qsfp56 cables. I need to use the cables directly from mellanox before they would show the correct 200G rate capability. Never...
  8. J

    How to connect U.2 SSDs with the least amount of adapters to an AsRock Rack ROMED6U-2L2T?

    if you want, I can send my tyan cable out for you to test. I still need it but at least you can rule out your current slimsas cable. You can pm me to sort out any logistics.
  9. J

    How to connect U.2 SSDs with the least amount of adapters to an AsRock Rack ROMED6U-2L2T?

    thanks for that insight. I guess you will be happy with them when you can get them to work :) It just seems strange that a brand new intel nvme drive won't show up even in the bios. Let me know what you find out when you get your new drives. If needed, I may be able to temporarily send you...
  10. J

    How to connect U.2 SSDs with the least amount of adapters to an AsRock Rack ROMED6U-2L2T?

    how long did it take to order those cables? I was going to order some cables through that site for another project as they were the only place that I could find them (the cables were for occulink.) They also seem to be on the high side regarding pricing. They do seem high quality and that is...
  11. J

    Help with CX456A ( HP OEM)

    looks like you need to switch from IB to Ethernet using the mellanox tools mlxcfg etc.
  12. J

    How to connect U.2 SSDs with the least amount of adapters to an AsRock Rack ROMED6U-2L2T?

    I would think that the cable that you have should work though. Are you testing with any other drives in the system at the same time? If not, I would try testing with just the one u.2 drive connected, then go into the bios and check the nvme menu. See if it recognizes the u.2 drive at that...
  13. J

    How to connect U.2 SSDs with the least amount of adapters to an AsRock Rack ROMED6U-2L2T?

    I think that is the same one. It is pretty expensive and has the molex vs the sata for power. It is also pretty bulky but I am not sure how to reduce the cable clutter with this setup. I have a few of the romed6 in some cerberus cases (matx) and it can be pretty challenging to fit everything...
  14. J

    How to connect U.2 SSDs with the least amount of adapters to an AsRock Rack ROMED6U-2L2T?

    just checked and it worked on my system. Make sure to check the bios settings to change from the default of sata to pci for Slim1 and Slim2. This can be found under Chipset/Slim1 mode/PCIE. Also be sure to change the link width to x4x4 if splitting into 2 U.2 drives. In my setup, I was...
  15. J

    nvme hw raid at 300Gbps R/W

    tested with 100GB files using fio and raid controller doesn't do any caching so 1GB doesn't seem to impact. 2 x highpoint 7505 in cross-sync. 4 x 1TB nvme m.2 wd850 black ssds in each 7505 server= 1 x amd epyc 7502
  16. J

    nvme hw raid at 300Gbps R/W

    After tweaking for a couple of weeks and thanks to a lot of help from folks on this forum, I was able to finally optimize some of my testing. The main test case was trying to sort out the potential bottlenecks of the dell perc h755n. In parallel, I had a project for work that was just trying...
  17. J

    truenas with new intel p5800x optane

    If I modify the iodepth to 8, I am able to improve the throughput to 135.2Gbps. I will need to sort out a couple more issues with the storage to try and take it to the ultimate goal of 200Gbps of sustained I/O. We're gonna need a bigger boat!
  18. J

    truenas with new intel p5800x optane

    at least I have finally eliminated the datastore as a potential bottleneck. Now to try and get a lagg working on the mellanox dual 100G nic.