Recent content by nutsnax

  1. N

    ESXi8 is now free again.. Really .. Bang and my last ESXi server has been decommisioned. Dropped off all my VMware books and materials at the recycler

    VMware Workstation was constantly broken on Linux for me... Virtualbox actually worked better.
  2. N

    Poor ConnectX 3 Pro performance

    Thanks for your input I appreciate it. I actually changed some BIOS settings (enhanced I/O or some HP-Speak like that) and iperf is now at 20-25Gbps. I just used MSCP and got 2.5GB/s to a NVME drive without even trying so this is absolutely a software/optimization issue. edit: to be clear...
  3. N

    Poor ConnectX 3 Pro performance

    I think my problem is that I expected a 40Gbps connection to transfer at something substantially north of 10Gbps in single file transfers using NVME hardware with Epyc CPU's, lots of RAM and good cables with relatively little configuration and in real-world use-cases (i.e. simple file...
  4. N

    Poor ConnectX 3 Pro performance

    Looks like NFS is one of the only options. Maybe Samba (direct?) but I have to read more on it.
  5. N

    Poor ConnectX 3 Pro performance

    Thanks, I'll start looking for guides on how to do this I appreciate it. Hopefully there's a way to make SFTP use RDMA.
  6. N

    Poor ConnectX 3 Pro performance

    Also, Debian Server A copying from Ubuntu Server B using straight FTP can only manage 500MB/s or thereabouts from NVME to NVME.
  7. N

    Poor ConnectX 3 Pro performance

    wow that's great to know. If only I could use it like sshfs.
  8. N

    Poor ConnectX 3 Pro performance

    Sorry I forgot to mention. Debian Server A is on dual Epyc 7763 with a terabyte of RAM Ubuntu Server B is on a dual Xeon 2697 v4 with 512GB RAM Ubuntu Server C is on a single Epyc 7D12 with 384GB RAM all are on PCI-E 3.0 8x. Loads of I/O in those servers.
  9. N

    Poor ConnectX 3 Pro performance

    I did a search on this and couldn't find what I felt were good guides/threads on performance or setup. I've got a bunch of Connect-X 3 Pro cards in various servers all flashed to the latest Mellanox firmware on the site (2.42.5000). All equipped with Samsung F320 cards or Samsung PM9A3 nvme...
  10. N

    hey I saw that you had one of those 7V13 ES CPU's on a Gigabyte MZ32-AR0 motherboard. Have you...

    hey I saw that you had one of those 7V13 ES CPU's on a Gigabyte MZ32-AR0 motherboard. Have you tested it with LRDIMM's and if so did it work? More specifically 64GB LRDIMM's.
  11. N

    Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

    Ahh, so Uplinking is called Stacking in Brocade-land. Got it. Is that enabled on a per-port basis? If so can I plug a standard NIC into it afterward or would stacking need to be disabled?
  12. N

    Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

    I picked up a 7250 and can't use the 10gbe SFP+ ports as uplinks to other switches only as standard ports for servers. Is there some mode that I need to set on the switch to allow me to uplink to other switches?
  13. N

    Nvidia Tesla P40 24gb for $149.99 +sht

    I dunno about you but I'm not buying anything with sht in the box.
  14. N

    Cheyenne supercomputer with 8,064 Xeon e5-2697v4 and 313,344GB of DDR4 auction!

    If the DDR4 is cheap enough I will load the boat with 16GB sticks for all of my servers. If I can get them for $5 per stick or something like that I might as well. I did the same with $20 64GB DDR3 sticks.