Recent content by llowrey

  1. L

    Nice Deal $28 - Adaptec ASR-71605 PCI-E 3.0 x8 16 Port SAS Controller

    I have two of these, well, one 24 port and one 16 port. Both ran very hot for me initially... 80+C. I added a low power low speed 120mm fan blowing down on the cards and now temps are under control. My ambient is high; thermostat is set for 78F (26C). This is the fan bracket I used...
  2. L

    48 Drive 4U Chassis: IBM Slicestor 3448 aka Chenbro RM43348

    I added a link to a zip containing my 3d printable drive rail STL and F3D files to the OP.
  3. L

    Solarflare SR-IOV on Linux (Partially Solved)

    My apologies for reviving a 2 year old thread, but this just saved me a bunch of time and pain. I'm running an ASRock Rack EPYCD8 and have my Mellanox CX3 set to 16 VFs. I updated the bios to 2.40 and suddenly could only get 7 VFs to work and got the dreaded "!!! Unknown header type 7f" for the...
  4. L

    Help with ConnectX 3 SR-IOV with Linux host and windows guest via kvm

    Also... /etc/modprobe.d/mlnx.conf blacklist mlx4_core blacklist mlx4_en blacklist mlx5_core blacklist mlx5_ib options mlx4_core num_vfs=16,0,0 port_type_array=2,2 probe_vf=1,0,0 /etc/modprobe.d/vfio.conf options vfio-pci ids=1022:7901,9005:028c,8086:1521,15b3:1004 ... and the following...
  5. L

    Help with ConnectX 3 SR-IOV with Linux host and windows guest via kvm

    Host: Epyc 7502 (32-core) OS: CentOS 8.1.1911 Kernel: 4.18.0-147.8.1.el8_1.x86_64 CX-3: MCX354A-FCB_A2-A5 (MT_1090120019) FW: 2.42.5000 OFED: v5.0-2.1.8 Device #1: ---------- Device type: ConnectX3 Device: /dev/mst/mt4099_pci_cr0 Configurations: Next...
  6. L

    Help with ConnectX 3 SR-IOV with Linux host and windows guest via kvm

    My configuration is a bit different. <interface type='network'> <mac address='52:54:00:76:9a:89'/> <source network='Mellanox'/> <model type='e1000e'/> <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/> </interface> Here's my network definition...
  7. L

    What is a HUH72808CLAR8000?

    Thanks for the info, especially your report that you suffered no ill effects.
  8. L

    HGST 10TB SAS 4Kn HDDs for $150. OBO

    Yikes. Sorry to hear that. Incidentally, I had all sorts of trouble initially and it was due to power brownouts. Turns out these drive draw heavily on the 5V line and my wiring from the PS to the backplanes wasn't able to handle the load. I re-arranged the wiring to pull fewer amps per line and...
  9. L

    HGST 10TB SAS 4Kn HDDs for $150. OBO

    I bought a bunch from kl0, got them about 2 weeks ago, and all show power on time and report aprox 2.5 years. If running linux, are you running 'smartctl -x'?
  10. L

    What is a HUH72808CLAR8000?

    The label on the top of the drive says HUH728080AL4200 but the drive identifies itself as a HUH72808CLAR8000. The physical appearance of the drive is also slightly different from the other HUH728080AL4200 drives I have. The top is polished aluminum with a white label covering about 1/2 the...
  11. L

    SR-IOV problem with CX3

    I have a Mellanox MCX354A-FCBT (flashed from HP OEM) that I'm running in SR-IOV mode with 8 VFs. The host is using the PF as its primary interface and, at present, I only have one guest running a VF. The guest is experiencing tons of problem with the VF. Connections will run at full speed for...
  12. L

    Epyc Rome: Unable to pass-through SATA ports to VM. FLR bug?

    I am not having any success passing through any of the built-in peripherals on my Epyc 7502 (SATA or USB). When I start a VM that has the built-in SATA or USB as PCI pass-through devices, I get a sequence of... vfio-pci 0000:45:00.0: not ready 1023ms after FLR; waiting vfio-pci 0000:45:00.0...
  13. L

    pre-owned Hitachi HGST 8TB 3.5" 12Gb SAS 4KN HUH728080AL4200 $99

    The $99 deal appears to be gone but here's a slightly better deal @ $85/drive + $14 shipping on 1st drive, $5 for each additional drive. HGST 8TB SAS 12.0 Gb/s 7200RPM Hard Drive 0F23651 | eBay
  14. L

    pre-owned Hitachi HGST 8TB 3.5" 12Gb SAS 4KN HUH728080AL4200 $99

    I received 3 of these yesterday. Had a heck of a time with them. All three were showing 512 for the sector size (logical & physical) and zero total capacity. One had an additional odd behavior of timing out and causing "Spinning up disk..." to be logged in dmesg repeatedly. I used sg_format...
  15. L

    Beware of EMC switches sold as Mellanox SX6XXX on eBay

    I managed to hack the SX6018 firmware to apply power to high power transceivers (eg LR4 and BiDi) but the switch would not recognize them. I verified that the transceivers were powered and emitting laser light so I think the issue is that the switch firmware won't recognize them because they...