Search results

  1. I

    Nvidia CMP 100HX (CMP100-210) Tensor cores working?

    Can you try a basic program in pytorch to test it?
  2. I

    [Solved] G292-z20 wont detect gpus

    I'm running stock no cables, there's software to talk to the z20 pcie switches which may help with troubleshooting
  3. I

    Nvidia CMP 100HX (CMP100-210) Tensor cores working?

    If you try Linux, may be able to modify the open drivers GitHub - tinygrad/open-gpu-kernel-modules: NVIDIA Linux open GPU with P2P support
  4. I

    8x 4090 motherboard recommendations

    Four cards fit under the 2200W power supplies and under-volting is also recommended.
  5. I

    Nvidia Tesla P40 24gb for $149.99 +sht

    They meet the VRAM requirements to run open models and will be slow, for any serious ML work you'd want a 3090 imo
  6. I

    Mellanox SX6036, Rail Kit

    Given the rush to buy GPU nodes for AI and the massive bandwidth required to scale. I'd expect a bunch of 100G gear to hit the market at some point as people upgrade
  7. I

    Mellanox SX6036, Rail Kit

    Cheaper Restored Mellanox SX6036 36 Port QSFP Managed InfiniBand Switch 2xPsu (Refubished)
  8. I

    [Solved] G292-z20 wont detect gpus

    Make sure the version of the Nvidia user space package is a matching version 550.54.15 and skip kernel module install with flag `sh ./NVIDIA-Linux-[...].run --no-kernel-modules` Otherwise you need to merge code to use a newer one Multi-GPU Tinygrad Patch
  9. I

    8x 4090 motherboard recommendations

    Depends on your device zero, if you can't run 16k with a batch size, it let's you scale.
  10. I

    8x 4090 motherboard recommendations

    Ring Attention with modified softmax split's the kv cache across devices, it also does a better job than fsdp, as it allows all devices to compute and pass the results. https://arxiv.org/abs/2311.09431
  11. I

    8x 4090 motherboard recommendations

    Ignoring the labor cost but there was a story on China about buying pallets loads cards, striping them down and replacing memory and heatsync. Given the cost of data center cards this could be a good way for small AI companies or universities to build a cluster.
  12. I

    8x 4090 motherboard recommendations

    I'm not using dual slot blower cards
  13. I

    8x 4090 motherboard recommendations

    This model can tokenize the MIDI audio standard BlinkDL/rwkv-5-music · Hugging Face
  14. I

    Any alternative drivers for Nvidia?

    https://gitlab.freedesktop.org/nouveau/wiki/-/blob/main/sources/CodeNames.mdwn https://github.com/NVIDIA/open-gpu-kernel-modules
  15. I

    [Solved] G292-z20 wont detect gpus

    Got it running, tested the tinygrad p2p driver also.
  16. I

    8x 4090 motherboard recommendations

    I hear good things about their risers for gen4 speed and less issues C-Payne PCB Design
  17. I

    [Solved] G292-z20 wont detect gpus

    Solved the power issue, aftermarket EPS cables aren't using the standard pinout https://www.corsair.com/uk/en/p/pc-components-accessories/cp-8920284/600w-pcie-5-0-12vhpwr-type-4-psu-power-cable-cp-8920284
  18. I

    [Solved] G292-z20 wont detect gpus

    Tested slot 1 with a raid card and was detected in Linux plus remote management
  19. I

    [Solved] G292-z20 wont detect gpus

    I ordered a low power GPU so I'll test that soon, I'm guessing populating only the 2nd slot isn't a problem. Could also borrow a multimeter and test the gpu power rails.
  20. I

    [Solved] G292-z20 wont detect gpus

    Hey so I got this gigabyte g292-z20 server with aim to run 2-4 GPU’s via the eight pcie slots. Unfortunatly when testing with a single pcie card both the cards I have 7900xtx and 4090 fail to detect in lspci… so I’m stuck image1000×760 50.3 KB Its running microsemi pci switches which I hope...
Top Bottom