Search results

  1. LDighera

    Minisforum MS-01

    Subject: MS-01: Can GRUB sound a tone through the headphone jack, or is there a buzzer connection? I would like my Minisforum MS-01 to produce a noticeable tone when the GRUB boot menu appears. A powered external speaker system is connected to the MS-01’s front 3.5 mm headphone jack. Sound...
  2. LDighera

    Minisforum MS-01

    In preperation for BIOS upgrade to V 1.72, I have created this BIOS Settings sheet on which to record the current settings. The UI prefents me from attaching the spreadsheet; xls is not among the permitted attachment file types. Menu Path Setting Observed Current Value Target /...
  3. LDighera

    Minisforum MS-01

    Small update, since this turned into a useful hardware lesson. The 31B text tests are not the only thing I have been doing with this box. I also have a local image-classifier workflow running on it. The current production path is llama.cpp with Gemma 4 E4B multimodal, behind a small local...
  4. LDighera

    Gemma 31B on a Minisforum MS-01 with RTX 4000 SFF Ada: what actually helped

    Small update, since this turned into a useful hardware lesson. The 31B text tests are not the only thing I have been doing with this box. I also have a local image-classifier workflow running on it. The current production path is llama.cpp with Gemma 4 E4B multimodal, behind a small local...
  5. LDighera

    Gemma 31B on a Minisforum MS-01 with RTX 4000 SFF Ada: what actually helped

    That is a fair way to put it. I would expect the MoE to be a worse general-purpose model than the 31B dense model too. My interest is more practical t han theoretical: what is the best fit inside this particular box, with this particular low-profile/70W GPU constraint? After your earlier reply...
  6. LDighera

    Gemma 31B on a Minisforum MS-01 with RTX 4000 SFF Ada: what actually helped

    Thanks, that was useful feedback. Fair point on the length. I should have made the original post more of a short field note: MS-01, RTX 4000 SFF Ada, Gemma 4 31B Q4_K_M, stable at -ngl 54, about 8.8 tok/s. The reason I included the extra detail is that this box has a fairly specific...
  7. LDighera

    Gemma 31B on a Minisforum MS-01 with RTX 4000 SFF Ada: what actually helped

    How many LLMs do you have running locally on your Minisforum MS-01?
  8. LDighera

    Gemma 31B on a Minisforum MS-01 with RTX 4000 SFF Ada: what actually helped

    Subject: Gemma 31B on a Minisforum MS-01 with RTX 4000 SFF Ada: what actually helped I spent a few days trying to turn a small workstation/homelab box into a useful local LLM host. The end result is not "this replaces cloud/frontier models." It does not. But the tuning results were concrete...
  9. LDighera

    Minisforum MS-01

    Subject: Gemma 31B on a Minisforum MS-01 with RTX 4000 SFF Ada: what actually helped I spent a few days trying to turn a small workstation/homelab box into a useful local LLM host. The end result is not "this replaces cloud/frontier models." It does not. But the tuning results were concrete...
  10. LDighera

    Minisfourm MS-01 Nvidia RTX A4000 PCIe Installation

    You'll have to research Proxmox's support for the RTX4000SFF. Be aware, that the Nvidia GPU has a PCI-16 interface; the Minisforum MS-01's PCI slot is Gen4, Four-Lane, so 1/4 throughput.
  11. LDighera

    Minisfourm MS-01 Nvidia RTX A4000 PCIe Installation

    What do you think about this? uxcell Voltage Converter Regulator DC/DC DC 12V Step-Up to DC 19V 20A 380W Power Boost Transformer
  12. LDighera

    Minisfourm MS-01 Nvidia RTX A4000 PCIe Installation

    The RTX 4000 SFF single slot cooler is due to arrive next week. In the meantime, I've managed to add support for the Intel M.2 NVMe PCIe WiFi 7 adapter card Model: Intel BE200.NGWG.NV to the Debian 12 Bookworm system running KDE Plasma desktop. I found the information in these two web pages...
  13. LDighera

    Minisfourm MS-01 Nvidia RTX A4000 PCIe Installation

    No. It has correct barrel-jack connector.
  14. LDighera

    Minisfourm MS-01 Nvidia RTX A4000 PCIe Installation

    The power adapter came with a US plug. So far, I haven't found it necessary. But, I need to test it with some large language models. I have the Nvidia RTX 4000 SFF Ada single slot cooler | n3rdware on order. There's a video showing it installed in the Minisfourm MS-01. I'll check the power...
  15. LDighera

    Minisforum MS-01 PCIe Transfer Rate With Nvidia RTX A4000AFF GPU

    Thank you for bringing that PCI-e x16 one-half throughput specification to my attention. Indeed, the Serve The Home review does mention: And, Minisforum does state similarly: However, Minisforum fails to mention the PCI-e 0x8 limitation in their blog post. So, I suppose I should have seen...
  16. LDighera

    Minisforum MS-01 PCIe Card and RAM Compatibility Thread

    Yaeh. I struggle with thos U-fl connectors too. I purchased two I-PEX 90435-001 MHF-4 CONNECTOR PUSH & PULL TOOL
  17. LDighera

    Minisforum MS-01 PCIe Transfer Rate With Nvidia RTX A4000AFF GPU

    With a Nvidia RTX A4000AFF GPU installed, Debian 12 is reporting this in the boot log: Does anyone have a suggested fix for this issue? Below are some PCIe data.
  18. LDighera

    Minisforum MS-01 PCIe Card and RAM Compatibility Thread

    Have you seen this real-time temperature and voltage display tool?
  19. LDighera

    Minisfourm MS-01 Nvidia RTX A4000 PCIe Installation

    Installing the Nvidia RTX A4000SFF driver on Windows 11 Professional has been even more problematic than on Linux, resulting in several reinstallation attempts. Lacking an image of the original Windows system installed on the MS-01 was evidently part of the activation problem, as using the...
  20. LDighera

    Minisfourm MS-01 Nvidia RTX A4000 PCIe Installation

    Thank you once again for your valuable input. The Nvidia RTX A4000 (desktop version) specifies 140 Watt maximum power consumption. The Nvidia RTX A4000SFF (mobile version) spec. is: 70 Watts. It is interesting that the BIOS Power Limit settings automatically change when the GPU is installed...