Small update, since this turned into a useful hardware lesson.
The 31B text tests are not the only thing I have been doing with this box. I also have a local image-classifier workflow running on it. The current production path is llama.cpp with Gemma 4 E4B multimodal, behind a small local...