A build log for one workstation: a 284B mixture-of-experts model across two GPUs and 256 GB of RAM, measured.
threadripper mixture-of-experts llama-cpp local-llm gguf speculative-decoding deepseek ik-llama-cpp moe-offloading
-
Updated
Sep 17, 2026 - Shell