DeepSeek-R1’s 671B MoE fits one eight-GPU HGX B300 node at FP8, with room for KV cache. See the fit math and why the node beats a multi-server build.
Tag: Model Deployment Fit
DeepSeek-R1 is a 671B MoE: its FP8 weights span about six discrete H200 cards. See the fit math, why MoE memory follows total params, and how to serve it.
Yes, Llama 3.3 70B runs on a single OpenMetal H200 at FP8 with full 128K context. See the VRAM fit math, KV-cache budget, and vLLM setup.