DeepSeek-R1 is a 671B MoE: its FP8 weights span about six discrete H200 cards. See the fit math, why MoE memory follows total params, and how to serve it.
Day 2 ready, fixed-cost infrastructure. Full root access. Powered by OpenStack and Ceph.
Enterprise servers. Supports virtualization, big data, blockchain, and more use cases.
Built for AI training, inference, and HPC, with transparent monthly pricing and no metered hours.
High performance object, block, and file storage. Simple prices, fair egress. Powered by Ceph.
Optimize cloud economics with efficient architectural decisions.
Running DeepSeek-R1 671B on an OpenMetal H200
DeepSeek-R1 is a 671B MoE: its FP8 weights span about six discrete H200 cards. See the fit math, why MoE memory follows total params, and how to serve it.