Hardware · November 21, 2026 · Low impact
Homelab Optane server runs 2.8T-parameter Kimi K3
A second-generation homelab build using Optane PMem 200 memory and a RAM drive is running Moonshot AI's Kimi K3 at 3.11 tokens per second. Two RTX 3090 GPUs handle the work. The model has 2.8 trillion parameters.
It shows how far used consumer GPUs and older server memory can be pushed to run very large AI models at home.