Moonshot Releases Full Weights of Kimi K3: The First 3T-level Open Source Model
On July 27, 2026, Moonshot AI released the full weights of Kimi K3 on Hugging Face and GitHub: it has a total of 2.8T parameters, 104B activations, and a 1M context window, adopting MoE + KDA attention and MXFP4 native quantization. This article sorts out the architecture specifications, coding evaluation performance and vLLM self-hosting key points, and discusses the gap between open-source weights and closed-source cutting-edge models as well as the deployment threshold.
Read MoreMoonshot Open-Sources 2.8T-Parameter Kimi K3: The Largest Open-Weight State-of-the-Art Model to Date
On July 27, 2026, Moonshot AI released the full weights of Kimi K3 on Hugging Face: with a total parameter size of 2.8T and 104B activation per token, the MXFP4 format weighs approximately 1.56 TB (split into 96 safetensors shards). The official claims it is the world's first open 3T-level model. This article sorts out its Stable LatentMoE architecture (896 choose 16 experts), KDA attention mechanism, 1-million-token context window, MoonViT-V2 multimodal capabilities, as well as self-hosting thresholds and API access methods, for developers to evaluate deployment and integration solutions.
Read More