Moonshot Open-Sources 2.8T-Parameter Kimi K3: The Largest Open-Weight State-of-the-Art Model to Date

On July 27, 2026, Moonshot AI released the full weights of Kimi K3 on Hugging Face: with a total parameter size of 2.8T and 104B activation per token, the MXFP4 format weighs approximately 1.56 TB (split into 96 safetensors shards). The official claims it is the world's first open 3T-level model. This article sorts out its Stable LatentMoE architecture (896 choose 16 experts), KDA attention mechanism, 1-million-token context window, MoonViT-V2 multimodal capabilities, as well as self-hosting thresholds and API access methods, for developers to evaluate deployment and integration solutions.

Read More