Moonshot Open-Source Kimi K3: An Open-Source Cutting-Edge Model with 2.8T Parameter MoE, 104B Activations and 1M Context Window

On July 27, 2026, Moonshot AI released the full weights of Kimi K3 on Hugging Face and GitHub: a 2.8T total parameter MoE model with 16 activated experts out of 896, 104B activated parameters, 1 million token context window, and native multimodal capabilities. Based on the official README and arXiv technical report, this paper sorts out the key points of the KDA and Stable LatentMoE architectures, interprets the differences between Agent evaluations such as Terminal-Bench and model harness tests, and introduces the API, deployment paths via vLLM/SGLang, and the usage boundaries of the Kimi K3 License.

Read More