Email Us
Growfiy Logo
Kimi K3 Explained: Moonshot AI's 2.8T Parameter Model (2026 Guide)

Kimi K3 Explained: Moonshot AI's 2.8T Parameter Model (2026 Guide)

Moonshot AI's Kimi K3 is the largest open-weight AI model ever released, with 2.8 trillion parameters. Here's what it is, how it works, and why it matters.

By Growfiy Team12 min read

On July 16, 2026, Beijing-based Moonshot AI released Kimi K3, a frontier-scale language model with roughly 2.8 trillion total parameters — making it, by Moonshot's own description, the world's first "open 3T-class" model and the largest open-weight AI model released to date. (Some early coverage cited the figure as 2.7 trillion; Moonshot's own documentation and most technical trackers list it at approximately 2.8 trillion.) The release landed at a pointed moment: just ahead of the 2026 World Artificial Intelligence Conference in Shanghai, and amid ongoing U.S. export restrictions on advanced chips aimed at slowing China's AI progress. For a company whose market position had reportedly weakened over the prior 18 months following the rise of rival lab DeepSeek, K3 represents a significant comeback moment. This guide breaks down what Kimi K3 actually is, how it works under the hood, how it performs against leading Western models, and why its release matters beyond the specs sheet.

Who Built Kimi K3?

Kimi K3 comes from Moonshot AI, a Beijing-based startup founded by Yang Zhilin, a former Google researcher. The company's Kimi chatbot has become one of China's most widely used consumer AI products, with annualized recurring revenue reportedly exceeding $200 million as of April 2026, driven by paid subscriptions and API usage.

Moonshot's investor base includes major Chinese tech players Alibaba, Tencent, and Meituan. The company raised $2 billion at a $20 billion valuation in May 2026 and was reportedly in talks for a subsequent round that would value it at $30 billion — underscoring how significant this release is to Moonshot's broader business trajectory.

What Makes Kimi K3 Technically Notable

A Massive but Efficient Architecture

Kimi K3 is a sparse Mixture-of-Experts (MoE) model. Rather than activating all 2.8 trillion parameters for every request, it contains 896 experts and activates only 16 of them per computation — roughly 1.8% of the total pool. This sparse activation approach means the model can hold a much larger total parameter count while keeping the actual compute cost per token far lower than a dense model of equivalent size would require.

To put the scale in perspective: at 2.8 trillion parameters, even a 4-bit quantized version of the model works out to roughly 1.4 terabytes of raw weight data — before accounting for additional runtime overhead, making self-hosting a serious infrastructure undertaking. Moonshot recommends deployment on supernode configurations with 64 or more accelerators for those looking to run the model independently.

Key Architectural Innovations

Two internally developed techniques underpin K3's design:

  • Kimi Delta Attention (KDA): A hybrid linear attention mechanism designed to improve efficiency across very long sequences
  • Attention Residuals: Described as a drop-in replacement for standard residual connections, intended to deliver more consistent performance gains as the model scales

Both techniques had previously been published as open research by the Moonshot team, and now form the technical backbone of K3.

Context Window and Multimodal Capabilities

Kimi K3 supports a 1-million-token context window, along with native visual understanding, allowing it to process images and long documents within a single session. The model also runs in an always-on "thinking mode," reflecting its design as a reasoning-first system rather than a purely conversational one.

How Kimi K3 Compares to DeepSeek and Other Chinese Models

Kimi K3's 2.8 trillion parameters make it roughly 75% larger than DeepSeek's V4 Pro, which stands at approximately 1.6 trillion parameters and had previously been the largest widely used open model. That makes K3 a clear marker of how quickly the scale of openly released Chinese models has grown within a single product cycle.

How Kimi K3 Performs Against Western Frontier Models

Moonshot positioned K3 directly against leading proprietary systems, and independent benchmarking has largely supported that framing — with some notable caveats.

On the Artificial Analysis Intelligence Index v4.1, an independent benchmark tracker, Kimi K3 scored 57.1, placing it as the #4 tested configuration, trailing GPT-5.6 Sol Max (58.9) and Claude Fable 5 with an Opus 4.8 fallback (59.9) by only a few points.

On more targeted evaluations, K3 has shown particular strength in coding and agentic tasks:

  • In the Frontend Code Arena benchmark, K3 ranked first place with 1,679 points in blind developer testing, ahead of Claude Fable 5
  • Moonshot itself noted that while K3 trails Claude Fable 5 and GPT-5.6 Sol on overall performance, it outperformed Claude Opus 4.8 and GPT-5.5 across coding and agentic benchmark categories

Moonshot describes K3 as its most capable open-source coding model to date, positioning it squarely for long-horizon coding, knowledge work, and agentic workflows rather than as a low-cost, general-purpose alternative.

Availability, Pricing, and Self-Hosting

At launch, Kimi K3 was available through Moonshot's Kimi applications and API, with full model weights initially withheld. Moonshot committed to releasing the complete weights by July 27, 2026 — a deadline the company met, releasing a checkpoint spanning 1.56 TB across 96 shards on Hugging Face, accompanied by a 47-page technical report. This made K3 the first openly downloadable model in the 3-trillion-parameter class.

API pricing has been reported at roughly $0.30 per million cache-hit input tokens, $3 per million on cache misses, and $15 per million output tokens, though exact figures vary slightly depending on the hosting provider, since multiple companies now offer inference access to the model.

Why Kimi K3's Release Matters

1. It Signals China Is Closing the AI Gap Despite Export Controls

K3's release is being read by many analysts as evidence that roughly three years of escalating U.S. restrictions on advanced GPUs and semiconductor manufacturing equipment have not stopped Chinese AI labs from approaching the global frontier. Reports indicate Moonshot used Nvidia Blackwell chips in training K3, adding another layer to the ongoing conversation around export enforcement and access to advanced compute.

2. It's a Landmark Moment for Open-Weight AI

By releasing full model weights for a model of this scale, Moonshot has pushed the boundary of what's publicly available in the open-weight ecosystem. Until K3, no openly downloadable model had reached the 3-trillion-parameter class. For developers, researchers, and companies wary of vendor lock-in with closed proprietary APIs, this expands the pool of frontier-capable models that can, at least in principle, be self-hosted.

3. It Raises the Bar for Coding and Agentic AI Tools

K3's strong coding and agentic benchmark results — including outperforming some established proprietary models in specific evaluations — suggest that open-weight models are increasingly viable options for serious software development and automation workflows, not just experimentation.

4. The Timing Carried a Political Signal

K3's release coincided with the 2026 World Artificial Intelligence Conference in Shanghai, where Chinese President Xi Jinping spoke about AI development requiring international cooperation rather than being dominated by a single country. The timing added a geopolitical dimension to what was, on the surface, a technical product launch.

Conclusion

Kimi K3 is more than a bigger number on a parameter count chart. It represents a meaningful jump in what's openly available to developers and researchers worldwide, a strong signal that Chinese AI labs are narrowing the gap with top U.S. frontier systems despite ongoing export restrictions, and a serious contender in coding and agentic AI workloads. Whether K3 becomes a mainstay in production AI stacks will likely depend on real-world performance beyond benchmarks — but its release has already reshaped the conversation around what "open-weight" AI can mean at frontier scale.

Frequently Asked Questions

How many parameters does Kimi K3 have?

Kimi K3 has approximately 2.8 trillion total parameters, though it activates only 16 of its 896 experts — about 1.8% of the total — for any given computation, thanks to its Mixture-of-Experts architecture.

Who created Kimi K3?

Kimi K3 was developed by Moonshot AI, a Beijing-based startup founded by former Google researcher Yang Zhilin, and backed by Alibaba, Tencent, and Meituan.

Is Kimi K3 open source?

Yes. Moonshot released the full model weights on July 27, 2026, making K3 the first openly downloadable model in the 3-trillion-parameter class, alongside a detailed technical report.

How does Kimi K3 compare to Claude and GPT models?

On independent benchmarks like the Artificial Analysis Intelligence Index, K3 scores close behind top proprietary models like Claude Fable 5 and GPT-5.6 Sol, and it has outperformed some other proprietary models on specific coding and agentic benchmarks.

Can I self-host Kimi K3?

Yes, now that full weights are available, though it requires substantial infrastructure — Moonshot recommends supernode configurations with 64 or more accelerators given the model's scale.

Kimi K3 ExplainedMoonshot AIKimi K3 ParametersOpen-Weight AI ModelKimi K3 vs DeepSeekKimi K3 BenchmarksMixture of Experts ModelKimi K3 Coding PerformanceChina AI Models 2026Kimi K3 vs Claude GPTKimi K3 Self-HostingFrontier AI Models 2026