Search for AI Courses, Tech News and, Blogs

Moonshot Releases 2.8T Kimi K3 Weights, but Running It Is Another Story

by Arun Padmanabhan | 3 days ago | 6 min read

Moonshot AI has released the weights for Kimi K3, turning one of the most closely watched AI launches of July into a much bigger industry moment.

The weights went live on July 27 through Hugging Face, eleven days after Kimi K3 was first introduced as an API-only model. The release gives developers access to a massive 2.8-trillion-parameter mixture-of-experts model built for long-context coding, knowledge work, visual understanding, and agentic workflows.

Moonshot is presenting the release as part of a broader open ecosystem. Alongside the model weights, the company is also opening parts of its surrounding infrastructure, including attention kernels, a mixture-of-experts communication library, and tooling for running agent environments at scale.

But the most important practical detail is this: Kimi K3 may be free to download, but it is not free to use in any normal sense.

A Huge Open-Weight Model

Kimi K3 is built as a mixture-of-experts model, which means only part of the full model activates for each token. It has 2.8 trillion total parameters, but roughly 104 billion are active per token. The system uses 16 experts out of 896 for each step.

The model also supports a one-million-token context window, giving it the ability to work across very large files, codebases, documents, images, and video inputs. Moonshot has also made its API compatible with common OpenAI and Anthropic-style workflows, which makes integration easier for developers and AI tool builders.

One of the notable engineering choices is Kimi Delta Attention. Instead of relying only on a conventional expanding key-value cache, K3 uses a fixed-size state handler. Moonshot says this reduces memory pressure and execution cost, especially for long-context inference.

That matters because long-context models can become expensive quickly. If K3 can process large files and long conversations at lower cost, it becomes more attractive for coding agents, research tools, document analysis, and workflow automation.

Open Weight, Not Fully Open Source

The release has been widely described as open source, but the more accurate label is open weight.

Moonshot published the model weights under its own Kimi K3 License, which allows commercial use with attribution and adds extra conditions only at very large scale. For most developers and startups, the licence is likely permissive enough to be useful.

But the training data and full training code are not included. That means researchers and companies can run and adapt the model, but they cannot fully reproduce how it was trained from scratch.

This distinction matters. Open weights give the ecosystem more control than a closed API, but they are not the same as a completely transparent open-source release.

Strong Benchmarks, With Caveats

Kimi K3 has performed strongly across several major evaluations. It ranked near the top of broader intelligence indexes and reached number one on a front-end coding leaderboard, where it beat several leading closed models.

That result is important because front-end coding is one of the most visible model-quality tests for developers. A strong front-end model must understand layout, styling, design logic, component behavior, and user interface polish.

Kimi K3’s coding performance has made it one of the strongest open-weight models released so far. It appears especially competitive against top proprietary models when cost is considered.

Still, it is not a clean victory across every test. Some leading closed models remain ahead on broader intelligence and software engineering benchmarks. Kimi K3 is also reportedly slower than some competitors, even when it matches them on quality. For real product teams, speed, cost, reliability, and hosting complexity matter as much as leaderboard position.

Kimi K3 rocks the AI industry as Moonshot AI undercuts closed-source  American competitors on price — but the huge 2.8T open-weight model still  needs serious hardware to deploy at scale | Tom's

Most People Cannot Run It

The biggest misunderstanding around Kimi K3 is the idea that anyone can simply download and run it.

The checkpoint is enormous. Stored in MXFP4 quantization, the download is around 1.4 terabytes, and all experts must sit in memory even though only a small number activate per token. Running it properly requires high-end server infrastructure, not a gaming PC, Mac Studio, or standard multi-GPU workstation.

At the low end, teams are looking at enterprise GPU nodes. Full long-context use can require even more memory across multiple high-end GPUs. Monthly infrastructure costs can reach tens of thousands of dollars depending on configuration and usage.

That makes the API or hosted endpoints the practical route for most developers, learners, and smaller teams. Moonshot’s listed API pricing is far more realistic for everyday use than self-hosting, especially unless a team is generating very high token volumes every day.

The real headline is not that the model is free. It is that the weights are available, but serious use still requires serious infrastructure.

The Geopolitical Fight

Kimi K3 has also intensified the political fight around AI competition between China and the United States.

Some U.S. officials and companies have raised concerns about whether Chinese labs are using distillation from American frontier models to accelerate development. Moonshot has been named in that broader debate, although public claims have not settled how much, if at all, Kimi K3 depends on that kind of technique.

At the same time, China is reportedly considering tighter controls over AI models, training data, and related technologies. Both sides now treat model weights as strategic assets, not just developer tools.

Why It Matters

Kimi K3 shows that open-weight models are moving into territory once dominated by closed frontier systems. It also shows the gap between access and usability.

For AI learners and developers, the practical lesson is simple. Kimi K3 is not a model most people will run locally. The useful path is learning how to call it through an API, compare it with other frontier models, and route tasks to whichever model performs best.

The release matters because it gives the AI ecosystem more choice. But it also reminds everyone that “open” does not always mean easy, cheap, or local.