Newsletter

Moonshot Gave Away a Frontier Model and Almost Nobody Can Run It

Kimi K3 open weights shipped July 27 on Hugging Face under Moonshot’s own license, not plain MIT. The model is a 2.8 trillion parameter mixture of experts. It carries a 1 million token context window and native understanding of text, images, and video. It tops Frontend Code Arena and beats Claude Fable 5 on extended coding benchmarks. But independent testing from Artificial Analysis clocked its hallucination rate at 51 percent, up from 39 percent on the previous generation. Moonshot recommends serving it on clusters of at least 64 accelerators, so free weights do not mean free inference. Meanwhile Washington is still deciding whether American developers should be allowed to touch Chinese open models at all.

Best for: teams already running GPU clusters, agent builders burning money on long coding loops, anyone who wants frontier capability without vendor lock.

Not ideal for: solo builders, laptop users, and anybody doing fact-sensitive work where a wrong answer costs more than a slow one.


Kimi K3 Open Weights Versus the Closed Frontier

Kimi K3Claude Fable 5GPT-5.6 Sol
WeightsPublic (Kimi K3 License)ClosedClosed
Parameters2.8T MoE, 16 of 896 activeUndisclosedUndisclosed
Context1M tokens1M tokens1M tokens
MultimodalText, image, video nativeText, imageText, image
API price per 1M$3 in / $15 outHigher tierComparable
Cost per typical task~$0.94~$3.20~$1.04
Hallucination rate (AA)51%LowerLower
Frontend Code Arena1stBelow K3Below K3
Self-hostableYes, 64+ acceleratorsNoNo

The column that matters isn’t any single benchmark. It’s the last row. Fable 5 and Sol are rentals. Kimi K3 is a file you own, so no vendor can deprecate it, reprice it, or decide your use case violates a policy you never read. That’s the entire pitch. And for a lot of teams it’s enough to accept a worse hallucination rate.


What Landed on Hugging Face

The repository at huggingface.co/moonshotai/Kimi-K3 went public a few hours ago. Inside are real safetensors shards, a license file, a config, and a 45 kilobyte model card. Not a placeholder. Not a coming soon page. The whole model.

Moonshot calls it the world’s first open 3T-class model, which is marketing, and also true. At 2.8 trillion total parameters it clears DeepSeek V4 Pro, GLM-5.2, and Llama 4 Behemoth on raw size. But only 16 of its 896 experts fire per token, so active parameters land closer to the mid range. Model size and cost of inference are different questions, and the coverage keeps collapsing them into one.

The Architecture Underneath

The architecture is where Moonshot earned something. Kimi Delta Attention mixes with Gated MLA at a three to one ratio, which is how they get roughly six times faster decoding across million token contexts. Attention Residuals then improve information flow between layers at under two percent extra compute. There’s also a vision encoder called MoonViT-V2, trained from scratch with next token prediction rather than contrastive pretraining. Moonshot’s own framing is 2.5x the intelligence per unit of compute, not just more parameters. For once the claim survives a look at the technical report.

They opened more than the weights, too. High performance attention kernels went public at the same time. So did the mixture of experts communication library and the infrastructure for running agent environments at scale. That second part matters more than the benchmark table, because weights alone do not get you a working agent farm.

One caveat keeps getting flattened in the coverage. This is open weights, not open source. Moonshot has never published training data or the full training pipeline for any model. And the Kimi K3 License is its own document rather than MIT. So you can download it, fine-tune it, and ship a product on it. Just don’t tell your compliance team it’s OSI approved.


The Benchmarks Everyone Is Copy Pasting

Kimi K3 took first place on Frontend Code Arena in blind developer testing, and first on Design Arena. On Terminal-Bench 2.1 it scored 88.3 against Claude Fable 5’s 84.6, essentially tying GPT-5.6 Sol at 88.8. Then on SWE-Marathon, which measures extended coding sessions, it hit 42.0 while Fable 5 managed 35.0. Several rival models collapsed into the teens on that same test.

After that the picture gets less flattering. On FrontierSWE it scored 81.2, well above Sol’s 71.3 but behind Fable 5 at 86.6. On GDPval, which measures long horizon judgment, K3 landed around 1668 Elo. Fable 5 sits at 1760 and Sol at 1748. Overall it ranks third or fourth on the Artificial Analysis Intelligence Index depending on which snapshot you read, behind both Western flagships.

So it wins narrow and loses broad.

Which is exactly what Fireworks AI found when it ran K3 against Fable 5 across roughly a thousand agentic tasks. K3 took security, crypto, and long terminal loops. Fable 5 took multilingual work and data visualization. Neither model dominated the other.

The Number Nobody Put in Their Thread

Here is the figure that deserves equal billing with the leaderboard screenshots.

Artificial Analysis measured K3’s hallucination rate at 51 percent on the AA-Omniscience Index. That’s up from 39 percent on the previous Kimi generation. Meanwhile raw accuracy improved over the same stretch, climbing from 33 percent to 46 percent.

Read those two numbers together, because they only make sense as a pair. The model got better at answering questions correctly. At the same time it got worse at shutting up when it doesn’t know. So it’s more useful and more confident about being wrong, in the same release.

For frontend code generation, where a wrong answer fails visibly in the browser, that tradeoff is survivable. But for research, legal summaries, medical questions, or anything where a fabricated citation sails through unchallenged, it’s a problem you have to design around. Developers self-hosting K3 are already reporting more hallucinations than they get from top closed models.

Moonshot acknowledges the increase. It just didn’t put the number on the benchmark chart, which is a very normal thing for a model lab to do. It’s also a very good reason to read independent evaluations before you route production traffic anywhere. This is the same pattern we flagged when Alibaba quietly closed Qwen’s open source tap. The announcement and the fine print rarely arrive on the same day.


Free Weights, Expensive Reality

The word “free” is doing an enormous amount of work in the coverage of this release.

Moonshot recommends serving Kimi K3 open weights on supernodes with at least 64 accelerators. A100 class clusters, running vLLM, SGLang, or TensorRT-LLM. The Hugging Face repo weighs 1.56 terabytes. So this is not a weekend Ollama project, and it will not run on your gaming rig no matter how many quantization threads promise otherwise this week.

For most people the practical path is a hosted endpoint. Those lit up within hours. Fireworks, Baseten, and Nebius Token Factory all shipped day zero support before most of the US woke up. One developer reported Fireworks serving K3 at 45 tokens per second with 1.44 second latency. Last week the same model was making people wait 11 seconds for a first token on Moonshot’s own API. That’s the open weight flywheel working exactly as advertised: you publish the file, and the industry fixes your infrastructure problems for you by lunch.

Moonshot’s first party API runs $3 per million input tokens and $15 per million output. Cached input drops to around $0.30, and coding workloads reportedly hit cache rates above 90 percent, so real invoices land well below sticker. Artificial Analysis measured a typical task at $0.94. That’s roughly 9 percent under GPT-5.6 Sol and about 66 percent under Claude Fable 5.

But the pricing tells its own story. K3 costs roughly three times what K2.6 did. So the era of Chinese models undercutting everyone by an order of magnitude is closing, and Moonshot has priced itself into Sonnet territory on purpose. If you’ve been running subscription math instead, our Claude Pro review covers what $20 a month buys on the other side of that fence.

The Bill Doesn’t Vanish, It Moves

There’s a second cost nobody quotes. Serving a 2.8 trillion parameter model with a million token context means the ops burden lands on you. So you pin engine versions. You load test the prefix cache before promising anyone a million tokens in production. And you keep a hosted fallback ready for the day your cluster melts.

Day zero repos also move fast. The model card was already edited twice within the first hour of the release, so anything production shaped needs a pinned commit hash rather than a branch name. Mirrors claiming to be K3 will flood search results this week too, and most of them will not be Moonshot’s.

Free weights transfer the bill from a vendor to your infrastructure team. They don’t delete it.


Washington Has Opinions About Your Free Model

This is where the story stops being about benchmarks.

Michael Kratsios, the White House science director, has alleged that Moonshot distilled Anthropic’s Fable model. He also claims K3 was trained on restricted Nvidia GB300 servers. Moonshot hasn’t responded. Meanwhile Commerce has opened a formal inquiry into whether Chinese labs are getting banned US chips, and Treasury Secretary Scott Bessent floated sanctions against firms caught stealing American intellectual property.

Then the pushback arrived from an unexpected direction.

On July 22, nearly 200 startups organized as the Little Tech Association wrote to Trump, Commerce Secretary Howard Lutnick, and Kratsios. Their ask was simple. Do not cut off American access to Chinese open weight models. Y Combinator signed. Proton signed.

Suhail Doshi, founder of the AI infrastructure startup Particle, gave Politico the quote that explains the whole fight. Hundreds of companies would instantly die, he said, and it would be great for Anthropic, because everyone would have to spend money there instead.

That’s not a China argument. That’s a margin argument. Thousands of small companies built their unit economics on Kimi-class pricing, and there is no cheaper fallback tier waiting if that access disappears. For now a White House official has called ban reports baseless speculation, and says no blanket prohibition was seriously discussed. For now.

If the dynamic sounds familiar, it should. We covered a version of it when the Pentagon went after Anthropic over supply chain risk. The pattern repeats reliably. The fight gets framed as national security, and the outcome mostly decides who gets to charge you.


What Kimi K3 Open Weights Change If You Don’t Own a Data Center

Practically, four things.

Coding agents get cheaper. If you’re running long autonomous sessions through Claude Code, Cursor, or any of the open source agent setups we’ve covered, K3 is now a legitimate backend for grind work at roughly a third of frontier pricing. Route the hard reasoning elsewhere and let K3 chew through the volume.

Self-hosting became real for mid-size companies, though not for individuals. If you already pay for GPU capacity, owning the model kills your per token bill entirely. But if you don’t, hosted K3 through Fireworks or Baseten is the move, and self-hosting is a fantasy dressed up as sovereignty.

Verification stops being optional. A 51 percent hallucination rate means you need a checking layer for anything factual, whether that’s a second model, a retrieval step, or a human reading the output. Budget for it now rather than after the first bad invoice.

And the open weight tier is now close enough to the frontier that “just use the closed model” stopped being an automatic answer. Nathan Lambert, who tracks this space closer than almost anyone, called K3 the strongest open model ever released. Moonshot managed it with a fraction of Anthropic’s or OpenAI’s resources, under export controls, while being publicly accused of copying the homework.


Where This Leaves Everyone

The benchmark discourse will burn itself out by Wednesday. Meanwhile the download will get quantized, mirrored, and squeezed onto smaller clusters by people who enjoy that particular kind of pain.

What sticks is the shape of the thing.

A Chinese lab published a frontier model, the full technical report, and the training infrastructure on the same morning that American policymakers were arguing about whether US developers should be permitted to open the file.

One of those two groups is competing on capability. The other is competing on access.


Is Kimi K3 free?

The weights are free to download and the license permits commercial use, but running the model is not free. Moonshot recommends at least 64 accelerators, so most teams will pay a hosted provider instead.

Is Kimi K3 open source?

No, it’s open weight. Moonshot published the trained parameters under the Kimi K3 License, but it has not released training data or the full training pipeline. So the model doesn’t meet the OSI definition of open source.

Where do I download Kimi K3 open weights?

The official repository is huggingface.co/moonshotai/Kimi-K3. Mirrors will flood search results this week, so verify you’re on the moonshotai organization and pin a commit hash before wiring anything to production.

How does Kimi K3 compare to Claude Fable 5?

K3 wins on frontend code, security tasks, and extended terminal sessions. Fable 5 wins on long horizon judgment, multilingual work, and data visualization, and it hallucinates significantly less.

Can I run Kimi K3 on a laptop?

No. The full weights run 1.56 terabytes, and the model needs multi-accelerator serving. Quantized community versions will appear, but a 2.8 trillion parameter model is not a consumer hardware target.