In partnership with

Login or Subscribe to participate

Kimi K3 dropped last week with a bold pitch (again): an open-weight model that performs at Opus level while charging Sonnet prices.

Moonshot's 2.8 trillion parameter monster went straight to #1 on Arena's Frontend Code leaderboard, above Claude Fable 5, and it’s all over my feed.

So I spent the weekend testing it against Opus 4.8 and by the end I had an answer.

Before we dive in, some catchup:

Partner with us

AI Cheatsheet 101

If today's piece left you wanting a proper handle on AI vocabulary, here is the best resource.

85 terms explained in plain English, structured so each section builds on the last.

Quick "test yourself" checkpoints between sections keep what you learn from evaporating, and 15 minutes of scrolling will leave you a lot more fluent than you were this morning.

DevTools of the Week

An Excel-compatible runtime for agents and humans, shipping as a native Mac app and a CLI where every command reads stdin and writes stdout, so a workbook pipes through jq, awk, curl, and sqlite like any other Unix tool.

Microsoft Research's open-source visualization language that hands AI agents a semantic middle layer instead of raw plotting code, so one compact spec compiles to 30+ chart types across Vega-Lite, ECharts, and Chart.js.

A family of small encoder models from Feyn that strip navigation, ads, and boilerplate from raw HTML and return clean Markdown in a single forward pass. The 210M model matches state-of-the-art extraction quality at 1/20th of the cost and fits on any GPU.

open-weight > open-source

K3 is “open-weight”, many are confusing it with “open-source”, which is not the same thing.

Open-weight means you get the finished model, trained parameters you can download, run, and fine-tune yourself.

K3's weights are due on Hugging Face by July 27, and if they follow every recent Kimi release they'll arrive under a Modified MIT license that allows commercial use.

Under this, you don't get the training data or the full training code, so you can use the model but you can't rebuild it or fully audit how it was made.

Open-source, in the strict sense, means all of that ships too.

Benchmarks:

Artificial Analysis scores K3 at 57 on its Intelligence Index, which puts it level with Opus 4.8 and GPT-5.5, and behind Fable 5 and GPT-5.6 Sol.

That is the best score any open-weight model has ever posted there. Hence, the following tests.

Test 1: the lunar lander

Prompt:

Build a single-file HTML page: a playable "Lunar Lander" game. Canvas rendering, realistic-feeling gravity and thrust physics, fuel gauge, particle exhaust, terrain with a flagged landing pad, win/crash states, score based on fuel remaining and landing softness, restart button. Polished visual design, this should look like a finished product, not a demo. No external libraries.

Output:

Opus handed me a working game on the first load.

K3's version had every feature from the prompt and none of them worked together.

Broken on first load, unplayable, and it took another 3 to 4 rounds of fix prompts before I could land the thing.

The twist is that K3's game looked better.

Arena is humans voting on pairs of outputs, and a screenshot of K3's game beats a screenshot of Opus's game.

Nobody in that voting booth has to play either one though.

Winner: Opus

Test 2: five planted bugs

Prompt:

This script produces wrong output sometimes and I can't figure out why. Find every problem, explain each one, and give me the corrected version. Don't rewrite the whole thing in your own style, minimal diffs.

Output:

Both models found all five. Neither invented a bug that wasn't there, and both respected the minimal diffs instruction instead of rewriting my file in their own accent.

So yes, a free open-weight model just matched Claude Opus on the kind of work that fills an actual dev's day, with 0 false positives.

The gap showed up after the fifth bug though.

K3 went on to catch 1 issue I hadn't planted.

Opus caught 2, including a formatting bug I'd missed in my own trap, then it worked out why the script only failed sometimes.

The splice bug needs 2 cancelled orders sitting next to each other, my random seed happened to never produce that pair, so Opus forced an adjacent pair into existence just to prove the failure was real.

It even flagged a design smell and deliberately left it alone because fixing it wasn't its call.

K3 found my bugs and Opus did my job.

Winner: Opus, on depth

My Take

The claim mostly survived my tests, and I'm a little annoyed about it.

I walked in expecting the usual open-model story. (impressive charts, falls apart on contact)

The frontend test delivered that, on the benchmark K3 is most famous for. Then the debugging test went and matched Opus bug for bug on real code, at a fraction of the price.

Opus is still the model I'd trust to be right the first time. But Kimi with a 5 out of 5, zero hallucinated bugs, minimal diffs respected? Damn.

Open models used to be a thing you rooted for. Now, you can actually hand it over your work.

Until next time,
Vaibhav 🤝🏻

If you read till here, you might find this interesting

# Partner 1

The Free Playbook Behind Millions in Off-Amazon Revenue

Most eCommerce brands running external traffic aren't scaling — they're just spending.

Wrong channels, no real attribution, and at the end of the month, still no clear answer to the only question that matters: what actually moved your BSR?

The brands getting it right aren't necessarily spending more. They've just stopped guessing. They know which channels pull weight on Amazon listings, which ones look good in a dashboard but bleed budget, and why creator traffic consistently outperforms paid social on ROI when it's set up correctly.

Levanta put together a free playbook breaking down 7 proven external traffic strategies. Inside you'll see how top brands are driving millions in off-Amazon revenue and why most channels underdeliver when brands don't know what to look for before they start spending.

If you're serious about growing outside of PPC, this is worth 5 minutes.

# Partner 2

Moda is the AI design agent with taste

Moda is an AI design product where you prompt what you need, get a complete on-brand design, and edit every element on a full canvas. 

Our viral launch hit 4.4M views in days, tens of thousands signed up, and executives at major finance and tech companies now use it.

Reply

Avatar

or to participate

Keep Reading