Top
Best
New

Posted by vincent_s 8 hours ago

Kimi K3: Open Frontier Intelligence(www.kimi.com)
https://www.kimi.com/en

Kimi K3 Intelligence, Performance & Price Analysis: https://artificialanalysis.ai/models/kimi-k3

890 points | 531 commentspage 3
XCSme 5 hours ago|
I finished benchmarking[0] it, but it was not fun, it only supports (max) reasoning and the model is quite slow. Apart from a few requests timing out, it also has some issues with tool calling/response format schemas (Moonshot rejected tools.function.parameters with anyOf schema).

It also, for some reason failed to generate either of the 2 coding demos (hamster svg and solar system css animation).

Intelligence-wise, it's between GPT-5.6 Terra and GPT-5.6 Sol. It's ~30% better than Kimi K2.6, but a lot slower and more expensive.

[0]: https://aibenchy.com/compare/moonshotai-kimi-k3-max/moonshot...

XCSme 5 hours ago|
Just saw the logs, coding demos failed due to the 5 minute/task timeout. I have increased it and retesting it now.

EDIT: With 10 minutes timeout, the CSS task completed, but the SVG generation task still timed out. Trying again with 30 minutes timeout...

EDIT2: It completed (now in only ~9 minutes). It's one of the best hamsters[0].

[0]: https://aibenchy.com/compare/moonshotai-kimi-k3-max/moonshot...

modeless 4 hours ago||
Anthropic's "durable advantage" theory of US AI dominance is looking pretty silly. There's zero indication that it will be hard for China to keep pace as models improve and start contributing to their own training. Which pretty much invalidates their policy recommendations.

They can't even blame it on distillation this time, unless they want to claim that their own preferred security measures were ineffective in preventing Chinese access to Mythos.

surgical_fire 3 hours ago||
I remember that more than a year ago, when Anthropic and OpenAI started to hide reasoning steps, some were claiming that Chinese models were done, as they could only distill those US models.

I am very curious for the next batch of Chinese models. I have been using DeepSeek and it is nothing short of excellent.

pacman1337 4 hours ago||
Likely won't improve much. They trained on every text already.
m_ke 3 hours ago||
most of the gains from the past year and a half have not been from web data, but from synthetic data and agent rollouts with RL.
esher 8 hours ago||
Half kidding feature request for HN: Mark all AI related posts so I can filter them out, when I need a pause.
lfx 8 hours ago||
Here you go https://tools.simonwillison.net/hacker-news-filtered
mrtksn 8 hours ago|||
This post is at the top when filtered against AI :) Maybe it should use llm based filters to understand if the post is about AI and filter it out?
cyanydeez 7 hours ago||
Us the AI to build the bubble against the AI, because everyone knows AI is the AI of the AI.
postalcoder 8 hours ago||||
I'll see your simonw tool and raise you one that actually works: https://hcker.news/?view=frontpage&ai=exclude

I's not just matching against titles. Ironically, I have an agent running daily scans, reading the contents of the top 200 stories of the day. It auto screens high-confidence ones and I make judgement calls on like 10-20 of them per day.

epihelix 7 hours ago||
Right now, that site doesn't show this post, regardless of whether the filter is active or not ...

So, it's impossible to know whether your filter is working on this story yet, either.

tngranados 8 hours ago||||
Except it literally shows this post as the first result
lfx 7 hours ago||
I saw it after posting. Ha. That is not very smart filter, but works most of the time!
addandsubtract 7 hours ago||
Sounds like a job for AI.
ComputerGuru 7 hours ago|||
Lol, this post is number one on the leaderboard on the “filtered” list list. Trusting ai slop to filter out ai is as ironic as it gets.
hahahaa 8 hours ago|||
https://hn.algolia.com/?dateRange=last24h&page=0&prefix=fals...

or

https://lobste.rs will probably have less AI

yreg 7 hours ago||
How does one get a lobsters invite?
lfx 7 hours ago|||
You need a friend there. I'm trying to get in for years, however RO mode is still worth it.
traceroute66 6 hours ago|||
> You need a friend there.

OR you need to make a blog post that is deemed worthy.

If someone features a blog post you wrote, then you automatically qualify for access. Sort of a "right of reply".

(Features as in "new post about", not "mentioned in some thread")

deivid 6 hours ago|||
send me an email
rs_rs_rs_rs_rs 7 hours ago||||
You don't need an invite to read.
deivid 6 hours ago|||
send me an email
virtue3 7 hours ago|||
definitely take the breaks when you need them. I've already had a few friends just get lost in the AI train of stuff and suffer mentally a bit.
jmward01 8 hours ago|||
I see a future HN post about how someone vibe coded HN to filter the AI stories. HNAI (Heck No AI)
_superposition_ 7 hours ago|||
I think we have a need to revise the old let me Google that for you thing

Click the link to view conversation with Kimi AI Assistant https://www.kimi.com/share/19f6b96d-fdd2-8589-8000-0000daada...

nazgulsenpai 8 hours ago|||
Same but 100% serious
boguscoder 8 hours ago|||
Why only a half measure
xyzsparetimexyz 7 hours ago||
Any updated Pareto frontier graphs? https://paraplouis.github.io/llm-pareto-frontier/ is quite out of date now.
tao_oat 7 hours ago||
I generally rely on LMArena for this: https://arena.ai/leaderboard/code/webdev/pareto

But it does take some days after model release before they collect enough data.

mdasen 5 hours ago|||
LMArena's "code" leaderboard is really skewed since it's a front-end JS code and design leaderboard. It generates a demo app with two models and then asks "do you prefer A or B". People can look at the code, but most of the time it's just going to be which one looks nicer.

Models that people like the design aesthetic of (Claude, GLM) tend to do better in LMArena than they do on other benchmarks. Design matters, but you look at a model like GPT-5.5 and it's behind Kimi K2.6, Sonnet 4.6, Qwen3.7 Max, and GLM-5.1 on LMArena's code leaderboard. Then you look at benchmarks like DeepSWE and GPT-5.5 blows them out of the water with only Fable and GPT-5.6 beating it.

I'm not saying that the LMArena leaderboard isn't useful, but I'm not sure how much weight I'd give it as a "code" leaderboard. I think often times it's a design comparison of simple front-end React apps rather than a coding comparison. GLM-5.2 is a very good model, but when you look at DeepSWE or Terminal-Bench v2, GPT-5.5 is well ahead.

Dibes 6 hours ago|||
Odd that open AI models aren't on that graph but are on the rankings! Must be a data lag issue?
Bromeo 7 hours ago|||
openrouter->rankings shows a pareto frontier. https://openrouter.ai/rankings#benchmarks
1899-12-30 6 hours ago||
you can get a rough version via artificialanalysis's cost per task https://artificialanalysis.ai/?cost=intelligence-vs-cost-per...
XCSme 7 hours ago||
Only supporting "max" reasoning is weird, their parameters are quite inflexible atm:

    Important limits:

    reasoning_effort currently supports only max; K3 always has thinking mode enabled.

    max_completion_tokens defaults to 131072 and can be set up to 1048576.

    temperature=1.0, top_p=0.95, n=1, presence_penalty=0, and frequency_penalty=0 are fixed; omit them from requests.

    Return the complete assistant message unchanged in multi-turn conversations and tool calls.

    Vision input does not support public image URLs. Use base64 or ms://<file-id>, and make content an array of objects.

    Web search is being updated and is not recommended for production workflows in the near term.
InsideOutSanta 3 hours ago||
The blog post is now online:

https://www.kimi.com/blog/kimi-k3

- The blog post is explicitly saying that the model is open; that language was removed from the previously shared link

- It shows benchmarks

I've been playing around with it for the past few hours, and I think it's an amazing model. I'm not sure I could tell the difference between this and Fable in a blind test. The quota in the $100 Kimi Coding plan seems to roughly align with what I get from the $200 Anthropic plan when I primarily use Fable.

cesarvarela 1 hour ago|
[dead]
swimwiththebeat 3 hours ago||
Did anyone see on the blog post[0] that it was able to code up an entire GPU compiler from scratch? It looks like it even outperformed triton on some GPU kernels. That just seems insane to me.

Wonder if they’ll open-source this and show how many tokens it cost.

[0] https://www.kimi.com/blog/kimi-k3

elinear 2 hours ago||
Is K3 marked as a proprietary model because its weights have not been released yet? Were there indications from Moonshot that K3 would or would not be open weights?
InsideOutSanta 2 hours ago|
The blog post says it's going to be open, but I don't think the weights have been released yet:

> Kimi K3 is the first open model to reach 2.8 trillion parameters. It marks the latest step in Kimi's sustained push at the scaling frontier: for nine of the past twelve months, Kimi models have set the upper bound of open-model sizes.

https://www.kimi.com/blog/kimi-k3

tfehring 2 hours ago||
> The full model weights will be released by July 27, 2026.

Still sensible to mark proprietary for now though.

baq 2 hours ago||
not much reason to think this won't happen except unconfirmed gossip, but I fully expect the next one to not be released. actually I won't be surprised if even this release was withheld and the announcement withdrawn.
Gecko4072 6 hours ago||
Very interesting to see how Gemini 3.5 Pro stacks up against this new wave of models. Hope they have something similar to a Gemini 3.1 moment soon. Their speciality has always been math and multi modal intelligence and the new models are recently all very coding focused.
copperx 4 hours ago||
Why Gemini 3.5 Pro in particular?
Gecko4072 3 hours ago||
The only major player left in this round if I’m not mistaken.
seatac76 4 hours ago||
Bloomberg has an exclusive today about how internal metrics on Gemini 3.5 Pro are not good enough, thus the release is delayed.

(Not posting link coz paywall)

Gecko4072 3 hours ago||
https://www.reuters.com/business/google-gemini-launch-delaye...
pr337h4m 7 hours ago|
It does seem to have retained the K2 series's creative writing abilities, at least with the prompts I've tested so far.
Alifatisk 5 hours ago|
Good that they are keeping it, Kimis way of speaking and conveying some sort of EQ is absolutely the best. The other models might be better at certain things, but nothing comes close to how good Kimi is at understanding language, emotions and reading the room in conversations.

I should maybe also mention that I have not used the later models like Opus or Fable, so my opinion might be a bit outdated.

When I remember that this site even showed Kimi having the highest score at one point https://eqbench.com

More comments...