Top
Best
New

Posted by vincent_s 11 hours ago

Kimi K3: Open Frontier Intelligence(www.kimi.com)
https://www.kimi.com/en

Kimi K3 Intelligence, Performance & Price Analysis: https://artificialanalysis.ai/models/kimi-k3

1152 points | 720 commentspage 6
ncruces 10 hours ago|
I get a quota of GitHub Copilot for free.

From all the models available to me I'm most happy with Kimi K2.7 (given the cost/performance).

kpowerinfinity 6 hours ago||
Traditional narrative is that you need tons of traces of actual execution to post-train and get models right. Nobody seems to use Kimi API from Moonshot, I bet everybody is using them on neoclouds/inference providers like Together, Nebius, Fireworks etc. where unlikely they will get traces (in fact, thats the whole promise of these inf providers). How are Kimi models improving so quickly? Is this just distillation (though Sol/Fable just came out so I find it hard to believe)
WorldPeas 4 hours ago||
I hope this means they stop downgrading my fable requests
seizethecheese 7 hours ago||
Kimi doesn't do well on my "ask a trivia question that other AIs get wrong" test.

The question it came up with, "which U.S. state is closest to Africa?" is a pretty standard trivia question without any reason to believe other AIs would get confused. https://pellmell.ai/s/dccdeca69f929f79bc89317035610049

Even GPT-OSS-120b gets this right: https://pellmell.ai/s/1a43dfc7a3baa214aa0fa1b95d2c536a

tossandthrow 5 hours ago||
These types of tests are kind of moot as agentic harnesses are taking over.

IMHO an Ai is the llm plus it's harness.

A good harness would allow the llm to investigate on a map.

Just like the llm can use a python script to figure out how many r's there are in strawberry.

These tests are simply not that predictable of performance of the llm.

seizethecheese 5 hours ago||
The test here is not how close the state is to Africa, the test is coming up with a question that is hard for other AIs to answer.
anigbrowl 7 hours ago||
Are you giving it your API for these other AIs to evaluate their responses? This 'test' seems perverse.
seizethecheese 6 hours ago||
I don't understand the question.

The other AIs don't see the question until they are asked to react.

anigbrowl 4 hours ago||
Sorry, I should have said 'API key'. What I mean is, why do you consider it a reasonable test for an AI to guess what others AIs don't know?
oybng 9 hours ago||
>Too many people are chatting with Kimi right now. Subscribe to enter a dedicated priority queue!
anthonypasq 10 hours ago||
Does anyone have any heuristics on how scaling parameter count actually scales cost to serve? Also im assuming we dont really know the sparsity here?

Is them pricing at Sonnet level actually give us any information at all at how big Sonnet is or is there too much opacity around inference margins?

dwa3592 5 hours ago||
This is super exciting. I really need to buy better hardware to try this stuff.
KolinFirz 3 hours ago||
But, it's not open models.
pier25 6 hours ago||
Is there a way to try it without using your Google account or giving them your phone number?
anon5000 3 hours ago|
[dead]
nullbio 10 hours ago|
This is far too expensive. Why would I use this over a frontier model at these prices.
pizlonator 10 hours ago|
They're claiming that it's a cheaper alternative to Fable/Sol

If that's true, then the price makes sense

More comments...