Top
Best
New

Posted by vincent_s 21 hours ago

Kimi K3: Open Frontier Intelligence(www.kimi.com)
https://www.kimi.com/en

Kimi K3 Intelligence, Performance & Price Analysis: https://artificialanalysis.ai/models/kimi-k3

1679 points | 989 commentspage 14
freestanding 18 hours ago|
[flagged]
1g10k 21 hours ago||
[dead]
kerriy 15 hours ago||
[dead]
kerriy 14 hours ago||
[dead]
ghm2199 13 hours ago||
[flagged]
ricardobeat 11 hours ago||
Hosted providers have filtering on their chat interfaces (you can see how the response starts streaming in), doesn't mean the model itself has that behaviour.

Plus, your video is of Kimi K2.6.

Kostic 13 hours ago|||
Your video is showing Kimi 2.6, not 3? Once the weights are released, there might be providers that serve it without the censorship filter.
largbae 13 hours ago|||
If this is open weight, would abliteration counter the refusals?
flexagoon 13 hours ago|||
> It’s possible that the chat/ux model does know and has an unbiased opinion about china, but the filtering is on the front end/client side and so the user facing model has not been fine tuned natively

This has always been the case with Chinese models. Their web ui is a service provided from China, so they are required to censor it, but not the models themselves.

joegibbs 10 hours ago|||
What does it say if you ask it in Chinese? I imagine English training data would be more critical of China than Chinese
FooBarWidget 12 hours ago||
There is no such thing as an unbiased opinion, opinions always contain some sort of value judgement. Besides, training data contains biases.

What is plausible is that they haven't made any attempts to explicitly steer certain opinions into a certain direction, and just let the model take over the bias of the training data, whatever that may be. Filtering in the front end is the easy, lazy way out to be legally compliant.

satvikpendem 20 hours ago||
Now, will they actually release the weights? Seems like Chinese model providers are slowly closing up, like Alibaba's Qwen 3.6 which did release weights (but not the biggest parameter count ones) and none for 3.7.
linzhangrun 9 hours ago||
Qwen's team has been reorganized, and not open-sourcing also fits Alibaba's usual corporate style...

Other companies have not shown similar problems so far.

China has many government agencies and state-owned enterprises that need models which can be deployed locally. This is also part of "Xinchuang" (self-owned systems, self-owned hardware, etc. New government computers all run special Linux versions on domestic CPUs, and LLMs also need to be like this).

j2j8 20 hours ago||
In the coming days
seizethecheese 17 hours ago|
Kimi doesn't do well on my "ask a trivia question that other AIs get wrong" test.

The question it came up with, "which U.S. state is closest to Africa?" is a pretty standard trivia question without any reason to believe other AIs would get confused. https://pellmell.ai/s/dccdeca69f929f79bc89317035610049

Even GPT-OSS-120b gets this right: https://pellmell.ai/s/1a43dfc7a3baa214aa0fa1b95d2c536a

tossandthrow 15 hours ago||
These types of tests are kind of moot as agentic harnesses are taking over.

IMHO an Ai is the llm plus it's harness.

A good harness would allow the llm to investigate on a map.

Just like the llm can use a python script to figure out how many r's there are in strawberry.

These tests are simply not that predictable of performance of the llm.

seizethecheese 15 hours ago||
The test here is not how close the state is to Africa, the test is coming up with a question that is hard for other AIs to answer.
anigbrowl 16 hours ago||
Are you giving it your API for these other AIs to evaluate their responses? This 'test' seems perverse.
seizethecheese 16 hours ago||
I don't understand the question.

The other AIs don't see the question until they are asked to react.

anigbrowl 13 hours ago||
Sorry, I should have said 'API key'. What I mean is, why do you consider it a reasonable test for an AI to guess what others AIs don't know?