Top
Best
New

Posted by softwaredoug 21 hours ago

“We have information that Moonshot distilled Fable for the development of K3”(twitter.com)
https://xcancel.com/mkratsios47/status/2079933645888880708
242 points | 633 commentspage 17
stego-tech 17 hours ago|
[flagged]
dang 7 hours ago|
Can you please not fulminate or post flamebait on HN? This is in the site guidelines: https://news.ycombinator.com/newsguidelines.html.

You may not owe AmericanAIBros better but you owe this community better if you're participating in it.

goldylochness 15 hours ago||
[flagged]
strictnein 17 hours ago||
[flagged]
sailingparrot 17 hours ago||
Yes they distill, but if you think you can trivially get a frontier-level model by "just" distilling from Claude's public API. you fundamentally do not understand the amount of work that goes into a modern post-training stack.

Without even talking about the fact that any distillation that was done was on Opus, as the timeline of Mythos/Fable vs Kimi 3 release dates just do not match in any plausible way.

If you want to read an educated take from someone that has actually spent the last few years working on post training I recommend Nathan Lambert's: https://x.com/natolambert/status/2079616308203942332

trollbridge 16 hours ago|||
“Distillation” is just a term of art these days. Usage of competitors’ models these days is mostly around RLHF (minus the H, I guess).
strictnein 16 hours ago|||
Very interesting, thanks!
anfogoat 16 hours ago|||
> Do we need 40 people saying the same thing about how they don't feel bad and it serves them right and all that surface level stuff on every single one of these?

Apparently we do, given that we've got govt officials wasting time, money, and effort on whining about this now.

jrflo 14 hours ago|||
Agreed, it's becoming a bit of an echo chamber anytime Chinese models are discussed here. This is really par for the course for China though, in physical manufacturing they've been doing this kind of thing for decades, I'm not surprised the mentality has persisted into the AI race. Looks like rather than jumping ahead, they will remain persistently 6 months behind.
recursive 14 hours ago|||
The responses will continue until distillation-posting improves.

If we keep hearing accusations about how someone distilled something from someone, it seems like one of the few reasonable responses.

If my friend keeps complaining about how the inside of his car is wet, I will probably keep telling him to close the windows when it's raining, even if he thinks that is a tiresome take, lacking in insight.

calendar938 16 hours ago||
Let's be real. In reality, it's the Chinese kid getting the 1600.
strictnein 16 hours ago||
lol, true true. Should have used a different example.
oybng 14 hours ago||
Who cares. It's all theft
alexruf 16 hours ago||
Who cares? Is it theft if a thief gets robbed of their stolen goods? Gives me more of a modern Robin Hood vibe tbh.

No, seriously: first of all, that's not the AI labs' data, it's ours. And if the AI labs think they can rake in tons of money using our data, then I'm actually glad if someone comes along and at least offers us a good product at reasonable prices.

brap 17 hours ago|
Anyone surprised by this is incredibly naive.

By all means use whatever works for you, I’m not even going to try to make an argument on ethics (and honestly I’m not even sure where I stand, given the behavior of American AI companies).

But I just cringe every time I see people acting like any of this is done in good faith.

Open source coming out of China is a state-sponsored criminal enterprise, built only for the benefit of the Chinese regime, one of the worst to exist in human history.