If it's true that in under 15 days of access significant improvements were realized in K3, then the moat of closed-weight models is far smaller than previously thought.

Doesn't bode well for the valuations of these labs.

Good pretext for bannign chinese APIs in the USA and their vassal states.

If distillation is so good, why aren't US companies distilling each other?

Considering that LLM are created using stolen content or against licensing, it’s only fair to distill and open source them.

Hmm. I wonder when this was detected. And was the CoT trace cut from Fable from the start on June 9th or just after the export ban and relaunch? Is this what the export ban was actually about? I honestly don’t know, just wondering aloud.

We already know K3 is really good; you don't need to glaze it even more by telling us it's like Fable.

if there are no consequences then who cares? You're not going to take Chinese companies to court and stealing IP is nothing new either. It's going to take some sort of policy change at the federal government level to do anything but they haven't done much up to this point. Maybe AI is important enough to actually get some kind of policy change, sucks for everyone else who have had their IP stolen with no consequences whatsoever.

A company that distills LLMs should be called "Moonshine" not "Moonshot"

Ba-dum-tss

I wonder how they detect this kind of thing. Seems like this is going to be a perpetual issue until it stops being worth doing.

Side note, didn't they stop releasing real thinking tokens for Fable? Or is it still part of some subs or API usage?

Hah tales as old as time. what’s next? Distillation of Disney theme park?