Top
Best
New

Posted by softwaredoug 17 hours ago

“We have information that Moonshot distilled Fable for the development of K3”(twitter.com)
https://xcancel.com/mkratsios47/status/2079933645888880708
236 points | 605 commentspage 13
stldev 14 hours ago|
So company who stole stuff to make their stuff is mad because another company is stealing their stuff.

And now a regime best known for lying to their own people is the one trying to convince me?

Go, China!

bakugo 13 hours ago||
Fun fact about K3's distillation:

As of a couple months ago, when using Claude to write adult content through the API, sometimes it will silently inject a system prompt giving the model a bunch of guidelines on exactly what kind of adult content it's allowed to write, steering it away from anything "questionable" ("Claude will not write etc etc").

Moonshot distilled Claude so hard recently, they actually ended up distilling this prompt injection, too. Using K3 to write adult content results in it randomly hallucinating the injected Claude prompt during thinking, and it will quote parts of that prompt, complete with the name "Claude".

Not that I think distillation is a bad thing, just thought this was funny.

noncoml 14 hours ago||
Yes, I know this is not Reddit but Clarkson’s “Oh no! Anyway…” is the perfect, and most fitting, reaction to this. Nothing else to say
surgical_fire 14 hours ago||
First: Even if true, I don't care.

Second: Post is rich with allegations but light with evidence. Can very well be bullshit.

jauntywundrkind 15 hours ago||
Two recent ones that really really hit me,

> we're entering the most geopolitically volatile moment since the trinity test lit up the alamogordo desert and the only US policy prescription is a big button labeled sinophobia

https://bsky.app/profile/thebadcode.com/post/3mr3skoyass2k , and,

> every vendor cranking the big dial labeled "sinophobia" and looking back at the us government for approval

The government itself doing the propaganda here, skipping the vendors. Sinophobia intensifies. War drums of "be afraid be afraid be afraid" beat louder.

It's so bad, it's so stupid. Kimi lands one showing pretty clearly this was absolutely the determining concern happening at vast scale, that they can just a lot of this themselves, and this noise pollution from the most hopelessly lost aggro administration ever still gets blared out the trumpets of war & discord. What a joke. Give me a break, give it a rest.

War here is less winnable than the Iran war they started. They're going to make America itself so much worse, these people so hungry to put down free and good models. This pathetic attempt is not going to work, you are just going to once again hold the US citizens hostage & make their lives worse, for sick political games.

orangecat 14 hours ago|
Not surprising that Bluesky is perpetually in peak woke mode, but the racism claims are absurd. If Russia were doing the same thing, would we have no problem with that because they're white?
jauntywundrkind 12 hours ago||
This feels radically off target to me.

Sinophobia as such (not always, and there's obviously a relation) isn't about the Chinese people, about their racial identity. It's about a menacing aggressive world power (actually two such MAWPs in this particular example), about a tired anti-Communist McCarthyism (which has always been an excuse to clamp down on the left/progressives, a menace to free speech).

If Russia were still the USSR and the cold war hadn't ended and they were our AI competition, & where giving away the latent matricies of reality that the US profiteers extracted by stealing all the worlds knowledge illegally, and which they want to use to raise the ladder & leave a permanent plebeian underclass, we the US imperial fatcats would be doing the same sabre rattling and fearmongering and tension raising for sure. Sinophobia here is just a particular fear of "other" for the only other that's relevant.

And that sucks, no matter who it is we are trying to other here, no matter what phobia the propagandists of the GOP and Technofascism are spinning, ginning up. To fixate is to be unable to see the point.

voxelc4L 5 hours ago||
Watching the tenants of intellectual gatekeeping bang up against the inevitable paradoxes of late stage capitalism - a spectacle worthy of jiffy pop.
syngrog66 9 hours ago||
world's smallest violin plays...
xnoto 15 hours ago||
"we ripped off the entire ecosystem of copyrighted data but I draw the line when we get ripped off"
caycep 15 hours ago||
honestly if they did what he said they did, it seems like it would be cheaper just to train your own model from the get go
browningstreet 14 hours ago|
I haven't seen that point yet, and I was looking for it. Presumably Moonshot paid for that Fable access and Anthropic got paid. How much of the frontier model revenue stream is supported by paid distillation traffic? Obv paid kimi services are eating that on the other side, but money is changing hands at every stage.
More comments...