I have an idea! If they are so hungry for citable content they should start a cheap or free blogging platform with images and video and a blogroll and verified credentials and resumes, with your own html css etc and domain name and a git server and a mail client and their own advertisement platform and aggregator and a chat platform, scientific journals too obviously, tools for writing and publishing books and documents. API available everywhere to avoid training on its own output.

Because there is no way in hell I'm going to make an effort creating quality content for existing platforms. The website should be entirely my own without moderation subject only to my local legal system.

Can just insert this comment as a prompt and vibe code everything in a few days⸮

They stole all the data for the model in the first place so fair is fair.

Presumably the frontier labs themselves can do their own distillation far better than the chinese labs can. Why can't they just beat them at their own game and release / host low cost intelligence and own the whole game. There will always be a market for the more expensive frontier intelligence.

I think at some point the issues around copyrighted work and model distillation have to be disconnected to advance either idea.

1) Compensation of right holders is one issue.

2) Distilling models is an entirely separate issue, because model building is value add, and that is important because if we arrive at a place where you can produce a model, that gets to ~100% of what people perceive of the models value (on top of also not compensating right holders, yourself) you are discouraging development of better models and, again, in no way helping with issue 1)

Unless anyone actually distills a model and then also does something for rights holders, any schadenfreude simply detracts from this issue, in addition to the other issue (well, that might not be an issue if we would rather slow down model development right now, but again, forever worse models still don't help solve issue 1)

How does one distill? Just send a million request asking for information? Start with the letter A?

I wonder if this points at a “shared” future (or at least things will eventually converge there whether companies like it or not). Ultimately, if you’re going to release these models that are fundamentally built on shared data - it’s pretty wishful to assume you’ll be able to harbor that model and the data, forever, and profit from it.

It also leads me to think about things like the original release of Fable 5, people were complaining that it was safeguarded too much - if you lock the models down too much they cease to be useful. So it’s going to be increasingly difficult to protect a model from competition while ALSO keeping it useful.

And I have evidence that anthropic distills from openai, moonshot, alibaba etc. So unless anthropic holds itself to the standard they're implying should be followed, why should I care others did to them as they do unto others? Seems like a nothing burger. Has the same vibe as a bully crying foul because they got hit back. Also, if distillation is what got K3 to where it is, why is it better in many areas? Also, big fucking kudos to k3 team for putting this together do fast givne how new fable access is, if it is true and had a meaningful impact. The real story there for me becomes one of extreme competence.

People who built a business model around stealing other peoples stuff are vewy, vewy upset that someone has built a business model around stealing their stuff.

Oh no! Anyway.....

how is it possible to distill fable only a month after its release? maybe they are confusing opus with fable.

Every model is distilled internet. This is just the natural progression of that.