Posted by brlewis 1 hour ago
- Anthropic told everyone Mythos was dangerous because it's proficiency with biologics and cyber security
- Anthropic didn't release Mythos like everything else. They released a neutered fable. They didn't get rid of Mythos
- Anthropic opens a lab in SF
There was always a quesiton of "will the labs stop releasing their models and start building around them instead?" Yes - they already have. Anthropic is a biologic and cyber security company, in addition to intelligience.
Personally I wonder if they've been holding back a lot. Opus 5.5 was a good release after a little stagnation. Open AI releases good models and everyone says Anthropic sucks and -- Oh would you look at that - a better model finally and all of a sudden.
Apparently OAI is already building GPT7 and GPT8
Claude Code is an awful codebase, has leaked its own source code multiple times, and scores the worst on number of tokens burned vs pass rate percentages.
Is anyone even using their Figma competitor?
growing up I always assumed that everyone would grasp some aspect of game theory intuitively, I still remember the day I found out game theory was a thing - it was like finding out that someone successfully systematized common sense.
most people take the things people say as if they were worth considering. signals without cost are only useful as knowledge of what the signaler wants fools to believe.
Game Theory as a field is actually very complex and often reveals dominant strategies that would never occur to someone as the "common sense" approach to a problem. It was arguably created to solve for problems where there was no obvious correct answer, even for a very intelligent person.
No matter how many people think press release X is obviously wrong - 80%, 95, 99% - it'll always be "the comments section criticizing the article," or "bloggers sharing incisive criticism."
It seems even otherwise intelligent people will cultivate as much ignorance as possible to try and bend reality.
> If recent news is to be believed, Anthropic culture even today seems to lean heavily on this effect
> In my opinion it has been the leading factor in getting and retaining the best employees who are often very worried about humanity dying to super intelligence.
I had not considered this viewpoint but this makes a lot of sense. A lot of Anthropic employees truly believe this and callout emphasis on safety as a key reason they work there. Now, Dario's post "Pacing the frontier" makes even sense -- it is as much for his employees than it is for the rest of the world.
But I think they both are thinking the same thing which is... "We are gonna run out of money at this pace."
However! If one of them blinks and turns off the money faucet before the other, they might fall behind. Falling behind is to forever lose. And if there's one thing that a CEO hates, it's losing to a rival CEO.
So what they want is to get someone, anyone, to put the brakes on their rivals and them at the same time so they can both Not Lose, and Stay Alive. Under those new rules, they are confident they can win. And by win, I mean beat the other AI CEO.
That's it. It's always about personal incentives. Get out of here with that safety BS. These guys just want to win.
An industry trying to figure out how to cut expenses, reduces the pace of training under the guise of "safety".
Coincidence?
Even if the leading US labs could agree amongst themselves to a coordinated slowdown (and this would likely run afoul of antitrust law), you still have Chinese labs who will catch up to the frontier eventually. To solve this, you'd need some sort of international agreement.
That's why Dario and others are saying loudly that we should pace the frontier in hopes that our political leaders will take up the issue and do something about it. We'll see if that happens...
Let Anthropic pace themselves without any sort of enforcement or even agreement for others to pace themselves, too. Then Anthropic is gone, overnight, and we're back to square one, except now there's even more centralization of power and authority.
These companies are literally asking for governments to regulate them specifically because they need something stronger than just a couple of Tweets from some CEOs loosely agreeing to ambiguous terms.
1) They genuinely want (and believe it is actually possible to achieve) an international agreement and governing body to “pace” AI development — and believe that governing body will be successful in doing so.
or
2) They see an opportunity for regulatory capture that grants them a stronger incumbent position and control over future AI regulation.