Top
Best
New

Posted by Ryan5453 5 hours ago

Project Glasswing: Securing critical software for the AI era(www.anthropic.com)
582 points | 238 commentspage 3
zachperkel 4 hours ago|
Mythos Preview has already found thousands of high-severity vulnerabilities, including some in every major operating system and web browser.

Scary but also cool

fsflover 3 hours ago||
Every piece of software definitely has serious vulnerabilities, perfection is not achievable. Fortunately we have another approach to security: security through compartmentalization. See: https://qubes-os.org
dakolli 3 hours ago||
Or more likely, its just an exaggeration or lie.
Sol- 3 hours ago||
I don't want to be overly cynical and am in general in favor of the contrarian attitude of simply taking people at their word, but I wonder if their current struggles with compute resources make it easier for them to choose to not deploy Mythos widely. I can imagine their safety argument is real, but regardless, they might not have the resources to profitably deploy it. (Though on the other hand, you could argue that they could always simply charge more.)
wilson090 3 hours ago||
Inference is where they make the money they spend on training, so this feels unlikely. Perhaps this does not true for Mythos though
rishabhaiover 3 hours ago||
I would have not believed your argument 3 months ago but I strongly suspect Anthropic actively engages in model quality throttling due to their compute constraints. Their recent deal for multi GWs worth of data center might help them correct their approach.
Sateeshm 3 hours ago||
The bars have solid fill for Mythos and cross shaded for Opus 4.6. Makes the difference feel more than it actually is.
jFriedensreich 3 hours ago||
The only thing reassuring is the Apache and Linux foundation setups. Lets hope this is not just an appeasing mention but more fundamental. If there are really models too dangerous to release to the public, companies like oracle, amazon and microsoft would absolutely use this exclusive power to not just fix their holes but to damage their competitors.
underdeserver 3 hours ago||
Interesting also is what they didn't find, e.g. a Linux network stack remote code execution vulnerability. I wonder if Mythos is good enough that there really isn't one.
tdaltonc 2 hours ago||
> Mythos finds bug.

> NSA demands that bug stays in place and gags Anthropic.

> Anthropic releases Mythos.

Then what? Is a huge share of the US zero-day stockpiles about to be disarmed or proliferated?

anVlad11 4 hours ago||
So, $100B+ valuation companies get essentially free access to the frontier tools with disabled guardrails to safely red team their commercial offerings, while we get "i won't do that for you, even against your own infrastructure with full authorization" for $200/month. Uh-huh.
SheinhardtWigCo 3 hours ago||
Yes, and that's normal. Coordinated disclosure is standard practice when the risk of public disclosure is unacceptable.
charcircuit 45 minutes ago||
Risk for who? It feels unfair that the risk to myself is ignored "for the greater good of everyone else."
unethical_ban 4 hours ago||
I'm sympathetic to your point, but I'm sure there are heightened trust levels between the participating orgs and confidentiality agreements out the wazoo.

How does public Claude know you have "full authorization" against your own infra? That you're using the tools on your own infra? Unless they produce a front-end that does package signing and detects you own the code you're evaluating.

What has it stopped you from doing?

9cb14c1ec0 4 hours ago||
You can do pretty much anything you want with public claude if you self-report to it that you have been properly authorized.
6thbit 2 hours ago||
This is silly and disingenuous. In a matter of days or weeks a competing lab will make public a model with capabilities beyond this “mythos” one.

Is this a huge fear-driven marketing stunt to get governments and corporations into dealing with anthropic?

More comments...