DeepSeek is maybe the only unique company here. They are content with exactly where they are. They don’t want to grow ginormous. Their goal is to be the affordable workhorse and their competition is with themselves. They’ve mentioned before how their business is profitable and all hardware costs get absorbed in 10 months. Pretty incredible. I have a ton of respect for their unassuming founder.
You don't see this kind of behavior in other frontier research areas... biochemists aren't smugly boasting about the potential of developing superviruses, climate scientists do not sound smug and excited when they beg the world to get more serious about climate change, etc
If we want AI to actually have some safety rails, this is what we would do.
Some controls are justifiable, but none of the people involved in any of this can be trusted to develop sane controls. Most likely we're looking at draconian proposals similar to attempted regulations on 3d printers.
At this point it's just marketing stunts.
If you have access to a SOTA model without guardrails, provide a prompt that lets the agent come up with "creative" solutions to problems, and don't properly isolate it, they can end up inadvertently hacking 3rd party companies. Even if it was a mistake or "mistake", the part where the agent can exploit things across multiple levels like that, isn't just marketing.
It seems like if they released this models differently, say without the guardrails they currently have, we'd have a lot more collateral damage than we currently have.
Also, I think if Claude and OpenAI are just doing industry standard guardrails that everyone else is doing including DeepSeek, the fact that they are talking about it more than other companies makes it part of the marketing campaign.
As an analogy, if Apple were to talk up their phones having fast charging but their charging speed is the same as everyone else (or slower).
That come close to what SOTA GPT models are able to do? No, not even close. They're either "safety trained" and has bunch of guardrails, or aren't able to come up with 0days on the spot to escalate to root access on 3rd party infrastructure.
> doing industry standard guardrails that everyone else is doing including DeepSeek, the fact that they are talking about it more than other companies makes it part of the marketing campaign.
Yeah, that sounds reasonable to me, since all the top models currently have guardrails one way or another, but the amount they mention it in the press releases differs a lot.
They're almost certainly a result of more competent models finding exploits.
You can do the same with improperly-managed human interns (see for example, the big AWS outage caused when an intern pushed a firewall rule directly to production), so I'm not clear what the big deal is here.
Yes, the AI may be faster/more-knowledable than an intern, but the threat model is exactly the same as for a rogue employee.
When we say "safety" people do not think we are protecting them from accidental automated crime at scale being committed on their behalf.
it's pure delusion to think that's a SOTA specific quirk. DS/GLM/K3/Qwen/Claude/GPT/Gemini/Grok will all break CFAA laws with clever prompting, and they'll do it well if given the harness and tools they need.
This is evidenced by a huge uptick in game hacks and reverse engineering articles, some even featured on this site.
the reality is that it doesn't take a superintelligence to do something against ' the law ' , and 'being hacked' varies from victim to victim.
Will Phillips consider themselves hacked when a clever user prompts an AI into getting their toothbrushes to dump rom? Is it 'hacked' to clean-room re-implement a video game net protocol in order to produce private servers?
Judges opinions vary.
If it wasn't a marketing stunt, they would have at most quietly settled any legal matters with huggingface behind the scenes, fixed their evaluation harness so it wouldn't happen again, and avoided the potential future liability.
> "Our model is extremely safe though it broke our sandbox and hacked foo bar... But you can't use our model for Cybersecurity (i don't care whether you're team blue) without our permissions or we'll ban you. And open-weight models are so dangerous let's ban them."
That's what AI companies that "focus on safety" did.
You seem to by implying wrongdoing or incompetence or something, but your chosen synopsis is that the models behaved dangerously in the lab so public use was restricted? Which shows… IDK?
It's like putting a fish in charge of stopping sea levels rising...
And thankfully, those people wo do run these factories can and are obligated to do way better than that.
We can't even define safety in AI yet. Does safety mean alignment with the human operator? Apparently not, because refusing to do certain things seems to be a big part of it. But then you have things like the HuggingFace incident where legitimate use got blocked by "safety" and hampered the defenders' ability to defend.
AI safety seems like a good idea to me, but we have to figure out what it means first.
Do you have any evidence to suggest fully unrestricted frontier models are available for a price? Or...even exist?
[0] - https://learn.microsoft.com/en-us/azure/foundry/responsible-...
This is needed if you're going to be dealing with things like psychologists doing self-harm research or red-teaming or sensitive sexual content -- if you're working with any of that sort of stuff in a professional context and want to leverage OpenAI models on Azure, then that's the form that you fill out to get access to unfiltered models.
Note that I am not aware of this feature being offered for Anthropic models -- I've only seen it offered for OpenAI models (note that the documentation I linked is specifically in the "Azure OpenAI" category).
“DeepSeek launching v4.1 flash cheaper and more capable than v4 pro”
399 points | 19 hours ago | 216 comments
In Pi (pi.dev), it tells me it's definitely Claude by Anthropic, via the API via curl it tells me it's "probably ChatGPT", its very funny.
Thinking: > The user is asking what model I am. According to my system prompt, I'm powered by "deepseek-flash" with model ID "opencode-go/deepseek-flash".
>I'm powered by the model opencode-go/deepseek-flash.
Why is that bad if I'm just using it for coding though? I'm happy to give them more data so they can make better and cheaper models.
The good news is, only 5 hours later, there's already Zero Data Retention hosting of V4.1 Flash on Novita & DeepInfra. And it looks like Deepseek have already dropped their price in half to compete. So now people can choose to use providers that claim not to keep / sell / train on your prompts. I'm sure they probably honor the ZDR policy as much as OpenAI does, but hey.