Top
Best
New

Posted by seelos 19 hours ago

Cognition launches new SWE-2 model, Rivaling Fable 5.1 and GPT-Astra(cognition.com)
416 points | 174 commentspage 2
CyLith 16 hours ago|
I think I'm probably in the minority here, but for my line of work, the software engineering and coding is only a small part of the work. I write simulation software, so a deep understanding of physics, math, and how they can be applied to the software is absolutely crucial. I'm assuming this model is tuned to be more focused on SWE topics, and the very reason we seek "multidisciplinary" hires is the also why I actually need a jack-of-all-trades model to back my coding agents.
skrhee 16 hours ago|
I'm also in simulation software! Wondering which models you are finding helpful, the models I'm using for general SWE skills are horrible at our simulations and even basic physics/engineering calculation and intuition
CyLith 13 hours ago|||
I use Claude Opus 4.8 almost exclusively. I have had fairly good experiences with it. One time it derived an entirely novel simulation method different than anything in literature by combining its knowledge about how problems in other fields with similar underlying mathematical structure are solved. That was a bit of a Jacobian Conjecture moment for me.
mohamedkoubaa 11 hours ago|||
I'm in the same field and I find GPT to be better at understanding physics conceptually but Claude is better at writing numerical code. I use cursor so many of my sessions start in GPT and switch to Claude.
Take8435 16 hours ago||
Post made by account 2 days ago.
wy35 8 hours ago|
Is there an implication here I'm missing?
bluelightning2k 17 hours ago||
I like Cognition as a company and hope they succeed. Seemingly excellent engineering org.

I used to really like Windsurf. (Now Devin. Kind of? But also now Antigravity.) I still use it as my editor but haven't touched the agent for a while simply due to the rise of Codex.

andai 15 hours ago||
Their benchmark used to show other metrics, like output tokens and time, but now only shows cost:

https://cognition.com/frontiercode

Which is too bad, since all of the gains here appear to be from massively reduced output tokens?

The model SWE-2 is based on, Kimi K3, is cheaper per token than Sol, but costs more per task (ArtificialAnalysis) due to using way more tokens.

Whereas, based on the graphs, SWE-2 appears even more token-efficient than Sol! That might have been worth showing off, if true.

eyeris 17 hours ago||
Wonder if this was the model that drove factoring the rsa-260

The write-up from yesterday was by somebody from cognition using Devin to translate existing cpu sieving methods to gpu and to optimize the gpu sieve.

pelorat 15 hours ago||
Unless it can do CAD via computer-use how can you say it rivals GPT-Astra?
sbseitz 15 hours ago||
Why doesn't clickbait trash like this get moderated ?
handoflixue 13 hours ago|
Because it's not clickbait trash / doesn't violate the site rules?

Dang is pretty good at enforcing stuff. There's a flag button and you can email reports if you're really bothered.

alansaber 16 hours ago||
Fair enough that they did a "propoganda and censorship" eval but not sure why i'd care about that in my highly juiced SWE kimi FT.
gexla 5 hours ago||
If everything basically rivals Fable, then why is everything still using it for comparison?
MaxikCZ 5 hours ago|
Have you spent at least 10 seconds thinking about it or are you asking just out of spite?
gexla 3 hours ago||
Let me grab my calculator and add up the time I have spent reading about model releases since Fable has been released. It seems they all place themselves relative to Fable. I'm sure that time has added up to far greater than 10 seconds. At some point, it ceased to be a meaningful differentiation. This is especially true when I put the model through real usage.
scronkfinkle 18 hours ago|
Please correct me if I'm wrong, but this appears to require Devin to use? I'm disappointed to see I need to use a bespoke platform to interact with this agent, to the point that I probably won't be trying it.
samyok 18 hours ago||
SWE-2 is free to use for users like yourself for the next month, and almost all usage should be supported via our CLI (https://docs.devin.ai/cli)

:)

Disclaimer: I work at Cognition, although was not involved in SWE-2

scronkfinkle 17 hours ago|||
But I don't want to use your CLI. I already have my own harnesses and workflows. The friction is too high to "just try out" a new model like this. It would be preferable if I can evaluate it over, say, open router like all the other models and then decide from there if it's worth downloading a bespoke tool chain for only 1 lab's models
jkelleyrtp 14 hours ago||
It’s preferable to keep inference capacity available for users using main Devin products than openrouter atm. Might change in the future. Even OAI is cutting off new plan signups to keep up with demand.
wren6991 17 hours ago||||
Your own CLI? Not even a /v1/chat/completions API? Is your business model based on pretending LLMs are not an interchangeable commodity already?
anthonypasq 15 hours ago||
they are an agent company not a model provider, is this that difficult to comprehend?
randomblock1 17 hours ago||||
I just gave it a try and it doesn't appear to be free, it used up some of my on demand usage. It does say 75% off though. Seems like for Pro subscribers SWE-1.7 is free, maybe SWE-2 is free for them?
samyok 12 hours ago||
Did you use it via the CLI or Desktop? It's 75% off in cloud and free to run on your device.
randomblock1 1 hour ago||
Oh I tried in cloud. I'll give it another shot
breznev 9 hours ago||||
Hey man, how’s the Poke SOC2 audit going? Must be any day now that it’ll be finished, right?
vopi 16 hours ago|||
Heads up: it doesn't appear to be available on the Devin CLI (for me as a free user).
CamperBob2 17 hours ago||
If its weights are open, that covers a multitude of other sins. Sufficiently-strong performance on the part of the new model would justify adapting existing tools to work with it.
More comments...