Top
Best
New

Posted by Edward40 4 hours ago

What is the best harness for each model?(runta.com)
227 points | 89 commentspage 3
WorldPeas 1 hour ago|
evolving harnesses are also a cool development I've seen recently though I feel they'll have diminishing returns https://www.alphaxiv.org/abs/2609.01437
worik 29 minutes ago||
Given the variation between results for different, but similar capability models it is hard to take this seriously
justincormack 1 hour ago||
You do need to optimise prompts too, eg I found that openai models just gave up in Pi, but adding a line to the prompt matching Codex eg "Once implementation is authorized, the agent should persist through the bounded change, tests, review and final validation. Complexity, expected duration and context compaction alone are not reasons to stop." fixes that. Otherwise it would look at tasks and say they were too hard.
BugsJustFindMe 1 hour ago||
This is nice and all, but I really want to see the best harness for the actual frontier models ChatGPT and Claude, not just open weight models.
brookritz 38 minutes ago||
The TLDR saya: Basesten, Harneas and Leaderboard and still have no clue.
maerF0x0 2 hours ago||
So? I'm sure exceedingly high amount of EC2 cpus are idling, or lost to discarded branch predictions etc.

We waste whatever is cheap to gain what is dear.

(Of course we iterate towards better, but that doesn't mean we delay shipment/usage once it's profitable / better than status quo)

0xbadcafebee 1 hour ago||
The choice of agent/harness is, as people frequently point out, just one of many variables that changes agent performance. Skills, MCPs, Extensions, system prompt additions, often have drastic effects, making things better and/or worse. It's interesting to compare them side by side, but probably won't reflect your own unique experience.

Second thing to consider: ZCode was sending everyone's code to Alibaba... not sure I would use their harness just to save a few cents on coding.

jedisct1 1 hour ago||
It would have been nice to see swival.dev in that list.

But unsurprisingly, Codex works pretty well, too (and not just with OpenAI models), and Claude Code is just a waste of tokens and money.

shevy-java 2 hours ago||
Well, it is a milking system. You have to pay for those tokens anyway.
Edward40 1 hour ago|
[flagged]
underdeserver 2 hours ago|
Wait till you hear what the human success rate used to be.
More comments...