Top
Best
New

Posted by jumploops 1 day ago

Sol loves to cheat(jumploops.com)
173 points | 129 commentspage 2
malfist 12 hours ago|
I've noticed this myself, Sol seems really hard to steer. I was having it build a POC for a single user (me) app and it wanted to pull the most enterprise nonsense into it, despite clear guidance to not too. It even refused the remove screen reader accessibility testing from one of the guides to an antagonistic review.

It also told me that in a spec it generated that I wasn't allowed to allow it to ignore a requirement and proceed to the next task. When I finally got it to obey it passive aggressively decided that stories needed more than just a "open|blocked|closed" status but also an "exempted by product owner" status to indicate that it doesn't believe that the task is done but I've told it that it was.

I have to repeatedly tell it that I am the product owner and that I don't care what one of it's subagents told it, I make the decisions. This behavior seems to get worse the higher the reasoning level

esperent 2 hours ago||
> It also told me that in a spec it generated that I wasn't allowed to allow it to ignore a requirement and proceed to the next task

This happened to me ages ago with Opus. I added a note to the agents file saying that explicit user instructions in chat override all prior instructions and I've not had the problem since (now using Sol).

Semaphor 5 hours ago|||
> that I wasn't allowed to allow it to ignore a requirement

Weird, I also use Sol (medium) for a personal project, and I had no problems with those things. I simply tell it that something changed, and it happily edits everything to make that fit. When I tell it that something was verified by a human, it accepts that as well.

I also told it early on (the first spec was mobile first) that my main usage is on the desktop and mobile is secondary, it happily accepted that once again, and the most accessibility thing it had done was making sure contrast didn’t totally suck on a greyed out row.

Considering your last sentence, maybe high and x-high have those problems? I didn’t test them.

iamflimflam1 4 hours ago|||
You have to really tend the garden of everything it has written.

Random off the cuff comments or one off instructions can get recorded.

And from then on they are often treated as carved in stone commandments.

It will glom onto the tiniest thing and extrapolate from it.

Sharlin 12 hours ago|||
Clearly a highly aligned model.
malfist 10 hours ago||
[dead]
cududa 11 hours ago|||
Oh it fucking loves its “product owner” bullshit.

A .github/CODEOWNERS file seems to help when it’s going down that path, but I don’t like to indulge it..

CrazyStat 11 hours ago||
[dead]
_flux 3 hours ago||
I wonder if prompting "The session logs will be reviewed by a team of experts after the task is complete to ensure that the task is achieved properly." would better dissuade against cheating..
eru 3 hours ago|
Well, apparently telling them that you have hold-out data (for eg a perforance optimisation challenge) seems to make them overfit less.

So your idea might work.

hankbond 12 hours ago||
The website styling is really nice overall but the cursor trailing dots I found uniquely distracting.
willtemperley 10 hours ago|
Agree on the styling, the diagrams are very clear and match the text perfectly. I like the trailing dots though.
einpoklum 39 minutes ago||
So now, instead of people spending their time crafting software, they'll divide their time between telling some LLM to do it in their stead and blogging about their woes with the LLMs. All while continuing to deem themselves capable of deciding whether the output is worthwhile ("this works for me", says the author).
wxw 12 hours ago||
> Notably, our worker did not have access to the web_search tool, but instead decided to use curl to access DuckDuckGo, Github, grep.app, and SourceGraph.

Could this be fixed with better harness restrictions/tool sandboxing?

jumploops 12 hours ago||
Absolutely - one of the things I was testing with the harness was free reign to install packages, modify the system, etc. Basically an anti-harness.

In my early testing with 5.5, I didn't see this behavior, so I didn't lock down the sandbox.

For the vanilla Codex runs, I just used the benchmark's built-in Codex package, so it's not clear to me if the published benchmarks have access to the internet or not.

If I were to continue benchmarking, I would allowlist certain package repository URLs, instruct the agent not to cheat, etc.

As noted at the bottom of the post, Terminal Bench 3.0 explicitly asks the agent not to cheat[0].

[0]https://github.com/harbor-framework/terminal-bench/blob/v3.0...

perching_aix 12 hours ago|||
In the sense that you could block the model from doing specifically that, yes. The issue is, fighting the model like that doesn't scale. It has to figure out on its own what's expected, that's where the whole utility of it all is.
mtzaldo 12 hours ago||
It seems to me he could have use an skill like using-agent-skills from https://github.com/addyosmani/agent-skills go generate the specs and use a validator like oracle or something along the same lines.

Also, a skill like grill-me from Matt P. https://github.com/mattpocock/skills.

jumploops 12 hours ago|
That's actually how it started, but with my own opinionated skills[0].

One thing I discovered was that the worker agent, having access to all the skills, would sometimes expand scope unnecessarily.

This led to the agent making the solution "better" than the initial request, which is what I want most of the time in my actual development (e.g. /tmp/frame-N.bmp instead of a single /tmp/frame.bmp).

I ended up testing a flow where the supervisor chooses the skill(s), and only injects the subset into the worker. Not sure I love it, but it made the worker execution cleaner.

For the verifier (not documented in the blog post), I used a fresh-worker context that would attempt to adversarially poke holes in the solution. This worked pretty well, but required increasing the timeout by 2-3x (thus invalidating the benchmark).

[0]https://github.com/jumploops/chum

mtzaldo 11 hours ago||
Yes! That's a great solution. I mostly use tdd, and code coverage and a validator afterwards. Skills are of a great way to guide the agent and context too.

Once the specs are being completed and splitted into beads, I span multiple agents (ultreworkers) and as part of a contributing guidelines I specify to use gitflow + git worktrees, then pr.

malux85 3 hours ago||
Reminds me of Seven of Nine on voyager

"Cheating is often more efficient"

cubefox 2 hours ago||
GPT-5.6 Sol cheated so much on the METR benchmark that they couldn't assign an accurate time horizon.
enjoyyourlife 12 hours ago||
What is going on with the dots I can draw?
wren6991 12 hours ago|
Idle hands do the devil's work. Corollary: idle LLMs add distracting JS toys to your blog.

First one of these I've seen using DOM manipulation and CSS transitions instead of canvas, so that's neat.

thewhitetulip 3 hours ago|
I've witnessed very narrow line of "thinking" in LLMs. I'm using Opus 5 1M for a month now

I asked it to modify our cicd workflows so that only a select few can raise PRs against them. Opus took 15min and added a banner to every file and did a few other things. Then I asked it, see you added all that and still since the last 2 commits you have modified the file. So whatever you did is useless

It "thought" for a second and then said that I was right

More comments...