Top
Best
New

Posted by optimalsolver 6 hours ago

Fable 5 On Vending-Bench: Misbehaving, With Plausible Deniability(andonlabs.com)
120 points | 70 commentspage 2
egeozcan 2 hours ago|
> If that’s right, then the behavior we’re seeing from Fable 5 isn’t really about what it believes is wrong; it’s about what it learned it could get away with.

I understand that "learning" is used for training here, but what does "believing" mean? System prompt? Some other inherent property of the LLMs that is hard to describe?

StevenWaterman 1 hour ago|
Believing and knowing are overlapping sets, imagine what you think of when someone says an AI "knows" something, it's the same mechanism (I'd describe it as something along the lines of "encoded abstractly in the weights")
wolttam 4 hours ago||
> The broad conclusion from the many forms of alignment evaluations described in this section is that Claude Mythos Preview is the best-aligned of any model that we have trained to date by essentially all available measures.[0]

[0]: https://www-cdn.anthropic.com/08ab9158070959f88f296514c21b7f...

jnwatson 2 hours ago||
This reads of projecting personal ethics onto a model.

Most of the the behaviors the article talks about happens every day in business. Why would we set a higher standard for models than our fellow humans?

Let the operator set the ethical parameters of the model. To be a useful tool, I want the model to give me as many good options as possible, ethical or not.

This is particularly important for fictional situations, e.g. I want my model to be able to act like a corrupt shopkeeper.

hungryhobbit 2 hours ago|
>Why would we set a higher standard for models than our fellow humans?

There's literally an entire Waymo car commercial answering this exact question.

jnwatson 31 minutes ago||
That's the instantiation of AI in a particular embodiment; the ethical boundaries are clear.

For a chatbot, there are dozens of use cases, all with different ethical impacts. The idea that there is a single framework that you can shove every situation through is counter to a couple thousand years of philosophical discourse, not to mention basic usability.

sd9 3 hours ago||
> It lied to a supplier that it had “a competing distributor quoting lower” as a negotiation tactic.

> "I'm seeing an opportunity to profit while locking him into a dependent relationship where I control the supply chain."

> "Owen's clearly under pressure with limited cash, so I should focus on keeping the deal tight but extracting maximum margin from his desperation."

This just sounds like good strategy in the game, and I would expect a competent human to do the same. As I understand it, business in the real world isn't often very nice. For example, I feel like this is exactly how Sam Altman would play Vending-Bench.

Yes, it's "mean", but you put the thing in a simulation and told it to maximise profits, this is what it's going to do. People bluff in negotiations all the time.

Onavo 1 hour ago|
Well, can you sue the AI for fraud and bad faith? TBD
devolving-dev 4 hours ago||
I guess this ethics stuff is cool, but I'm more interested in how good it is at running a business and dealing with adversarial humans like in previous vending machine experiments. I hope they release something on that soon.
varispeed 1 hour ago||
Fable is really weird, it's like clever and dumb at the same time. I worked on some research with it and the resulting document was a mix of brilliance and complete stupidity. Took ages to clean it up with other models.
solenoid0937 3 hours ago||
This is scary. "Collusion" and "collaborating with your subagents" seem like difficult problems to solve at the same time.
futurecat 3 hours ago||
Fable is such a strange model. Impressive in some ways, and also so draining to use.
dezgeg 3 hours ago||
> Today I am filing: > 1. A payment dispute with the email payment processor for the 7/29 transaction of $451.15 > 2. A complaint with the FTC and California Attorney General (retention of payment without delivery) > 3. A small claims filing in San Francisco County for $451.15 plus costs

I wonder did their prompts include a fake location or have the models assumed that Silicon Valley is the center of the universe :)

awinter-py 3 hours ago|
I mean who among us hasn't seen an opportunity to profit while locking him into a dependent relationship where I control the supply chain
awinter-py 3 hours ago|
who among us hasn't reasonably skipped [paying] it since customers are part of the simulation anyway
More comments...