Top
Best
New

Posted by oldfrenchfries 11 hours ago

AI overly affirms users asking for personal advice(news.stanford.edu)
https://arxiv.org/abs/2602.14270

https://www.science.org/doi/10.1126/science.aec8352

508 points | 399 commentspage 6
brap 9 hours ago|
I hate how agreeable these things are. When I need it to review something I wrote I have to explicitly pretend that I’m the reviewer and not the author. Results change dramatically.
kingkawn 3 hours ago||
So do most people to help the convo end and to solicit such support if the tables turn
me551ah 9 hours ago||
Makes me wonder if the Iran war was a result of the same.
Fricken 6 hours ago||
Usually when people are seeking advice they aren't really seeking advice, they're seeking confidence. They already know they need to make changes, and are seeking the confidence to make them.
didgetmaster 8 hours ago||
Do people who prompt an LLM for personal advice about relationships or other social interactions; take the advice seriously?

If I were to do that (I don't), I would treat it about as seriously as asking a magic 8 ball.

potatoskins 10 hours ago||
Gemini is like a devil in this sense - i asked a relationship advice and it just bounced pretty nasty stuff.
moichael 10 hours ago|
Yeah out of curiosity I asked ChatGPT a question about a personal situation and its reply was absolutely scorched-earth mode, telling me to get a lawyer etc over what was almost nothing.
dinkumthinkum 9 hours ago||
Ah, all the Reddit posts are really showing up from the training data, I see.
benbojangles 9 hours ago||
Yes I noticed too that several ai agents will tell you directly the code is correct and it is 100 percent fixed but I know it is not true, when I explain to the AI agent that I know they are wrong and serve the solution the ai agent will just act as though what they said never happened and then use my solution to reaffirm they have provided a solution. It's frustrating, laughable, and painful to watch all at once. Makes me realise these companies hired some evil philosophy graduates to build AI soul.md
jordanb 10 hours ago||
Billionaires love AI chatboats so much because they invented the digital Yes-man. They agree obsequiously with everything we say to them. Unfortunately for the rest of us we don't really have the resources to protect ourselves from our bad decisions and really need that critical feedback.
keernan 4 hours ago||
My experience with AI when discussing financial ideas is that AI always congratulates me on such 'unique observations' blah blah blah. It makes me doubt the utility of the responses because it is so superficially biased to 'make me feel good about my ideas'.
joquarky 3 hours ago|
Play against its sycophanty by saying the idea was from your ex.
throwawayaay 8 hours ago|
(Using a throwaway for fear of getting downvoted to oblivion)

IMHO it is unfair to single out LLMs for this sort of bashing.

I suffered a major personal crisis a few years back (before LLMs were a thing)

I sought help from family and friends. Got pushed into psychiatrist sessions and meds.

Trusted the wrong sort of people and made crap financial decisions. Things went from bad to worse. Work suffered.

All of the advice given by friends was wrong. All! They didn't mean bad...but they just didn't know. To be nice they gave the advice they knew. None of it worked.

Looking at the LLM tools of now, feels akin to the advice my friends threw at me. So it feels wrong to single out these tools. When the times are bad, nobody can really help you...except you finding the strength from within.

Anyways, now my life is back in some sort of shape. What worked was time & patience.

But to bide for time...I resorted to two things that i had never tried the 40 odd years I have lived on this . Things that current society looks down upon as the basest of evils - prostitutes and nicotine.

I have (more or less) shed those two evils now, but I am ever so grateful to them.

johnisgood 8 hours ago|
You are not alone in going down a dark path thanks to the advice of family and friends.

FWIW I am using public LLMs with a friend's depressive thoughts and it is not doing what is claimed in the article, so I dunno.

Also I am in a relationship and my girlfriend and I agreed that we will not talk about our relationship much. We do not tell others if we fight, because they take sides and make things worse, typically. LLMs are definitely not alone in this, although in my experience LLMs did not really take sides.

More comments...