Top
Best
New

Posted by Brajeshwar 1 day ago

Folk are getting dangerously attached to AI that always tells them they're right(www.theregister.com)
276 points | 216 commentspage 4
erelong 1 day ago|
So, be more skeptical
add-sub-mul-div 1 day ago||
That's like saying "so, exercise more" upon the invention of fast food. Maybe you will, that's great. But society is going to be rewritten by the lazy and we all will have to deal with the side effects.
Lerc 1 day ago|||
I think you inadvertently make a good point.

The invention of fast food does not change anyone's ability to excersize. When fast food was invented people excersized way more than they do today.

Time constraints have caused an increase in fast food consumption and a reduction in excersize.

Both issues then seem to be addressed by coercion to change behaviour when what is needed is a systemic change to the environment to provide preferable options.

throwatdem12311 1 day ago|||
[flagged]
nahkoots 1 day ago|||
Fat shaming doesn't work. It can maybe work, sometimes, on an individual level, like if you're a big enough dick to your friend or partner maybe you can get them to lose some weight. But the problem we (society) have isn't that your spouse is fat and my friend is fat, it's that everyone's friend and everyone's spouse is fat, and we (as a society) have already tried being mean to all the fat people and it didn't work. Show me the incentive and I'll show you the outcome. You can't set up a society awash with processed foods which are addictive by design, force everyone to use a car to get to the store/work/school, refuse to educate children on how to purchase and cook healthy foods, and expect everyone individually to recognize these flaws in our system and make a conscious effort to counteract them in their own lives. Maybe some people will do it, good for them, but the average person will do what's easy. If you want a healthy society, you need to make being healthy the easiest thing.

If your coworker keeps asking you to review merge requests filled with garbage code they copy/pasted from an LLM, sure, shaming them might be part of the solution. But if people are turning to AI because it's too difficult for them to get certain types of emotional validation in the physical world, making them feel bad about it probably isn't going to help.

cindyllm 1 day ago|||
[dead]
est 1 day ago||
so, always spawn another AI agent to debate!
saltyoldman 20 hours ago||
We keep diaper wrapping the world. I think we ought to have sycophantic LLMs as well as LLMs that call you a bitch. The only thing I think we ought to do about it is tell people that it exists.
6510 21 hours ago||
Everyone also visits websites that share their world view. If it is slightly off you keep noticing how the articles seem one sided.

I just see an article about migrants destroying things in Britain. Not to excuse the behavior but I wondered where they came from. It turned out to be shit countries fostering that behavior. Why are they shit? Have they always been like that? Well no, the British empire destroyed them. You could think that it's to long ago but they also continue to enjoy spoils. I offer no solutions. The point was that a sensationalist article wouldn't go there because the reader doesn't want to know.

ChrisArchitect 21 hours ago||
[dupe] Discussion on source: https://news.ycombinator.com/item?id=47554773
jmyeet 22 hours ago||
There's a guy on Tiktok who is singlehandedly showing just how bad AI still is and how much it lies and hallucinates eg [1]. Watch a bunch of his videos.

So these tools can be useful when you know the subject matter. I've done queries and gotten objectively false answers. You really need to verify the information you get back. It's like these LLMs have no concept of true or false. They just say something that statistically looks right after ingesting Reddit. We've already seen cases of where ChatGPT legal briefs filed by actual lawyers include precedents that are completely made up eg [2].

There's a really interesting incentive in all this. People like to be told they're right and generally be gassed up, even when they're completely wrong. So if you just optimize for engagement and continued queries and subscriptions, you're just going to get a bunch of "yes men" AIs.

I still think this technology has so far to go. I'm somewhat reminded of Uber actually. Uber was burning VC cash at a horrific rate and was basically betting the company (initially) on self-driving. Full self-driving is still far away even though there are useful things cars can automate like lane-following on the highway and parking.

I simply can't see how the trillions spent on AI data centers can possibly be recouped.

[1]: https://www.tiktok.com/@huskistaken/video/762093124158341455...

[2]: https://www.theguardian.com/us-news/2025/may/31/utah-lawyer-...

seanmcdirmid 22 hours ago|
If you believe AI is bad, and ask AI about it, it’s more than likely going to reinforce your belief just for the engagement.
kogasa240p 1 day ago||
The ELIZA effect is alive and well, and I'm surprised people aren't talking about it more (probably because it sounds less interesting than "AI psychosis").
blurbleblurble 1 day ago|
Personally I don't think the ELIZA effect is the interesting part of this. For me it's how the incentives set this dynamic up right from the start, and how quickly they've been taken to the extreme.
jmclnx 1 day ago||
I never thought this could happen, but I do not use AI.

Anyway no real surprise, we have many examples of people ignoring facts and moving to media that support their views, even when their views are completely wrong. Why should AI be different.

shevy-java 1 day ago||
Flattery works. Also with regards to Trump.

The problem is: flattery is often just like the cake. And the cake is a lie. Translation: people should improve their own intrinsic qualities and abilities. In theory AI can help here (I saw it used by good programmers too) but in practice to me it seems as if there is always a trade-off here. AI also influences how people think, and while some can reason that it can improve some things (it may be true), I would argue that it over-emphasises or even tries to ignore and mitigate negative aspects of AI. Nonetheless a focus on quality would be an objective basis for a discussion, e. g. whether your code improved with help of AI, as opposed to when you did not use AI. You'd still have to show comparable data points, e. g. even without AI, to compare it with yourself being trained by AI, to when you yourself train yourself. Aka like having a mentor - in one case it being AI; in the other case your own strategies to train yourself and improve. I would still reason that people may be better off without AI actually. But one has to improve nonetheless, that's a basic requirement in both situations.

93po 20 hours ago|
is it really necessary to mention trump in something that has absolutely nothing to do with politics, the news, or the US in general?
justsomehnguy 23 hours ago||
"Humans are exceptionally succeptible for a positive affirmations", other news at 11.

It's not news at all for anyone who actually engage with the people.

cindyllm 23 hours ago|
[dead]
taytus 1 day ago|
The stupidest people you know are getting the “you are absolutely right!!” Validation they do not need
kakacik 22 hours ago|
What could go wrong, where this will lead humanity in few decades... yay!
More comments...