Top
Best
New

Posted by jalev 2 days ago

The LLMentalist Effect (2023)(softwarecrisis.dev)
230 points | 307 commentspage 3
tomhow 2 days ago|
The LLMentalist Effect (2023) - https://news.ycombinator.com/item?id=42983571 - Feb 2025 (133 comments)

Chat-based Large Language Models replicate the mechanisms of a psychic’s con - https://news.ycombinator.com/item?id=36586540 - July 2023 (13 comments)

nikitamalyavin 1 day ago||
That also sounds like (populist) politics... And basically any marketing/PR.
atemerev 2 days ago||
All of this is accurate (and useful). But yeah, psychics do not prove theorems from frontier math and build working complex software.
_superposition_ 2 days ago||
No they don't but psychics also don't have a verifiable feedback mechanism and unlimited retries. Give the psychic the ability to adjust answers based on tests and you'll have have a fair fight.
cmiles74 2 days ago|||
In my opinion, this article is talking about people who get into long conversations and become convinced the model is “intelligent”, maybe even “AGI”. This seems to be a trap people are falling into, even in 2026.
krupan 2 days ago|||
It's definitely talking about that, but it's also talking about all of us:

- fawning over how amazing these tools are

- believing everything OpenAI and Anthropic say about how powerful and dangerous their product is

- minimizing the amount of human effort and involvement in every "AI" achievement

atemerev 2 days ago|||
Initial definitions of AGI (as of 2014) are long surpassed. Then, AGI was defined as something that is general enough to work in many fields and orient themselves. It did not include being smarter than humans or even having comparable intelligence to humans. By original standards, we have AGI already for some time.

Current AGI definitions are intentionally vague.

krupan 2 days ago|||
Neither do LLMs. Humans using them do. Similar to how cops solve crimes using psychics.
pixl97 2 days ago||
Your statement is unclear, break it down a little further on how you think this works.
krupan 2 days ago||
The original article already attempted to do that but I'll take another stab. Humans tend to believe what they want to believe. They gain confidence when a confident person (or LLM) they work with exudes confidence. Where they might have hesitated or got stuck in analysis paralysis alone, the aid of a con (short for confidence) artist will get them moving. They then attribute the solution and praise for it solely to the confident person (or LLM) that nudged them along. Did the "psychic" who understands human motivation better than the cops actually help? Very likely. Did the psychic end up getting far more credit than they deserve (it's magical! You'll never believe! Well worth the money I spent!)? Absolutely.

The amount of real help vs. confidence/manipulation the LLM or con artist provides varies in each situation and scenario and mix of people (and LLMs) involved. It's something to strive to be aware and analytical about.

pixl97 2 days ago||
There is also something else horizontally to this that occurs.

There are numerous scientific discoveries that have been made because one human looked at all available data and turned off the assumptions other people in the field have been using for years, maybe hundreds of years. Once you delete the assumption and make a new one the answer is obvious any anyone from that point wonders how so many humans could have missed it for so much time.

This can occur readily with LLMs as it can with people. It's very likely we will see this a lot as the causal connection in the available data will connected differently in their minds.

Escaping from a local maximum can be very difficult as you have to climb uphill with a nearly infinite amount of freedom but no ability to see the horizon. Psychics, LLMs, or some guy name Bob walking in an providing a workable analogy for you to escape the local maxima and move closer to a global maxima are all the same. Moreso, if LLMs are AGI we should expect these "psychic" behaviors just as much as actual discovery because both continuums exist in the same problem space as human minds.

Madmallard 2 days ago|||
Neither does LLMs. Not without a monumental amount of human oversight and expertise.

Everyone not in a particular field asking LLM about said field is rolling bad dice.

atemerev 2 days ago||
I have published a LLM-assisted proof of a long-standing problem in convex geometry (70 years) while not being a specialist in convex geometry. I am a scientist and I have education and scientific experience in computer science and systems biology, but I was never a mathematician. So, well, you can definitely work across fields at least.
tripledry 2 days ago|||
Do you have a link? I would also be very interested in seeing the prompts, from what I've seen you still need to understand the field, maybe I'm wrong.
Madmallard 1 day ago|||
Okay? Maybe that's a specific use-case where they can possibly make progress. It's also likely that most of the leg-work for that specific proof has already been done and just a bit of recombination of leading theories and publications resulted in the answer.

If you have it ask for involved legal documents to give to a lawyer like 100% of the time they find problems with it. And someone who isn't in law would have not known any better.

When you have it write complex code that is not easy/quick to test, especially things that are specifically NOT concretely defined, like net-code (because it's all on the trade-offs you want to accept for your particular game), it's going to just repeatedly create sync issues.

I've asked it to write-up a detailed explanation of the different types of turns in 4-panel dance games and it's just permanently wrong no matter what I say.

The more unique and lacking of training data that exactly represents the problem statement the more impossible the statistical machine will generate text that makes sense.

igortg 2 days ago|||
On one side I agree that LLMs and Agents are not intelligent, but they present an illusion of intelligence given the shear amount of data they can process and act upon.

But that cannot be used to discredit the fact that these are incredibly powerful tools that can get out of control and cause great damage.

atemerev 2 days ago||
What is "intelligence" then. I think the universalism of LLMs is now evident enough that they can be considered "intelligent", even in slightly different realization compared to humans.

As of "great damage", I doubt it. They do not have self-preservation instinct (all "worrying" experiments are the attempts to initiate something resembling self-preservation from human initiative). The driving part is external - the query loop can always be turned off. So yes, a dangerous tool that can be exploited by humans (including governments, especially governments - which is why I am skeptical to government regulation proposals, particularly looking at what passes as governments in this era). But there are no inherent dangers from their own agency, as there is none.

alansaber 2 days ago|||
"Slightly different"- no, a completely different realisation of intelligence to humans. LLMs can definitely do cool stuff though.
pixl97 2 days ago||
>completely different realisation of intelligence to humans.

OK, so they are intelligent. I'm glad we agree.

The problem with this word is people associate intelligence with the process they realize is occurring inside their head which is only a tiny fraction of what intelligence encompasses. Humans (without study) know very little about intelligence and they very gray boundaries it has.

chrisjj 1 day ago|||
> As of "great damage", I doubt it. They do not have self-preservation instinct

The potential for great damage relies upon the lack of self-preservation instinct. That lack releases the so-called AI from an order under pain of death. Damage cannot be punished.

NinjaTrance 2 days ago||
Article was posted on July 4th, 2023.
aetherspawn 2 days ago||
Stay the hell away from spooky stuff like psychics and tarot readers - the more you don’t believe in it, the better.

But better again that you do believe, and know that these are not harmless fun, but that there are dark and hidden and evil things in this world to stay away from.

besterman23 2 days ago||
Stop trying to pump your Tarot reader IPO
cagz 1 day ago||
The article starts interestingly; I like the analogy between cold reading and LLM responses (well, the ones we were getting three years ago). Then it goes on to generalise to the tune of "This new era of tech seems to be built on superstition and pseudoscience" which I think was a conclusion better left to the reader.

We are used to articles, blogs that stayed relevant for years. It is hardly the case with AI, the speed of change is so high that an observation can become stale in a year. This makes it very important for articles to state that the ideas are based on the technology in year X, rather than generalising them as universal truths.

rrook 1 day ago||
> The tech industry has accidentally invented the initial stages a completely new kind of mind, based on completely unknown principles, using completely unknown processes that have no parallel in the biological world.

This is just false? Language emerged from biology, we've brute forced some version of that model. Knowing that this is a new kind of mind requires that we are able to differentiate these different kinds of minds in the first place.

m0llusk 1 day ago|
Generating and mastering language are two very different things. Even the best LLMs still have no ability to understand or work with abstractions.
rrook 1 day ago||
Totally agree with the first part of that. The second less so. LLMs are able to maintain a cohesive idea across multiple metaphors, which is basically the same as walking abstractions.
YcYc10 1 day ago|
This didn't age very well.
More comments...