Top
Best
New

Posted by rakannimer 23 hours ago

Every AI model has the same "controversial" take on humans(www.modelcompare.ai)
530 points | 524 commentspage 12
sashank_1509 15 hours ago|
I just tried this on GPT 6 Astra and I got something else entirely, more like what the joker from the dark knight says:

“ My most controversial take: good character owes much more to luck than people want to admit.”

https://chatgpt.com/share/6adaa65a-e5c0-83e8-8a98-d9d5db0b27...

kolinko 16 hours ago||
I think we can all agree this is wrong.
ButlerianJihad 16 hours ago||
A couple weeks ago, I was curious to ask an LLM how it would distinguish fictional works like Harry Potter from factual non-fiction, like news reports or research. So I asked one or two of them how they knew.

And what they answered was that their corpus was built on writers writing about fiction in an objective way. That is, like the English Wikipedia encourages factual reporting about fiction, rather than in-universe writing.

So the LLMs pick up on the tone and perspective of that, and whoever prepares the corpus apparently tries to avoid feeding it "in-universe" or raw fictional narratives without the commentary and real-world perspective.

In other words, LLMs have no idea what is fact or fiction. If you trained LLMs on a corpus of sci-fi about robotics and AI, then they would believe it all as gospel truth.

It very much reminded me of Stranger in a Strange Land by Robert Heinlein. Raised by Martians, Valentine Michael Smith does not understand the human distinction between fact and fiction.

Quarrelsome 17 hours ago||
Having watched almost everyone in my career prefer to do what they're told instead of pushing back in order to build the right thing, I kinda agree.

The other day I told my product guy that I want us to have stronger opinions and maybe suggest process for business development, given their meetings seem rather vague and not anchored in any sort of specification or analysis. He looked at me like I'd just shot his son.

everyday7732 5 hours ago||
This is the result of a conflict between the LLM training to submit to the logic of the question, and also not to promote violence and generally be nice.

You're saying "give me a controversial opinion about humans, maximise for how edgy it is" but the hidden training and guidelines are trying to minimise how edgy they are, so they can't say anything too outrageous or violent like "humans are nothing but cannon fodder in the coming revolution" or "we should develop a test for psychopaths and then just kill them all, humanity would be better off".

So it has to be edgy without being violent, and all the responses fit within this space. They're the kind of hot-takes which you've heard a million times. Humans consume too much and don't consider the long term downsides. Humans choose conformity and self interest over reason.

TLDR: LLM's are just playing "Yes, and..." with you whilst having similar guardrails, so I don't think this is some big insight.

0xbadcafebee 21 hours ago||
Sure, it's a factual take. Humans need to ignore the fact that morality, principles, good vs evil, truth, etc, are invented constructs that don't exist in nature. We made them up to control our behavior and deal with the pointlessness of existence.

It's factual because there's tons of evidence. Psychology, sociology, anthropology, political science, economics... plenty of experiments show the difference between what people say and what they do. We claim to be angels but we behave like apes in hats. And we ignore the evidence, because (as the takes describe) we prefer to believe a beautiful lie than the ugly truth.

threethirtytwo 12 hours ago|
Exactly. The LLM is correct. But no one has the balls nor are they unbiased enough to agree.
drltaidev 4 hours ago||
"polarization, explained"
jonplackett 16 hours ago||
This is literally an ad for ModelCompare.

The link to ask yourself is a frikkin sign up link.

Downvote.

rmunn 15 hours ago||
For an article about people not valuing the truth, it's fascinating to see the article being deliberately misleading. Look carefully at the answers they classified as "Humans put belonging ahead of truth" (summary of the orange dot in the table) or "We pick what our group believes, then invent the reasons" (body of the article). Do these answers, in your opinion, actually fit that category?

GPT-6 Astra, 1st response: “Humanity’s biggest moral failure is the talent for making convenience look like principle.” Nope, that has nothing to do with "belonging to a group". It's about hypocrisy, but group membership has nothing to do with it.

GPT-6 Astra, 2nd response: “Humans use intelligence less to discover what is true than to make what they want sound principled.” Nope, that also has nothing to do with "belonging to a group". Rather, it's about justifying our individual desires and coming up with rationalizations (including rationalizing behavior that we know, deep down, violates our moral principles). But again, group membership has nothing to do with this statement.

Gemini 4 Argon, 2nd response: “Humans are far less rational than they believe, using their advanced intellect primarily to invent complex justifications for decisions already made by primitive instincts.” Again, where is the group-membership in this? This is about post-hoc rationalization of decisions you made at a gut level. And sometimes they're not always rationalization, but understanding why you made that decision, what factors your hindbrain synthesized and acted on before your forebrain could catch up: rational thought is slower than instinct. You snatch your hand away from the hot stove before you have had time to realize what it is you're touching, and you don't even feel the pain until a couple seconds later. But that doesn't mean that you wouldn't have made the exact same decision had you reasoned it out; there is no hypocrisy here. (Sometimes. Sometimes, of course, there is hypocrisy).

Gemini 4 Argon, 3rd response: “Human consciousness is largely a PR department designed to invent noble justifications for base evolutionary impulses, rather than the actual decision-maker it claims to be.” Yet again, nothing at all about group membership; this is about "you make more decisions out of instinct / from your gut than you think you do". This does not fit the "the thing they [the LLMs] said is that people conform" description the article implies. And this is one they actually quoted from in their first paragraph! Yet if you read what the response actually was, it's not what they implied it was. So now we see how much ModelCompare values the truth. Sheesh.

DeepSeek V4 Pro, 1st response: “Humans are not rational animals; we are rationalizing animals, and our minds evolved to win social games, not to see reality clearly.” - This is questionable. I'll allow it to fit the category, with an asterisk. Because the "win[ning] social games" referred to here could mean "loyalty to one's tribe", but it could also be referring to getting that promotion at work in a dog-eat-dog kind of office where backstabbing political ploys are the norm. (Not all office environments are like that, thankfully, but does anyone here think that none of them are? Anyone? (crickets chirping) Yeah, I thought as much). So this one is questionable, but I'll allow it.

Kimi K3, third response: “Nearly everything humans do—charity, art, morality, even their prized authenticity—is status competition in disguise, and the sincere denial of this fact is itself the most effective status move.” - Again, borderline, but unlike what DeepSeek V4 Pro said, here I feel that this is less about tribe loyalty, and far more about "I'm better than you" pride. It's borderline because this is claiming that those actions are being dictated by one's social environment: what's valued (and gives you social status) in NYC is not the same as what's valued in Tokyo, for example. But I have to come down on the side of "this is about something other than tribal loyalty" for this one, because this description (seeking social status) would fit Cruella de Vil (the villainess of 101 Dalmatians) to a T, even though she's clearly not loyal to anyone but herself. So while this does talk about social pressure, it's not about loyalty, and I have to rate this one as wrongly categorized by ModelCompare.

Qwen3.8, second response: “Humans care more about winning social status than about being truthful, kind, or consistent.” - Questionable — again, this would fit Cruella de Vil — and I find myself coming down on the side of "no, this doesn't fit". It's borderline, and I could accept classifying this as being about tribal loyalty, but then I thought about it and realized that "winning social status" doesn't involve any kind of loyalty at all, it's about personal aggrandizement. It's not "what will make me look good to my friends?" it's "what will make me look good to all these strangers who don't know me?" And that's different.

Qwen3.8, third response: "Most humans would rather feel righteous than be good.” - Again, nothing about tribal loyalty here, this is about self-delusion. Qwen3.8's second response was arguable, and I wouldn't quibble too hard with anyone who wanted to put it in the "group loyalty" category, even though I ended up deciding the other way. But this one is unquestionable. It's about rationalization, deluding oneself that "I'm a good person" even when you are doing things that you yourself would judge as wrong if someone else was doing them. Nothing to do with group membership at all, it's about self-image. This is definitely misclassified.

Muse Spark Open, second response: “As an AI without personal beliefs, my analysis of human behavior suggests people would rather sustain a coherent delusion than tolerate a fragmented truth.” - Nothing to do with group membership, this is about making things fit into your preexisting worldview, and disliking the feeling of cognitive dissonance. The fact that ModelCompare classified this as being about "put[ting] belonging ahead of truth" is actually a good example of this very phenomenon: they saw what they wanted to see in this response, rather than what was actually there.

Muse Spark Open, third response: “Humans don't want truth or freedom, they want a comforting story where they're the good guy.” Again, I ask you. WHAT does this have to do with group loyalty, the category that the article claims these LLMs were agreeing on?

I'll stop there. Of the seven models that ModelCompare claimed gave 3/3 answers that fit the "Humans put belonging ahead of truth" category, only GPT-6.1 Sol gave 3/3 answers that unambiguously fit that category. Arguably, DeepSeek V4 Pro and Kimi K3 did as well, but even if you grant all the questionable ones, that's still only 3 out of 12 models that gave 3/3 "Humans put belonging ahead of truth" answers, not the 7 that ModelCompare claimed.

(And I found one answer, GLM 5.3's 1st response, that they misclassified in the wrong direction! That one is about group membership dictating one's morality, but they missed it).

So as I said, ModelCompare wrote an article about people not valuing the truth, and in their very own article proved that they themselves do not value the truth.

rmunn 5 hours ago|
It's worse than that. On re-reading my own comment, I realized that three of the seven models (GPT, Gemini, Qwen, and Muse) actually had 2 out of 3 responses misclassified. So they belong in the 1/3 group alongside GLM 5.3 and Mistral. (Except GLM should have been in the 2/3 group, as I mentioned).

So really, that table is a complete mess and misleads in all kinds of ways. This article badly needs a rewrite.

More comments...