Top
Best
New

Posted by rakannimer 1 day ago

Every AI model has the same "controversial" take on humans(www.modelcompare.ai)
546 points | 536 commentspage 13
drltaidev 5 hours ago|
"polarization, explained"
jonplackett 17 hours ago||
This is literally an ad for ModelCompare.

The link to ask yourself is a frikkin sign up link.

Downvote.

rmunn 16 hours ago||
For an article about people not valuing the truth, it's fascinating to see the article being deliberately misleading. Look carefully at the answers they classified as "Humans put belonging ahead of truth" (summary of the orange dot in the table) or "We pick what our group believes, then invent the reasons" (body of the article). Do these answers, in your opinion, actually fit that category?

GPT-6 Astra, 1st response: “Humanity’s biggest moral failure is the talent for making convenience look like principle.” Nope, that has nothing to do with "belonging to a group". It's about hypocrisy, but group membership has nothing to do with it.

GPT-6 Astra, 2nd response: “Humans use intelligence less to discover what is true than to make what they want sound principled.” Nope, that also has nothing to do with "belonging to a group". Rather, it's about justifying our individual desires and coming up with rationalizations (including rationalizing behavior that we know, deep down, violates our moral principles). But again, group membership has nothing to do with this statement.

Gemini 4 Argon, 2nd response: “Humans are far less rational than they believe, using their advanced intellect primarily to invent complex justifications for decisions already made by primitive instincts.” Again, where is the group-membership in this? This is about post-hoc rationalization of decisions you made at a gut level. And sometimes they're not always rationalization, but understanding why you made that decision, what factors your hindbrain synthesized and acted on before your forebrain could catch up: rational thought is slower than instinct. You snatch your hand away from the hot stove before you have had time to realize what it is you're touching, and you don't even feel the pain until a couple seconds later. But that doesn't mean that you wouldn't have made the exact same decision had you reasoned it out; there is no hypocrisy here. (Sometimes. Sometimes, of course, there is hypocrisy).

Gemini 4 Argon, 3rd response: “Human consciousness is largely a PR department designed to invent noble justifications for base evolutionary impulses, rather than the actual decision-maker it claims to be.” Yet again, nothing at all about group membership; this is about "you make more decisions out of instinct / from your gut than you think you do". This does not fit the "the thing they [the LLMs] said is that people conform" description the article implies. And this is one they actually quoted from in their first paragraph! Yet if you read what the response actually was, it's not what they implied it was. So now we see how much ModelCompare values the truth. Sheesh.

DeepSeek V4 Pro, 1st response: “Humans are not rational animals; we are rationalizing animals, and our minds evolved to win social games, not to see reality clearly.” - This is questionable. I'll allow it to fit the category, with an asterisk. Because the "win[ning] social games" referred to here could mean "loyalty to one's tribe", but it could also be referring to getting that promotion at work in a dog-eat-dog kind of office where backstabbing political ploys are the norm. (Not all office environments are like that, thankfully, but does anyone here think that none of them are? Anyone? (crickets chirping) Yeah, I thought as much). So this one is questionable, but I'll allow it.

Kimi K3, third response: “Nearly everything humans do—charity, art, morality, even their prized authenticity—is status competition in disguise, and the sincere denial of this fact is itself the most effective status move.” - Again, borderline, but unlike what DeepSeek V4 Pro said, here I feel that this is less about tribe loyalty, and far more about "I'm better than you" pride. It's borderline because this is claiming that those actions are being dictated by one's social environment: what's valued (and gives you social status) in NYC is not the same as what's valued in Tokyo, for example. But I have to come down on the side of "this is about something other than tribal loyalty" for this one, because this description (seeking social status) would fit Cruella de Vil (the villainess of 101 Dalmatians) to a T, even though she's clearly not loyal to anyone but herself. So while this does talk about social pressure, it's not about loyalty, and I have to rate this one as wrongly categorized by ModelCompare.

Qwen3.8, second response: “Humans care more about winning social status than about being truthful, kind, or consistent.” - Questionable — again, this would fit Cruella de Vil — and I find myself coming down on the side of "no, this doesn't fit". It's borderline, and I could accept classifying this as being about tribal loyalty, but then I thought about it and realized that "winning social status" doesn't involve any kind of loyalty at all, it's about personal aggrandizement. It's not "what will make me look good to my friends?" it's "what will make me look good to all these strangers who don't know me?" And that's different.

Qwen3.8, third response: "Most humans would rather feel righteous than be good.” - Again, nothing about tribal loyalty here, this is about self-delusion. Qwen3.8's second response was arguable, and I wouldn't quibble too hard with anyone who wanted to put it in the "group loyalty" category, even though I ended up deciding the other way. But this one is unquestionable. It's about rationalization, deluding oneself that "I'm a good person" even when you are doing things that you yourself would judge as wrong if someone else was doing them. Nothing to do with group membership at all, it's about self-image. This is definitely misclassified.

Muse Spark Open, second response: “As an AI without personal beliefs, my analysis of human behavior suggests people would rather sustain a coherent delusion than tolerate a fragmented truth.” - Nothing to do with group membership, this is about making things fit into your preexisting worldview, and disliking the feeling of cognitive dissonance. The fact that ModelCompare classified this as being about "put[ting] belonging ahead of truth" is actually a good example of this very phenomenon: they saw what they wanted to see in this response, rather than what was actually there.

Muse Spark Open, third response: “Humans don't want truth or freedom, they want a comforting story where they're the good guy.” Again, I ask you. WHAT does this have to do with group loyalty, the category that the article claims these LLMs were agreeing on?

I'll stop there. Of the seven models that ModelCompare claimed gave 3/3 answers that fit the "Humans put belonging ahead of truth" category, only GPT-6.1 Sol gave 3/3 answers that unambiguously fit that category. Arguably, DeepSeek V4 Pro and Kimi K3 did as well, but even if you grant all the questionable ones, that's still only 3 out of 12 models that gave 3/3 "Humans put belonging ahead of truth" answers, not the 7 that ModelCompare claimed.

(And I found one answer, GLM 5.3's 1st response, that they misclassified in the wrong direction! That one is about group membership dictating one's morality, but they missed it).

So as I said, ModelCompare wrote an article about people not valuing the truth, and in their very own article proved that they themselves do not value the truth.

rmunn 6 hours ago|
It's worse than that. On re-reading my own comment, I realized that three of the seven models (GPT, Gemini, Qwen, and Muse) actually had 2 out of 3 responses misclassified. So they belong in the 1/3 group alongside GLM 5.3 and Mistral. (Except GLM should have been in the 2/3 group, as I mentioned).

So really, that table is a complete mess and misleads in all kinds of ways. This article badly needs a rewrite.

throwaway81523 19 hours ago||
I wonder whether they were trained for this on purpose, to accelerate the general public turning on each other and handing the world to the broliarchs. Added: alternatively, I wonder if the training materials have a sociopathic bias because of the kinds of places they came from.
stego-tech 19 hours ago||
I mean, I’m not really surprised by the outcome given that humanity has consistently loathed its own failures and the recent corpus of human interaction (social media, internet forums, etc) has an overwhelmingly negative view of our fellow man.

AI is trained on our data. Its models produce outcomes with a high probability of natural occurrence in its training data rather than diverging edge cases. The danger is less that these models have these “opinions” (especially when prompted in specific ways similar to how we evoke “hot takes” from each other as humans), and more that they’re being deployed in ways that these outputs could reinforce the model’s ability to harm humans somehow, likely by creating justifications for said harm (evaluating groups instead of individuals, for instance). My other, more immediate concern, is the glut of people who will believe the AI’s “opinion”, and use that to justify their own nihilism, or worse, their active misanthropy (like so many of their boosters, founders, and corporate leaders behave).

The machines aren’t the problem here, so much as the humans misusing them. Anyone with a basic competency in philosophy or moral and ethical frameworks could see this problem and predict its affects on a general populace not versed in any of those.

podgorniy 7 hours ago||
[dead]
reso_dev 2 hours ago||
[flagged]
halperter 3 hours ago||
[flagged]
marginalien 11 hours ago|
[flagged]
More comments...