Top
Best
New

Posted by sizzle 8 hours ago

Algorithmic Monocultures in Hiring(hai.stanford.edu)
https://algorithmichiring.github.io/

https://arxiv.org/abs/2605.27371

135 points | 144 commentspage 3
xrd 7 hours ago|
Would be very interested to see how this affects post-50 workers. That's a protected class and I would imagine an ambulance chasing lawyer would be excited for a class action lawsuit.
OrvalWintermute 6 hours ago||
The Pymetrics game is rigged by design:

Only 40% self report gender/race

no resume data, no education information, degrees, schools, GPA, major, work experience, skills/certifications

Zero job qualifications

zerocrates 6 hours ago|
Well, they're only looking at whether the pymetrics gameplay algorithm ML thing recommends the candidate, not any of that other stuff. The outcome they're looking at here isn't whether the people actually got hired, or got passed by other screening layers or anything.
ETH_start 6 hours ago||
A racially disparate outcome is not evidence of racial bias.
TheMagicHorsey 6 hours ago|
Imagine if they applied this same logic to the NBA draft.
black6 7 hours ago||
I'm struggling to figure out what they're trying to say here in the linked (and very anemic) paper:

> 30% of Black applicants apply to at least one position that demonstrates adverse impact against Black applicants.

The whole thing reads like a tautology.

gacgacgac 6 hours ago|
You are reading a paper without understanding the language of the paper. Adverse Impact has a specific meaning, and in this case it's specifically meaning that Black candidates were selected only four fifths as often as white candidates when their qualifications were identical. The study is only suggesting that further investigation is warranted.
black6 4 hours ago||
Thanks. It was unclear reading the article and linked paper. I didn't follow the citation/link trail far enough.
rayiner 4 hours ago||
Your initial assessment was correct and this part of the post above is incorrect: “when their qualifications were identical.” The paper doesn’t control for identical qualifications.
x313 7 hours ago||
This study only looks at one specific vendor algorithmn (a job assesment given by a company called pymetrics)
all2 7 hours ago|
LLMs are trained on the Internet, which isn't exactly known for it's race agnostic opinions.
xdennis 5 hours ago||
It's surprising to me to hear that these systems are considered racist when they're the same ones that are so color blind that they generate pictures of SS soldiers as African American women.
roysting 5 hours ago||
There is no isolation of variables. This is not science. This is propaganda.
jongjong 5 hours ago||
I think the discrimination aspect is downstream from this fact:

> We follow 3.4 million people who submit 4 million job applications to 1,700 job postings across 150 employers and 11 industry sectors. Each job application was assessed by an AI hiring tool built by a single third-party vendor.

3.4 million people applying to just 150 employers... Who are all using just 1 platform. WTF. This is where the discrimination is happening. Why the f do 3.4 million people feel forced to apply to just 150 employers and why the f do all these 150 employers feel forced to use just one platform. WTF.

zeroonetwothree 5 hours ago|
That’s the platform that gave them the data. I don’t think they claim it’s all the applications of this set of people.
jongjong 5 hours ago||
I realise this but it's still incredible to think because that's about 22k applicants per company.

Even if that's just part of each company's total hiring pipeline, it's clear; something's wrong. I don't know how long this study has been running but 22k is a lot of people, even over a year. These companies are too big. That's the problem.

petesergeant 6 hours ago||
I’m sure (really sure) there are real problems with AI and bias, but this is a weird study that isn’t looking at resumes or anything, it’s looking at how candidates did in some weird psychometric tests.
gacgacgac 6 hours ago|
Double check the link. The study clearly looked at resumes.
petesergeant 6 hours ago||
I’ve rechecked it, and I still think I’m right. What am I missing? This is the paper under discussion: https://arxiv.org/pdf/2605.27371
engineer_22 7 hours ago|
> Using our large dataset of real hiring AI recommendations, we test our hypothesis. We find that people who submit multiple applications to positions screened by the same algorithmic hiring vendor are more likely to be rejected from every position to which they apply than would be true if the companies made decisions statistically independently from one another.

I would be surprised if the results were different.

More comments...