Posted by seltzerboys 1 day ago
AI changes the underlying job you're testing for. So, obviously, the tests you might have been using pre-AI won't work anymore; they're testing something that isn't really the job anymore. Update your tests so they're about the real work again, that's all. For coding, that probably means assuming (or requiring) candidates use AI to do your assessment.
What AI really does mess with is conversational/interactive interviewing. We do all our interactive scripted interview on Slack, but I can imagine us having to end that practice and return to face-to-face.
By all measures, the way you describe any hiring processes you've designed and had input on designing the metric and the work sample, probably is both high in signal, and not very arbitrary in scoring. They sound genuinely and refreshingly good. Maybe one day I'll interact with one :)
But man, that is very much not how work sample tests work in _a lot_ of places out there.
Places with actual, formalized rubrics for what constitutes a "pass" or a "good" score are very rare, it's almost always just based on vibes of whatever person is reading your code. If there _are_ formalized rubrics, then they have "suggested allowed time" that is incongruous with what the requirements for a "pass" actually are.
All of that is downstream, fundamentally, from the design of the tests not being taken very seriously by the people doing that. And because they're not actually thinking about it very deeply (or they're not allowed to because of time constraints or whatever); "sit down and redesign this task from first principles thinking about what AI enables now" is just not something that happens, and you just get people increasing the scopes of the project blindly.
But of course this is a lot of unnecessary steps compared to the usual method: length of work and education history +18 years.
I can remember mine just fine.
If you're really looking for smart people, use "Answer this word problem in two or more paragraphs. Write your answer on the sheet of paper provided. In cursive."
Doing this may well expose you to age discrimination lawsuits, since it's just sneaky indirect age filtering.
Another example would be if you required a minimum SAT score of 1601. Sure, someone could have gone off and taken the SAT as an adult or a young child but in reality it is mainly an age filter.
My kids are learning cursive in elementary school right now, FWIW.
By definition, people who know more things are smarter than people who know fewer things. That's just how it works.
For centuries, people have striven to improve themselves through the acquisition of knowledge and skills. It is a quirk of recent generations that so many members take pride in their lack of knowledge.
I'm repeatedly bewildered by my Millennial colleagues who proudly say "I don't know what that means," or boast "I don't know what that is" with no sense of shame.
Imagine, you have two people. Person A knows cursive, person B does not. Person B knows the ins and outs of Newtonian physics, person A does not.
Which person is smarter? Which person would the cursive test say is smarter?
What you seem to have mistook for people not knowing things without shame, is people valuing knowledge not by the preponderance of its quantity but by its total when multiplied by its utility.
Otherwise I do not envy the shame you must feel at lacking the knowledge of which plants are edible, how to.clean a carcass, how to fashion a needle from bone and an axe from stone, the mixture of clays to use to make your bricks, and all manner of other once-necessary tidbits whose usefulness has lapsed for the general population.
One could learn this skill in their 20s or beyond, but there's an opportunity cost – why not something else that would actually improve work performance, or that you enjoy doing?
I still wish I'd been taught in elementary school, though, because it would've been really useful as a student. Some of our teachers discreetly handed out practice booklets to students who'd "expressed interest" (their parents taught them the basics and teacher noticed); most of us were not so lucky.
Communication skills, teamwork skills...
How to cook better, maintain relationships better, keep a tidier space...
Not perfect! But time well spent.
Not wanting to learn cursive is like not wanting to know lower case just because caps lock exists.
Same schedule every single day, you get a lunch break, exams are designed in a way that there's only one single correct answer, outside of the box thinking is wrong, and you'll get at least a B+ if you just do your homework everyday.
I'm pretty sure this is (part of) what's being filtered for quite intentionally.
Heard nothing but bad things about their hiring process.
It was horribly translated, every sentence was written like something this: "A and B are two broters/sisters. A gives B 3 apples and he/she/them eats one and returns one to he/she/them…" at some point one section had the instructions wrong so I did all the questions wrong. There was no way to change the language or re-read the instructions to try to understand what the original text might have actually been.
That's when I closed the tab.
I'm a Debian Developer.
If you think my decades old SAT score is relevant, then I know all I need to know about your company.
It was also the single highest density of talent I’ve ever worked, by a long shot. Crazy talented coworkers.
https://en.wikipedia.org/wiki/File:SAT-ACT-Preference-Map.sv...
Difficulty wise, the ACT was easier, but not by a lot. They seemed to have pretty similar predictive strengths, based on percentiles of people I knew lining up between the two, but obviously the ACT loses precision because of how coarsely it's scored.
