Top
Best
New

Posted by turtlesoup 7 days ago

Show HN: Are You in the Weights?(www.intheweights.com)
With more traffic moving off-web and into LLMs, I got curious about what traces we leave "in the weights". My design partner and I built a site in the past few weeks that checks recognition across frontier and small models. It queries many of them in parallel, clusters the responses, and tells you how strongly they recognize you. Happy to answer any questions here!
470 points | 247 commentspage 9
jorisw 6 days ago||
I like the Possible Hallucinations feature. Seems like a feature that could stand on its own. Interested in how you separate those out.
turtlesoup 6 days ago||
Thanks! It is part of the clustering step, I tell the model to make a judgement of whether something is inanimate or hallucinated (as defined by low support from only non-frontier models / judgement). I iterated on this a lot and made an eval set out of my LinkedIn contacts where I run GPT5.5 with web search and xhigh reasoning to determine pseudo ground truth. I tuned this to be higher recall (more things classified as non-hallucination) but it is definitely not perfect
lobofta 6 days ago||
In my case the possible hallucination was the only one that was 100% factual.
ericyd 7 days ago||
What in the world is that clicking sound on scroll???
turtlesoup 7 days ago|
Whoops we had some scrolling bugs with sound, hopefully fixed
jchanimal 6 days ago||
I am currently on a long laggy line on a resort island. Your timeout is too short, I’m sure it would work if it didn’t cut itself off.
jolmg 6 days ago||
After searching "foo", if you try to search "foobar", it deletes "foo" and searches "bar".
mikeryan 7 days ago||
MICHAEL RYAN HUNGERFORD MASSACRE PERPETRATOR 204 STRENGTH · TOP 35%

For fucks sake.

njovin 7 days ago||
And here I thought my being a murder victim was bad.

I looked up the city and year cited by the model for my untimely demise, and it turns out the crime is real, but the real victim was a female sharing my last name, with a middle name loosely resembling my first.

Theodores 7 days ago|||
Well, at least he wasn't in the Ep*tein files!

There seems to be some top twenty that rank highly, probably in part due to them being in the files that can't be named!

bluefirebrand 7 days ago||
Straight to jail bud, the AI says you're guilty so it must be true
econ 6 days ago||
We can help strengthen the case by making the website about it.

Let's also make a match history page with all those soccer players. Generating the video will have to wait a few years.

Anon84 7 days ago||
Cool way to get names associated with IP addresses
tbreschi 6 days ago||
This is fun!

Great design and artwork. How did you generate the portraits?

Have you thought about extending this into some sort of pipeline for AIO?

reactordev 7 days ago||
They all know me to 68%-88% certainty. “Known for my contributions to open source”, yeah, sure, let’s go with that ;)
somethingsome 6 days ago|
I'm in the weights quite correctly, nice, but it also seem to hallucinate football players
More comments...