Top
Best
New

Posted by turtlesoup 7 days ago

Show HN: Are You in the Weights?(www.intheweights.com)
With more traffic moving off-web and into LLMs, I got curious about what traces we leave "in the weights". My design partner and I built a site in the past few weeks that checks recognition across frontier and small models. It queries many of them in parallel, clusters the responses, and tells you how strongly they recognize you. Happy to answer any questions here!
470 points | 247 commentspage 14
tosief 7 days ago|
[flagged]
georgemcbay 7 days ago||
"George McBay"

> Llama 3.2 1B says

> American actor, best known for his roles in films such as 'The Big Lebowski' and 'The Big Lebowski 2'.

Nailed it! /s

But even the entries that aren't marked as likely hallucinations are wrong for me on this site.

> George McBay

> African American chemist and educator

No, that's Henry Cecil McBay (no direct relation that I'm aware of).

Google Search's AI mode does match actual me, but the information it spits out is all mixed up with information on another person who has my same name (also no relation that I'm aware of) and is also a software developer.

turtlesoup 7 days ago|
Aye... right now the clusterer does the classification of whether it thinks it is a hallucination or not (it is biased against only small model support) but I tried to optimize for recall over precision. The query is essentially "Who is <name>" so a lot of the hallucinations are just the LLMs their usual mysterious way of thinking - usually some relation but loose.
vladsiu 6 days ago||
[dead]
pixelneon 7 days ago|
It looks like something perfect, what is its purpose?
turtlesoup 7 days ago|
No purpose, just a fun hack and science experiment. Glad to see it getting a good reception!