Posted by paulpauper 3 days ago
The author asked LLMs to produce lists of data which are readily available on the likes of wikipedia. Author date of birth, list of publications, and publication release date are all fairly easy to get hold of. They just need formatted appropriately. The LLMs produced a few false positives, and missed out some prominent works.
I get that this is just the author working in public & writing about what they're up to, but the number of avoidable errors introduced by the methodology make reading it a poor use of time.
> So I tried to cast the net more broadly and asked LLMs (…)
> EDIT: also hunted down several mistakes, as one would expect from LLMs; thanks to commenters.
This is a slop post. You can’t trust any of the data. It’s baffling and worrying the author apparently understands mistakes from LLMs are to be expected but still decided to publish without doing due diligence.
Things seem a bit more dire now.
In my opinion the effect of your pushback is nudging people to not disclose their use of LLMs. I'm not sure that's what you want.
In other words, if every time someone says "I used an LLM to assist me with this article" they get backslash, these people will not stop using LLMs. They'll stop telling that they did.
No.