that's really nice, I was so impressed by pangram AI text detector so I hope image detector is also that good
my002 2 days ago||
People often shit on AI detectors but Pangram's text AI detection has been very good, IME. Not perfect, but good enough to be useful in most circumstances.
jszymborski 2 days ago|
My trouble with Pangram is that the calibration is totally off. It can tell you if there is a drop or an ocean of AI in the text you submit. The "X% of AI" message doesn't really mean much. You can test this yourself: Slowly add generated text to a human write paragraph and you'll see it hit "100% AI" quite quickly.
Matticus_Rex 2 days ago|||
It analyzes in segments, and the percentage is of the segments, not of the words.
jszymborski 2 days ago||
Yes but the segment sizes are huge and any amount of LLm generated sequences within that block cause all of it to be flagged as AI.
Matticus_Rex 1 day ago||
That's the state of the tech right now. It'll be nice if we can get it and keep it more granular than that, but even at the current state it's pretty impressive.
jrhizor 2 days ago||||
Good?
Alpha3031 2 days ago|||
I don't really know why you would expect a "X% chance of containing AI" number to rise slowly or smoothly alongside the percentage of text that has a 100% chance of containing AI.
kingofmen 2 days ago||
Because it isn't an "X% chance". It's an "X% of words".
Alpha3031 2 days ago||
Surely not at the sub-paragragh level? OP said their test passage was a paragraph.
74948494i4 2 days ago||
What’s the use case for these things?
tantalor 2 days ago||
A few likely use cases,
1. Social media moderation. You want to limit the proliferation of this stuff because it annoys users.
2. Trades where authenticity matters, like journalism, law, education. You have to weed out the crap and people will try to deceive you.
80fj0348i 2 days ago|||
eCommerce - you may want to reduce fraudulent listings, e.g. used goods, housing, collectibles/auctions...
poszlem 2 days ago||
What's the use case for knowing when you are looking at a fake AI image and not at a real photo? Is that seriously your question?
nwhnwh 2 days ago||
The cookie modal is disgusting... It takes a few moments to realize that if you only want the necessary ones, you need to close the modal as the existing action button is for allowing everything.
leothetechguy 2 days ago||
Awesome research like this restores my faith in humanity.