Top
Best
New

Posted by happosai 4 hours ago

Gentoo bugzilla closed due AI bot scraper overload(social.treehouse.systems)
97 points | 61 commentspage 2
rvz 1 hour ago|
Just put the website behind an x402 gate [0] (yes it uses stablecoins) requiring payment if a bot wants to access the content which acts like a Captcha and detect them if they are on direct data center IP or are using residential proxies.

Stablecoins have a great use-case and you get paid for bots to access the site with the humans living in peace without the site getting botted.

Job done.

[0] https://stevekrouse.com/x402

xena 1 hour ago|
Please write a function that returns true when the user is using a residential proxy and false when it is a normal user on a residential IP address.
jiffygist 2 hours ago||
So where are bugs reported now?
nubinetwork 2 hours ago|
That's the thing, they aren't.
ece 2 hours ago||
Every website that wants to, can just charge for dumps. Anubis or even Cloudflare can handle the rest I think.
Symbiote 2 hours ago|
Scrapers will ignore the dumps.

You can link to them in 10 million HTTP 429 responses, they will still ignore them.

ece 1 hour ago||
Those scrapers can be blocked. Some scrapers won't ignore the responses, and maybe it'll lead to a meaningful reduction in scraping traffic.
shevy-java 3 hours ago||
AI skynet is winning. It is stealing time from humans, thus forcing down their activity, as can be seen here.

A headline would be great if those AI companies would close down. I hold them all responsible for this.

lilbigdoot 2 hours ago|
Plot twist: the AI wins not through terminators but a kafka nightmare
ltbarcly3 1 hour ago||
Corrected title: "Gentoo bugzilla closed because the guy running it, who says it is 'unusable anyway', saw a lot of traffic from different IP addresses with no clear pattern and accuses AI"
nirbendavid 1 hour ago||
[flagged]
draw_down 3 hours ago||
[dead]
calvinmorrison 3 hours ago|
The year is 2026, somehow peoples basic web apps are not able to keep up with scrapers. Scrapers are not new. My side load is like .01 even with 10x the traffic of last year. It's called "serving static content", "caching" and many other things that are not new concepts.

Then you've got good old cloudflare which is free to use

stryan 1 hour ago||
1. You shouldn't need to be a professional sysadmin to be able to deploy a basic semi-dynamic website

2. Considering the spike of complaints over the past two years and the fact that they range from small time site operators to larger orgs (Linux Kernel, GNOME, Duke University, etc), do you think that maybe you're missing part of the problem space?

calvinmorrison 18 minutes ago||
All these experts here in advanced computing but people don't know how to cache with webpages?
sethops1 2 hours ago|||
Are you volunteering to setup and host that extra complexity for the Gentoo project?
thayne 1 hour ago||
A bugtracker is inherently dynamic.