Posted by damir 4 days ago
Ask HN: Website with 6^16 subpages and 80k+ daily bots
It's little over a year old and now every day there's 60k-100k bots visiting and crawling the shit out of two-trillion-something sub pages...
I am out of ideas what to do with this site. I mean, it's probably one of the largest websites on the Internet, if counted by sub-pages...
What cool experiment/idea/stuff should I do/try with this website?
I'm sure AI could be (ab)used somehow here... :)
is it russian bots? You basically created a honeypot, you out to analyze it.
Yea, AI analyze the data.
I created a blog, and no bots visit my site. Hehe
If you want to expand further, maybe include pages to represent colours using other colour systems.
I highly advise not sending any harmful response back to any client.