Posted by damir 4 days ago
Ask HN: Website with 6^16 subpages and 80k+ daily bots
It's little over a year old and now every day there's 60k-100k bots visiting and crawling the shit out of two-trillion-something sub pages...
I am out of ideas what to do with this site. I mean, it's probably one of the largest websites on the Internet, if counted by sub-pages...
What cool experiment/idea/stuff should I do/try with this website?
I'm sure AI could be (ab)used somehow here... :)
integrate google adsense and run ads
add a blog to site and sell backlinks
embed google ads..
That should generate you some link depth for the bots to burn cycles and bandwidth on.
[1]: Not even remotely a color theorist