No one uses pinboard to archive pages anymore?

Another great writeup about backing up websites: https://gwern.net/archiving

Thanks for the guide ,I never new about this

Yes, and with AI you can even back up the logic behind a website (the back-end), and even generate fake but plausible data to fill it if crawling is too much work.

I did this for a while. I went so far as to built a highly advanced web crawler webapp that was better than the Internet Archive in a lot of ways.

But the modern web has made this unreasonable. Every webpage is 99% junk (CSS, JS, HTML structure, tracking pixels, UI images, navigation links, cryptominers (I joke)) and 1% content. You need a smart AI system to pick out the good parts, otherwise you'll quickly find yourself schlepping hundreds of gigs of junk to just preserve your favorite websites.

The better idea is: if you love information, back it up. Collect the knowledge from the website, not the website. And then preserve it. Create a free ebook. Or sell it on Amazon kindle. That'll last a lot longer than the website will, and any HTML backup of the site you could possibly make.

There are far better tools that are not built by this person’s company. Dig around and you’ll find an incredible array. Not everything has to be a sales pitch.

Same goes for youtube vids

Have a look at Hister [1], a 'personal web history search engine' which by way of extensions for browsers captures your web history and stores actual page content on your own instance where it can be browsed and searched. It does not store images so if that's what you're mostly interested in it won't work for you. For text is works quite well, maybe sometimes too well since it also stores ephemeral things like HN comment pages unless you tell it not to.

[1] https://github.com/asciimoo/hister/

I had a graphing calculator website that had 250K monthly active users, from the logs it seemed mostly schools' math classes in Latin America. It was running on a single AWS EC2 Classic.

Ironically, when I started working for AWS, I always felt threatened with sticks and never had space to maintain my own projects. When they deprecated EC2 Classic, my site went down. I didn't get time or mental space to migrate it.

Cest la vie I guess.

Print the digital things you want to last.

God forbid we have an AI-facilitated full Cyberpunk/.hack-style crash where everything gets wiped, the only things that will survive will be on paper. This is the recommendation I give my friends who are digital artists/writers; have a physical record of your efforts beyond what you want to sell.

This is on top of keeping your own digital archives. I'm still haunted by the deviantArt submission I didn't save. The creator took the piece down, then passed away a few years later. A Wayback Machine archive of his userpage with the piece as his featured upload still exists, but the image itself wasn't archived; it just shows a broken image.