Top
Best
New

Posted by afilipovski 14 hours ago

Backups Aren't Simple(filipovski.net)
241 points | 145 commentspage 3
ryuuseijin 7 hours ago|
A bit of a tangent, but the linked rsnapshot tool is about 7k lines of perl code. The COPYING file is 20 years old and it's still maintained, the last change was 6 months ago. I'm feeling really old.

[1]: https://github.com/rsnapshot/rsnapshot/blob/master/rsnapshot...

geye1234 5 minutes ago|
Yes, rsnapshot is excellent, I'm glad the article mentioned it. I use it for my weekly backups. So wonderfully simple. I wish the config file weren't quite so strict about syntax, but I only need to change it about twice a decade so no big deal.
b3lvedere 2 hours ago||
"Also make sure not to run backups at 2AM or 3AM, or things may get scary."

I never though of daylight savings times causing such an issue. Learned something today.

999900000999 5 hours ago||
They are simple.

The issue is companies love to fire QA people who should be the ones testing these.

Microsoft says we don’t need no SDETs, our products can ship full of issues.

What are the hostages, I mean customers going to do about it?

I have no sympathy for any major corp who suffers data loss. Now individuals who lost grandmas wedding photos, that sucks.

But my recovery strategy for that is simple. After scanning I emailed it out to one cousin who emailed them out to a few more. Plus I have a cloud backup ( I have no idea where the the original files are).

Data is meant to be shared after all

bnegreve 7 hours ago||
I have a cron script that rsync my entire home directory every day with a remote server. Since rsync doesn't remove remote files, I re-create a backup from scratch the first day of each month and store a copy of the previous one.

Using old standardized open source tools means it survives system updates without having to fix anything for years. I got my laptop stolen/lost 3 times over the past 15 years, and I have always been able to restore everything the next day on a new laptop, in the time it takes to transfer the files over the network.

I haven't given much thought, I'm sure there is a realistic scenario where this strategy would fails but I haven't found it yet.

graemep 5 hours ago|
rsync can delete remote files with --delete or --delete-after

What is missing is recovering accidentally deleted or corrupted data.

wolfi1 7 hours ago||
concerning backups, when it comes to disaster recovery you need a strategy for restoring as well, sometimes it's not only the data you would need but the systems as well
innocent_name 11 hours ago||
>Motivated by our success in developing this solution, we try to use it to backup the homelab with its 10 Docker containers. But later we find out from logs on the individual machines that backups are failing. The reason being that many Docker containers like to create root-owned files, and if you’re not careful you can create a cronjob running as the default user.

and a privesc also.

afilipovski 3 hours ago||
The ideal setup is rootless Podman and having all your containers not even be able to create root-owned files.

It would also be great if services did their own database dumps. Immich does this and it's such a relief to just be able to copy over its volume for backup purposes.

Unfortunately we don't live in an ideal world and so much of the software both doesn't dump it's own databases, and is incapable of running in a rootless container.

If you weigh the probability of a privesc from your backup with full access to the volumes, against the probability that the software you run has a CVE, which one is worse?

This is one of those things I consciously chose to ignore in my setup. Maybe it will come back to bite me in the future, sure. Or maybe I will learn a better approach that pushes my frontier of convenience-security forward.

cvhc 10 hours ago||
Yeah it feels it can be risky to "make the backup also dump the databases, and give it full filesystem permissions on our Docker volumes", depending on what binaries get the root privileges.

What I do is having a minimal systemd timer under root that only calls restic for backing up files (with some additional systemd seucurity restrictions). App-dependent backup logics, like dumping databases, are done by user/container-level cronjobs separately.

mattbillenstein 4 hours ago||
Ran duplicity - it's really a blunt hammer, lots of duplication, rotation, etc.

Then switched to Restic - so much better - highly recommend this.

mrheosuper 9 hours ago||
As an average-techie person, the only piece of data that i truly practice 3-2-1 is photos and videos. 1 on my phone, 1 on my small server running Immich, and 1 is on Google Photo(sadly, the quality is loss, but i can live with that).

Most of other data i only have 2 backup, usually 1 at my local machine(code) and 1 online(github). Yeah it's not ideal, but another question to ask yourself, is it truly worth it. I trust the engineers at MS doing much better job at backing up their data than me.

dsego 7 hours ago|
I tried to set up something similar, photos and videos on local NAS + cloud storage. Also with data loss, eg. I don't sync any large RAW camera files to cloud. I clone my local machine with CCC onto an external drive, that way it should be easy to just restore the last state onto a new machine. So I think it's archival storage for media vs snapshots of your working setup so you can restore quickly.
bakinator 8 hours ago||
On the topic of backups, 7zip recently changed its handling of the FILE_ATTRIBUTE_ARCHIVE bit on unzipped files which caused an issue with some old software I was using. This is from the old DOS days with the BACKUP/RESTORE commands - the bit was set if any backup was made of the file. It's comically naive because it only assumes a single backup and this bit was forgotten to the sands of time until it was disturbed by some meddling kids!
overtone1000 6 hours ago|
+1 for restic.

ZFS snapshots + restic backups to backblaze for my homeserver. My secret sauce is a healtchecks.io instance that blows up my phone if ZFS scrubs throw any errors, when local snapshots fail, or when restic checks or backups fail.

More comments...