I have 3 servers:
- my house
- my sister house
- my parents house
My server has a lot of services (Nextcloud and Immich the ones that use more space), the other 2 servers only have Home Assistant, Frigate and some shared folders. On my server I use Backrest to backup locally and on Wasabi, the other 2…well…are not backed up 🙈 …yet!
I was thinking to buy a couple of 14/20TB drives and install them in my parents and sister servers so that each server can backup data on the other 2. The backup will be done locally on all the servers with Backrest. How do I copy the backups across servers? Should I use Syncthing or is it better to use one repository per location on each Backrest? Or…other ideas?
Thanks!
You must log in or register to comment.
I ended up using rsync to do my backups. I have a laptop, an Android phone with Termux, a HomeAssistant docker image on a Raspberry Pi 4 and a home PieFed instance on a Raspberry Pi 5.
Each RPi board will create a complete backup on it’s on storage. I’ll then make a copy of each backup to my laptop. And finally another copy from my laptop to an external usb storage device. I also made a specific folder on my Android phone for the purpose of syncing with my laptop.
What I like about rsync is that it can be made to only transfer any changed files and not everything each time.
Since I use docker images on both my RPi boards, I made a script that shuts down all the containers before make a backup copy and finally starting the containers again. I even made a script to do something similar to restore from the saved backup.
Took a lot of trail and error to get them working but I am pretty happy with it. I have the scripts here if anyone is interested. I labelled what I did but didn’t really leave comments explaining things. They are pretty simple anyways.
I could have used rsnapshot but learning how to use rsync has been interesting enough to me.
I went a little crazy and setup my own wireguard VPN network, all the remote hosts connect to the VPN and the primary server connects to each of them and pushes backups. Because I use btrfs and lots of snapshots I use btrbk, annoying to setup but now my hourly snapshots get pushed everywhere, minimal bandwidth and it flawlessly has worked for years.
I like borg with rsync.
Configure and Pre backup the drives before bringing them to family members to save yourself some bandwidth
Definitely a good suggestion!
As for the other question in thr post: If you are using btrfs or zfs I believe both of those have a send function that operates at a block level and will only send block changes rather than full file changes
I have an offsite NAS where I run the Restic REST server as a docker container. I connect to it over Nebula but you could also use a traditional VPN, Tailscale, Headscale, Pangolin or whatever.
Works like a charm.
Tailscale+Headscale or Zerotier, use whatever backup software you want for the local backups. Simple script to rsync backups to other sites and remove copies past a certain age.
Pretty simple, and no need to expose machines in any less than safe ways.
Why Tailscale AND Headscale? Arent’t they the same thing?
Tailscale is both a client and server. If you use only Tailscale, you have to pay for the service after so many devices are connected, which by all means support the company and do so and avoid using Headscale.
Headscale is an open source implementation of the Tailscale service, so it’s free to use with all the usual Tailscale clients published. You setup Headscale somewhere, register your Tailscale clients to it, and use it like usual. It’s just skipping the need to pay for Tailscale servers as a service, and gives you greater control over how traffic routed. Completely optional.
Yeah but it’s like 100 devices, I think. And I believe 3 users (meaning under one account; sharing a device with someone who makes their own account doesn’t count as a “user”). You’re right, but they’re pretty generous.
I don’t think it takes many resources to provide the service to consumers; it’s not like you’re using any of their bandwidth (minus the tiny amount used for coordination between clients). Oh, or if you use their DERP servers (encrypted, but still).
In general, people should know there are self hosted, truly private options, though. So thanks for mentioning Headscale.
I’d do it like this:
-
borg backup
-
(optional) borgmatic for easier use, but a diy shell script might suffice
-
(optional) https://github.com/Ravinou/borgwarehouse for easier gui based “serverside” setup on each location
-
(if you have no way to reach the servers from the internet yet) set up dyndns for each location so you can reach them by domain
-
might need to setup portforwarding rules in the router of each location
Didn’t know about borg warehouse. Thanks for the heads up!
-
I use sync thing with untrusted keys. That way the data ends up in multiple locations but it’s not accessible remotely. If you don’t care about the data and the locations you don’t have to do that but it’s a nice feature.
You don’t want to send as that’s means that an adversary can delete the backups.
Make each one do a pull instead.
Huh?
Configure each backup machine to read from the data you are backing up
You can do it that way, but I don’t see how that’s more secure. Fewer server bits to maintain I guess?
I think what he means is that if your backup is triggered from your main server and your main server is compromised the backups can also be attacked immediately. If the backup is requested from the backup machine you will at least have the time between the attack and the next backup to prevent the attack from reaching your backup machines.
I’m sorry, but I still don’t understand what you mean. Could you please elaborate bit? Thanks!
You configure the backup systems to connect to the device to be backed up. The idea is if something bad happens on the main machine it won’t impact the backups
Got it, good idea, thanks!
I use rsync for a similar system. One of the nice things is that you can set a bandwidth limit so that it doesn’t saturate your family’s internet connections.
