I just started getting into self hosting using docker compose and I wonder about possible backup solutions. I only have to safe my docker config so far, but I want host files as well. What software and hardware are you using for backup?
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.
Rules:
Be civil: we’re here to support and learn from one another. Insults won’t be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it’s not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don’t duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.
Resources:
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
I usually use HanBrake, MakeMKV, or DVDFab to copy bluray disc.
For app data, Borg as backup/restore software. Backup data is then stored on Hetzner as an offsite backup - super easy and cheap to setup. Also add healthchecks.io to get notified if a backup failed.
Edit: Backup docker compose files and other scripts (without API keys!!!) with git to GitHub.
At the moment I’m doing primarily hopes and prayers
Ah yes, the ostrich algorithm.
I had to upgrade to Hopes&Prayers+ after I ran out of hope and my prayers kept getting return to sender.
veeam is pretty simple and powerful, the community version is free if you are only using it for a small environment (CPU cores is what it counts)
I havn’t used it for docker but it says it is supported
I use Veeam to backup shares on my NAS to rotated external drives. I also backup a Linux server.
I use restic (and dejadup just to be safe) backing up to multiple cloud storage points. Among these cloud storage points are borgbase.com, backblaze b2 and Microsoft cloud.
I doubt your using NixOS so this config might seem useless but at its core it is a simple systemd timer service and bash scripting.
To convert this to another OS you will use cron to call the script at the time you want. Copy the part between script=“” and then change out variables like the location of where docker-compose is stored since its different on NixOS.
Let me explain the script. We start out by defining the backupDate variable, this will be the name of the zip file. As of now that variable would be 2023-07-12. We then go to each folder with a docker-compose.yml file and take it down. You could also replace down with stop if you don’t plan on updating each night like I do. I use rclone to connect to Dropbox but rclone supports many providers so check it out and see if it has the one you need. Lastly I use rclone to connect to my Dropbox and delete anything older than 7 days in the backup folder. If you end up going my route and get stuck let me know and I can help out. Good luck.
I host everything on Proxmox VM’s so I just take daily snapshots to my NAS
I use kup to back up my important PC files (the basic pre-installed backup software on KDE neon), which backs up to a separate drive on my PC, and that gets synced to my Nextcloud instance on my local server, and that - along with all the other data for my containers running on it - gets backed up by Kopia to DigitalOcean spaces.
I couldn’t recommend Kopia strongly enough, because you have such fine control of what gets backed up, when it gets backed up, how many to keep etc. and it is versioned so doesn’t grow exponentially, and it compresses and encrypts the backup. I also have a setup where it executes a script before and after the backup starts that stops and starts the containers to maintain file integrity since nothing will be writing to the files. And it’s also a Docker container so it can just fit into your current compose setup.
Someone on lemmy here suggested Restic, a backup solution written in Go.
I back up to an internal 4TB HDD every 30 minutes. My most important files are stored in an encrypted file storage online in the cloud.
Restic is good stuff.
Desktop: I was using Duplicati for years but I’ve recently switched to Restic directly to B2. I’m using this powershell script to run it.
Server: I’m also using restic to b2.
I also have a Qnap NAS. I’m synchronizing my replaceable data to crappy old seagate NAS locally. For the irreplaceable data that’s using the Qnap backup client to B2.
my 20 TB storage is currently hosted by Hetzner on a SMB Share with a acompanying server The storage is accessable via NFS/SMB i have a Windows 10 VPS running Backblaze Personal Backup for 7$/Month with unlimited storage while mounting the SMB share as a “Physical Drive” using Dokan because Backblaze B1 doesn’t allow backing up Network shares If your Storage is local you can use the win Backup Agent in a Docker container
At home I have a Synology NAS for backup of the local desktops. Offsite Backups are done with restic to Blackblaze B2 and to another location.
my solution is
syncthing
Backblaze B2. Any software that is S3 compatible can use B2 as the target and it’s reasonably priced for the service. I backup all the PCs and services to a Synology NAS and then backup that to B2 (everything except my Plex media, that would be pricy and it’s easy enough to re-rip from disc if needed).
I have an old synology DS1513+
it runs Active Backup for business and Active backup for google workspace, as well as an AFP share for Apple machines. This is about 95% of all backups. Those backup archive files are then ALSO backed up to one of two large 14TB hdds. I swap them out monthly (or thereabout) and keep the spare at my office or in my firesafe when at home.
I have a couple other things out there too. A small SSh box to handle some scripting of config file backups etc. My main synology 1815+ also has a cloud sync up to backblaze that happens in realtime, but only keeps 1 copy of stuff as well as a hyperbackup job for super important stuff up to Backblaze, in addition to the nightly backups to the 1513+. This way if my house burns down I still have something (and likely a full copy with the 14TB HDD)