Hi! I’m looking for a good cloud storage provider for my backups. I will encrypt them locally and rclone them, so integration is important. I’ve been looking through reddit, and every single provider has something behind their ears (closes accounts, scans files, sketchy, blah blah blah), so I’m having a bit of an analysis paralysis.
Free tier would be ideal. I don’t need a lot of space, just a few GBs. Thanks :)
If you want something that works very well and is quite convenient, I can recommend the Scaleway S3 Glacier storage. If you only need a few GBs, it will only cost a couple of cents per month.
Backbone has an option where you can store the encryption key yourself if you don’t want others accessing your files. Of course, the usual caveats around being extra careful with that key apply.
I think 10GB of storage is free and then 6$ for 1TB. There is also a cost if you want to download backup, but its free for 3x of the data stored. Amazing for backups
I forget how truenas does it but I moved to restic which calculates changes locally then uploads the changed bits making it easily doable daily without extra charges.
Yeah I saw that, but not sure how it works in detail tbh. Anyway, I had 10GB that increased to 200GB recently and it cost me 2$ since April this year. That was for storage and few downloads to test bckups. I trck the cost and so far Im happy
I use onedrive because you can get like 6TB of space included with Office for like $99/year. Second choice would be backblaze.
Out of curiosity, as someone thinking about starting a cloud/hosting provider, what features would make a huge difference to you beyond price? I do plan to have some pretty amazing pricing for individuals/small businesses, but beyond that….
Full rclone/kopia/restic/borg/etc compatibility, down to 2FA (thing that Mega lacks on unfortunately), encryption, someone could probably use versioning. As long as it’s private and easy to use and understand :)
Hetzner Storage Box and rsync.net are the best because can work like a normal storage, super simple. Hetzner is cheaper while rsync.net have better managment (no-javascript panel, normal 22 port, normal installation of ssh keys).
AWS S3 has a free tier that covers the first 5Gb. I recommend it because the AWS cli is excellent, and gives you lots of options for how to sync your data. The pricing is $0.023/GB/month after the free tier. It can be overwhelming to get into AWS but it is worth it to have access to the ultimate IT service swiss army knife.
It’s complicated. I gave the most expensive pricing, which is their fastest tier and includes stripping across three availability zones and guarantees 11 nines of data durability. Additionally, the easy integration with all other AWS services and the feature richness of S3 buckets makes it hard to do a fair apple to apple comparison unless you really have well defined needs. So I gave the highest price to keep it simple, and for someone who says they just have a few GB, any cost should be trivial.
How much is their cheapest glacier tier? Seems complicated to calculate, seems there’s some relation to s3 storage or I’m just missing something? Haven’t looked that closely.
So you just asked the most confusing thing about AWS service names due to how names changed over time.
Before S3 had an archival tier, there existed a separate service that AWS named AWS Glacier Storage, and then renamed to AWS S3 Glacier.
Around 2012 AWS started adding tiers to S3 which made the standalone service redundant. I received you look at S3 proper unless you have something like a Synology that can directly integrate with the older job based API used by the original glacier service.
So, let’s say I have a 1TB archival file, single tarball, and I upload it to a brand new S3 bucket, without version, special features, etc, except it has a life cycle policy to move objects from S3 standard to S3 Glacier instant access after 0 days. So effectively, I upload the file and it moves to Glacier class storage.
The S3 standard is ~$24/tb/month, and lets say worst case scenario our data sits on standard for one whole day before moving.
$0.77+$0.005 (API cost of the put)
Then there is the lifecycle charge to move the data from standard to glacier, with one request per object each way. Since we only have one object the cost is
$0.004 out of standard
$0.02 into glacier
The cost of glacier instant tier is $4.1/tb/month. Since we would be there all but one day, the cost on the first bill would be:
$3.95
The second month onwards you would pay just the $4.1/month unless you are constantly adding or removing.
Let’s say six months later you download your 1tb archive file. That would incur a cost of up to $30.
Now I know that seems complicated and expensive. It is, because it is providing services to me in my former role as director of engineering, with complex needs and budgets to pay for stuff. It doesn’t make sense as a large-scale backup of personal data, unless you also want to leverage other AWS services, or you are truly just dumping the data away and will likely never need to retrieve it.
S3 is great for complying with HIPAA, feeding data into a cdn, and generally dumping data around in performant way. I’ve literally dropped a petabyte off data into S3 and it just took it and did its thing.
In my personal AWS account I use S3 as a place to dump cache contents built by lambda functions and served up by API gateway. Doing stuff like that is super cheap. I also use private git repos (code commit), private container registry (ecr), and container host (ECS), and it is nice have all of that stuff just click together.
For backing up my personal computer, I use iDrive personal and OneDrive, where I don’t have to worry about the cost per object, etc. iDrive (not an Apple service) let’s you backup multiple devices to their platform and keeps them versioned.
Anyway, happy to help answer questions. Have a great day.
Wow. Thank you for that incredibly detailed explanation!!
It does sound like though that it is POTENTIALLY cheaper than something like B2, but also much easier to misconfigure and end up in a more expensive tier.
Seems to me unless you have a reason to use Amazon storage or already have something using it, using it for backup isn’t the best idea.
That’s a good takeaway. AWS is the ultimate Swiss army knife, but it is easy to misconfigure. Personally, when you are first learning AWS, I wouldn’t put more data in then you are willing to pay for on the most expensive tier. AWS also gives you options to set price alerts, so if you do start playing with it, spend the time to set cost alerts so you know when something is going awry.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !selfhosted@lemmy.world
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.
Rules:
Be civil: we’re here to support and learn from one another. Insults won’t be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it’s not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don’t duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
If you want something that works very well and is quite convenient, I can recommend the Scaleway S3 Glacier storage. If you only need a few GBs, it will only cost a couple of cents per month.
Don’t hate me because I’m using Google Cloud Platform buckets…
I use AWS S3 🤷
i honestly am in love with cubbit.io
I hate when no pricing is published.
true, in case of cubbit is a bad move…italians…cant help it…anyway, their services are worth each cent
I’m always suspicious of a service that doesn’t publish fees/costs up front.
Sure, they have a trial. But with no idea what the costs are like, I’m not wasting my time with testing or requesting a quote.
I despise these kinds of sales tactics.
Backblaze b2 and rsync.net (which shouldn’t be a problem for rclone)
Neither is sketchy in the slightest and run solid services with many options.
I’m using backblaze. I use truenas. I encrypt before send. Not sure about a free tier but I think I’m using a couple terabytes
Backbone has an option where you can store the encryption key yourself if you don’t want others accessing your files. Of course, the usual caveats around being extra careful with that key apply.
I think 10GB of storage is free and then 6$ for 1TB. There is also a cost if you want to download backup, but its free for 3x of the data stored. Amazing for backups
Note- there is also a charge for calls per day.
https://www.backblaze.com/cloud-storage/transaction-pricing
I forget how truenas does it but I moved to restic which calculates changes locally then uploads the changed bits making it easily doable daily without extra charges.
Yeah I saw that, but not sure how it works in detail tbh. Anyway, I had 10GB that increased to 200GB recently and it cost me 2$ since April this year. That was for storage and few downloads to test bckups. I trck the cost and so far Im happy
Hetzner storage box
i’ve been trialing wasabi.com and switched to a paid plan recently, 1TB for $7 with no egress fees using daily restic snapshots btw
I’ve heard good things about https://www.tarsnap.com/ and https://www.rsync.net/
I use onedrive because you can get like 6TB of space included with Office for like $99/year. Second choice would be backblaze.
Out of curiosity, as someone thinking about starting a cloud/hosting provider, what features would make a huge difference to you beyond price? I do plan to have some pretty amazing pricing for individuals/small businesses, but beyond that….
Full rclone/kopia/restic/borg/etc compatibility, down to 2FA (thing that Mega lacks on unfortunately), encryption, someone could probably use versioning. As long as it’s private and easy to use and understand :)
Why rclone? S3 sync the files on a schedule, enable versioning for immutability and encrypt at the bucket level.
If you’re encrypting locally, a free Nextcloud provider would probably do the trick. Use one in Europe for better privacy rights.
Hetzner Storage Box and rsync.net are the best because can work like a normal storage, super simple. Hetzner is cheaper while rsync.net have better managment (no-javascript panel, normal 22 port, normal installation of ssh keys).
Iam using it exactly like op eants. it works great and is cheap
I’ve been using Hetzner with borg for a while now and it’s been super solid, can’t be beaten price wise either as far as I’ve looked
Hetzner storage boxes look really compelling. Thanks for sharing!
AWS S3 has a free tier that covers the first 5Gb. I recommend it because the AWS cli is excellent, and gives you lots of options for how to sync your data. The pricing is $0.023/GB/month after the free tier. It can be overwhelming to get into AWS but it is worth it to have access to the ultimate IT service swiss army knife.
Wow, $24/TB? That’s 4x the cost of Backblaze B2? (Am I doing that math right?)
It’s complicated. I gave the most expensive pricing, which is their fastest tier and includes stripping across three availability zones and guarantees 11 nines of data durability. Additionally, the easy integration with all other AWS services and the feature richness of S3 buckets makes it hard to do a fair apple to apple comparison unless you really have well defined needs. So I gave the highest price to keep it simple, and for someone who says they just have a few GB, any cost should be trivial.
How much is their cheapest glacier tier? Seems complicated to calculate, seems there’s some relation to s3 storage or I’m just missing something? Haven’t looked that closely.
So you just asked the most confusing thing about AWS service names due to how names changed over time.
Before S3 had an archival tier, there existed a separate service that AWS named AWS Glacier Storage, and then renamed to AWS S3 Glacier.
Around 2012 AWS started adding tiers to S3 which made the standalone service redundant. I received you look at S3 proper unless you have something like a Synology that can directly integrate with the older job based API used by the original glacier service.
So, let’s say I have a 1TB archival file, single tarball, and I upload it to a brand new S3 bucket, without version, special features, etc, except it has a life cycle policy to move objects from S3 standard to S3 Glacier instant access after 0 days. So effectively, I upload the file and it moves to Glacier class storage.
The S3 standard is ~$24/tb/month, and lets say worst case scenario our data sits on standard for one whole day before moving.
$0.77+$0.005 (API cost of the put)
Then there is the lifecycle charge to move the data from standard to glacier, with one request per object each way. Since we only have one object the cost is
$0.004 out of standard
$0.02 into glacier
The cost of glacier instant tier is $4.1/tb/month. Since we would be there all but one day, the cost on the first bill would be:
$3.95
The second month onwards you would pay just the $4.1/month unless you are constantly adding or removing.
Let’s say six months later you download your 1tb archive file. That would incur a cost of up to $30.
Now I know that seems complicated and expensive. It is, because it is providing services to me in my former role as director of engineering, with complex needs and budgets to pay for stuff. It doesn’t make sense as a large-scale backup of personal data, unless you also want to leverage other AWS services, or you are truly just dumping the data away and will likely never need to retrieve it.
S3 is great for complying with HIPAA, feeding data into a cdn, and generally dumping data around in performant way. I’ve literally dropped a petabyte off data into S3 and it just took it and did its thing.
In my personal AWS account I use S3 as a place to dump cache contents built by lambda functions and served up by API gateway. Doing stuff like that is super cheap. I also use private git repos (code commit), private container registry (ecr), and container host (ECS), and it is nice have all of that stuff just click together.
For backing up my personal computer, I use iDrive personal and OneDrive, where I don’t have to worry about the cost per object, etc. iDrive (not an Apple service) let’s you backup multiple devices to their platform and keeps them versioned.
Anyway, happy to help answer questions. Have a great day.
Wow. Thank you for that incredibly detailed explanation!!
It does sound like though that it is POTENTIALLY cheaper than something like B2, but also much easier to misconfigure and end up in a more expensive tier.
Seems to me unless you have a reason to use Amazon storage or already have something using it, using it for backup isn’t the best idea.
That’s a good takeaway. AWS is the ultimate Swiss army knife, but it is easy to misconfigure. Personally, when you are first learning AWS, I wouldn’t put more data in then you are willing to pay for on the most expensive tier. AWS also gives you options to set price alerts, so if you do start playing with it, spend the time to set cost alerts so you know when something is going awry.
Have a great day!
Quite happy with borgbase
Same here! 10gb free is more than enough for the volumes I mount on my containers with config, etc
That’s on my todo list. So far backing up several machines, including some from my family.
Backblaze will only charge you for what you use. So 1TB is $6 per month, but 500GB is $3
Yep, I went with Backblaze and Mega as secondary.