I used to rock a bare metal 1Tib HDD server for 17€/month, that I used as an NFS server for all my other servers which needed storage space.
First of all, NFS kinda sucks and I’m looking for alternative solution that I can use on OpenBSD to mount remote volumes.
Secondly, I’m planning to move this server to hetzner (my current provider), but they lack affordable storage (it’s 50€/month for 1Tib). Do you know an hosting provider which would provide high volumes for not so expensive prices ?
And here I am running NFS as the backing storage on an R720xd for 4 other M630 VM hosts.
Connected via SFP+ DAC. I get max bandwidth saturation, and ~65k IOPS!! NFS is great 😅
You could use things like AWS S3 or similar offerings from other providers like digitalocean. They have plenty of documentation that guide you through how they work.
My main issue with NFS is that it’s been unreliable in my case (multiple servers connected over wireguard, over internet). Which cause locks and latency for the applications that read/write to it (Matrix server, distributed repository, …).
Of course if you can afford connecting the NFS server directly to the servers, that’s perfect but I’m more on the worst case scenario ^^
I ise backblaze for backups already. But is an S3 backend any good for mounting locally and doing many read/write ? What are my options to mount it besides rclone ?
Google and dropbox are ~10€ a month for 2 TB. Idk is that solution for you, but I would consider building NAS at home. I mean…this is selfhosted channel :)
For backup I use backblaze, but thats cheap only if you dont download a lot, also not sure can it be used for your case. Sry, not rly helpful (:
I’m never going with Google/Dropbox ^^ the goal is to be in control of my data. Backblaze could be an option, but I expect too many read/writee for it to be cheap.
I considered the NAS at home but my home net is not reliable enough.
TBH I’m still looking for a better option to share storage between servers other than NFS. There has to be something better in 2023!
NFS kinda sucks and I’m looking for alternative solution
Rsync + cron? If you just need to backup some files/directories.
Edit: ah, saw that you will read/write a lot. Do you really need to do that over the network? Why not upload a .tar, a snapshot or whatever of the changes?
If you could be a bit more specific then maybe we could give some better advice.
Use a seedbox if you’re downloading stuff and dont have enough disk space.
The best example would be a running an email or chat server. The spool/media directories can go large pretty quick as users share pictures, gifs, … So I would like to mount it from a remote location because the matrix server itself only has a 20G SSD for the whole OS. Rsync won’t cut it there as I have a specific process writing to a location.
I’ll look more into FUSE based remote storage more generally because it seems to be my only option besides NFS. I’ve heard great feedback from SSHFS so I’ll bench it eventually and see how it goes.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !selfhosted@lemmy.world
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.
Rules:
Be civil: we’re here to support and learn from one another. Insults won’t be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it’s not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don’t duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.
Resources:
selfh.st Newsletter and index of selfhosted software and apps
I use Digital Ocean Spaces (S3 Bucket) costs $5 / 250 GB / month
How do you use them ? Do you mount the bucket locally on the server ?
deleted by creator
Well i just connect directly to bucket, You can mount it too
How do you mount it ?
I used s3fs:
https://www.nakivo.com/blog/mount-amazon-s3-as-a-drive-how-to-guide/
Ok thanks, so it’s similar to
rclone mount, just with another tool.And here I am running NFS as the backing storage on an R720xd for 4 other M630 VM hosts.
Connected via SFP+ DAC. I get max bandwidth saturation, and ~65k IOPS!! NFS is great 😅
You could use things like AWS S3 or similar offerings from other providers like digitalocean. They have plenty of documentation that guide you through how they work.
My main issue with NFS is that it’s been unreliable in my case (multiple servers connected over wireguard, over internet). Which cause locks and latency for the applications that read/write to it (Matrix server, distributed repository, …).
Of course if you can afford connecting the NFS server directly to the servers, that’s perfect but I’m more on the worst case scenario ^^
Time4vps will get you a full vps with a 1tb disk for ~50 euro/year. (Or ~ 5€/month if billed monthly)
I’ve had a couple of those for years, they’re ok but don’t expect stellar performance from the vps itself.
That’s cheap indeed. Is it possible to install a different OS than those listed on their website ?
Nope, the options I get are: AlmaLinux 8, CentOS 7, Debian 10-11, Ubuntu 14.04 - 22.04.
Hetzner has their storage boxes which are very cheap, might be an option.
Alternatively use an external S3 provider like Wasabi or Backblaze.
I ise backblaze for backups already. But is an S3 backend any good for mounting locally and doing many read/write ? What are my options to mount it besides rclone ?
Fuse
I didn’t know about their storage box. That’s interesting, thanks !
Google and dropbox are ~10€ a month for 2 TB. Idk is that solution for you, but I would consider building NAS at home. I mean…this is selfhosted channel :)
For backup I use backblaze, but thats cheap only if you dont download a lot, also not sure can it be used for your case. Sry, not rly helpful (:
I’m never going with Google/Dropbox ^^ the goal is to be in control of my data. Backblaze could be an option, but I expect too many read/writee for it to be cheap.
I considered the NAS at home but my home net is not reliable enough.
TBH I’m still looking for a better option to share storage between servers other than NFS. There has to be something better in 2023!
https://buyvm.net
Selfhosting storage is pretty good to, if you’re into that.
I’d like to avoid that as I don’t consider my home network reliable enough for such a critical task.
Understandable. Sadly, really reliable storage is pretty pricey.
Rsync + cron? If you just need to backup some files/directories.
Edit: ah, saw that you will read/write a lot. Do you really need to do that over the network? Why not upload a .tar, a snapshot or whatever of the changes?
If you could be a bit more specific then maybe we could give some better advice.
Use a seedbox if you’re downloading stuff and dont have enough disk space.
The best example would be a running an email or chat server. The spool/media directories can go large pretty quick as users share pictures, gifs, … So I would like to mount it from a remote location because the matrix server itself only has a 20G SSD for the whole OS. Rsync won’t cut it there as I have a specific process writing to a location.
Ah, I see.
Perhaps sshfs could be an alternative. Not sure of the performance out of the box, but it is possible to tweak a bit.
https://www.ports.to/path/sysutils/sshfs-fuse.html
I’ll look more into FUSE based remote storage more generally because it seems to be my only option besides NFS. I’ve heard great feedback from SSHFS so I’ll bench it eventually and see how it goes.