Here is the thing, I have 4 RPi’s of different generations (all the way from Zero W to 4B 4GB) that I use to host services at home for personal use.
Lately, I have realized I am running out of RAM to host more services, not to mention not enough switch ports to connect to.
Now I know the obvious solution is to get a more powerful setup (maybe a thin client) but electricity isn’t cheap and I am not particularly in the best shape financially speaking to shell out $300+ on a decent client to host my services.
I use a quartz64 from pine. Back when it came out it was beefier than the rpi4. With the 5 that has now changed but it still is a great little machine.
My instance runs on it aswell as my other webservices (A Homepage, cgit instance and a small blog). Handles everything really well with the 8GiB of RAM.
Setup is a bit of a pain, especially because I had the urge to run gentoo on it. Compile times are actually acceptable.
It costs 80 bucks, which is really acceptable.
Edit: Forgot to mention energy efficiancy, ARM is unbeaten by x86 in that department. People on here recommend old PCs a lot, which, depending on your local energy prices could quiet quickly void the savings made by buying it.
Also it has a SATA port, which requires some tinkering with the Devicetree to get running but allowed me to use an old 1TB SSD i had in the house.
The Quartz64 is good but to slow to do anything to complicated. You can pickup minipcs for the same price that will have way more performance but will still draw only a few watts.
I’m not super into the whole sphere here. But as you mentioned the Pi I thought I might chime in. I just ordered a Pi 5, 8GB RAM and 2-3x effective speed of the Pi 4.
I’d youre looking for more powerful hardware in this format the Rockx 5 and Orange Pi 5 are alternatives that go up to 16GB RAM.
I had budget to try xeon d soc motherboard for a smal itx case. Put 64gb ecc ram into it but could hold 128gb.
That server will be 8 yo this year. That particular supermicro mb was ment for some oem routerlike 64_86x with 10g ports and remote management.
I’m not sure if intel or amd have any cpus in that segment anymore, but it’s very light on wattage if mostly idle/maintaining vms.
One option I’m looking at is to get a dedicated hetzner server, even the auction and lowest grade ‘new’ offerings are pretty good for the price if you account for energy costs and upfront gear cost.
If you don’t already use it, zram swap is great for providing a little bit extra oomph. If your server doesn’t have a lot of compressed data in memory, it can literally more than double your effective ram.
Can you please explain to me the difference? How does a swapdisk compare to RAM? I don’t mind googling it but I highly doubt I’ll get a straightforward ELI5 style answer from there.
I would really appreciate it if you can elaborate, if you have the time that is.
There are two types of computer memory that fundamentally matter on the consumer level:
memory, as in RAM, which is like short-term memory in people, or how much you can think about at once. It is blanked when the computer restarts. It is very fast.
drive storage, as in hdd or ssd space. This is like long-term memory or overall knowledge capacity, and persists across boots. It is comparatively slow.
Solid state disk storage, and in particular some SD cards, can be vulnerable to excessive writes.
Ram, however, is not impacted by the number of uses.
A swap file works like this:
When memory gets full, you move the least-used parts onto the swap file.
A normal swapfile is on-disk. When memory gets close to full, the system moves some onto the (much much slower, like 10-1000x) on-disk swapfile.
Zram swap creates a compressed swapfile out of your free memory. A file in linux does not have to be on a hard disk/ssd, it just has to look and quack like a file. When memory gets close to full, the system copies some onto the in-memory compressed file. This is very fast, but uses some cpu. It doesn’t touch your drive storage.
Get a mini pc. If you can find a cheap intel NUC on ebay for example. Way more power in a compact form that doesn’t draw that much more power than a rpi… much less four of them.
Or even a thinkcentre, I got mine for less than $300 with 36gb ram, 1tb nvme ssd, and es i9
It was even closer to $200, and I had a plan to make a cluster out of these, but one this thing is powerful enough to do like anything, so I dropped the idea
Edit: also, about the power consumption, it’s very similar to rpi5 and at the same time can do so much stuff
I upgraded my Plex and *arr server (i3 nuc) with a beelink 12i N100 based mini pc and could not be happier. $167 with 512gb nvme and 16gb RAM. It pulls 6W peak power
Base os is Ubuntu, Plex Media server is installed via apt from Plex repo, *arr services (lidarr, sonarr, radarr, bazaar, sabnzbd) all run on containers which I manage in a docker compose file. Media storage is an external, 4 bay SATA enclosure attached via USB. 4 six terrabyte disk drives in raid 6 on lvm/md, plus a 4tb SSD which is stand alone storage, formatted as btrfs.
With hardware support enabled it can live transcode four 1080p streams, which my old NUC (5th Gen i3) could also do. The GPU on the NUC could not handle 4k, so it would fall back to using the CPU which would not keep up with a live stream.
The N100 can transcode one 4k HDR with Atmos 7.1 audio and stream in real time. It was just a test, there was a bit of a stutter as it settled in, but I think that might be due to the drive enclosure being connected via USB, so it was storage bandwidth rather than CPU/GPU. The USB ports on the computer are 3.2 gen 2, but the enclosure is only 3.0 at 5Gb/s.
You can use it as a firewall/router or a VPN gateway and even slap a wireless NIC or two on there and make it a combo router/AP, which can simultaneously play and transcode video as a Plex/Jellyfin server with zero hit to networking performance.
I’ve heard good things about used/refurb HP (elite desk and pro desk) and Lenovo (m700 and m900) mini-pcs. A quick search shows they’re going for ~120-140$ for a quad core with 16 gigs of memory.
That’s what I’ve literally just traded up to from a Pi. Prodesk 600 G3 comes standard with a 6 core i5 8500, has 4 full size ram slots, an m2 ssd slot and has a mount for 3.5” hdd, all drawing only 65w.
There’s a low profile one as well but then you’re stuck with sodimm, no space for a full size hdd and no pci-e slots.
I picked it up second hand for NZD 100 so I imagine it would be even cheaper in the states.
Do prefer the Elite Desk though. The Pro only has one drive bay, so you’d have to use an adaptor to use the slim optical bay for a 2.5" drive. The Elite has 2x 3.5" bays and one 2.5" bay plus an NVMe slot so you can build a decent starter NAS. It’s also got 4 DIMM slots for up to 64 GB of memory and if you get a 7th gen Intel with it, it’ll have hardware accelerated transcoding.
There’s the Orange Pi 5 Plus if you want something really energy efficient. It has 16GB of RAM, an 8 core CPU, dual 2.5G ethernet, and it can use an M.2 2280 SSD. It looks like there’s going to be a 32GB version, but it’s not available yet.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !selfhosted@lemmy.world
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.
Rules:
Be civil: we’re here to support and learn from one another. Insults won’t be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it’s not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don’t duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
I use a quartz64 from pine. Back when it came out it was beefier than the rpi4. With the 5 that has now changed but it still is a great little machine.
My instance runs on it aswell as my other webservices (A Homepage, cgit instance and a small blog). Handles everything really well with the 8GiB of RAM.
Setup is a bit of a pain, especially because I had the urge to run gentoo on it. Compile times are actually acceptable.
It costs 80 bucks, which is really acceptable.
Edit: Forgot to mention energy efficiancy, ARM is unbeaten by x86 in that department. People on here recommend old PCs a lot, which, depending on your local energy prices could quiet quickly void the savings made by buying it. Also it has a SATA port, which requires some tinkering with the Devicetree to get running but allowed me to use an old 1TB SSD i had in the house.
The Quartz64 is good but to slow to do anything to complicated. You can pickup minipcs for the same price that will have way more performance but will still draw only a few watts.
Minisforum makes good basic SFF PCs for super cheap.
Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:
10 acronyms in this thread; the most compressed thread commented on today has 4 acronyms.
[Thread #515 for this sub, first seen 15th Feb 2024, 04:55] [FAQ] [Full list] [Contact] [Source code]
I had Plex in my name first!
Lol 😂
I’m not super into the whole sphere here. But as you mentioned the Pi I thought I might chime in. I just ordered a Pi 5, 8GB RAM and 2-3x effective speed of the Pi 4.
I’d youre looking for more powerful hardware in this format the Rockx 5 and Orange Pi 5 are alternatives that go up to 16GB RAM.
Those are all arm though
I had budget to try xeon d soc motherboard for a smal itx case. Put 64gb ecc ram into it but could hold 128gb. That server will be 8 yo this year. That particular supermicro mb was ment for some oem routerlike 64_86x with 10g ports and remote management. I’m not sure if intel or amd have any cpus in that segment anymore, but it’s very light on wattage if mostly idle/maintaining vms.
One option I’m looking at is to get a dedicated hetzner server, even the auction and lowest grade ‘new’ offerings are pretty good for the price if you account for energy costs and upfront gear cost.
I use an oracle free tier server for my heavy lifting (wordpress and owncloud), and have a pi4 on my fibre optic connection which is my storage.
Get a cheap SFF desktop, slap some cheap RAM in it and run KVM. It’ll be 10X better than a fleet of Pi’s.
If you don’t already use it, zram swap is great for providing a little bit extra oomph. If your server doesn’t have a lot of compressed data in memory, it can literally more than double your effective ram.
Doesn’t swap reduce the lifespan of storage though?
Zram swap is basically this: Turn all of your free ram into a swapdisk. Compress all access to that swapdisk.
So, it’s not using you storage, buy your memory. Most stuff in memory is usually highly uncompressed - so it compresses really well.
Instead of getting the additional space from disk, it’s getting it from compression.
Can you please explain to me the difference? How does a swapdisk compare to RAM? I don’t mind googling it but I highly doubt I’ll get a straightforward ELI5 style answer from there.
I would really appreciate it if you can elaborate, if you have the time that is.
Thank you.
Basically zram is compression inside ram
There are two types of computer memory that fundamentally matter on the consumer level:
Solid state disk storage, and in particular some SD cards, can be vulnerable to excessive writes.
Ram, however, is not impacted by the number of uses.
A swap file works like this: When memory gets full, you move the least-used parts onto the swap file.
A normal swapfile is on-disk. When memory gets close to full, the system moves some onto the (much much slower, like 10-1000x) on-disk swapfile.
Zram swap creates a compressed swapfile out of your free memory. A file in linux does not have to be on a hard disk/ssd, it just has to look and quack like a file. When memory gets close to full, the system copies some onto the in-memory compressed file. This is very fast, but uses some cpu. It doesn’t touch your drive storage.
That is a great explanation. It makes perfect sense to me know. Thank you
It just compresses your ram contents so you can fit more stuff in memory at once
Get a mini pc. If you can find a cheap intel NUC on ebay for example. Way more power in a compact form that doesn’t draw that much more power than a rpi… much less four of them.
Or even a thinkcentre, I got mine for less than $300 with 36gb ram, 1tb nvme ssd, and es i9
It was even closer to $200, and I had a plan to make a cluster out of these, but one this thing is powerful enough to do like anything, so I dropped the idea
Edit: also, about the power consumption, it’s very similar to rpi5 and at the same time can do so much stuff
Your best option would probably be to buy a refurbished office PC that has at least 16 gb of RAM.
Something like this:
https://www.amazon.com/dp/B08GCX4JKJ
That way you get a bunch of memory in a decent system for cheap, and you’re only using up one port on your switch.
But any old PC that is x86. Even if it second hand/refurbished (as long as it’s a branded pc Like HP, Levono).
I upgraded my Plex and *arr server (i3 nuc) with a beelink 12i N100 based mini pc and could not be happier. $167 with 512gb nvme and 16gb RAM. It pulls 6W peak power
Hi! Could you please indicate how you manage the system on the beelink? Base OS, how you deal with storage , containers or VMs?
Thanks in advance!!!
Base os is Ubuntu, Plex Media server is installed via apt from Plex repo, *arr services (lidarr, sonarr, radarr, bazaar, sabnzbd) all run on containers which I manage in a docker compose file. Media storage is an external, 4 bay SATA enclosure attached via USB. 4 six terrabyte disk drives in raid 6 on lvm/md, plus a 4tb SSD which is stand alone storage, formatted as btrfs.
Is Plex doing any transcoding? That 6w peak is Pi Zero territory! Wow.
With hardware support enabled it can live transcode four 1080p streams, which my old NUC (5th Gen i3) could also do. The GPU on the NUC could not handle 4k, so it would fall back to using the CPU which would not keep up with a live stream.
The N100 can transcode one 4k HDR with Atmos 7.1 audio and stream in real time. It was just a test, there was a bit of a stutter as it settled in, but I think that might be due to the drive enclosure being connected via USB, so it was storage bandwidth rather than CPU/GPU. The USB ports on the computer are 3.2 gen 2, but the enclosure is only 3.0 at 5Gb/s.
It’s a 6W TDP CPU, but not 6W for power consumption.
At full tilt it’ll be about 25-30W, but typically it’s around 10W for me.
Ah, that makes a lot more sense.
Was wondering what magic was happening to get 6w peak.
Still, 30w peak is pretty nice, especially if you’re idling at 10w.
Hardware transcoding is highly efficient. The downside is sometimes it introduces artifacting in low resolution live TV.
With Intel QSV enabled it should be able to transcode like 4-6 1080p streams IIRC. Quicksync is very impressive hardware acceleration.
Where do people find equipment this cheap? Ya’ll are mind blowing with your ability to score things for such low prices.
Any links?
I’ll recommend the EQ12 instead. Comes with DDR5 and 2x2.5Gb NICs. When on sale it’s ~$200.
I’ve been doing computer stuff for a long time and now I have a really dumb question… what’s the benefit of 2x NICs?
In case you don’t have a 2.5gb switch and you daisy chain to a NAS or something?
You can use it as a firewall/router or a VPN gateway and even slap a wireless NIC or two on there and make it a combo router/AP, which can simultaneously play and transcode video as a Plex/Jellyfin server with zero hit to networking performance.
Well I’m no network engineer either but I think the most common use is a VLAN but I believe you can also just connect both to get 5Gb/s.
Exactly my setup. 2x EQ12 with 32 GB RAM and a standalone network for my Proxmox Cluster. Nice little things.
It looks like it regularly goes on sale that cheap on Amazon, at least in my region:
https://camelcamelcamel.com/product/B0BVFS94J5
I’ve heard good things about used/refurb HP (elite desk and pro desk) and Lenovo (m700 and m900) mini-pcs. A quick search shows they’re going for ~120-140$ for a quad core with 16 gigs of memory.
That’s what I’ve literally just traded up to from a Pi. Prodesk 600 G3 comes standard with a 6 core i5 8500, has 4 full size ram slots, an m2 ssd slot and has a mount for 3.5” hdd, all drawing only 65w.
There’s a low profile one as well but then you’re stuck with sodimm, no space for a full size hdd and no pci-e slots.
I picked it up second hand for NZD 100 so I imagine it would be even cheaper in the states.
I’ve been looking all over for something in that price range, where did you find them for those prices?
Do prefer the Elite Desk though. The Pro only has one drive bay, so you’d have to use an adaptor to use the slim optical bay for a 2.5" drive. The Elite has 2x 3.5" bays and one 2.5" bay plus an NVMe slot so you can build a decent starter NAS. It’s also got 4 DIMM slots for up to 64 GB of memory and if you get a 7th gen Intel with it, it’ll have hardware accelerated transcoding.
Most of my services use a network mounted drive so storage isn’t really a factor (although the more the merrier of course).
My main bottleneck is computation power.
In that case a SFF would be better than either. There are great deals in the used market.
If you are fine with the slim: US amazon.
Bruh, I love you.
Ebay. Or whatever is your preferred local classified app.
Thank you
I use a N100 Mini PC. They’re very popular for this purpose these days. Mine has 16GB DDR5.
Wait, the N100 supports DDR5?
4 and 5, yes. But only single channel (arbitrary Intel limitation).
There’s the Orange Pi 5 Plus if you want something really energy efficient. It has 16GB of RAM, an 8 core CPU, dual 2.5G ethernet, and it can use an M.2 2280 SSD. It looks like there’s going to be a 32GB version, but it’s not available yet.
That looks very sexy, what’s the price range on those?
The 16GB version is around $160 US with a 256GB eMMC module and case.
At this price point, why are RPi’s even a thing? Wow!
Established ecosystem, I’d guess. Also brand recognition. I mean, you can tell that this one is also called “some fruit name” PI, for good reason.
Valid point, I see where you are coming from.
More and more people are asking that question every day. Especially with the company going public.