In this tutorial, I will talk about Prometheus and Grafana. You will learn to install both on CentOS/RHEL and understand how to use Prometheus and Grafana
running a lemmy instance has learned me a lot about devops already!
I love playing around with this, the lemmy instance was a great reason. lemmyfly.org doesn’t have a lot of traffic yet, I think it can handle some more. Currently running on 2 vcpu/4gb ram.
After chatting to my devops colleague at work I wanted to set up a Grafana dashboard with metrics on the server.
Seems it’s pretty pretty doable!
I created a second server at my VPS. Very cheap, and don’t think I’ll be running the Prometheus/Grafana 24/7 so I’ll just create a snapshot of it, destroy the server and re-create when wanted
Created an internal private network so the instances can communicate without exposing ports to the public
log in to Grafana, admin:admin then change password
Go to the Grafana home dashboard, click on + sign and click on Import. In Import via grafana.com, put the dashboard id 1860 (preset for all prometheus node_exporter metrics) and click on Load.
Done!
Last 2 hours in the garden with a beer on the side, WFH FTW
actually I did delete the server (after creating a snapshot of it) a week or so ago. But this morning I wanted to check lemmyfly.org, couldn’t load the page. Checking my Hetzner dashboard I noticed CPU was spiked at 200%?! It did drop again though, but apparently had last for 2-3 minutes.
But prometheus was down, so no graphs apart from the hetzner ones. I doesn’t relate to network traffic spikes, so I don’t know what caused it.
I’ve started the prometheus server again (that snapshot was really useful :) ) and will leave it on for a couple of months now.
current system consumption:
I might need to get an extra volume for storage, Lemmy is starting to eat up the root filesystem…
Does anyone know how I re-configure Lemmy to look at a different volume for storage ?
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !selfhosted@lemmy.world
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.
Rules:
Be civil: we’re here to support and learn from one another. Insults won’t be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it’s not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don’t duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
Very cool! What’s bandwidth and system consumption been like so far?
actually I did delete the server (after creating a snapshot of it) a week or so ago. But this morning I wanted to check lemmyfly.org, couldn’t load the page. Checking my Hetzner dashboard I noticed CPU was spiked at 200%?! It did drop again though, but apparently had last for 2-3 minutes. But prometheus was down, so no graphs apart from the hetzner ones. I doesn’t relate to network traffic spikes, so I don’t know what caused it. I’ve started the prometheus server again (that snapshot was really useful :) ) and will leave it on for a couple of months now.
current system consumption:
I might need to get an extra volume for storage, Lemmy is starting to eat up the root filesystem… Does anyone know how I re-configure Lemmy to look at a different volume for storage ?