Running services, network usage, memory usage, bandwidth, disk I/O, successful logins, whether the thing is even alive, etc…
So far my only method has been “hope and pray”.
How do you monitor your servers?
English
You must log in or register to comment.
- 4 days
I plan to perhaps, just maybe, I am not sure, to try self-hosting an email server. But I’ll need a good uptime.
Although I am really scared about security.- bertlewirth@lemmy.worldEnglish4 days
Well, it’s a good learning experience. But…… don’t. Good luck getting around the major email providers’ smart screen shit. It’s probably not gonna happen. I tried a few years ago, and even microslop couldn’t figure out why their shit screen crap wouldn’t allow my emails. It’s not in there best interest to fix it. So they don’t. But it’s worth doing it in the short term to learn how to do it. Teaches you about email, spf, dkim etc. which actually does translate to real world skills. I used what I learnt setting it up in my real life job.
- Dultas@lemmy.worldEnglish4 days
Yeah, email is one of the more annoying things to self host. Google rejects mine because my ISP has all their non static IPs on block lists (even though my IP hasn’t changed once since I’ve been with them it’s still not “static”, can’t change the reverse DNS) and I’m not paying 150% more a month for a business account to get a static IP. I ended up just using a free email relay. Still had to setup SPF, DKIM, DMARC, and all that jazz still.
- bertlewirth@lemmy.worldEnglish4 days
Yup. It’s so damn annoying hosting email. Do it once to learn, but don’t do it as a permanent solution. It takes so much maintenance to keep it going, if you even do get it working.
- InFerNo@lemmy.mlEnglish4 days
What maintenance do you mean? run OS updates and pay the vps bill. that’s true for any self hosted application. which specific maintenance are you referring to?
- frongt@lemmy.zipEnglish4 days
Setting up the newfangled security thing. TLS, DKIM, DMARC, SPF are the big ones over the years. Finding out you’ve been silently blackisted by a provider and hoping and praying they’ll answer your request to unblock. Managing your own spam filter.
- InFerNo@lemmy.mlEnglish4 days
Been running one for many years, mostly issue-free. Had to request whitelists way in the beginning, but things turned out ok.
Check out this super great guide. https://workaround.org/ispmail-trixie
4 daysI self-host my own email, have done so for years. I’ve not gotten pwned. Use an SSH key and a firewall, only expose the ports that should be public, have reasonable access controls, etc, just practise general cybersecurity—it applies to servers too.
I know everyone complains about hosting email. But I’ve not run into major problems. My emails get through spam filters and I have good uptime. It’s also a fun learning experience.
- NotEasyBeingGreen@slrpnk.netEnglish4 days
I think that you have to do quite a bit more setup on email than most other services. There’s SPF and DKIM and DMARC and so on. Plus spam filtering, setting up accounts and authentication, …
Plus email is arguably more important than anything else, since it’s kind of the lowest common denominator of the Internet; your dentist will probably send you an email to remind you of appointments, job offers will arrive via email, password resets arrive via email, and so on.
So it is a bit scary.
Having said that, as long as you’re not hosting from a residential IP addresses it is definitely achievable. You can start with one domain and use it for low-value purposes (or for accounts that allow multiple email addresses, like GitHub).
Yes, it can be a bit involved. I’d say I can spin up a mail server in 1–2 days though provided the OS is already installed and I have a domain name and port 25 isn’t blocked (that’s the main one that tends to be blocked). It may take longer for people who aren’t familiar with mail servers but it’s not some huge operation.
You can just try spinning up a mail server for fun. If it goes badly then just don’t move over your dentist appointments to it. It’s only critical infra if you use it for critical things, which you probably shouldn’t till it’s stable.
I have a robust monitoring system for my Jellyfin server, been running for the last few years. Checks in periodically, at least once per 24 hours and notifies me if it’s down. Doesn’t use any electricity, but does consume a good amount of Cheerios and mac & cheese.
- Scott@sh.itjust.worksEnglish5 days
Does this monitoring system also happen to be a dependent on your taxes?
Indirectly. But as another commenter pointed out, it balances out with the tax rebates.
- 4 days
I notice something stopped working, or someone in the household notices.
Then I go fix it.
And the best time to notice that the backups weren’t working is when you need access to the backup. 😅
- 4 days
Backups? In this economy?
But I need to get something working. I am about to move to VaultWarden and that makes me very nervous.
I run a vaultwarden container since forever and it’s really smooth. All updates went through just fine, never had an issue with it.
- curbstickle@anarchist.nexusEnglish5 days
Well I used to use VGA for my monitors, now its mostly displayport.
Seriously though, prom+Loki+alloy+a few other things to Grafana, with alerting in grafana.
- frongt@lemmy.zipEnglish5 days
I pay a group of schoolchildren to refresh a group of browser tabs and yell if anything isn’t responding.
There are plenty of previous threads with recent answers if you search.
- Magiilaro@feddit.orgEnglish3 days
I have the best detector for issues with my self hosted services: my wife!
- TheHive@feddit.orgEnglish4 days
I have a basic dashboard set up in my home assistant that I never check. Don’t even know how it works, I forgot. That’s why I really want to just put my whole setup in code. That’s why nothing is happening, the chore just seems so daunting.
So I listen for complains ringing through the house and react accordingly.
- lIlIlIlIlIlIl@lemmy.worldEnglish5 days
Uptime Kuma! For HDDs I have them report their “ping” as percentage full
- lIlIlIlIlIlIl@lemmy.worldEnglish4 days
Sure! In Uptime Kuma, add a monitor with type
Push. It gives you a URL with a unique token, and the monitor goes into “down” state if nothing calls that URL within the heartbeat interval. Then have a cron (or a systemd timer or whatever) run this on the machine with the drive every 5 or 10 minutes:use=$(df --output=pcent /mnt/yourdrive | tail -1 | tr -dc ‘0-9’) curl -fsS -G “http://your-kuma:3001/api/push/TOKEN --data-urlencode “status=up” --data-urlencode “msg=${use}% used” --data-urlencode “ping=${use}”Pingis of course meant to be response time, but Kuma will graph any number you toss in, so you get a “filled” chart for the drive. I also sendstatus=downonce usage passes a threshold. And if the box itself should fall over for some reason, the missing check-ins trigger the alert too.(I typed this quick on my phone, so please double-check and probably don’t blindly copy-paste)
- mr_jay@lemmy.zipEnglish3 days
I run UptimeKuma for monitoring a couple of things, but honestly, I’m pretty much my only user and my homelab is independent of the regular home network, so I don’t really care too much. I’ve been considering some simple log monitoring… when I get around to it :-)
- pHr34kY@lemmy.worldEnglish4 days
It’s running the private DNS for my phone. If it goes down, I realise quite quickly.
- dimjim@sh.itjust.worksEnglish4 days
My primary monitoring system is Beszel, but since I just migrated from VMs to LXCs it can’t properly see the memory/CPU usage, so it just checks for disk usage and liveliness. Home assistant with Proxmox & Dockhand integrations gives me the rest of my monitoring needs.
- sakphul@discuss.tchncs.deEnglish4 days
I am also using Beszel after using checkmk. For me checkmk was way too complicated (but is also way more powerfull) to setup and maintain propperly. So I switcheed to beszel because it is much easier and good enough for my use case which is:
- Is the thing running at all?
- Disk full?
- CPU, network, etc. on full throttle for some strange reason?
- send me a mail if somethings wrong
Besides that I don’t need anything. The only thing missing is SNMP support to check switches, routers and AP’s.
- 5 days
I use naemon (nagios fork) and grafana Loki Prometheus influxdb
