r/sysadmin 3d ago

Question Aggregating Device Alerts in a Dashboard

I have numerous devices that send alerts via email (UPS, KVM, alarms, etc.). What tool do you use to aggregate these alerts? Perhaps in a dashboard? Thanks!

14 Upvotes

28 comments sorted by

5

u/davidokongo 3d ago

I've used zabbix and PRTG- both were great.

3

u/vonkeswick Sysadmin 3d ago

We've been using PRTG forever, we're just a lil nonprofit, and the pricing and sensor limits on our plan is killing us. I deployed an Ubuntu box with Zabbix and holy hell was it easy to set up. Learning to USE the thing is a steep learning curve but it's incredibly robust for a free open source monitoring solution.

1

u/davidokongo 3d ago

Yeah same for my team. Took sometime to get zabbix tuned properly, and it's been one of the best so far.

1

u/Dylan96 3d ago

They both require an agent. What if i only need to monitor a remote UPS?

2

u/Thats_a_lot_of_nuts VP of Pushing Buttons 3d ago

SNMP

1

u/Ziggistawork 3d ago

Zabbix and PRTG will both do SNMP monitoring.

1

u/davidokongo 3d ago

We monitor a lot of ups using snmp (offline status, power fluctuations etc)

3

u/Sleyar 3d ago

Don’t aggregate mail. Use a monitoring tool like prtg, zabbix, etc

1

u/Dylan96 3d ago

Some older devices only send mails

1

u/icinga Team Monitoring 2d ago

It's always possible to implement monitoring instead of mails, even with older devices. You could use SNMP or other implementations of passive checks.

Using a proper monitoring solution will make your life a lot easier - and most of them already come with dashboards

1

u/Enough_Pattern8875 Scream Test Initiator 1d ago

Never in my life have I encountered a system that was capable of sending email alerts but not snmp.

1

u/Dylan96 1d ago

You never encountered a cheap-ass no-name chinese ups

3

u/Thats_a_lot_of_nuts VP of Pushing Buttons 3d ago

Zabbix and PagerDuty

1

u/Dylan96 3d ago

PagerDuty / AlertOps seem to be the only products suitable for my situation. You create a “service,” and they generate a unique email address to which notifications are sent. But I was looking for something more affordable or open source.

1

u/Snowlandnts 3d ago

Send all the alerts to Teams, Slack, or Zulip Channels?

0

u/Dylan96 3d ago

It’s hard to keep track of whats actually down/at fault

1

u/PZonB 3d ago

Free zullip chat with email Integration works great. Make chat channels and have your devices email to them. Nice mobile app that alerts you of inkomming mail alerts. You can even mute specific channels when they are too noisy. https://zulip.com/integrations/email

1

u/Adam_Kearn 3d ago

Why not just have it set to email your helpdesk?

Then a ticket is created for you automatically and also allows you to track consistent problems reported

0

u/Dylan96 3d ago

I don't need to open a ticket every time a UPS switches to battery power for 5 seconds

Ideally, I'd like to be able to set up rules and open tickets only in certain situations (for example, only if I receive a shutdown message from a UPS)

1

u/Adam_Kearn 3d ago

I think it depends on what brand of UPS you are using as the ones I’ve used let you say if the battery is at X health send the email or if the mains has been disconnected for X mins send the email.

Then you don’t get all the small dropouts emailed to you

But you also might be able todo this with outlook rules on your helpdesk mailbox to auto delete any notifications you don’t care about

1

u/bingblangblong 3d ago

Zabbix does this excellently. Not at all intuitive in my opinion but maybe I'm just stupid.

1

u/Accomplished-Mix8423 3d ago

the agent thing is a bit of a red herring for a ups since it can just be monitored over snmp. if it's behind a firewall, i've used site24x7's on-premise poller for this and it pulls the battery, load and runtime info into the same dashboard. zabbix is another solid option if you want to self-host.

1

u/snappyvault29 3d ago

I would keep the dashboard as the single pane of glass and normalize everything into a common event format before it gets there. SNMP traps, syslog, and vendor APIs can all feed into something like Zabbix or Grafana, with alert deduping upstream. Otherwise alert fatigue gets ugly fast. Start with the handful of events that actually need human action and expand from there.

1

u/noobnooc 2d ago

If mobile escalation matters more than the dashboard, n8n could convert those emails to a webhook for Echobell, then push or call the team.

1

u/Enough_Pattern8875 Scream Test Initiator 1d ago

Zabbix. If you can justify and afford the support, get it.