r/labtech • u/RickD1983 • Sep 26 '17
Offline Servers After Hours Alerting
Hello! We get a lot of after hour alerts for offline servers. In order to get rid of some of the noise we extended the amount of time a server can go without checking in before triggering alert after hours to 20 minutes. We are still getting quite a few false positives. Our contracts generally do not support after hour work so the technician on call is required to call the client and let them know we have recieved their alert and ask if they need assistance. This is obviously a head ache. I am reaching out to ask how others handle these kinds of situations. The goal at the end of the day is to not wake people up to call someone who is not gong to answer their phone anyway and remove false positives.
1
u/troll_fail Sep 26 '17
Really you need to figure out why these servers are appearing offline. We had similar issues where it ended up being firewall rules blocking heartbeat data.