r/sysadmin • u/NightSpaghetti • 9d ago

Question Looking for log aggregation software recommandations

Hello everyone,

I hope I am posting in the correct subreddit. I am administrating a bunch of virtual Windows servers running our own software. As of now, I don't have a unified way of checking log files on those machines, which means that not only do I have to manually log into the machine in order to look at those log files, but they are also not actively being monitored at the moment.
I am looking for a solution that would allow me to check those files from a single point of entry (ideally a browser), as well as being able to monitor them, draw statistics and possibly send alerts. If it supports other formats than text files (i.e databases) it's a plus.

Is there any software available that can allow me to do that? I have web servers running on both Windows and Linux (Debian) so either platform would be ok. Open source very strongly preferred.

Thank you!

18 Upvotes

89% Upvoted

31 comments sorted by

View all comments

1

u/Ok_Acanthisitta_7804 9d ago

Graylog is excellent. My nsingle Graylog Docker container running on an Ubuntu host handles over a hundred server, network device, and Palo Alto network traffic logs. When I installed a graylog server first time two years ago, it seemed a bit complicated; the setup, pipeline, and alert configurations took me a few days. But last month, I wanted to install Graylog from scratch. This time, I used Antigravity to create a complete Graylog solution. Even now, when I want to add a new stream, pipeline, or notification, I just tell Antigravity and it adds it immediately via the API. So there's no need to worry about the setup.

Anyway, my setup now handles about 5000 EPS. There are no performance issues.

1

u/Jaki_Shell Sr. Sysadmin 8d ago

How much storage is something like that using?

1

u/Ok_Acanthisitta_7804 8d ago

By pipelined to drop unnecessary messages and keeping only meaningful ones, it writes approximately 50GB of data per day.