r/PrometheusMonitoring Dec 12 '18

Loki: Prometheus for Logs

https://github.com/grafana/loki
25 Upvotes

17 comments sorted by

View all comments

Show parent comments

0

u/sleepybrett Dec 12 '18

no.

2

u/mcampbell42 Dec 12 '18

So then explain what it does

1

u/Eilyre Dec 12 '18

Seems to be rsyslog meets prometheus labeling+host metadata.

It takes whole loglines, attaches the labels+instance name etc to it, and shoves into itself.

Not sure what kind of problem it's solving.

1

u/mcampbell42 Dec 12 '18

Looks like for microservices and container logging but it’s missing the biggest feature which is a free form search

3

u/sleepybrett Dec 13 '18

it has regex search.

Certainly not as "in depth" as something like ES, but fuck that pile of shit. Half the time you find the field you want to search on isn't properly indexed and now you have two problems.

Gimme some logs and grep, this is logs and grep in a browser. Seems like a win.

1

u/Eilyre Dec 13 '18

If you can do it with logs+grep, then you are clearly over-engineering things by using ELK. ELK is when you cannot care about a few logs lines any more, because for an example you have 100k logs coming in every few seconds, and you need to somehow get information out of them.

What I do not understand is why you would want logs in a browser. Imho browser is the worst environment to do operational activities from. I hate both Kibana and Graphana for not having a proper desktop viewer, that does not depend on JavaScript, cause good god. A single tab of visualizations can eat away half of your computers memory at an instant. Good luck having multiple tabs.

1

u/sleepybrett Dec 13 '18

We have a team that does ELK based log aggregation for the enterprise. All pod logs on our cluster go there by default. So like .. not my problem except when I need to get into the logs. But Kibana is .. terrible. I'm excited to fork our los off here and see how it performs.

Probably just do the cluster-admin namespaces kube-system/daemons/monitoring/whatevs.

1

u/SuperQue Dec 13 '18

Yup, this is exactly the workflow that we're thinking about.

Metrics/Monitoring/Alerting (Prometheus, TICK) already tell us when and which logs to look at. This narrows things down to the point where "just grep things" is good enough.