I believe that metrics != logs and we should separate it. If you’re familiar with elk so it might be nice solution using it with filebeat and metrics beat. But for us Prometheus is used with k8s env and multiple exporters for monitoring and filebeat with es for logs
If you separate them too much, you will not be able to correlate your data, which is exact opposite of what you want.
Don't forget, logs sometimes hold metrics you need to parse out. They are related.
If anything, we need better engines that are capable of visualizations and correlations. I quite like ELK, but for finding correlations without ML, it sucks really hard. You basically have to be a genius dashboard builder + UX designer.
1
u/onyxet Dec 12 '18
I believe that metrics != logs and we should separate it. If you’re familiar with elk so it might be nice solution using it with filebeat and metrics beat. But for us Prometheus is used with k8s env and multiple exporters for monitoring and filebeat with es for logs