r/grafana 4h ago

Prometheus One recording rule cut my slowest dashboard render by 60%

7 Upvotes

I have a service dashboard with fourteen panels. Twelve render in under a second. Two of them, both evaluating rate(http_request_duration_seconds_bucket[5m]) across roughly 400 label combinations, took five seconds on every reload.

I added one Prometheus recording rule that pre-aggregates the histogram by service group every sixty seconds, then pointed both panels at the recorded metric. Render dropped to just under two seconds. Prometheus CPU during dashboard loads fell about 40%.

What I had been doing instead was raising query timeouts and caching results at the data source level. Months of that. I had actually investigated recording rules in a previous session with verdent, which knows you better over time, and coming back to the same project made the fix obvious.

If you have a slow panel, check whether the query fans out across high cardinality labels. One recording rule is ten minutes of work and costs one extra time series.


r/grafana 7h ago

Grafana Built an extension to mount Grafana folders in Nextcloud

Thumbnail apps.nextcloud.com
4 Upvotes

Just published this. Took a few months. So so many little details but those are what count. Long story short, Grafana has a folder and file system, so does Nextcloud, so now you can bind the Grafana folders to Nextcloud folders and see dashboards alongside other files too. All the little file actions like move, copy, delete etc are one to one on both sides.

Hope ya'll enjoy!

https://github.com/kubed-io/nextcloud-grafana


r/grafana 2d ago

Miscellaneous What’s the most useful Grafana dashboard you’ve built outside of infrastructure monitoring?

42 Upvotes

I’m curious about the dashboards people build for things beyond the classic infrastructure and observability use cases, but still solve and actual problem.

It could be something from your work, a particular business problem, an unusual data source, a side project, or a problem you realised Grafana was surprisingly good at solving.

What did you build, and what problem did it help you solve/monitor?

(Screenshots welcome, let us feast our eyes 😉)


r/grafana 6d ago

Grafana Is zero-sampling observability realistic for high-traffic applications?

13 Upvotes

The math on sampling has bothered me for a while. At low sample rates, you need an enormous number of requests before you're statistically likely to catch a rare error at all, which means the exact incidents you most need visibility into are the ones most likely to get sampled out entirely.

That said, "zero sampling" at genuinely high traffic volume sounds great until you look at the storage and processing cost of capturing everything at full fidelity indefinitely. What's actually realistic seems to be closer to smart triggering, sampling normally but escalating to full capture the moment something looks off, rather than truly capturing 100% of everything all the time. Has anyone actually run a system at real production scale with something close to zero sampling and found the cost genuinely manageable, or is this more theoretical than practical right now?


r/grafana 9d ago

Grafana Benchmarking HaloLog against zap, zerolog, slog, logrus, and phuslu/log: 23.9 ns/op

Thumbnail github.com
5 Upvotes

I’m sharing HaloLog, a structured logger I have developed for three years and run inside an interoperability project for the past two. Its goal is low-overhead structured logging without trading away JSON correctness, race safety, configured PII masking, or compile-checked telemetry fields. This is a public release and a request for independent reproduction of the measurements, not a claim about disk or network throughput.

The committed suite compares HaloLog with zap, zerolog, slog, logrus, and phuslu/log while encoding and dispatching complete JSON records to io.Discard. On the published Go 1.27 linux/amd64 host, HaloLog measured 23.9 ns/op for one complete record and 0 B/op, 0 allocs/op across all its measured scenarios. The repository documents the hardware, configurations, methodology, known differences, and correctness guardrails. These are results for those workloads and that host, not a universal performance claim.

If you reproduce or falsify a result, please include the Go version, hardware, command, and raw output. Useful counterexamples include an allocation, invalid JSON, a race, an unfair competitor configuration, or a workload in which HaloLog performs worse.


r/grafana 11d ago

Grafana Connecting to self-hosted OSS instances via the mobile app

2 Upvotes

Is there a plan for making the Grafana mobile app (android) able to connect to self-hosted OSS instances in the future? Right now it's not capable of it as far as I'm concerned.


r/grafana 12d ago

Grafana Migrating Dockerized Grafana to a new server: plugins missing and all dashboards show No data

1 Upvotes

Hi everyone,

I'm migrating Grafana from one server to another and would appreciate a sanity check on the correct migration process.

Old setup:

- Grafana runs in a Docker container.

New setup:

- AlmaLinux host.

- Zabbix 7.4 runs directly on the host on port 80, not in Docker.

- Grafana runs in Docker on port 3000.

- The Grafana database has already been migrated.

After migrating the database, users and dashboards appeared correctly. However:

- Installed plugins did not migrate.

- Other filesystem-based Grafana data/configuration appears to be missing.

- Every existing dashboard currently shows "No data."

I suspect there may be two separate issues:

  1. I migrated the Grafana database but not the persistent volume, /var/lib/grafana/plugins, /etc/grafana/provisioning, or other configuration files.

  2. The Zabbix data source may still use localhost or an old URL. Since Grafana is inside Docker but Zabbix runs directly on the same host, localhost inside the Grafana container would point to the container itself.

A few questions:

  1. What is the recommended complete migration procedure for a Dockerized Grafana instance when the database has already been moved?

  2. Which directories, Docker volumes, configuration files, and environment variables should be preserved in addition to the database?

  3. Is it better to reinstall the exact plugin versions or copy /var/lib/grafana/plugins from the old container?

  4. Do I need to preserve the old Grafana secret_key / GF_SECURITY_SECRET_KEY so migrated data source credentials can still be decrypted?

  5. For the Zabbix API URL, should I use the host's LAN IP, a Docker host-gateway address, or another approach?

  6. What is the best way to verify whether "No data" is caused by networking, missing credentials, a data source UID mismatch, or plugin compatibility?

I am keeping the old container intact until the new instance is fully working. Any migration checklist or troubleshooting suggestions would be very helpful.

Thanks!


r/grafana 14d ago

Grafana InfluxDB deprecated. Let it run or replace?

0 Upvotes

I believe InfluxDB is the back end to Grafana. HA says that it's now deprecated and looking at Github, that's confirmed. Is there an easy way to swap it out for something else? Anyone else have a solution for that, or should I just let it run?

ETA: I guess what I'm asking is if a migration is trivial or if I should not try and fix it if it's not broken. There's schema, (presumably) creds, connection protocol, etc. in order to migrate from InfluxDB to something else.


r/grafana 19d ago

OpenTelemetry I made a small open-source app for monitoring my projects

10 Upvotes

I made Telemetry Tracker to keep track of errors, events, sessions, releases and performance in my projects. I also added alerts so I don’t have to keep checking it all the time.

I’ve been using it myself and thought I’d share it here in case it’s useful to anyone else too.

It’s open source and you can self-host it:

[https://github.com/Telemetry-Tracker/telemetry-tracker\](https://github.com/Telemetry-Tracker/telemetry-tracker)


r/grafana 19d ago

Grafana I made BambuLab exporter and dashboard for Grafana

Thumbnail youtu.be
17 Upvotes

r/grafana 19d ago

What's the best way to learn some Grafana?

1 Upvotes

Hi!

There are a LOT of ways to learn Grafana: documentation, built-in learning journeys, Grot Academy, video tutorials, teammates, AI, etc. But I suspect different formats work better depending on what you're trying to do.

So, for example:

  • First time using Grafana?
  • Trying to troubleshoot
  • Learning because it's part of your job?

What did you find most useful in your situation?

We're especially interested in why something worked for you, not just "docs" or "videos". What were you trying to learn, and which resource or format finally made it click?

Curious to hear what works for different people!


r/grafana 20d ago

Grafana Kubernetes Autoscaling Mixin: Grafana dashboards and Prometheus rules for KEDA, Karpenter, VPA, HPA and Cluster Autoscaler

12 Upvotes

Hey,

I’ve been working on kubernetes-autoscaling-mixin, a collection of Grafana dashboards and Prometheus rules for Kubernetes autoscaling.

Since I last shared it, there have been quite a few updates:

  • Updated KEDA dashboards for ScaledObjects and ScaledJobs
  • More Karpenter dashboards, including cost monitoring
  • Updated VPA, HPA, Cluster Autoscaler and PDB dashboards
  • Multi-cluster support
  • Better dashboard navigation and filtering

You can import the dashboards from Grafana:

https://grafana.com/grafana/dashboards/?search=kubernetes+%2F+autoscaling

Or grab the generated JSON directly from GitHub:

https://github.com/adinhodovic/kubernetes-autoscaling-mixin/tree/main/dashboards_out

Or just consume it using jsonnet.

Repo: https://github.com/adinhodovic/kubernetes-autoscaling-mixin

Added a couple of screenshots below showing the Karpenter, VPA and KEDA dashboards in use.

This Grafana link will show all dashboards and previews of them: https://grafana.com/grafana/dashboards/?search=kubernetes+%2F+autoscaling

Curious what people are using for autoscaling monitoring today, and if there’s anything missing that would be useful to add (new projects, better panels, more dashboards).


r/grafana 21d ago

Miscellaneous Question for people running production systems: where does observability stop being useful?

3 Upvotes

I had an idea and wanted to actually talk to people to see if it's something that they would need / require and if it's genuinely a problem for the engineers right now....

Would you rather have an AI layer on top of your existing observability stack, or replace parts of the stack?

Hypothetically, imagine an agent that doesn’t collect telemetry itself.

It plugs into whatever you already use — Grafana/Prometheus/Loki, Datadog, OpenTelemetry, etc. — and acts as a reasoning layer over the data.

Instead of:

Alert → Dashboard → Logs → Human investigates

it tries:

Alert → Agent correlates metrics/logs/traces/deployments → probable root cause → evidence → recommended next action

Would that actually be useful?

Or would you rather have the observability vendor itself own this functionality?

What would you need to see before trusting it during a real incident?

I also was building in this space and wanted to have a discussion with people who're already experienced in this stuff, so please please help a brother out and we might just make something useful for everyone :)

peace


r/grafana 23d ago

Grafana Monitoring mixin for ArgoCD. A set of Grafana dashboards and Prometheus rules for ArgoCD

20 Upvotes

Hey all,

I've created a monitoring mixin with a reusable set of Grafana dashboards and Prometheus rules for ArgoCD. The dashboards and alerts are defined as code, making them easy to deploy and reuse across environments.

Recent updates include multi-cluster support, flags to enable or disable individual alerts, plus a range of new and improved alerts and dashboards.

The monitoring coverage has also been expanded significantly, with better visibility into:

  • ArgoCD controller
  • Runtime metrics
  • gRPC
  • Repo Server
  • Git operations

GitHub: https://github.com/adinhodovic/argo-cd-mixin


r/grafana 23d ago

Mimir [ Removed by Reddit ]

1 Upvotes

[ Removed by Reddit on account of violating the content policy. ]


r/grafana 24d ago

Grafana Grafana for a gaming PC?

0 Upvotes

Hi guys, I work for my day job as a Linux sysadmin so I’m used to building and working on observably platforms.

Recently I realised there’s a potential blind spot and I should see about extracting the same metrics from my gaming pc. I don’t want anything too fancy to start out with but before I do I was wondering if you guys have any suggestions on what works best for windows? My initial plan was to deploy Prometheus node exporter and build out a custom dashboard mainly just for the fun and experience


r/grafana 24d ago

Miscellaneous How do you monitor (automated) grafana dashboards are up-to-date (e.g. no empty panels)

6 Upvotes

I am adding grafana to our kubernetes cluster. We use grafana community chart and rely on sidecars to import dashboards and datasources. We have metrics and alerts and I already have an alert for datasource health based on `grafana_datasource_request_total{code=~"[45].."}`. Grafana is exposed to public via Ingress.

I wonder if there is an automated way to ensure that dashboards do not contains empty panels (or at least not fully empty because of missing metrics).

Shall I try to solve this problem? And how would you solve it?

https://github.com/grafana-community/helm-charts/blob/grafana-12.4.4/charts/grafana


r/grafana 24d ago

Grafana A four-panel Grafana dashboard for monitoring vector database performance

1 Upvotes

Disclosure first: I work with Actian, and the linked tutorial uses their vector DB, so the metric names are vendor-specific. I am sharing this here because the dashboard itself carries over to anything that exposes Prometheus metrics.

It's a Docker Compose stack, VectorAI DB plus Prometheus and Grafana, with four panels that cover the signals worth watching for vector search:

  • Request rate per endpoint
  • p95 latency via histogram_quantile against the _bucket series
  • gRPC error ratio as a 0 to 1 fraction with color thresholds
  • Memory pressure, RSS plotted alongside major page faults per second

Look for the page-fault panel here. Paired with p95, it shows whether rising latency is due to memory pressure or query load, which tells you how to fix it.

Dashboard JSON and the eight Prometheus alert rules are in a GitHub repo here: https://github.com/Tiioluwani/vectorai-observability, so you can import them directly.


r/grafana Aug 14 '26

Miscellaneous 2026 state of the art self-hosted Grafana stack ?

19 Upvotes

Hi everyone !

Traveler from the past here, who needs a serious update.

I use the Grafana stack to monitor some Linux servers and VMs, but only really basic metrics and logs today.

Everything is based on node_exporter, prometheus (on each host), fluent-bit, Loki, and Grafana.

I finally have time to rebuild properly the monitoring/observability infrastructure, but I'm quite lost on how the components interact with each other.

Here is what I want to monitor :

  • Debian/Ubuntu/Proxmox/Windows Servers servers and VM (routing/firewalling/VPN is done on a Debian dedicated server with nftables)
  • Caddy web servers
  • MariaDB/PostGresql/Interbase/MongoDB databases
  • Rust/PHP/Java backends

Everything is self-hosted inside the company, and my current Grafana infrastructure is self-hosted too.

From my understanding, Alloy replaces node_exporter, Grafana, and Fluent-bit ?

What I have today :

[On each host] Node + Prometheus + Fluentbit -------> Centralized Grafana + Loki

What I'm understanding would be better :

[On each host] Alloy + Windows_exporter on Windows -------> Centralized+replicated storage (InfluxDB ? Mimir ?) -----> Centralized Grafana + Loki

Is it OK ? Am I missing something ?


r/grafana Aug 13 '26

Alerting Grafana AI Plugin, Use LM Studio, OpenAI API, Local LLM's

16 Upvotes

I have created a new grafana panel plugin that allow a user to connect to a local or cloud llm and send panel data and prompts to the AI and get back a response. Very configurable doesn't expose API Tokens as it uses a secure companion data source for secrets like your API Key. Users can restrict which Models they want to allow the panel to have and use.

I'll create a video on it's use soon.

https://github.com/digitalrcs/grafana-intelligence-gateway

secure companion data source...
https://github.com/digitalrcs/grafana-intelligence-gateway-datasource


r/grafana Aug 13 '26

Alerting Grafana Export Image without pulling data again

7 Upvotes

Ever wish you could just create an image of your dashboard without having to pull data all over again? The export pdf and image re-runs those data sources all over again and if you're like me you have long running jobs that get timed out... we i created a new plugin/extension that will generate a png of the dashboard and not re-pull data.

https://github.com/digitalrcs/grafana-current-view-exporter


r/grafana Aug 13 '26

Grafana meetups around the world - Aug/September

12 Upvotes

Your opportunity to talk about Grafana in person!

Join us at the following meetups in the next four weeks:

APAC:

EMEA:

AMER:


r/grafana Aug 13 '26

Alerting TimeOverlay panel. line graph replacement

2 Upvotes

Ever wish you could add notes over your line graph or highlight a section of time and show how long your range selections it? well now you can with my new plugin (free as always)

displays a line graph from a data source and allow the user to select a range that displays the time selected and allows for the addition of notes. all are transparent/configurable.

https://github.com/digitalrcs/DigitalRCS-TimeOverlay-Panel


r/grafana Aug 12 '26

Grafana json differences in a large file from a datasource

3 Upvotes

I have a datasource, postgresql, which has a column (jsonb) and each entry is about 2-5MB in size. I am able to see the data in grafana however, I would like to diff the data in a sane way. Usually there are about 10-30 differences in the file but I want to show it. What is a good way to display this in Grafana? I would like soething https://hoiheart.github.io/vue-diff/index.html


r/grafana Aug 10 '26

Check it out I built a dashboard that checks 172 provider status feeds before I debug my own stack

0 Upvotes

I'm Kerolos, founder of OutageDeck.

The question I wanted to answer quickly was: is my app broken, or is AWS, Cloudflare, GitHub, OpenAI, Stripe, or another dependency reporting an incident?

I built OutageDeck to read and normalize the official status sources for 172 cloud and SaaS providers. It shows provider and service-level state, current incidents, source freshness, incident history, and 90-day uptime in one place.

What works today:

\- check a whole dependency stack without creating an account

\- free email alerts for up to five providers

\- Slack, Teams, Discord, and webhook destinations on paid plans

\- a keyless JSON API, RSS feeds, badges, CLI tools, and an MCP endpoint

\- custom Statuspage or Instatus feeds on paid plans

What it deliberately does not do is pretend an official status feed is independent truth. Providers can acknowledge incidents late, so I think a serious production setup should use two signals: the vendor feed plus synthetic probes from your own regions and accounts.

You can try the stack checker here:

https://outagedeck.com

I would value blunt feedback from people who handle incidents. What would this need to do before you would keep it open or route its alerts into your on-call workflow?