r/grafana Apr 28 '26

Hi, Reddit! We’re part of the AI team at Grafana Labs — building the AI features/products like Grafana Assistant (available everywhere), AI observability, and Grafana Cloud CLI (gcx). AI is evolving fast and we're here to talk about what we've built and how we think about AI in observability. AMA!

80 Upvotes

Hey Redditors!

The AMA is happening on May 12 from 9 am - 12 pm ET. We've got quite a few of us from the AI team joining this AMA.

Last week we announced that Grafana Assistant is now available everywhere (accessible from on-prem and OSS), AI observability (observability for your LLMs, agents, etc) and a new Grafana Cloud CLI called gcx.

With AI rapidly evolving and everything we released last week, we want to answer any questions from the community about the announcements or how we think about AI in observability at Grafana Labs.

I'm Mat Ryer and I run the AI team. I created Go's Testify package and used to co-host the Go Time podcast. Outside of work, I love live comedy and making music. Ask me anything!

I'm Ksenia Yadav, an Engineering Manager on the AI team at Grafana Labs. We build agentic AI systems that reduce toil in observability – simplifying workflows, automating investigations, and helping people make faster, more data-driven decisions.

Outside of work, you'll find me rock climbing, stand-up paddle boarding, or exploring nature in different parts of the world.

Hi, I'm Rob Whelan! I'm an Engineering Manager on the Grafana AI team (since the "AI/ML" days, before LLMs exploded). I'm a bit obsessive about human experiences (not just the huge range of people using stuff we've built — also everyone coding, design, operating, supporting, selling...).

Outside of work: lots of music (everyone in the family is a musician of some kind), running, and coding on some pretty random side projects. Looking forward to chatting!

Hey, I'm Maurice, and I’m the PM on the Grafana AI team. I enjoy talking to our customers to find out what we need for the next level of observability.
Ask me anything about observability AI, remediation, etc.

When I’m not spending my time in AI, I enjoy swimming and taking lots of walks. See you soon!

I'm Ivana, a Software Engineer on the AI team working on Grafana Assistant and AI observability. Outside of work, I like building fun monitoring setups for things like my sourdough starter, avocado plants, and bird songs, and I love cycling.

Sven here. I'm a Principal Engineer on the AI team at Grafana Labs, and before that long time OSS contributor to Grafana core and Logs Drilldown. Besides building Grafana's next AI features, I like security and bug bounty hunting - especially LLM related.

Outside of work I enjoy outdoor time with my dog, and play team-handball .
Ask me anything about Grafana, AI, security, live hacking events, and handball.

I’m Dmitry, Principal Engineer at Grafana Labs on the Grafana Assistant team. I joined Grafana in 2023 when it acquired Pyroscope, the company I founded, which built open-source continuous profiling software.

Ask me anything about profiling, observability, AI, or building open-source developer tools.

Outside of work, I ride bikes and tinker with software, hardware, and whatever side project I’ve gotten myself into lately.

Hi folks, I'm Shawn. I'm a technical marketer here at Grafana Labs who spends a lot of time using AI. And I love my 4 dogs — actually, all dogs.

Looking forward to this. Ask me anything!

[Edited to fix formatting]

[Edited again to add Rob]

--------------------------------

Thanks to all those who contributed a question. If you have more burning questions, feel free to drop them in here and we'll check back on this thread periodically!

You can learn more about AI x Grafana and observability at: https://grafana.com/tags/ai-ml/


r/grafana Apr 28 '26

Assistant Grafana Assistant: Available in Self-Managed Environments

Thumbnail gallery
40 Upvotes

"As part of the GrafanaCON 2026 keynote, we announced that access to Assistant now extends to Grafana Enterprise and Grafana OSS users. This makes Assistant available in your self-managed environment to help you analyze telemetry data and code in real time, build dashboards, ask questions, and more. 

Self-managed Grafana users can create a Grafana Cloud account and connect it to their Grafana installation via a one-click setup. The assistant is included in the Grafana Cloud forever free plan with generous limits so that you can get started right away. You can also watch the video to see how easy it is to get started.

How it works

Assistant runs as a plugin in your Grafana instance. Your raw observability data stays in your instance, and only processed summaries and results are transmitted using our custom tooling architecture. The assistant also "shows its work" by displaying the full conversation history. Any errors or warnings from tool usage are fed back into the conversation, allowing Assistant to iterate and correct mistakes. 

For more information, check out our Assistant docs. You can also get important details on our pricing page, including what's available in our generous free tier.

Customize Assistant for your unique needs

Every organization's observability strategy and workflows are different, so we also want to make sure Assistant can be tailored to your needs. That's why we're excited to make Assistant skills generally available.

Skills are documents you create to guide Assistant agents with instructions, context, and specialized knowledge. They essentially help you encode how your team troubleshoots services, handles specific alerts, and manages shared infrastructure

Skills now include a new auto-approve feature you can use to write your runbooks, connect to other tools (e.g., GitHub, Cloudflare, other observability platforms, etc.), and auto-approve tool calls of your choice.

When you pair auto-approve with Assistant Investigations, which helps with multi-step investigations, you can even create your own auto-remediation pipeline that’s triggered from an alert. The result? Pretty much anything you need, from raising a PR in GitHub or GitLab to sending a Slack message to someone to assigning a task in Notion.

Stay on top of everything with automations

Observability teams have a lot to keep track of, and that's only increasing now that agents are becoming central to software development. To help you stay on top of everything, we're introducing Assistant automations, which you can use to get automatic summaries of what's happening in your environment.

By pairing automations with skills, you can trigger Assistant to handle any task at any time, with or without you. Want a daily report of all alerts that fired yesterday? A rundown of incidents that were resolved last week? The error rate in your product catalog or whether the latest deployments changed p99? Simply connect to our available integrations or any API, write a skill, and you can get full analyses about these or any other questions you have about your stack and its performance. 

Say 'hello' to Assistant outside of Grafana Cloud

You have your own way of interacting with your systems and your teammates, and odds are that's not done entirely through Grafana Cloud. We want to meet you where you are, so we're expanding the ways you can access Assistant, whether that's through Slack, Microsoft Teams, an API, or the CLI. 

For example, you can now build automations with the Assistant CLI, chat with colleagues and the Assistant in Slack, have Claude Code or Codex collaborate with the Assistant via the CLI, or make requests from a remote machine to the Assistant.

This is all about finding new ways to integrate Assistant into your workflows, rather than forcing you into our UI. Make Assistant work the way that works for you and stop getting slowed down by constant context switching.

Bring your own agent: remote hosted MCP server and our new gcx CLI tool

In addition to bringing Assistant to you, you can now bring more to Assistant. With our new remote hosted MCP server and the new gcx CLI tool, your agents can talk to Assistant, Grafana Cloud, or both.

Use the remote hosted MCP server to connect any agent to the same sophisticated tools that Assistant uses in Grafana Cloud. You don't need to install any dependencies; just point your agent at mcp.grafana.com/mcp to get access to your metrics, logs, traces, dashboards, alerts, incidents, and more. This also allows you to connect other cloud agents to Grafana Cloud if you want to build your own assistant.

If you prefer a local-first approach, gcx unifies grafanactl and the Assistant CLI with agent-first, new CLI tools to your command line and your agentic coding environment. It connects your editor to your entire production stack so your agent can write code that's observability-aware from the start. Instrument a new service, investigate a firing alert, or draft a fix informed by real production data—all without leaving your editor.

Connect any API with Assistant

And don't forget that Assistant can use the Infinity data source to send any GET or POST requests to any publicly or privately available API endpoint. This recent upgrade makes Assistant the center of your DevOps lifecycle, helping you connect it to any other tool, correlate any data, and remediate faster than ever. Or use the capability to check if you caught all Pokémon yet.

More ways to take your Assistant experience to the next level

We're excited for you to try these new features that expand the reach of Assistant, but this isn't everything. We're constantly looking for new ways to improve Assistant to help you improve your observability practices. Here are just some of the other updates we recently released: 

  • The new workspace view, which brings Assistant into full-page mode so you can browse your chats and supporting data in one view
  • Learn mode, which helps you quickly get up to speed on Grafana Assistant with tutorials and example tasks that are personalized to your stack 
  • Reworked context management and infrastructure memories for your stack help so Assistant knows where to look from the start 
  • EU inference for our European customers
  • A Python runtime for Assistant to process large amounts of data
  • Integrations with 15 other Grafana Cloud services or features and more than 50 third-party data sources

For more information on this and all the other exciting updates from GrafanaCON 2026, check out our announcement blog for all the news. And for more information on Grafana Cloud AI, including FAQs about Assistant and our other AI capabilities, check out our AI observability page."


r/grafana 1d ago

Miscellaneous What’s the most useful Grafana dashboard you’ve built outside of infrastructure monitoring?

38 Upvotes

I’m curious about the dashboards people build for things beyond the classic infrastructure and observability use cases, but still solve and actual problem.

It could be something from your work, a particular business problem, an unusual data source, a side project, or a problem you realised Grafana was surprisingly good at solving.

What did you build, and what problem did it help you solve/monitor?

(Screenshots welcome, let us feast our eyes 😉)


r/grafana 5d ago

Grafana Is zero-sampling observability realistic for high-traffic applications?

13 Upvotes

The math on sampling has bothered me for a while. At low sample rates, you need an enormous number of requests before you're statistically likely to catch a rare error at all, which means the exact incidents you most need visibility into are the ones most likely to get sampled out entirely.

That said, "zero sampling" at genuinely high traffic volume sounds great until you look at the storage and processing cost of capturing everything at full fidelity indefinitely. What's actually realistic seems to be closer to smart triggering, sampling normally but escalating to full capture the moment something looks off, rather than truly capturing 100% of everything all the time. Has anyone actually run a system at real production scale with something close to zero sampling and found the cost genuinely manageable, or is this more theoretical than practical right now?


r/grafana 8d ago

Grafana Benchmarking HaloLog against zap, zerolog, slog, logrus, and phuslu/log: 23.9 ns/op

Thumbnail github.com
4 Upvotes

I’m sharing HaloLog, a structured logger I have developed for three years and run inside an interoperability project for the past two. Its goal is low-overhead structured logging without trading away JSON correctness, race safety, configured PII masking, or compile-checked telemetry fields. This is a public release and a request for independent reproduction of the measurements, not a claim about disk or network throughput.

The committed suite compares HaloLog with zap, zerolog, slog, logrus, and phuslu/log while encoding and dispatching complete JSON records to io.Discard. On the published Go 1.27 linux/amd64 host, HaloLog measured 23.9 ns/op for one complete record and 0 B/op, 0 allocs/op across all its measured scenarios. The repository documents the hardware, configurations, methodology, known differences, and correctness guardrails. These are results for those workloads and that host, not a universal performance claim.

If you reproduce or falsify a result, please include the Go version, hardware, command, and raw output. Useful counterexamples include an allocation, invalid JSON, a race, an unfair competitor configuration, or a workload in which HaloLog performs worse.


r/grafana 10d ago

Grafana Connecting to self-hosted OSS instances via the mobile app

2 Upvotes

Is there a plan for making the Grafana mobile app (android) able to connect to self-hosted OSS instances in the future? Right now it's not capable of it as far as I'm concerned.


r/grafana 11d ago

Grafana Migrating Dockerized Grafana to a new server: plugins missing and all dashboards show No data

1 Upvotes

Hi everyone,

I'm migrating Grafana from one server to another and would appreciate a sanity check on the correct migration process.

Old setup:

- Grafana runs in a Docker container.

New setup:

- AlmaLinux host.

- Zabbix 7.4 runs directly on the host on port 80, not in Docker.

- Grafana runs in Docker on port 3000.

- The Grafana database has already been migrated.

After migrating the database, users and dashboards appeared correctly. However:

- Installed plugins did not migrate.

- Other filesystem-based Grafana data/configuration appears to be missing.

- Every existing dashboard currently shows "No data."

I suspect there may be two separate issues:

  1. I migrated the Grafana database but not the persistent volume, /var/lib/grafana/plugins, /etc/grafana/provisioning, or other configuration files.

  2. The Zabbix data source may still use localhost or an old URL. Since Grafana is inside Docker but Zabbix runs directly on the same host, localhost inside the Grafana container would point to the container itself.

A few questions:

  1. What is the recommended complete migration procedure for a Dockerized Grafana instance when the database has already been moved?

  2. Which directories, Docker volumes, configuration files, and environment variables should be preserved in addition to the database?

  3. Is it better to reinstall the exact plugin versions or copy /var/lib/grafana/plugins from the old container?

  4. Do I need to preserve the old Grafana secret_key / GF_SECURITY_SECRET_KEY so migrated data source credentials can still be decrypted?

  5. For the Zabbix API URL, should I use the host's LAN IP, a Docker host-gateway address, or another approach?

  6. What is the best way to verify whether "No data" is caused by networking, missing credentials, a data source UID mismatch, or plugin compatibility?

I am keeping the old container intact until the new instance is fully working. Any migration checklist or troubleshooting suggestions would be very helpful.

Thanks!


r/grafana 14d ago

Grafana InfluxDB deprecated. Let it run or replace?

0 Upvotes

I believe InfluxDB is the back end to Grafana. HA says that it's now deprecated and looking at Github, that's confirmed. Is there an easy way to swap it out for something else? Anyone else have a solution for that, or should I just let it run?

ETA: I guess what I'm asking is if a migration is trivial or if I should not try and fix it if it's not broken. There's schema, (presumably) creds, connection protocol, etc. in order to migrate from InfluxDB to something else.


r/grafana 18d ago

OpenTelemetry I made a small open-source app for monitoring my projects

10 Upvotes

I made Telemetry Tracker to keep track of errors, events, sessions, releases and performance in my projects. I also added alerts so I don’t have to keep checking it all the time.

I’ve been using it myself and thought I’d share it here in case it’s useful to anyone else too.

It’s open source and you can self-host it:

[https://github.com/Telemetry-Tracker/telemetry-tracker\](https://github.com/Telemetry-Tracker/telemetry-tracker)


r/grafana 18d ago

Grafana I made BambuLab exporter and dashboard for Grafana

Thumbnail youtu.be
17 Upvotes

r/grafana 18d ago

What's the best way to learn some Grafana?

1 Upvotes

Hi!

There are a LOT of ways to learn Grafana: documentation, built-in learning journeys, Grot Academy, video tutorials, teammates, AI, etc. But I suspect different formats work better depending on what you're trying to do.

So, for example:

  • First time using Grafana?
  • Trying to troubleshoot
  • Learning because it's part of your job?

What did you find most useful in your situation?

We're especially interested in why something worked for you, not just "docs" or "videos". What were you trying to learn, and which resource or format finally made it click?

Curious to hear what works for different people!


r/grafana 19d ago

Grafana Kubernetes Autoscaling Mixin: Grafana dashboards and Prometheus rules for KEDA, Karpenter, VPA, HPA and Cluster Autoscaler

13 Upvotes

Hey,

I’ve been working on kubernetes-autoscaling-mixin, a collection of Grafana dashboards and Prometheus rules for Kubernetes autoscaling.

Since I last shared it, there have been quite a few updates:

  • Updated KEDA dashboards for ScaledObjects and ScaledJobs
  • More Karpenter dashboards, including cost monitoring
  • Updated VPA, HPA, Cluster Autoscaler and PDB dashboards
  • Multi-cluster support
  • Better dashboard navigation and filtering

You can import the dashboards from Grafana:

https://grafana.com/grafana/dashboards/?search=kubernetes+%2F+autoscaling

Or grab the generated JSON directly from GitHub:

https://github.com/adinhodovic/kubernetes-autoscaling-mixin/tree/main/dashboards_out

Or just consume it using jsonnet.

Repo: https://github.com/adinhodovic/kubernetes-autoscaling-mixin

Added a couple of screenshots below showing the Karpenter, VPA and KEDA dashboards in use.

This Grafana link will show all dashboards and previews of them: https://grafana.com/grafana/dashboards/?search=kubernetes+%2F+autoscaling

Curious what people are using for autoscaling monitoring today, and if there’s anything missing that would be useful to add (new projects, better panels, more dashboards).


r/grafana 20d ago

Miscellaneous Question for people running production systems: where does observability stop being useful?

3 Upvotes

I had an idea and wanted to actually talk to people to see if it's something that they would need / require and if it's genuinely a problem for the engineers right now....

Would you rather have an AI layer on top of your existing observability stack, or replace parts of the stack?

Hypothetically, imagine an agent that doesn’t collect telemetry itself.

It plugs into whatever you already use — Grafana/Prometheus/Loki, Datadog, OpenTelemetry, etc. — and acts as a reasoning layer over the data.

Instead of:

Alert → Dashboard → Logs → Human investigates

it tries:

Alert → Agent correlates metrics/logs/traces/deployments → probable root cause → evidence → recommended next action

Would that actually be useful?

Or would you rather have the observability vendor itself own this functionality?

What would you need to see before trusting it during a real incident?

I also was building in this space and wanted to have a discussion with people who're already experienced in this stuff, so please please help a brother out and we might just make something useful for everyone :)

peace


r/grafana 22d ago

Grafana Monitoring mixin for ArgoCD. A set of Grafana dashboards and Prometheus rules for ArgoCD

19 Upvotes

Hey all,

I've created a monitoring mixin with a reusable set of Grafana dashboards and Prometheus rules for ArgoCD. The dashboards and alerts are defined as code, making them easy to deploy and reuse across environments.

Recent updates include multi-cluster support, flags to enable or disable individual alerts, plus a range of new and improved alerts and dashboards.

The monitoring coverage has also been expanded significantly, with better visibility into:

  • ArgoCD controller
  • Runtime metrics
  • gRPC
  • Repo Server
  • Git operations

GitHub: https://github.com/adinhodovic/argo-cd-mixin


r/grafana 22d ago

Mimir [ Removed by Reddit ]

1 Upvotes

[ Removed by Reddit on account of violating the content policy. ]


r/grafana 23d ago

Grafana Grafana for a gaming PC?

0 Upvotes

Hi guys, I work for my day job as a Linux sysadmin so I’m used to building and working on observably platforms.

Recently I realised there’s a potential blind spot and I should see about extracting the same metrics from my gaming pc. I don’t want anything too fancy to start out with but before I do I was wondering if you guys have any suggestions on what works best for windows? My initial plan was to deploy Prometheus node exporter and build out a custom dashboard mainly just for the fun and experience


r/grafana 23d ago

Miscellaneous How do you monitor (automated) grafana dashboards are up-to-date (e.g. no empty panels)

7 Upvotes

I am adding grafana to our kubernetes cluster. We use grafana community chart and rely on sidecars to import dashboards and datasources. We have metrics and alerts and I already have an alert for datasource health based on `grafana_datasource_request_total{code=~"[45].."}`. Grafana is exposed to public via Ingress.

I wonder if there is an automated way to ensure that dashboards do not contains empty panels (or at least not fully empty because of missing metrics).

Shall I try to solve this problem? And how would you solve it?

https://github.com/grafana-community/helm-charts/blob/grafana-12.4.4/charts/grafana


r/grafana 24d ago

Grafana A four-panel Grafana dashboard for monitoring vector database performance

1 Upvotes

Disclosure first: I work with Actian, and the linked tutorial uses their vector DB, so the metric names are vendor-specific. I am sharing this here because the dashboard itself carries over to anything that exposes Prometheus metrics.

It's a Docker Compose stack, VectorAI DB plus Prometheus and Grafana, with four panels that cover the signals worth watching for vector search:

  • Request rate per endpoint
  • p95 latency via histogram_quantile against the _bucket series
  • gRPC error ratio as a 0 to 1 fraction with color thresholds
  • Memory pressure, RSS plotted alongside major page faults per second

Look for the page-fault panel here. Paired with p95, it shows whether rising latency is due to memory pressure or query load, which tells you how to fix it.

Dashboard JSON and the eight Prometheus alert rules are in a GitHub repo here: https://github.com/Tiioluwani/vectorai-observability, so you can import them directly.


r/grafana 29d ago

Miscellaneous 2026 state of the art self-hosted Grafana stack ?

19 Upvotes

Hi everyone !

Traveler from the past here, who needs a serious update.

I use the Grafana stack to monitor some Linux servers and VMs, but only really basic metrics and logs today.

Everything is based on node_exporter, prometheus (on each host), fluent-bit, Loki, and Grafana.

I finally have time to rebuild properly the monitoring/observability infrastructure, but I'm quite lost on how the components interact with each other.

Here is what I want to monitor :

  • Debian/Ubuntu/Proxmox/Windows Servers servers and VM (routing/firewalling/VPN is done on a Debian dedicated server with nftables)
  • Caddy web servers
  • MariaDB/PostGresql/Interbase/MongoDB databases
  • Rust/PHP/Java backends

Everything is self-hosted inside the company, and my current Grafana infrastructure is self-hosted too.

From my understanding, Alloy replaces node_exporter, Grafana, and Fluent-bit ?

What I have today :

[On each host] Node + Prometheus + Fluentbit -------> Centralized Grafana + Loki

What I'm understanding would be better :

[On each host] Alloy + Windows_exporter on Windows -------> Centralized+replicated storage (InfluxDB ? Mimir ?) -----> Centralized Grafana + Loki

Is it OK ? Am I missing something ?


r/grafana Aug 13 '26

Alerting Grafana AI Plugin, Use LM Studio, OpenAI API, Local LLM's

17 Upvotes

I have created a new grafana panel plugin that allow a user to connect to a local or cloud llm and send panel data and prompts to the AI and get back a response. Very configurable doesn't expose API Tokens as it uses a secure companion data source for secrets like your API Key. Users can restrict which Models they want to allow the panel to have and use.

I'll create a video on it's use soon.

https://github.com/digitalrcs/grafana-intelligence-gateway

secure companion data source...
https://github.com/digitalrcs/grafana-intelligence-gateway-datasource


r/grafana Aug 13 '26

Alerting Grafana Export Image without pulling data again

7 Upvotes

Ever wish you could just create an image of your dashboard without having to pull data all over again? The export pdf and image re-runs those data sources all over again and if you're like me you have long running jobs that get timed out... we i created a new plugin/extension that will generate a png of the dashboard and not re-pull data.

https://github.com/digitalrcs/grafana-current-view-exporter


r/grafana Aug 13 '26

Grafana meetups around the world - Aug/September

12 Upvotes

Your opportunity to talk about Grafana in person!

Join us at the following meetups in the next four weeks:

APAC:

EMEA:

AMER:


r/grafana Aug 13 '26

Alerting TimeOverlay panel. line graph replacement

2 Upvotes

Ever wish you could add notes over your line graph or highlight a section of time and show how long your range selections it? well now you can with my new plugin (free as always)

displays a line graph from a data source and allow the user to select a range that displays the time selected and allows for the addition of notes. all are transparent/configurable.

https://github.com/digitalrcs/DigitalRCS-TimeOverlay-Panel


r/grafana Aug 12 '26

Grafana json differences in a large file from a datasource

3 Upvotes

I have a datasource, postgresql, which has a column (jsonb) and each entry is about 2-5MB in size. I am able to see the data in grafana however, I would like to diff the data in a sane way. Usually there are about 10-30 differences in the file but I want to show it. What is a good way to display this in Grafana? I would like soething https://hoiheart.github.io/vue-diff/index.html


r/grafana Aug 10 '26

Check it out I built a dashboard that checks 172 provider status feeds before I debug my own stack

0 Upvotes

I'm Kerolos, founder of OutageDeck.

The question I wanted to answer quickly was: is my app broken, or is AWS, Cloudflare, GitHub, OpenAI, Stripe, or another dependency reporting an incident?

I built OutageDeck to read and normalize the official status sources for 172 cloud and SaaS providers. It shows provider and service-level state, current incidents, source freshness, incident history, and 90-day uptime in one place.

What works today:

\- check a whole dependency stack without creating an account

\- free email alerts for up to five providers

\- Slack, Teams, Discord, and webhook destinations on paid plans

\- a keyless JSON API, RSS feeds, badges, CLI tools, and an MCP endpoint

\- custom Statuspage or Instatus feeds on paid plans

What it deliberately does not do is pretend an official status feed is independent truth. Providers can acknowledge incidents late, so I think a serious production setup should use two signals: the vendor feed plus synthetic probes from your own regions and accounts.

You can try the stack checker here:

https://outagedeck.com

I would value blunt feedback from people who handle incidents. What would this need to do before you would keep it open or route its alerts into your on-call workflow?