#monitoring (2020-11)

Prometheus, Prometheus Operator, Grafana, Kubernetes

Archive: https://archive.sweetops.com/monitoring/

2020-11-19

2020-11-18

2020-11-17

joshmyers avatar
joshmyers

How are folks managing their Grafana dashboards? Templating JSON isn’t the one.

btai avatar

I had intended to go the path of version controlled dashboards w/ infra-as-code methodology but @Jeremy (Cloud Posse) made some good points on why that route is pain (specifically around updating dashboards). at the moment we’re just doing click-ops dashboard creation in the ui saved to a remote RDS db.

Jeremy (Cloud Posse) avatar
Jeremy (Cloud Posse)

@joshmyers Grafana dashboards are things where we do not want drift detection to undo ClickOps changes: we want people to be able to customize the dashboards via the Grafana UI.

We have a script in Geodesic called grafana-db we use to upload dashboards from various sources to Grafana via the Grafana API, and have Grafana store them in a remote database. This solves the problem of importing published dashboards in a way that makes them editable. For our installation, we maintain a script that loads the Grafana API key and runs grafana-db for every dashboard source we want.

cloudposse/geodesic

Geodesic is a cloud automation shell. It's the fastest way to get up and running with a rock solid, production grade cloud platform built on top of strictly Open Source tools. ★ this repo! h…

:--1:1
joshmyers avatar
joshmyers

Yeah, that isn’t gonna cut it for us. 100+ microservices that we want dashboards for so want something to generate via code

joshmyers avatar
joshmyers
grafana/grafonnet-lib

Jsonnet library for generating Grafana dashboard files. - grafana/grafonnet-lib

alxrem/terraform-provider-jsonnet

Terraform provider for generating JSON documents from Jsonnet templates - alxrem/terraform-provider-jsonnet

joshmyers avatar
joshmyers

https://github.com/grafana/grafonnet-lib doesn’t feel ready for prime time quite yet

grafana/grafonnet-lib

Jsonnet library for generating Grafana dashboard files. - grafana/grafonnet-lib

joshmyers avatar
joshmyers

heh, this is quite nice actually

    keyboard_arrow_up