Category "prometheus"

Prometheus - debugging slow query

The following query is taking more than 1 min, and timing out. It's made from Grafana: /grafana/api/datasources/proxy/2/api/v1/query_range? query=rate(rmq_pu

Use conditional operator in Prometheus alert rules to set severity

I would like to use the conditional operator into the Prometheus alert.rules definition to set a specific severity. For instance, if the environment is producti

Prometheus create label from metric label

We are running the node-exporter in containers. To quickly identify on which host each node-exporter is running, I created a metric that looks like this: host{h

Prometheus scrape config for multiple metric endpoints per pod

We have a Kubernetes Pod which provides multiple metric endpoints (:3093/metrics and :9113/metrics), but it also has an port which doesn't provide any metric (:

How to configure prometheus with alertmanager?

docker-compose.yml: This is the docker-compose to run the prometheus, node-exporter and alert-manager service. All the services are running great. Even the h

Grafana chained variables in repeating rows

I have a dashboard that uses two variables: $clients is a static list and $running_sessions is the result of a MySql query that uses $clients (something like s

Why endorser_proposals_recieved (Hyperledger fabric peer-metric) is giving different values at different peers?

We are using Hyperledger fabric 2.2.3 with 3 organizations 2 peers each, a total 6 endorsing peers,3 orderers, and using the Prometheus tool for monitoring. usi

Prometheus query in Grafana with query variable

My Grafana panel query is sum(kube_pod_container_resource_limits_cpu_cores{node=~"$workers"}) / sum(kube_node_status_allocatable_cpu_cores{node=~"$workers"}) T

Use Prometheus in .net core application

I am doing POC using Prometheus in .net core app. I did not found sufficient information on Prometheus website to get started , I have following question if som

promQL how to divide node_load by number of cores

I have load. node_load1 node_load1{group="FTP",instance="10.41.48.100:9100",job="node"} 0.1 node_load1{group="Prometheus",instance="localhost:9100",job="node"}

Prometheus not sending alarms to Alertmanager

although I can see my alarms on prometheus, I cannot view alarms via alertmanager, although their status is Firing. My settings; prometheus.yml config # Alert

Match by exported instance in Grafana and Prometheus

I'm working in Grafana and Prometheus and I have Pushgateway exporting some stats for me. In Grafana, I am trying to display these results per machine. My jobs

Filter prometheus gauge metrics by value range

Prometheus does support binary comparison operators between an instant vector and a scalar. E.g. memory_usage_bytes > 1024. But is it possible to query a gau

Loki Ruler not sending alerts to alert Manager

I have loki + grafana + prometheus running in EKS using official helm charts. I want to send alerts based on error log messages and for that i'm trying to use t

aggregate of <aggregation>_over_time() in prometheus?

Prometheus has functions to e.g. get the max of a given range of data points or min or ... See the documentation for more info. Now when I want min(data) and m

Can I find the timestamp of the last value change

Given a time series, is it possible to find the timestamp of the last value change? For example, a cron job runs every night. It first runs an rsync job, and l

How to set Prometheus Alertmanager externalURL and generatorURL via configuration

How to set externalURL and generatorURL? Is it possible to set the URL via configuration file or environment variable? Who can help me?

What is the maximum scrape_interval in Prometheus

I used Prometheus to measure business metrics like: # HELP items_waiting_total Total number of items in a queue # TYPE items_waiting_total gauge items_waiting_

How to relabel address with it's current value and a label

In a json config file (referred to from file_sd_configs ) I have entries such as [ ... "targets": [ "10.123.456.789"], "labels": { "node_exporter_port

Why Alertmanager failed to send alerts to slack

I have created alerts, that fires and can be seen in Alertmanager. So previously I was able to get notifications to the Slack channel. I don't know what caused