[kube-prometheus-stack] Kubernetes / Kubelet grafana dashboard - running containers metrics issue

[TomaszSienko]

Hi,
I've noticed Kubernetes / Kubelet grafana dashboard is not correctly showing the sum of running containers. The Running Containers panel using query:

sum(kubelet_running_containers{cluster="$cluster", job="kubelet", metrics_path="/metrics", instance=~"$instance"})

Which is not showing the correct amount of running containers.

The correct one should be:

sum(kubelet_running_containers{cluster="$cluster", job="kubelet", metrics_path="/metrics", instance=~"$instance", container_state="running"})

So it should also include the container_state="running" parameter.

What's your helm version?

v3.15.1

What's your kubectl version?

v1.30.1

Which chart?

prometheus-community/kube-prometheus-stack

What's the chart version?

66.3.0

What happened?

No response

What you expected to happen?

No response

How to reproduce it?

No response

Enter the changed values of values.yaml?

No response

Enter the command that you execute and failing/misfunctioning.

sum(kubelet_running_containers{cluster="$cluster", job="kubelet", metrics_path="/metrics", instance=~"$instance", container_state="running"})

Anything else we need to know?

No response