Enabling "ignore-daemonsets-utilization" in Production AKS

[SenuraMalaka]

The ignore-daemonsets-utilization feature is still in preview, raising concerns about its stability for production use.

Our Use Case
Daemonsets consume about 42% of resources per node, preventing scaling down due to high overall resource usage (In combination resource allocation for other regular services).

We considered:

• Setting scale-down-utilization-threshold to 0.6 or 0.65 to trigger scaling down when resource usage is below 60-65%. However, Daemonsets alone use 42%, and adding other services pushes overall usage beyond 70%.
• Enabling ignore-daemonsets-utilization, but this feature's preview status makes its reliability uncertain.

Questions:

1. Is it safe to enable ignore-daemonsets-utilization in production for our use case? Are there known issues with this preview feature?
2. How will AKS assess resource utilization for scaling down if ignore-daemonsets-utilization is enabled?
   Example: With Daemonsets using 40% CPU and other services 30%, total CPU usage is 70%. With scale-down-utilization-threshold at 0.5, scaling down won’t occur. If ignore-daemonsets-utilization is enabled, will AKS only consider the 30% from regular services, thus triggering scaling down?