Dynamically Tagging Pods with 'safe-to-evict' During Idle Times

[rhyswilliamsza]

The recommended approach for autoscaling RunnerSets/deployments is to tag them accordingly, allowing cluster-autoscaler to evict runners where needed for node autoscaling.

annotations:
cluster-autoscaler.kubernetes.io/safe-to-evict: "true"

It would help us if this annotation could be dynamically applied to the pod when no jobs are running. This will allow the cluster-autoscaler to clean up unnecessary nodes during idle times, preventing the autoscaler from evicting pods while running jobs.