Execution with wrong timestamps in action workflow #6336
-
|
Hello, we have having the issue where the executions were running in wrong timestamps and failing the action workflow. The action workflow is triggered by cron for every 45 minutes. The Stackstorm is deployed in K8s in HA mode. I looked at the logs and saw RabbitMQ is syncing messages. May I know what might causing this issue?
|
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
I’ve figured out what happened. Two Redis pods were down and lost the quorum. The Redis cluster only went back online at 11:49, and all the triggered workflow queues started running. I wish Stackstorm could skip the old triggered workflows and only run the latest ones. I need to find a workaround. |
Beta Was this translation helpful? Give feedback.
I’ve figured out what happened. Two Redis pods were down and lost the quorum. The Redis cluster only went back online at 11:49, and all the triggered workflow queues started running. I wish Stackstorm could skip the old triggered workflows and only run the latest ones. I need to find a workaround.