Replies: 1 comment
-
I've got the same use case. What we did was, have dag produce a Asset with a Cron interval and add this to the schedule of the needed Dag. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi everyone,
I’m working on a use case where I need to run a DAG only when two conditions are both met:
This is essentially the reverse of the current behavior with
DatasetAll
orDatasetAny
, where datasets trigger a DAG immediately when ready. What I’m looking for is a way to combine time-based scheduling and dataset triggering using an AND condition, so that the DAG only runs when:AND
The motivation behind this is to avoid premature DAG runs — for example, if the dataset is delayed or not produced yet, the DAG should skip the current time slot and wait for the next one where both conditions are satisfied.
I've been experimenting with a custom
Timetable
to implement this, but I wanted to first ask:Would love to hear your thoughts or suggestions for a cleaner way to achieve this.
Thanks!
Beta Was this translation helpful? Give feedback.
All reactions