How to clenup table event_logs? #12985
-
|
Hi. I noticed that the dagster database takes up a lot of disk space. The largest table is event_logs (99% size) | event_logs | 18 GB | How can I clear these logs? Can I set a retention period for these logs? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 3 replies
-
|
Hey Vasyl! Have you seen this post on how to programmatically clean up the event logs? The summary is that you can use I don't believe there is a way to set a retention policy, but I'll take that feedback back to the team! If that satisfies your needs, I'll mark this discussion as a duplicate of that linked one! |
Beta Was this translation helpful? Give feedback.
-
|
Thank you for your help. Yes, I saw this message. I hope the feature "set a retention period for logs" will be added in the near future) |
Beta Was this translation helpful? Give feedback.
-
|
+1 on retention period for logs |
Beta Was this translation helpful? Give feedback.
-
|
+1 on log retention |
Beta Was this translation helpful? Give feedback.
#12047
Hey Vasyl! Have you seen this post on how to programmatically clean up the event logs? The summary is that you can use
DagsterInstance.get(), fetch the run logs from there, and then delete those runs and their logs.I don't believe there is a way to set a retention policy, but I'll take that feedback back to the team!
If that satisfies your needs, I'll mark this discussion as a duplicate of that linked one!