Spark Operator Integration with Dagster #28700
dineshpabbi10
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Was checking flyte.io which supports spark operator out of the box. Would be great to have something similar set up for Dagster. Although we do have support for EMR/GLUE, some teams prefer to host their apps within a k8s environment and not pushing their images to ECS (Hard dependency when using EMR/GLUE)
Beta Was this translation helpful? Give feedback.
All reactions