spark-submit operator dag issue with standalone server #13280
Unanswered
Karthik-PlantSense
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
hi everyone,

i want to submit my python code through spark submit operator. but the dag got import error.
it is saying
Broken DAG: [/home/chaithanya/karthik/airflow/dags/sparkDag.py] Traceback (most recent call last): File "/home/chaithanya/karthik/airflow/lib64/python3.6/site-packages/airflow/providers/apache/spark/hooks/spark_submit.py", line 32, in <module> from airflow.kubernetes import kube_client File "/home/chaithanya/karthik/airflow/lib64/python3.6/site-packages/airflow/kubernetes/kube_client.py", line 101, in <module> ) -> client.CoreV1Api: NameError: name 'client' is not defined
anyone help me to submit my python file.
and also the connection for spark is
Beta Was this translation helpful? Give feedback.
All reactions