Submit Spark Application on Kubernetes in Cluster mode : Configured service account doesn't have access Submit Spark Application on Kubernetes in Cluster mode : Configured service account doesn't have access kubernetes kubernetes

Submit Spark Application on Kubernetes in Cluster mode : Configured service account doesn't have access


You have to create an authorized service account: https://spark.apache.org/docs/latest/running-on-kubernetes.html#rbac

kubectl create serviceaccount sparkkubectl create clusterrolebinding spark-role --clusterrole=edit --serviceaccount=default:spark --namespace=default

And then pass it as a parameter to the submit

--conf spark.kubernetes.authenticate.driver.serviceAccountName=spark