Running YARN cluster in Kubernetes/Mesos

apache-spark docker kubernetes hadoop-yarn mesos

You can use the Apache Livy build for Kubernetes: https://github.com/jahstreet/spark-on-kubernetes-helm .This setup fully replaces Yarn supported features for Spark and adds some additional capabilities atop.