REST API interacting with Spark
You can use Apache Livy. It is specifically designed for this use case. We have used it in the past to control batch and regular jobs on a Spark cluster.
You can use Apache Livy. It is specifically designed for this use case. We have used it in the past to control batch and regular jobs on a Spark cluster.