Graphite exporter mapping regex difficulties
If I understand correctly you try to build something like Spark -> Graphite -> Prometheus -> Grafana. Avoid to do that since Graphite adds overhead to your monitoring system.
You have several options available:
- Query Graphite directly from Grafana with Graphite data source
- Setup Jmx Exporter properly. You can refer the discussion to get the idea on how to do it with jmx-exporter. Also I can help you to deal with the errors you have if you share the problems you have with it.
- Setup Prometheus Push Gateway and the corresponding Spark Prometheus sink. Note that this solution is advised for short running jobs. If you have long running jobs the Jmx Exporter is preferable.
Hope it helps.