Accessing hdfs from docker-hadoop-spark--workbench via zeppelin
Reason for the exception is that the sparkSession
object is null
for some reason in Zeppelin.
private SparkContext createSparkContext_2() { return (SparkContext) Utils.invokeMethod(sparkSession, "sparkContext");}
Might be a configuration related issue. Please cross-verify the settings/configuration and spark cluster settings. Make sure that spark is working fine.
Reference: https://zeppelin.apache.org/docs/latest/interpreter/spark.html
Hope this helps.