Accessing hdfs from docker-hadoop-spark--workbench via zeppelin Accessing hdfs from docker-hadoop-spark--workbench via zeppelin hadoop hadoop

Accessing hdfs from docker-hadoop-spark--workbench via zeppelin


Reason for the exception is that the sparkSession object is null for some reason in Zeppelin.

Reference: https://github.com/apache/zeppelin/blob/master/spark/src/main/java/org/apache/zeppelin/spark/SparkInterpreter.java

private SparkContext createSparkContext_2() {    return (SparkContext) Utils.invokeMethod(sparkSession, "sparkContext");}

Might be a configuration related issue. Please cross-verify the settings/configuration and spark cluster settings. Make sure that spark is working fine.

Reference: https://zeppelin.apache.org/docs/latest/interpreter/spark.html

Hope this helps.