error when reading from S3 using Spark/Hadoop error when reading from S3 using Spark/Hadoop hadoop hadoop

error when reading from S3 using Spark/Hadoop


When you run a Hadoop job you have to set the Hadoop classpath Environmental Variable. Typically, this is done in the Hadoop startup script.

export HADOOP_CLASSPATH=/path/to/yourlib:/path/to/your/other/lib

replace the : with a ; if you are on windows.