Cannot connect locally to hdfs kerberized cluster using IntelliJ
The Spark conf object was set incorrectly. Below is what worked for me:
val conf = new Configuration()conf.set("fs.defaultFS", "hdfs://namenodename.hugh.com:8020")conf.set("hadoop.security.authentication", "kerberos")conf.set("hadoop.rpc.protection", "privacy") ***---(was missing this parameter)***conf.set("dfs.namenode.kerberos.principal","hdfs/_HOST@HUGH.COM") ***---(this was initially wrongly set as dfs.namenode.kerberos.principal.pattern)***