Convert dataframe to hive table in spark scala Convert dataframe to hive table in spark scala hadoop hadoop

Convert dataframe to hive table in spark scala


saveAsTable in spark is not compatible with hive. I am on CDH 5.5.2. Workaround from cloudera website:

df.registerTempTable(tempName) hsc.sql(s"""   CREATE TABLE $tableName (     // field definitions   ) STORED AS $format """) hsc.sql(s"INSERT INTO TABLE $tableName SELECT * FROM $tempName")

http://www.cloudera.com/documentation/enterprise/release-notes/topics/cdh_rn_spark_ki.html