Pyhive, SASL and Python 3.5 Pyhive, SASL and Python 3.5 hadoop hadoop

Pyhive, SASL and Python 3.5


We (I should say, IT-team) find a solution

Upgrade of python packages thrift (to version 0.10.0) and PyHive (to version 0.3.0) don’t know why the version we used wasn’t the latest.

Added the following:

<property><name>hive.server2.authentication</name><value>NOSASL</value></property>

To the following Hive config parameters in Cloudera Manager:

HiveServer2 Advanced Configuration Snippet (Safety Valve) for hive-site.xmlHive Client Advanced Configuration Snippet (Safety Valve) for hive-site.xml necessary so that HUE would work

from pyhive import hiveconn = hive.Connection(host="myserver", auth='NOSASL')import pandas as pdimport sysdf = pd.read_sql("SELECT * FROM my_table", conn) print(sys.getsizeof(df))df.head()

worked without problem/error.

Best,Tom


check if you have all the dependencies installed :

gcc-c++python-devel.x86_64cyrus-sasl-devel.x86_64

(assuming youre on windows)