Error: Python3.4 -> java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
Find the correct path of installed python3:
which python3
Assume that the result is:
/usr/bin/python3
Include
--python-bin
argument with in your command:python3 MovieRecommender.py --python-bin /usr/bin/python3 -r hadoop --items hdfs:///user/lim/u.data hdfs:///user/lim/u.item > test.txt
Or
Create a
~/.mrjob.conf
file with this content:runners: hadoop: python_bin: /usr/bin/python3
Then run your program with this command:
python3 MovieRecommender.py -r hadoop --items hdfs:///user/lim/u.data hdfs:///user/lim/u.item > test.txt