Error: Python3.4 -> java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1 Error: Python3.4 -> java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1 hadoop hadoop

Error: Python3.4 -> java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1


Find the correct path of installed python3:

which python3

Assume that the result is:

/usr/bin/python3
  • Include --python-bin argument with in your command:

    python3 MovieRecommender.py --python-bin /usr/bin/python3 -r hadoop --items hdfs:///user/lim/u.data hdfs:///user/lim/u.item > test.txt

Or

  • Create a ~/.mrjob.conf file with this content:

    runners:  hadoop:    python_bin: /usr/bin/python3

    Then run your program with this command:

    python3 MovieRecommender.py -r hadoop --items hdfs:///user/lim/u.data hdfs:///user/lim/u.item > test.txt