Broken python pipeline in Hadoop streaming
Mystery solved! It should be due to the memory limitation imposed by hadoop that caused the command cannot load successfully. The command needs about 2G memory and hadoop is configured to allow about 800MB per node.