Pig JVM java heap space error Pig JVM java heap space error hadoop hadoop

Pig JVM java heap space error


Probably a problem with the BZip codec - the API does note that it's rather memory hungry:

When you increased the memory with -Xms2048m did you set the options for the pig grunt shell, or for the map/reduce jobs?

set mapred.child.java.opts=-Xmx2048m

You can check by looking in the JobTracker, find the job that failed, open the job.xml and locate the value of mapred.child.java.opts