Hadoop : Code shipped from master to slave Hadoop : Code shipped from master to slave hadoop hadoop

Hadoop : Code shipped from master to slave


From the mapreduce tutorial:

The framework will copy the necessary files to the slave node before any tasks for the job are executed on that node. Its efficiency stems from the fact that the files are only copied once per job and the ability to cache archives which are un-archived on the slaves.

More info here:

http://hadoop.apache.org/common/docs/current/mapred_tutorial.html