measure the duration of the whole map phase per node in Hadoop measure the duration of the whole map phase per node in Hadoop hadoop hadoop

measure the duration of the whole map phase per node in Hadoop


You can use the User Defined Java Counters to derived the time taken by all Mappers per Node.

In the Mapper implementation you need to do the following,1. override the setup and record the starttime.long startTime = System.currentTimeMillis();2. override the cleanup method

long endTime = System.currentTimeMillis(); String hostname = java.net.InetAddress.getLocalHost().getHostName(). context.getCounters(hostname,"time consumed").increment(endTime - startTime);