Mapreduce combinefileinputformat java.lang.reflect.InvocationTargetException while two jobs access same data Mapreduce combinefileinputformat java.lang.reflect.InvocationTargetException while two jobs access same data hadoop hadoop

Mapreduce combinefileinputformat java.lang.reflect.InvocationTargetException while two jobs access same data


Finally i got the cause of this issue, actually i have been using the CombineFileInputFormat with gzip, so the first runnning job was extracting the gzip file in the same folder and was deleting it on its completion, however when i ran another job in parallel it also takes the file unzipped by the firstjob in its input.

So in between the execution of the second job the unzipped file was getting deleted by the first job, this actually was causing error.

Similar will be the case with hive.