Why oozie submits shell action to yarn? Why oozie submits shell action to yarn? hadoop hadoop

Why oozie submits shell action to yarn?


To answer this question, the difference is between

  1. running a shell script independently(.sh file or from CLI)
  2. running a shell action as a part of an oozie workflow.(shell script in an oozie shell action)

The first case is very obvious.

In the second case, oozie launches the shell script via YARN(is the resource negotiator )to run your shell script on the cluster where oozie is installed and runs MR jobs internally to launch the shell action. So the shell script runs as a YARN application internally. The logs of the oozie workflow shows the way the shell action is launched in oozie.