Where does Hadoop store the logs of YARN applications? Where does Hadoop store the logs of YARN applications? hadoop hadoop

Where does Hadoop store the logs of YARN applications?


The container logs should be under yarn.nodemanager.log-dirs:

Where to store container logs. An application's localized log directory will be found in ${yarn.nodemanager.log-dirs}/application_${appid}. Individual containers' log directories will be below this, in directories named container_{$contid}. Each container directory will contain the files stderr, stdin, and syslog generated by that container.


Log-aggregation has been implemented in YARN, because of which the log file locations will vary when compared with Hadoop 1.

You can get the logs of your application in two ways, WebUi and Command line access.

Please go through the below document which gives you a very clear information on this log-aggregation implementation on YARN.

http://hortonworks.com/blog/simplifying-user-logs-management-and-access-in-yarn/

Thanks to the blog author, Vinod Kumar Vavilapalli.