yarn-daemon.sh writes to wrong log directory in HDP
Majid,
The startup script you are using, i.e. /usr/hdp/current/hadoop-yarn-resourcemanager/sbin/yarn-daemon.sh sources the yarn-env.sh script that is located in the configuration directory you specified, in your case
--config /etc/hadoop/conf
Chances are that those environment variables are being overridden in that script. If you are using the companion files provided by Hortonwork's then they are indeed being changed to:
export YARN_LOG_DIR=/var/log/hadoop-yarn/$USERexport YARN_PID_DIR=/var/run/hadoop-yarn/$USERexport HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexecYou're best bet is to change these values in your /etc/hadoop/yarn-env.sh script to the values you desire and retry