Hadoop: Connecting to ResourceManager failed Hadoop: Connecting to ResourceManager failed hadoop hadoop

Hadoop: Connecting to ResourceManager failed


The problem connecting recource manager was because ive needed to add a few properties to yarn-site.xml :

<property><name>yarn.resourcemanager.address</name><value>127.0.0.1:8032</value></property><property><name>yarn.resourcemanager.scheduler.address</name><value>127.0.0.1:8030</value></property><property><name>yarn.resourcemanager.resource-tracker.address</name><value>127.0.0.1:8031</value></property>

Yet, my Jobs arent runing but connecting is successful now


Make sure you've started Yarn. Use this command to start it:

start-yarn.sh

Then use this command to verify that the Resource Manager is running:

jps

The output should look something like this:

17542 NameNode

17920 SecondaryNameNode

22064 Jps

17703 DataNode

18226 ResourceManager

18363 NodeManager


The proper way might be adding the following lines in yarn-site.xml :

<property>    <name>yarn.resourcemanager.hostname</name>    <value>127.0.0.1</value></property>

Because the value field host represent a single hostname that can be set in place of setting all yarn.resourcemanager* address resources. Results in default ports for ResourceManager components.

Apache Hadoop 2.7.1 - Configurations for ResourceManager

  • Parameter: yarn.resourcemanager.hostname
  • Value: ResourceManager host.
  • Notes: host Single hostname that can be set in place of setting all yarn.resourcemanager*address resources. Results in default ports for ResourceManager components.