build hadoop 2.2 on windows

I found the solution to this problem. I have VS 2012 on Windows 8.1 andfaced this exact issue. I checked out the pom.xml under hadoop-common forthat execution id and ran the following command

F:\HDP>msbuild F:\HDP\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln /nologo/p:Configuration=Release;OutDir=bin

It gave me the following exception

C:\Program Files(x86)\MSBuild\Microsoft.Cpp\v4.0\V110\Microsoft.Cpp.Platform.targets(42,5): error MSB8020: The builds tools for Visual Studio 2010 (Platform Toolset ='v100') cannot be found.To build using the v100 build tools, either click the Project menu or right-click the solution, and then select "Update VC++ Projects...". Install Visual Studio 2010 to build using the Visual Studio 2010 build tools.[F:\HDP\hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj]

Since I do not have Visual Studio 2010 on my machine, the problem had to bein the solution. I opened the solution in VS 2012 and compiled it once.Executing maven again gave me another error but this time pointing tohadoop-common\src\main\native\native.sln. I opened that on VS 2012 too andno error.

Hope this helps

ThanksRohit

I have followed following steps to install Hadoop 2.2.0

Steps to build Hadoop bin distribution for Windows

1. Download and install Microsoft Windows SDK v7.1.

2. Download and install Unix command-line tool Cygwin.

3. Download and install Maven 3.1.1.

4. Download Protocol Buffers 2.5.0 and extract to a folder (say c:\protobuf).

5. Add Environment Variables JAVA_HOME, M2_HOME and Platform if not added already. Note : Variable name Platform is case sensitive. And value will be either x64 or Win32 for building on a 64-bit or 32-bit system. Edit Path Variable to add bin directory of Cygwin (say C:\cygwin64\bin), bin directory of Maven (say C:\maven\bin) and installation path of Protocol Buffers (say c:\protobuf).

6. Download hadoop-2.2.0-src.tar.gz and extract to a folder having short path (say c:\hdfs) to avoid runtime problem due to maximum path length limitation in Windows.

7. Select Start --> All Programs --> Microsoft Windows SDK v7.1 and open Windows SDK 7.1 Command Prompt. Change directory to Hadoop source code folder (c:\hdfs). Execute mvn package with options -Pdist,native-win -DskipTests -Dtar to create Windows binary tar distribution.

8. If everything goes well in the previous step, then native distribution hadoop-2.2.0.tar.gz will be created inside C:\hdfs\hadoop-dist\target\hadoop-2.2.0 directory.

Install Hadoop

1. Extract hadoop-2.2.0.tar.gz to a folder (say c:\hadoop).

2. Add Environment Variable HADOOP_HOME and edit Path Variable to add bin directory of HADOOP_HOME (say C:\hadoop\bin).

Configure Hadoop

C:\hadoop\etc\hadoop\core-site.xml

<configuration>        <property>                <name>fs.defaultFS</name>                <value>hdfs://localhost:9000</value>        </property></configuration>

C:\hadoop\etc\hadoop\hdfs-site.xml

<configuration>        <property>                <name>dfs.replication</name>                <value>1</value>        </property>        <property>                <name>dfs.namenode.name.dir</name>                <value>file:/hadoop/data/dfs/namenode</value>        </property>        <property>                <name>dfs.datanode.data.dir</name>                <value>file:/hadoop/data/dfs/datanode</value>        </property></configuration>

C:\hadoop\etc\hadoop\mapred-site.xml

<configuration>        <property>           <name>mapreduce.framework.name</name>           <value>yarn</value>        </property></configuration>

C:\hadoop\etc\hadoop\ yarn-site.xml

<configuration>        <property>           <name>yarn.nodemanager.aux-services</name>           <value>mapreduce_shuffle</value>        </property>        <property>           <name>yarn.nodemanager.aux-services.mapreduce_shuffle.class</name>           <value>org.apache.hadoop.mapred.ShuffleHandler</value>        </property></configuration>

Format namenode

For the first time only, namenode needs to be formatted.

C:\Users\abhijitg>cd c:\hadoop\bin c:\hadoop\bin>hdfs namenode –format

Start HDFS (Namenode and Datanode)

C:\Users\abhijitg>cd c:\hadoop\sbinc:\hadoop\sbin>start-dfs

Start MapReduce aka YARN (Resource Manager and Node Manager)

C:\Users\abhijitg>cd c:\hadoop\sbinc:\hadoop\sbin>start-yarnstarting yarn daemons

Total four separate Command Prompt windows will be opened automatically to run Namenode, Datanode, Resource Manager, Node Manager

Reference : Build, Install, Configure and Run Apache Hadoop 2.2.0 in Microsoft Windows OS

I had the same problem. I solved it by

1. opening a dos command prompt

2. starting "c:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\vcvarsall.bat" which modifies the PATH variable and sets some other variables

3. After that I started cygwin directly from this command prompt
   
   C:\cygwin64\bin\mintty.exe -i /Cygwin-Terminal.ico -
   
   

Now the PATH is properly formatted and msbuild is found ...

Hope this helps!

BTW: If it is complaining about the wrong version of msbuild maybe you have to install Visual Studio Express 2010. Or as I read elsewhere you can use VisualStudioExpress2012 and set VS100COMNTOOLS pointing to VS110COMNTOOLS.