problems running simple map-reduce hadoop examples in cygwin problems running simple map-reduce hadoop examples in cygwin hadoop hadoop

problems running simple map-reduce hadoop examples in cygwin


Here is a simple-to-use workaround that doesn't require any yak shaving:

https://github.com/congainc/patch-hadoop_7682-1.0.x-win


I've managed to get this working to the point where jobs are dispatched, tasks executed, and results compiled.

However we still need to get the servlets to understand cygwin symlinks. I have no idea how to do this in Jetty.

These two links show how to allow Tomcat and jetty to follow symlinks, but I don't know if this works in cygwin.* http://www.lamoree.com/machblog/index.cfm?event=showEntry&entryId=A2F0ED76-A500-41A6-A1DFDE0D1996F925* Configure Symlinks for single directory in Tomcat

Otherwise we'll have to open up the jetty code and replace java.io.File with org.apache.hadoop.fs.LinkedFile.