Figured it out! Hadoop looks for libraries inside the "lib" folder of the final jar. So, add the following to the "jar" task.
jar { doFirst { into('lib') { from configurations.runtime } } }