Loop over files in HDFS directory

This should work

for filename in `hadoop fs -ls /path/to/directory | awk '{print $NF}' | grep .csv$ | tr '\n' ' '`do echo $filename; done

bash hadoop hdfs

The -C option will display only the file paths.

for filename in $(hadoop fs -ls -C /path/to/directory/*.csv); do    echo "${filename}"done

CodeHunter