How can I list subdirectories recursively for HDFS?

list hadoop find hdfs

The answer given by @Shubhangi Pardeshi is correct but for latest hadoop version command has deprecated. So new latest command can be used as below

hdfs dfs -ls -R /user | grep drwx

list hadoop find hdfs

To list directory contents recursively hadoop dfs -lsr /dirname command can be used.

To filter only directories , you can grep "drwx" (since owner has rwx permission on directories) in output of above command.

Hence whole command will look like as below.

$hadoop dfs -lsr /sqoopO7 | grep drwx

list hadoop find hdfs

The following method should be more robust to only get directories because it depends less on the permissions.

hdfs dfs -ls -R /folder | grep "^d"

CodeHunter