Checking if directory in HDFS already exists or not Checking if directory in HDFS already exists or not hadoop hadoop

Checking if directory in HDFS already exists or not


shell hadoop scripting hdfs

Try w/o test command []:

if $(hadoop fs -test -d $yourdir) ; then echo "ok";else echo "not ok"; fi

shell hadoop scripting hdfs

Since

hdfs dfs -test -d $yourdir

return 0 if exists, then

if [ $? == 0 ]; then    echo "exists"else    echo "dir does not exists"fi

shell hadoop scripting hdfs

Hadoop fs is deprecatedUsage: hdfs dfs -test -[ezd] URI

Options:The -e option will check to see if the file exists, returning 0 if true.The -z option will check to see if the file is zero length, returning 0 if true.The -d option will check to see if the path is directory, returning 0 if true.Example: hdfs dfs -test -d $yourdir

Please check the following for more info: https://hadoop.apache.org/docs/r2.4.1/hadoop-project-dist/hadoop-common/FileSystemShell.htmlRegards

Recent Posts
How can I color dots in a xy scatterplot according to column value?
How to update a claim in ASP.NET Identity?
What does {0} mean when initializing an object?
Accessing members of items in a JSONArray with Java
How to log SQL statements in Spring Boot?
Powershell Get-WebSite name parameter is ignored
How to detect scroll to bottom of html element
Java synchronized method
How to test controllers with CodeIgniter?
Detect Visual Composer
Matplotlib: Specify format of floats for tick labels
Rails join a list of strings with commas and "and" before the last