how to clean the hadoop-hdfs logs under /var/log/hadoop-hdfs how to clean the hadoop-hdfs logs under /var/log/hadoop-hdfs hadoop hadoop

how to clean the hadoop-hdfs logs under /var/log/hadoop-hdfs


First of all, Hadoop is designed for much larger capacity than the ones you mention, which means that 5.5GB logs aren't that much usually. This explains why the default settings is not appropriate in your case.

You can:

  • reduce the number of log files that are retained with the variable navigator.audit_log_max_backup_index (usually 10)
  • or the max log file size with navigator.audit_log_max_file_size