How to ignore headers when merging single column of multiple CSV files? How to ignore headers when merging single column of multiple CSV files? unix unix

How to ignore headers when merging single column of multiple CSV files?


bash csv unix

You can do it with awk, nearly as you have already done, by adding a condition on the FNR (the record number per file):

awk -F, 'FNR > 1 {print $3}' *.csv > merged.csv

bash csv unix

Use tail and cut:

tail -q -n +2 *.csv | cut -f3 -d, > merged.csv
  • tail -n +2 prints all lines of files starting from line number 2
  • -q suppresses printing of file names
  • cut -f3 -d, extracts the third field, treating , as the delimiter

bash csv unix

try: If you have to read only 2 files.

awk -F, 'FNR>1{print $(NF-1)}' file[12]

Here I am making field separator as comma and then checking if line number is greater than 1 then printing the second last field. Point to be noted here is file[12] will only read files named file1 and file2, if you have more than that files use file* then.

Recent Posts
How can I color dots in a xy scatterplot according to column value?
How to update a claim in ASP.NET Identity?
What does {0} mean when initializing an object?
Accessing members of items in a JSONArray with Java
How to log SQL statements in Spring Boot?
Powershell Get-WebSite name parameter is ignored
How to detect scroll to bottom of html element
Java synchronized method
How to test controllers with CodeIgniter?
Detect Visual Composer
Matplotlib: Specify format of floats for tick labels
Rails join a list of strings with commas and "and" before the last