Best way to do a find/replace in several files? Best way to do a find/replace in several files? shell shell

Best way to do a find/replace in several files?


I'll throw in another example for folks using ag, The Silver Searcher to do find/replace operations on multiple files.

Complete example:

ag -l "search string" | xargs sed -i '' -e 's/from/to/g'

If we break this down, what we get is:

# returns a list of files containing matching stringag -l "search string"

Next, we have:

# consume the list of piped files and prepare to run foregoing command# for each file delimited by newlinexargs

Finally, the string replacement command:

# -i '' means edit files in place and the '' means do not create a backup# -e 's/from/to/g' specifies the command to run, in this case,# global, search and replacesed -i '' -e 's/from/to/g'


find . -type f -print0 | xargs -0 -n 1 sed -i -e 's/from/to/g'

The first part of that is a find command to find the files you want to change. You may need to modify that appropriately. The xargs command takes every file the find found and applies the sed command to it. The sed command takes every instance of from and replaces it with to. That's a standard regular expression, so modify it as you need.

If you are using svn beware. Your .svn-directories will be search and replaced as well. You have to exclude those, e.g., like this:

find . ! -regex ".*[/]\.svn[/]?.*" -type f -print0 | xargs -0 -n 1 sed -i -e 's/from/to/g'

or

find . -name .svn -prune -o -type f -print0 | xargs -0 -n 1 sed -i -e 's/from/to/g'


As Paul said, you want to first find the files you want to edit and then edit them. An alternative to using find is to use GNU grep (the default on Ubuntu), e.g.:

grep -r -l from . | xargs -0 -n 1 sed -i -e 's/from/to/g'

You can also use ack-grep (sudo apt-get install ack-grep or visit http://petdance.com/ack/) as well, if you know you only want a certain type of file, and want to ignore things in version control directories. e.g., if you only want text files,

ack -l --print0 --text from | xargs -0 -n 1 sed -i -e 's/from/to/g'# `from` here is an arbitrary commonly occurring keyword

An alternative to using sed is to use perl which can process multiple files per command, e.g.,

grep -r -l from . | xargs perl -pi.bak -e 's/from/to/g'

Here, perl is told to edit in place, making a .bak file first.

You can combine any of the left-hand sides of the pipe with the right-hand sides, depending on your preference.