How to search for non-ASCII characters with bash tools? How to search for non-ASCII characters with bash tools? bash bash

How to search for non-ASCII characters with bash tools?


Try:

nonascii() { LANG=C grep --color=always '[^ -~]\+'; }

Which can be used like:

printf 'ŨTF8\n' | nonascii

Within [] ^ means "not". So [^ -~] means characters not between space and ~. So excluding control chars, this matches non ASCII characters, and is a more portable though slightly less accurate version of [^\x00-\x7f] below. The \+ means 1 or more and will get multibye characters to have a color shown around the complete character(s), rather than interspersed in each byte, thus corrupting the multibyte sequence


Try this command:

grep -P '[^\x00-\x7f]' file