How to remove \xa0 from string in Python?
\xa0 is actually non-breaking space in Latin1 (ISO 8859-1), also chr(160). You should replace it with a space.
string = string.replace(u'\xa0', u' ')
When .encode('utf-8'), it will encode the unicode to utf-8, that means every unicode could be represented by 1 to 4 bytes. For this case, \xa0 is represented by 2 bytes \xc2\xa0.
Read up on http://docs.python.org/howto/unicode.html.
Please note: this answer in from 2012, Python has moved on, you should be able to use unicodedata.normalize now
There's many useful things in Python's unicodedata library. One of them is the .normalize() function.
Try:
new_str = unicodedata.normalize("NFKD", unicode_str)Replacing NFKD with any of the other methods listed in the link above if you don't get the results you're after.
Try using .strip() at the end of your lineline.strip() worked well for me