Python: How to get StringIO.writelines to accept unicode string? Python: How to get StringIO.writelines to accept unicode string? python python

Python: How to get StringIO.writelines to accept unicode string?


python string unicode ascii stringio

You can wrap the StringIO object in a codecs.StreamReaderWriter object to automatically encode and decode unicode.

Like this:

import cStringIO, codecsbuffer = cStringIO.StringIO()codecinfo = codecs.lookup("utf8")wrapper = codecs.StreamReaderWriter(buffer,         codecinfo.streamreader, codecinfo.streamwriter)wrapper.writelines([u"list of", u"unicode strings"])

buffer will be filled with utf-8 encoded bytes.

If I understand your case correctly, you will only need to write, so you could also do:

import cStringIO, codecsbuffer = cStringIO.StringIO()wrapper = codecs.getwriter("utf8")(buffer)

python string unicode ascii stringio

StringIO documentation:

Unlike the memory files implemented by the StringIO module, those provided by [cStringIO] are not able to accept Unicode strings that cannot be encoded as plain ASCII strings.

If possible, use StringIO instead of cStringIO.

python string unicode ascii stringio

You can also encode your string as utf-8 manually before adding it to the StringIO

for val in rows:    if isinstance(val, unicode):        val = val.encode('utf-8')result.writelines(rows)

Recent Posts
How can I color dots in a xy scatterplot according to column value?
How to update a claim in ASP.NET Identity?
What does {0} mean when initializing an object?
Accessing members of items in a JSONArray with Java
How to log SQL statements in Spring Boot?
Powershell Get-WebSite name parameter is ignored
How to detect scroll to bottom of html element
Java synchronized method
How to test controllers with CodeIgniter?
Detect Visual Composer
Matplotlib: Specify format of floats for tick labels
Rails join a list of strings with commas and "and" before the last