What is the python "with" statement designed for? What is the python "with" statement designed for? python python

What is the python "with" statement designed for?


  1. I believe this has already been answered by other users before me, so I only add it for the sake of completeness: the with statement simplifies exception handling by encapsulating common preparation and cleanup tasks in so-called context managers. More details can be found in PEP 343. For instance, the open statement is a context manager in itself, which lets you open a file, keep it open as long as the execution is in the context of the with statement where you used it, and close it as soon as you leave the context, no matter whether you have left it because of an exception or during regular control flow. The with statement can thus be used in ways similar to the RAII pattern in C++: some resource is acquired by the with statement and released when you leave the with context.

  2. Some examples are: opening files using with open(filename) as fp:, acquiring locks using with lock: (where lock is an instance of threading.Lock). You can also construct your own context managers using the contextmanager decorator from contextlib. For instance, I often use this when I have to change the current directory temporarily and then return to where I was:

    from contextlib import contextmanagerimport os@contextmanagerdef working_directory(path):    current_dir = os.getcwd()    os.chdir(path)    try:        yield    finally:        os.chdir(current_dir)with working_directory("data/stuff"):    # do something within data/stuff# here I am back again in the original working directory

    Here's another example that temporarily redirects sys.stdin, sys.stdout and sys.stderr to some other file handle and restores them later:

    from contextlib import contextmanagerimport sys@contextmanagerdef redirected(**kwds):    stream_names = ["stdin", "stdout", "stderr"]    old_streams = {}    try:        for sname in stream_names:            stream = kwds.get(sname, None)            if stream is not None and stream != getattr(sys, sname):                old_streams[sname] = getattr(sys, sname)                setattr(sys, sname, stream)        yield    finally:        for sname, stream in old_streams.iteritems():            setattr(sys, sname, stream)with redirected(stdout=open("/tmp/log.txt", "w")):     # these print statements will go to /tmp/log.txt     print "Test entry 1"     print "Test entry 2"# back to the normal stdoutprint "Back to normal stdout again"

    And finally, another example that creates a temporary folder and cleans it up when leaving the context:

    from tempfile import mkdtempfrom shutil import rmtree@contextmanagerdef temporary_dir(*args, **kwds):    name = mkdtemp(*args, **kwds)    try:        yield name    finally:        shutil.rmtree(name)with temporary_dir() as dirname:    # do whatever you want


I would suggest two interesting lectures:

  • PEP 343 The "with" Statement
  • Effbot Understanding Python's"with" statement

1.The with statement is used to wrap the execution of a block with methods defined by a context manager. This allows common try...except...finally usage patterns to be encapsulated for convenient reuse.

2.You could do something like:

with open("foo.txt") as foo_file:    data = foo_file.read()

OR

from contextlib import nestedwith nested(A(), B(), C()) as (X, Y, Z):   do_something()

OR (Python 3.1)

with open('data') as input_file, open('result', 'w') as output_file:   for line in input_file:     output_file.write(parse(line))

OR

lock = threading.Lock()with lock:    # Critical section of code

3.I don't see any Antipattern here.
Quoting Dive into Python:

try..finally is good. with is better.

4.I guess it's related to programmers's habit to use try..catch..finally statement from other languages.


The Python with statement is built-in language support of the Resource Acquisition Is Initialization idiom commonly used in C++. It is intended to allow safe acquisition and release of operating system resources.

The with statement creates resources within a scope/block. You write your code using the resources within the block. When the block exits the resources are cleanly released regardless of the outcome of the code in the block (that is whether the block exits normally or because of an exception).

Many resources in the Python library that obey the protocol required by the with statement and so can used with it out-of-the-box. However anyone can make resources that can be used in a with statement by implementing the well documented protocol: PEP 0343

Use it whenever you acquire resources in your application that must be explicitly relinquished such as files, network connections, locks and the like.