launching adhoc docker instances: Is it recommended to launch a docker instance per request? launching adhoc docker instances: Is it recommended to launch a docker instance per request? nginx nginx

launching adhoc docker instances: Is it recommended to launch a docker instance per request?


Originally I said this should work well for low traffic sites, but upon further thought, no, this is a bad idea.

Each time you launch a Docker container, it adds a read-write layer to the image. Even if there is very little data written, the layer exists, and each request will generate one. When a single user visits a website, rendering the page will generate 10's to 1000's of requests, for CSS, for javascript, for each image, for fonts, for AJAX, and each of these would create those read-write layers.

Right now there is no automatic cleanup of the read-write layers -- they persist even after the Docker container has exited. By default, nothing is lost.

So, even for a single low traffic site, you would find your disk use growing steadily over time. You could add your own automated cleanup.

Then there is the second problem: anything uploaded to the website would not be available to any other requests unless it was written to some out-of-container shared storage. That's pretty easy to do with S3 or a separate and persistent database service, but it does start showing the weakness in the "one new Docker container per request" approach. If you're going to have some persistent services, why not make the Docker containers more persistent and run them longer?