Efficient Python to Python IPC [closed] Efficient Python to Python IPC [closed] python python

Efficient Python to Python IPC [closed]


Native objects don't get shared between processes (due to reference counting).

Instead, you can pickle them and share them using unix domain sockets, mmap, zeromq, or an intermediary such a sqlite3 that is designed for concurrent accesses.


Use multiprocessing to start with.

If you need multiple CPU's, look at celery.


Both execnet and Pyro mention PyPy <-> CPython communication. Other packages from Python Wiki's Parallel Processing page are probably suitable too.