Quantcast
Channel: Dev Blog
Viewing all articles
Browse latest Browse all 10

In Python, thread safe does not mean fork safe

$
0
0

We discovered this in a not so easily reproducible way. Here at Mahalo we use this wonderful distributed task queue called Celery. Upon restarting the celeryd server, rarely (until recently) and only some of the workers would throw MemcachedError during their first task. The cause of the issue would be receiving a "STORED" reponse to a memcached_get (wtf?!) or some other variant of invalid response or an EINPROGRESS (which is the socket is already busy doing something). Now another tidbit, we also use Pylibmc which is a wrapper around the libmemcached C library which we've written a custom Django cache interface for.

Read More...


Viewing all articles
Browse latest Browse all 10

Trending Articles