Celery with Django - deployment

Question

I am considering using celery in my project. I found a lot of information about how to use it etc. What I am interested in is how to deploy/package my solution.

I need to run two components - django app and then celeryd worker (component that sends emails). For example I would like my django app to use email_ticket task that would email support tickets. I create tasks.py in the django app.

@task
def email_ticket(from, message):
...

Do I deploy my django app and then just run celeryd as separate process from the same path?

./manage.py celeryd ...

What about workers on different servers? Deploy whole django application and run only celeryd? I understand I could use celery only for the worker, but I would like to use celerycam and celerybeat.

Any feedback is appreciated. Thanks

Thanks for any feedback.

Good question. The accepted answer ("deploy everything") is certainly simple and robust -- but not optimal. Maybe someone can think of a nice way to distribute only the required code to "worker" machines, while not complicating the whole process too much. — Nick Perkins

Ted Carroll Ted Carroll · Accepted Answer · 2011-01-26T01:04:13

This is covered in the documentation here. The gist is you need to download some init scripts and setup some config. Once that's done celeryd will start on boot and you'll be off and running.

Celery with Django - deployment

1 Answers