Saturday, April 20, 2013

Re: How many workers do you run on one machine using django celery?

Both Michael and Shawn are spot-on in terms of scaling and using the queuing.

However, I'd like to add that 5 seconds to complete a single task like this seems way too slow to me. I don't have much experience with sending SMS but if you're using an external SMS API, it should be extremely quick. I imagine it's something along the lines of just a simple HTTP Request and checking the response to make sure the request was successfully accepted. Manually test this to see how long it takes from your own computer. If it is very quick, check for bottlenecks elsewhere. Without knowing the implementation details of your system there's not much more I could suggest checking into.


On Sat, Apr 20, 2013 at 11:40 PM, Shawn Milochik <shawn@milochik.com> wrote:
In addition to Michael's good comments:

I suspect you won't have 100,000 tasks coming in every second of every day. If you have to send out SMS messages and some of them take a few minutes to go out, that should be fine for most purposes. In addition, some SMS services have some limit per minute/hour for the number of messages you can send. If so, you'll be forced to queue them regardless and trickle out the sending.

--
You received this message because you are subscribed to the Google Groups "Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to django-users+unsubscribe@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at http://groups.google.com/group/django-users?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

--
You received this message because you are subscribed to the Google Groups "Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to django-users+unsubscribe@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at http://groups.google.com/group/django-users?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

0 Comments:

Post a Comment

Subscribe to Post Comments [Atom]

<< Home


Real Estate