Implement Child Batching

[danhunsaker]

See chrisboulton/php-resque#35 for details and an early implementation.

In a nutshell, reuse job processes for up to X jobs rather than forking for every one.

[mfn]

In a nutshell, reuse job processes for up to X jobs rather than forking for every one.

The X-factor could be multiple conditions:

• number of jobs executed
• total runtime of the child
• memory usage (i.e. only execute jobs as long as certain threshold isn't met)

Such a change is definitely a game changer for performance.

[danhunsaker]

Indeed so! Looking forward to seeing what comes of this one.

[rajibahmed]

Hi @danhunsaker, I am busy these day. I will have install everything and start working on it from this weekend. Can we create slack or discord channel to talk realtime ?

[danhunsaker]

That sounds like an excellent idea. I'll get you the details once that's created.