[Feat]: Support batches

[codelonesomest]

Similar to what bullMQ Pro Batches does from https://docs.bullmq.io/bullmq-pro/batches which would be nice

[noxify]

Hey,

Thanks for the feature request.

Sounds like a good improvement.

I will take a look next week how we can implement it.

Question: would you expect a new class (e.g. BatchQueue ) or just an extended config object like

new Queue(
  new MemoryQueueAdapter(),
  { 
    name: "example", 
    batch: true, 
    minSize: 5
  }
)

[codelonesomest]

Thank you for being willing to implement this feature.

I think we can extended config instead of new class BatchQueue.

I think we can do like this

new Queue(
  new MemoryQueueAdapter(),
  { 
    name: "example", 
    batch: {
      size: 10, // Maximum jobs per batch
      minSize: 5, // Wait for at least 5 jobs (optional)
      timeout: 30_000 // Wait up to 30 seconds (optional)
    }
  }
)

[noxify]

Another question:

A) Would you expect to have full control about the batch processing in the callback and having something like job.getBatch (similar to the batch implementation from BullMQ)

B) or would you expect that the callback is for the batch element and we have a "simple loop" which can't be changed

C) a combination of both, default is Option B, but you can override the handling via a config prop which allows you to configure your own processing logic in the callback

[codelonesomest]

Not very clear of (B). But if possible, a combination of both will be better since it is flexible