Inference slicer batching

[LinasKo]

Description

PR for inference slicer with batching. If batch_size is set, collections of slices are passed to the model.
Note that user need to define a callback that can accept list of images.

Still using threads if worker_threads > 1 (both batches and threads can be used simultaneously)

Previous PR, auto-closed during rewrite: #1108

Type of change

Please delete options that are not relevant.

• New feature (non-breaking change which adds functionality)

How has this change been tested, please provide a testcase or example of how you tested the change?

https://colab.research.google.com/drive/1cfqBss7n-jc6VyKdjJ1AN9TnOBjdYQwZ?usp=sharing

Any specific deployment considerations

Docs

• Docs updated? What were the changes:

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 2 committers have signed the CLA.

✅ LinasKo
❌ Linas Kondrackis

---

Linas Kondrackis seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[LinasKo]

I've seen multiple CLA-related updates just now. Let's sort it out when I'm back from my trip.

P.S. It may also be due to me changing my github email a week ago.

[LinasKo]

Issues with threading: #1632

[roversch]

Hey this is great! Works out of the box.

Can we merge this plz? I now have to copy pasta it into the package.