Any plan to support batch inference for local run?

[RyanHuangNLP]

No description provided.

[praeclarumjj3]

Hi @RyanHuangNLP, thanks for your interest. We haven't explicitly planned on doing that. I may push a script if I find the time in the near future.

Although, I don't think it should be too hard for you to write your own batch inference script. You could take hints from the model_seg_loader.py script if you plan on doing that. Let me know if you have any other questions.

[RyanHuangNLP]

@praeclarumjj3 thanks, I will take a try

[dg845]

I have opened a PR to add a batched inference script: #3.