Failed to process batch: Currently, only support `batch_size=1`
#2
by
Phoenix1551
- opened
When will support for batch size > 1 be available, or where should I make modifications to enable this feature?
Hi, Phoenix. We have added support for batch inference in the code. Please update your code and refer to the batch inference example in the model card for guidance.
xxyyy123
changed discussion status to
closed