Is it possible to pad inputs?
#2
by
omers66
- opened
Say I want to work with fixed size input prompts, for that I should pad my input prompt. Is there a specific token I should use?
For batch inference, please refer to https://github.com/QwenLM/Qwen#batch-inference. If you need to pad inputs in training, using <|endoftext|> should be generally okay.
jklj077
changed discussion status to
closed
Cool. Thanks