Update values of `bos_token_id` and `eos_token_id` in generation_config.json
#25
by
regisss
HF staff
- opened
The vocab size is 49152 so the token ids should not be set to 50256.
See https://huggingface.slack.com/archives/C031GD0V5S5/p1717609689224529 for more context.
thanks!
loubnabnl
changed pull request status to
merged