why eos_token_id is different between config.json and generation_config.json
#9
by
xjpang85
- opened
In config.json eos_token_id is 2 and in generation_config.json is 7.
Can we just modify the bos and eos setting in config.json and tokenizer_config.json and make it align with generation_config.json? If yes, I can make a PR.