gpt2-small-theseus-bg / added_tokens.json
rmihaylov's picture
add tokenizer
3f444dc
raw
history blame contribute delete
No virus
81 Bytes
{"<pad>": 50259, "[SEP]": 50258, "[MASK]": 50260, "[CLS]": 50257, "<unk>": 50261}