airesearch
/

wangchanberta-base-att-spm-uncased

Inference Endpoints

Model card Files Files and versions Community

wangchanberta-base-att-spm-uncased / tokenizer_config.json

lalital's picture

Remove trailing comma

1049ef5 almost 4 years ago

181 Bytes

	{
	"bos_token": "<s>",
	"eos_token": "</s>",
	"unk_token": "<unk>",
	"sep_token": "</s>",
	"cls_token": "<s>",
	"pad_token": "<pad>",
	"mask_token": "<mask>"
	}