missing tokenizer.json

#1
by Suparious - opened

the tokenizer.json is used by inference engines to determine the prompt template and other things.
Without providing, the tokenizer configuration, this model doe not work well in inference engines, such as TGI, vLLM and ollama.
Without this file, I cannot make any quantized versions of this model in: https://huggingface.co/solidrust

Sign up or log in to comment