add tokenizer.json and tokenzier_config.json
#4
by
brunopio
- opened
copy of tokenizer.json and tokenzier_config.json from https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct for GGUF conversion #3 and #1.
brunopio
changed pull request title from
Upload 2 files
to add tokenizer.json and tokenzier_config.json
medmekk
changed pull request status to
merged
Thank you brunopio for the tokenizer addition