GGUF file
#8
by
BB8-dev
- opened
大神您好,方便上传一下GGUF格式的模型文件吗?感激不尽!!
已经看到评测,效果很棒,期待gguf
期待gguf,感谢感谢!
We provide the official 8bit-quantized and fp16 versions of Llama3-8B-Chinese-Chat in the following links, respectively. You are welcome to have a try!
8bit-quantized: https://huggingface.co/shenzhi-wang/Llama3-8B-Chinese-Chat-GGUF-8bit
fp16: https://huggingface.co/shenzhi-wang/Llama3-8B-Chinese-Chat-GGUF-fp16
shenzhi-wang
changed discussion status to
closed