Hugging Face's logo

LoneStriker
/
Yi-34B-Spicyboros-3.1-5.0bpw-h6-exl2

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Model card Files Community
Yi-34B-Spicyboros-3.1-5.0bpw-h6-exl2

Commit History

Added note on repetition penalty setting
28d75ae

LoneStriker commited on

Added note on repetition penalty setting
6027400

LoneStriker commited on

Update README.md
eb90ed0

LoneStriker commited on

ExLLaMA V2 quant of Yi-34B-Spicyboros-3.1-5.0bpw-h6-exl2
dc96ca2

LoneStriker commited on

initial commit
318fefb

LoneStriker commited on