tsumeone
/

llama-30b-supercot-4bit-cuda

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

tsumeone commited on Apr 23, 2023

Commit

a0689c8

•

1 Parent(s): 3820759

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -10,4 +10,6 @@ Command used to quantize:
 Evaluation & Score (Lower is better):
 * WikiText2: 4.66
 * PTB: 17.64
-* C4: 6.50

 Evaluation & Score (Lower is better):
 * WikiText2: 4.66
 * PTB: 17.64
+* C4: 6.50
+Groupsize version is here: https://huggingface.co/tsumeone/llama-30b-supercot-4bit-128g-cuda