Commit
•
449ed48
1
Parent(s):
a980e66
Upload perplexity.md
Browse files- perplexity.md +31 -0
perplexity.md
ADDED
|
@@ -0,0 +1,31 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
Qwen2.5-1.5B-Instruct
|
| 3 |
+
Quant Size (MB) PPL Size (%) Accuracy (%) PPL error rate
|
| 4 |
+
IQ1_S 417 193.6245 1.77149
|
| 5 |
+
IQ1_M 443 66.9068 0.52878
|
| 6 |
+
IQ2_XXS 488 33.3356 0.25559
|
| 7 |
+
IQ2_XS 525 20.2870 0.14936
|
| 8 |
+
IQ2_S 538 18.2927 0.13380
|
| 9 |
+
IQ2_M 574 15.4838 0.11113
|
| 10 |
+
Q2_K_S 611 16.0169 0.11623
|
| 11 |
+
IQ3_XXS 638 12.3935 0.08770
|
| 12 |
+
Q2_K 645 14.1657 0.10105
|
| 13 |
+
IQ3_XS 698 11.7112 0.08256
|
| 14 |
+
Q3_K_S 726 12.4782 0.08842
|
| 15 |
+
IQ3_S 728 11.4241 0.07977
|
| 16 |
+
IQ3_M 741 11.4058 0.07862
|
| 17 |
+
Q3_K_M 786 11.3529 0.08018
|
| 18 |
+
Q3_K_L 840 11.1934 0.07913
|
| 19 |
+
IQ4_XS 855 10.5302 0.07351
|
| 20 |
+
IQ4_NL 893 10.5116 0.07335
|
| 21 |
+
Q4_0 895 10.8217 0.07576
|
| 22 |
+
Q4_K_S 897 10.5236 0.07360
|
| 23 |
+
Q4_K_M 941 10.4628 0.07310
|
| 24 |
+
Q4_1 970 10.5100 0.07347
|
| 25 |
+
Q5_K_S 1048 10.2715 0.07148
|
| 26 |
+
Q5_0 1051 10.3196 0.07212
|
| 27 |
+
Q5_K_M 1073 10.2529 0.07143
|
| 28 |
+
Q5_1 1126 10.2624 0.07140
|
| 29 |
+
Q6_K 1214 10.2030 0.07108
|
| 30 |
+
Q8_0 1571 10.1670 0.07068
|
| 31 |
+
F16 2951 10.1512 0.07058
|