Update to new gguf-split for direct loading.
Browse files- README.md +7 -2
- grok-1-Q2_K-split-00001-of-00009.gguf +2 -2
- grok-1-Q2_K-split-00002-of-00009.gguf +2 -2
- grok-1-Q2_K-split-00003-of-00009.gguf +2 -2
- grok-1-Q2_K-split-00004-of-00009.gguf +1 -1
- grok-1-Q2_K-split-00005-of-00009.gguf +2 -2
- grok-1-Q2_K-split-00006-of-00009.gguf +2 -2
- grok-1-Q2_K-split-00007-of-00009.gguf +2 -2
- grok-1-Q2_K-split-00008-of-00009.gguf +1 -1
- grok-1-Q2_K-split-00009-of-00009.gguf +1 -1
README.md
CHANGED
@@ -1,8 +1,13 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
-
|
|
|
5 |
|
6 |
You need to merge the GGUF file using `gguf-split` before using them (there's already a PR to change this).
|
|
|
|
|
|
|
|
|
|
|
7 |
|
8 |
-
For now only Q2_K Quant, others will follow soon.
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
+
|
5 |
+
Unofficial GGUF Quantizations of Grok-1. Should just run with llama.cpp once the [PR- Add grok-1 support #6204](https://github.com/ggerganov/llama.cpp/pull/6204) is merged.
|
6 |
|
7 |
You need to merge the GGUF file using `gguf-split` before using them (there's already a PR to change this).
|
8 |
+
The splits now use [PR: llama_model_loader: support multiple split/shard GGUFs](https://github.com/ggerganov/llama.cpp/pull/6187).
|
9 |
+
Therefore no merging using `gguf-split` is needed anymore.
|
10 |
+
|
11 |
+
For now only Q2_K Quant, others (Q3_K, Q4_K, Q5_K & Q6_K) are prepared waiting to upload.
|
12 |
+
|
13 |
|
|
grok-1-Q2_K-split-00001-of-00009.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1db56d899df9ed37cb1cc015aef0d5275020d6e940f8c5ed99db8c2fb34bb7c0
|
3 |
+
size 14898085760
|
grok-1-Q2_K-split-00002-of-00009.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:257be550ea42cb6878d2e041c95062e8866dc19292fac86c039147ff66db1be6
|
3 |
+
size 13817626304
|
grok-1-Q2_K-split-00003-of-00009.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3e9001fdf252128c247989ca870c301ec586ce2d26e85757365d8d1416d13c18
|
3 |
+
size 13817626368
|
grok-1-Q2_K-split-00004-of-00009.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 14223499008
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:957d6174af4ae2618ada7bd594626deaed9b6622a926e2dd21e6efe47a3d337e
|
3 |
size 14223499008
|
grok-1-Q2_K-split-00005-of-00009.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3c60377303e347a08c8876d33a055757ce54345e82bacd850deafd87705d0024
|
3 |
+
size 14036180768
|
grok-1-Q2_K-split-00006-of-00009.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8640abdd4d61201db7d19851f7b71b6c8541d1fd1b6280abd9718aed8f0d73e1
|
3 |
+
size 13838073600
|
grok-1-Q2_K-split-00007-of-00009.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b248ad03b13dc8224753125411c3fa2c019bed0eb22c9756ba2ab8535e9b797c
|
3 |
+
size 13817626368
|
grok-1-Q2_K-split-00008-of-00009.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 14137016064
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:48bef2547453453da432ad52fef9a053c134714f8678e57f6819c36ff1039493
|
3 |
size 14137016064
|
grok-1-Q2_K-split-00009-of-00009.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 3601887424
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:fb0bd4b2a0acbcbd6818b6e13aeb693d8d811c286008a9ad73d57aa43df1109c
|
3 |
size 3601887424
|