File size: 285 Bytes
576ff45 14dd1ce |
1 2 3 4 5 6 7 8 9 |
---
license: apache-2.0
---
Unofficial GGML Quantizations of Grok-1. Should just run with llama.cpp once the PR is merged.
You need to merge the GGUF file using `gguf-split` before using them (there's already a PR to change this).
For now only Q2_K Quant, others will follow soon.
|