GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin/bagel-dpo-20b-v04-llama
The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
Layers | Context | Template |
---|---|---|
48 |
32768 |
[INST] <<SYS>> |
- Downloads last month
- 127
Inference API (serverless) is not available, repository is disabled.