Lewdiculous
commited on
Commit
•
9819c32
1
Parent(s):
935f312
Update README.md
Browse files
README.md
CHANGED
@@ -9,7 +9,9 @@ inference: false
|
|
9 |
---
|
10 |
|
11 |
This repository hosts GGUF-Imatrix quantizations for [ResplendentAI/Datura_7B](https://huggingface.co/ResplendentAI/Datura_7B).
|
12 |
-
|
|
|
|
|
13 |
```python
|
14 |
quantization_options = [
|
15 |
"Q4_K_M", "Q5_K_M", "Q6_K", "Q8_0"
|
|
|
9 |
---
|
10 |
|
11 |
This repository hosts GGUF-Imatrix quantizations for [ResplendentAI/Datura_7B](https://huggingface.co/ResplendentAI/Datura_7B).
|
12 |
+
```
|
13 |
+
Base⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)
|
14 |
+
```
|
15 |
```python
|
16 |
quantization_options = [
|
17 |
"Q4_K_M", "Q5_K_M", "Q6_K", "Q8_0"
|