sophosympatheia
commited on
Commit
•
7254f86
1
Parent(s):
b9157b8
Update README.md
Browse filesAdded link to exl2 quant
README.md
CHANGED
@@ -168,7 +168,8 @@ This version definitely has more of a tendency to speak out of turn as compared
|
|
168 |
Use the Llama 3 instruct format. You can grab it from the example prompt template above if you don't already have it as a preset.
|
169 |
|
170 |
### Quantizations
|
171 |
-
|
|
|
172 |
|
173 |
### Licence and usage restrictions
|
174 |
[META LLAMA 3 COMMUNITY LICENSE AGREEMENT](https://huggingface.co/meta-llama/Meta-Llama-3-8B/blob/main/LICENSE)
|
|
|
168 |
Use the Llama 3 instruct format. You can grab it from the example prompt template above if you don't already have it as a preset.
|
169 |
|
170 |
### Quantizations
|
171 |
+
* EXL2
|
172 |
+
* 4.65bpw - [Kotokin/sophosympatheia_New-Dawn-Llama-3.1-70B-v1.1-exl2-4.5bpw](https://huggingface.co/Kotokin/sophosympatheia_New-Dawn-Llama-3.1-70B-v1.1-exl2-4.5bpw)
|
173 |
|
174 |
### Licence and usage restrictions
|
175 |
[META LLAMA 3 COMMUNITY LICENSE AGREEMENT](https://huggingface.co/meta-llama/Meta-Llama-3-8B/blob/main/LICENSE)
|