iandennismiller
commited on
Commit
•
b81d6ed
1
Parent(s):
50e6a19
initial commit
Browse files- .gitattributes +1 -0
- Readme.md +23 -0
- samantha-1.1-llama-33b.Q4_K_S.gguf +3 -0
.gitattributes
CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
*.gguf filter=lfs diff=lfs merge=lfs -text
|
Readme.md
ADDED
@@ -0,0 +1,23 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
inference: false
|
3 |
+
license: other
|
4 |
+
language:
|
5 |
+
- en
|
6 |
+
model_name: Samantha 1.1 Llama 33B
|
7 |
+
quantized_by: iandennismiller
|
8 |
+
base_model: ehartford/samantha-1.1-llama-33b
|
9 |
+
datasets:
|
10 |
+
- ehartford/samantha-data
|
11 |
+
---
|
12 |
+
|
13 |
+
# Eric Hartford's Samantha 1.1 Llama 33B GGUF
|
14 |
+
|
15 |
+
Samantha 1.1 is a very smart model.
|
16 |
+
For those of us with 24gb usable RAM (including Apple Silicon with 32gb RAM), this is just about the best model available as of October, 2023.
|
17 |
+
|
18 |
+
I've converted the model to GGUF for the sake of compatibility.
|
19 |
+
Currently, only Q4_K_S is available because that's the largest model that runs in 24gb.
|
20 |
+
|
21 |
+
For more information, see [Eric Hartford's Samantha 1.1 Llama 33B](https://huggingface.co/ehartford/samantha-1.1-llama-33b).
|
22 |
+
To examine the original quant, see [TheBloke/samantha-1.1-llama-33B-GGML](https://huggingface.co/TheBloke/samantha-1.1-llama-33B-GGML)
|
23 |
+
|
samantha-1.1-llama-33b.Q4_K_S.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:05441329aaefaa3f861e41711e1e24548d9a03481a19b82cd88858d03953bbdf
|
3 |
+
size 18301055456
|