Hugging Face's logo

HiroseKoichi
/
Llama-Salad-4x8B-GGUF

Transformers
GGUF
nsfw
Not-For-All-Audiences
llama-3
text-generation-inference
Mixture of Experts
mergekit
Merge
Inference Endpoints
conversational
Model card Files Community
HiroseKoichi commited on
Commit
ead4da5
•
1 Parent(s): 0889608

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Llama-Salad-4x8B.Q4_K_M.gguf +3 -0
  3. Llama-Salad-4x8B.Q5_K_M.gguf +3 -0
  4. Llama-Salad-4x8B.Q5_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -36,3 +36,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
36
  Llama-Salad-4x8B.bf16.gguf filter=lfs diff=lfs merge=lfs -text
37
  Llama-Salad-4x8B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
38
  Llama-Salad-4x8B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
36
  Llama-Salad-4x8B.bf16.gguf filter=lfs diff=lfs merge=lfs -text
37
  Llama-Salad-4x8B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
38
  Llama-Salad-4x8B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Llama-Salad-4x8B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Llama-Salad-4x8B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Llama-Salad-4x8B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-Salad-4x8B.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a3f4f0ee842ad60d709e9c35d226eb1e979f95c4a75e928748ab29cce8b1b51
3
+ size 15162179232
Llama-Salad-4x8B.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3121d5b43d3d9d832e8a26e40d71afa78ae9fdc2a1d9e0ec1fc2b73196535666
3
+ size 17736040096
Llama-Salad-4x8B.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31791e1d4a566276ab2d1181f08dc50453b48eb68003597f725848704d69336d
3
+ size 17228005024