Hugging Face's logo

DZgas
/
GIGABATEMAN-7B-GGUF

Text Generation
GGUF
English
quantized
2-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
text2text-generation
mistral
roleplay
Merge
Inference Endpoints
Model card Files Community
DZgas commited on
Commit
9d0aebf
•
1 Parent(s): 8d49cb9

Upload 4 files

Browse files
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. GIGABATEMAN-7B.Q2_K.gguf +3 -0
  3. GIGABATEMAN-7B.Q4_K_M.gguf +3 -0
  4. GIGABATEMAN-7B.Q5_K_M.gguf +3 -0
  5. GIGABATEMAN-7B.Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  GIGABATEMAN-7B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  GIGABATEMAN-7B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ GIGABATEMAN-7B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ GIGABATEMAN-7B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ GIGABATEMAN-7B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ GIGABATEMAN-7B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
GIGABATEMAN-7B.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8950f59a9b0f447ecf5096017a78f30c83eb20f5fb75323388d73e610564ce31
3
+ size 2719241952
GIGABATEMAN-7B.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e87817f48ead706f95a7f08881165bdabbd69e6e4745e3801de8d96f00fdba51
3
+ size 4368439008
GIGABATEMAN-7B.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afc217f8c77b6c38f1b0e899a7ec776b0f079bb99bf5f28d5694f5210ab0c21f
3
+ size 5131409120
GIGABATEMAN-7B.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6497e71b95918aa27c071ef579038840ef0ed2532c4694e40c015ab66f54d1a
3
+ size 7695857376