Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Saul-Base-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
legal
conversational
en
arxiv:2403.03883
Inference Endpoints
text-generation-inference
License:
mit
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
2a48f7c
Saul-Base-GGUF
1 contributor
History:
10 commits
MaziyarPanahi
064bb85682d8488c1863846ad3e16b2a619993541ab86319f22d128d39d2eb05
2a48f7c
verified
8 months ago
.gitattributes
2.04 kB
064bb85682d8488c1863846ad3e16b2a619993541ab86319f22d128d39d2eb05
8 months ago
Saul-Base.IQ4_XS.gguf
3.94 GB
LFS
4dde9db9a598a645a8ae0a7fe2eae6093d4befa05a1807b8874c913a7e696005
8 months ago
Saul-Base.Q2_K.gguf
2.72 GB
LFS
6ff90aa1bc0e4f941838082c7e99e484c1dcc20febd9418e69b1ce29405ee50a
8 months ago
Saul-Base.Q3_K_L.gguf
3.82 GB
LFS
24cc79f23a6b3a05f32672a4fb2bc9112646f2f17a5dcbab0c6d42fad67738a9
8 months ago
Saul-Base.Q3_K_M.gguf
3.52 GB
LFS
6052342f90ac6578f3a2ca88f097154043bee084731ebabe1d9aae7bd7eaaa7e
8 months ago
Saul-Base.Q3_K_S.gguf
3.16 GB
LFS
2b4ce7bdd87c1b33c8a8cf63aab93bcd9393d83b4ef1580884f76db1277767c1
8 months ago
Saul-Base.Q4_K_M.gguf
4.37 GB
LFS
ff9a28bf663e320ff1d029de801a27d311939071a51aeaf193850a39c0539ee9
8 months ago
Saul-Base.Q4_K_S.gguf
4.14 GB
LFS
5f9f1772cfd319cedd7bcbfeb92a3eec3e0fb1342e29b5e469e48d4a94a807f7
8 months ago
Saul-Base.Q5_K_M.gguf
5.13 GB
LFS
b48d2fd2cf166a19d294c5a1e6e1fe00892c67886e6366b978356812163c557e
8 months ago
Saul-Base.Q5_K_S.gguf
5 GB
LFS
064bb85682d8488c1863846ad3e16b2a619993541ab86319f22d128d39d2eb05
8 months ago