Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
2-bit
text-generation-inference
AutoTrain Compatible
Inference Endpoints
4-bit precision
8-bit precision
Merge
custom_code
Eval Results
Mixture of Experts
Misc with no match
text-embeddings-inference
Carbon Emissions
Apply filters
Models
1,156
Full-text search
Edit filters
Sort: Trending
Active filters:
2-bit
Clear all
MaziyarPanahi/solar-pro-preview-instruct-GGUF
Text Generation
•
Updated
7 days ago
•
7.56k
•
11
MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF
Text Generation
•
Updated
May 14
•
2.51k
•
162
MaziyarPanahi/Mistral-Small-Instruct-2409-GGUF
Text Generation
•
Updated
3 days ago
•
111
•
2
MaziyarPanahi/BioMistral-7B-GGUF
Text Generation
•
Updated
Feb 19
•
937
•
42
MaziyarPanahi/WizardLM-2-8x22B-GGUF
Text Generation
•
Updated
Apr 16
•
1.5k
•
115
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
•
Updated
May 22
•
297k
•
58
kaitchup/Qwen2-7B-gptq-2bit
Text Generation
•
Updated
Jun 11
•
1
MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF
Text Generation
•
Updated
Jul 22
•
639
•
28
MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF
Text Generation
•
Updated
Jul 29
•
168k
•
9
MaziyarPanahi/calme-2.3-legalkit-8b-GGUF
Text Generation
•
Updated
Aug 7
•
677
•
8
MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF
Text Generation
•
Updated
16 days ago
•
517
•
4
MaziyarPanahi/DeepSeek-V2.5-GGUF
Text Generation
•
Updated
9 days ago
•
245
•
2
MaziyarPanahi/reader-lm-0.5b-GGUF
Text Generation
•
Updated
9 days ago
•
97
•
2
MaziyarPanahi/reader-lm-1.5b-GGUF
Text Generation
•
Updated
9 days ago
•
102
•
1
MaziyarPanahi/Qwen2.5-0.5B-Instruct-GGUF
Text Generation
•
Updated
1 day ago
•
138
•
1
MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF
Text Generation
•
Updated
1 day ago
•
118
•
1
MaziyarPanahi/Qwen2.5-3B-Instruct-GGUF
Text Generation
•
Updated
1 day ago
•
129
•
1
MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF
Text Generation
•
Updated
1 day ago
•
132
•
1
MaziyarPanahi/Qwen2.5-14B-Instruct-GGUF
Text Generation
•
Updated
1 day ago
•
227
•
1
MaziyarPanahi/Qwen2.5-32B-Instruct-GGUF
Text Generation
•
Updated
about 22 hours ago
•
1
Ayushnangia/bloom3B-2bit-gptq
Text Generation
•
Updated
Aug 28, 2023
•
8
kaitchup/Llama-2-7b-gptq-2bit
Text Generation
•
Updated
Sep 11, 2023
•
12
•
1
nesty/sg-bart-large-4096-gptq-2bit
Text2Text Generation
•
Updated
Sep 21, 2023
•
2
Arylwen/instruct-palmyra-20b-gptq-2
Text Generation
•
Updated
Oct 5, 2023
•
8
lebe1/opt-125m-2bit
Text Generation
•
Updated
Nov 21, 2023
•
10
Sujan42024/dlite-v2-1_5b-2bitQuantization
Text Generation
•
Updated
Nov 28, 2023
•
6
kaitchup/Mistral-7B-v0.1-gptq-2bit
Text Generation
•
Updated
Jan 19
•
6
kaitchup/Llama-2-13b-hf-gptq-2bit
Text Generation
•
Updated
Jan 19
•
6
kaitchup/Llama-2-7b-hf-gptq-2bit
Text Generation
•
Updated
Jan 20
•
648
MaziyarPanahi/phi-2-GGUF
Text Generation
•
Updated
Jan 26
•
303
•
6
Previous
1
2
3
...
39
Next