Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,604

Full-text search

Active filters: 8-bit

MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • Updated Jul 17 • 1.04M • 5

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22 • 1.05M • 30

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • Updated Aug 7 • 2.62k • 30

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29 • 1.05M • 35

anokimchen/sd-turbo-openvino-8bit-no-calibration

Text-to-Image • Updated Aug 7 • 1

anokimchen/sd-turbo-openvino-8bit-GPT4vision-calibrated

Text-to-Image • Updated Aug 7 • 1

alpindale/Meta-Llama-3.1-70B-Instruct-GPTQ-INT8

Updated Aug 13 • 1.59k • 2

neuralmagic/gemma-2-9b-it-quantized.w8a8

Text Generation • Updated Oct 9 • 219 • 2

MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF

Text Generation • Updated Aug 18 • 980k • 7

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation • Updated about 1 month ago • 870 • 2

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20 • 1.04M • 4

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_8.0bpw_h8

Text Generation • Updated Aug 23 • 141 • 2

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21 • 35.4k • 13

Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21 • 5.86k • 9

HF1BitLLM/Llama3-8B-1.58-Sigmoid-k100-10B-tokens

Text Generation • Updated Sep 18 • 60 • 11

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated Sep 13 • 1.07M • 17

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 24 • 3.23k • 6

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 2.04k • 5

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 3.9k • 10

MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 18 • 753k • 2

brunopio/Llama3-8B-1.58-100B-tokens-GGUF

Text Generation • Updated Sep 19 • 1.15M • 9

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 1.34k • 2

CalamitousFelicitousness/Qwen2-VL-72B-Instruct-GPTQ-Int8-tpfix

Image-Text-to-Text • Updated Sep 22 • 6 • 1

velvetScar/llm2vec-llama-3.1-8B

Sentence Similarity • Updated Sep 23 • 15 • 1

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 1.06M • 5

MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated Sep 25 • 1.04M • 3

neuralmagic/Llama-3.2-1B-Instruct-quantized.w8a8

Text Generation • Updated 25 days ago • 1.7k • 3

Statuo/MS-Cydonian-Gutenberg-22b-8bpw

Text Generation • Updated Sep 26 • 14 • 2

MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-8.0bpw-h8-exl2

Updated Sep 26 • 38 • 1

adriabama06/Llama-3.2-1B-Instruct-GPTQ-8bit-128g

Text Generation • Updated Sep 28 • 1.82k • 1