Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,069

Full-text search

Active filters: chat

leafspark/magnum-v2-123b-fp8-dynamic

Text Generation • Updated Aug 30 • 446 • 2

QuantFactory/Llama3.1-8B-Fireplace2-GGUF

Text Generation • Updated Aug 28 • 269 • 1

QuantFactory/Llama3.1-8B-Cobalt-GGUF

Text Generation • Updated Aug 28 • 380 • 1

QuantFactory/Llama3.1-8B-ShiningValiant2-GGUF

Text Generation • Updated Aug 28 • 232 • 1

hellork/calme-2.1-qwen2-7b-IQ4_NL-GGUF

Text Generation • Updated Sep 17 • 21

lucyknada/Luni_StarDust-12b-v1-exl2

Text Generation • Updated Aug 29

backyardai/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 29 • 591 • 1

Ffftdtd5dtft/Qwen2-7B-Instruct-Q2_K-GGUF

Text Generation • Updated Aug 29 • 167 • 1

Ffftdtd5dtft/Qwen2-1.5B-Instruct-Q2_K-GGUF

Text Generation • Updated Aug 29 • 276

backyardai/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 30 • 409 • 1

mradermacher/StarDust-12b-v1-GGUF

Updated Aug 31 • 219 • 1

mradermacher/StarDust-12b-v1-i1-GGUF

Updated Aug 31 • 79 • 2

Ffftdtd5dtft/Qwen2-Math-72B-Instruct-Q2_K-GGUF

Text Generation • Updated Aug 31 • 15

Ffftdtd5dtft/Qwen2-Math-7B-Instruct-Q2_K-GGUF

Text Generation • Updated Aug 31 • 78

Triangle104/magnum-v2-4b-Q4_K_M-GGUF

Text Generation • Updated Aug 31 • 14

Triangle104/magnum-v2-4b-Q5_K_M-GGUF

Text Generation • Updated Aug 31 • 4

Triangle104/magnum-v2-4b-Q6_K-GGUF

Text Generation • Updated Aug 31 • 16

Triangle104/magnum-v2-4b-Q8_0-GGUF

Text Generation • Updated Aug 31 • 11

Triangle104/magnum-v2-12b-Q4_K_M-GGUF

Text Generation • Updated Sep 16 • 23

Triangle104/magnum-v2-12b-Q5_K_M-GGUF

Text Generation • Updated Sep 16 • 28

Triangle104/magnum-v2-12b-Q6_K-GGUF

Text Generation • Updated Sep 16 • 15

byroneverson/gemma-2-27b-it-abliterated-gguf

Text Generation • Updated Sep 9 • 568 • 12

async0x42/magnum-72b-v2-exl2_3.75bpw

Text Generation • Updated Aug 31 • 8

sequelbox/Llama3.1-8B-MOTH

Text Generation • Updated Sep 19 • 24 • 1

Statuo/Stardust-12b-MN-EXL2-8bpw

Text Generation • Updated Sep 1 • 8

Statuo/Stardust-12b-MN-EXL2-6bpw

Text Generation • Updated Sep 1 • 8

Statuo/Stardust-12b-MN-EXL2-4bpw

Text Generation • Updated Sep 1 • 2

QuantFactory/StarDust-12b-v1-GGUF

Text Generation • Updated Sep 1 • 51 • 3

bartowski/calme-2.2-qwen2-72b-GGUF

Text Generation • Updated Sep 1 • 468

mradermacher/magnum-v2.5-12b-kto-GGUF

Updated Sep 1 • 226 • 2