Edit Models filters

Inference status

Misc

arxiv: 2403.17887

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

30

Full-text search

Active filters: 2403.17887

jimmycarter/LibreFLUX

Text-to-Image • Updated 17 days ago • 5.02k • 137

chargoddard/llama3-42b-v0

Text Generation • Updated Apr 24 • 401 • 117

Na0s/Llama-3.1-8B-Pruned-4-Layers

Text Generation • Updated Aug 8 • 71 • 2

arcee-ai/Mistral-7B-Instruct-v0.2-sliced-24-layer

Text Generation • Updated Apr 12 • 1.34k • 6

blockblockblock/Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw2.25

Text Generation • Updated Apr 11 • 3

blockblockblock/Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw2.5

Text Generation • Updated Apr 11 • 4

blockblockblock/Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw3

Text Generation • Updated Apr 11 • 2

blockblockblock/Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw3.5

Text Generation • Updated Apr 11 • 4

blockblockblock/Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw3.7

Text Generation • Updated Apr 11 • 2

blockblockblock/Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw4

Text Generation • Updated Apr 11 • 2

blockblockblock/Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw4.2

Text Generation • Updated Apr 11 • 2

blockblockblock/Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw4.4

Text Generation • Updated Apr 11 • 5

blockblockblock/Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw4.6

Text Generation • Updated Apr 11 • 4

blockblockblock/Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw4.8

Text Generation • Updated Apr 11 • 17

blockblockblock/Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw5

Text Generation • Updated Apr 11 • 2

blockblockblock/Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw5.5

Text Generation • Updated Apr 11 • 3

blockblockblock/Mistral-7B-Instruct-v0.2-sliced-24-layer-bpw6

Text Generation • Updated Apr 11 • 2

InferenceIllusionist/llama3-42b-v0-iMat-GGUF

Updated Apr 22 • 283 • 12

lucyknada/chargoddard_llama3-42b-v0-3.8bpw-EXL2

Text Generation • Updated Apr 22

lucyknada/chargoddard_llama3-42b-v0-3.5bpw-EXL2

Text Generation • Updated Apr 22 • 9

lucyknada/chargoddard_llama3-42b-v0-4.0bpw-EXL2

Text Generation • Updated Apr 22 • 3 • 4

kuotient/Llama-3-6B-Instruct-pruned

Text Generation • Updated Apr 23 • 10 • 5

jsfs11/meta-LLama3-6B-PruneMe-TEST-21_29

Text Generation • Updated May 2 • 1

RESMPDEV/Qwen2-Wukong-5B-Instruct-Sliced

Text Generation • Updated Jul 6 • 20 • 1

RichardErkhov/RESMPDEV_-_Qwen2-Wukong-5B-Instruct-Sliced-gguf

Updated Jul 22 • 245

RichardErkhov/Na0s_-_Llama-3.1-8b-Pruned-4-Layers-gguf

Updated Aug 24 • 532

Na0s/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-3.0

Text Generation • Updated Sep 5 • 28 • 3

RichardErkhov/Na0s_-_Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-3.0-gguf

Updated Aug 9 • 240

deepnet/ShortGpt

RichardErkhov/arcee-ai_-_Mistral-7B-Instruct-v0.2-sliced-24-layer-gguf

Updated Oct 8 • 57